Evolution always notifies you of new messages by adding a yellow star to the mailer icon in the window switcher.
Switcher layout when a new message has arrived
In order to also be notified of new messages in the GNOME Notification area at the bottom of the screen, make sure that
Switcher layout when a new message has arrived