Sharepoint to Outlook calendar invitations

Okay, so I have created a calendar through Sharepoint and linked it to my Outlook.  I have the calendar settings in Sharepoint set to invite attendees, but when I add a meeting through Outlook is doesn't give me the option of adding attendees.  

How can I include attendees when going through Outlook to set up a meeting for a sharepoint calendar?