Create a Gmail filter that will find all Google Calendar-related emails. I use it to apply a label to the emails so I can go and bulk delete them later.
(("invitation" OR "updated invitation" OR "declined" OR "canceled event") AND (-collaborate OR -"invitation to edit")) AND (has:attachment)