IMAP performance in Outlook 2010

I upgraded to Outlook 2010 and I have the feeling that my IMAP account performance has become slower. Especially when switching folders, it takes quite a while for Outlook to become active again and shows “Not Responding” in the Title Bar.

Is there any way to speed up IMAP performance in Outlook 2010?