Though the task managers says only Outlook (32-bit, Windows 7 Ultimate) is not responding, the fact is X1 isn't responding either when that happens even though the task manager doesn't indicate it's not responding.
Killing the X1ServiceHost process brings Outlook back immediately.