Uninstalling Outlook or Office updates

After installing an update for Outlook, I’m encountering some strange issues with Outlook which I think are directly related to the update and not to any other Outlook issue.

How can I uninstall the update again to verify if the issue will indeed be gone then?