Folder or drive lock after saving attachment or message

On occasion I save an attachment to a folder which I then decide to move to a better location. However, I then get the error that the folder is in use.

A similar thing happens when I save an attachment or message to a USB-drive; I cannot eject the drive and get the error that the device is currently in use. I then need to close Outlook for it to release the lock.

Is there any way to prevent Outlook for creating such a lock or to release it without restarting Outlook?