Hide your Free/Busy information completely

I’m working in a large organization with an Exchange account and I recently noticed that everyone within the company can see my free/busy information.

I can understand this importance for a small company or a single department but to everyone else in a large company, I find that my availability is none of their business.

Is there anyway I can hide my availability completely or make it available to just the people I work with?