You can unshare your Outlook calendar if you want to remove someone from a previously shared calendar.