VRChat offers the ability to mute individual users or hide their avatars without affecting how you view an entire rank. Alternatively, if a user is bothering you, you can block them entirely.