I want to work by myself rather than with my special needs coworker
Why don't you want to work with your special needs coworker?
My coworker stinks. It's really hard to work with him
It can be difficult to work with somebody who smells but you shouldn't shun him because of that. It is better to talk to his caregiver and tell him your concerns.
Do you think that will work?
Yes I think it might help if his body odor is the only problem he has. If he can do the job and do it right you should make sure they know to help keep them healthy.