I have relocated the Bible study to a place where I knew a homeless man would not be able to join it.
Why? Is there something wrong with the homeless man?
My priest stated that it is not appropriate.
I think I can get a little bit uncomfortable being with a homeless person as well, but I think it's very unkind of you to exclude them to the Bible study. How about you go back to the original location of the Bible study, and try to maybe find a place for that homeless person to live so that he would not be homeless anymore.
How could I help with finding him a home?
You can get case management a try. Case managers are good with finding housing for people depending on the country.