I have two choices. Go with him or go home and never see him again.
Is there a reason why you don't want to see him?
I think he has symptoms of a learning disability.
You shouldn't abandon someone because they have symptoms of a learning disability. You aren't a doctor and aren't trained to actually diagnose that. Even if it were true, you shouldn't judge someone based on their disabilities because it's likely you're creating stereotypes about them.
Ugh I'm going to go with option B and abandon him.
It's not okay to abandon people for perceived faults. It's going to be really hard for you to maintain relationships if you leave people cruelly.