I think it's too soon to spend the weekend with him.
Why do you think that it would be too soon?
He's a great person and a good friend, but maybe it is too early to spend the weekend with him.
It is up to you what you do in this situation. If you feel safe about it you can spend the weekend with him. If you don't feel safe, then don't do  it until you feel he is trustworthy enough.
My friends don't like him, so I'll just lie to them about it.
It is important that you be honest with them. If you feel safe enough there is no need to explain it to anyone else.