I really hate it when people use fast forward
Why do you hate that?
I feel like you miss a lot of important things by fastforwarding.
If you don't want to, you should not have to. Tell them that you do not want to fast forward.
I wish it was that easy.
It sounds like you might find yourself in the minority, when others around you all want to fast-forward.  But if you make your wishes known clearly, they might be willing to accommodate you.  If not, you can always watch things on your own, or re-watch the skipped parts later.