Pamiętaj!

would rather + czasownik bez "to"

would prefer + czasownik w bezokoliczniku (z "to")

I would rather go.

I would prefer to go.

Would you rather join the PE club or the IT club?

I'd rather join the IT