They're called thrust bearings!!

Finally found what I was on about, I knew what problem I was trying to solve just didn't know what to use.

Thrust bearings will stop the wheels rubbing against the sides and reduce friction.