unless its really smooth.
if the drive wheels are rear mounted and you have quite a grippy front wheel that will act like a brake and stop the robot turning so smoothly . It will have no major affect on the performance of the robot but it would be better to just use a caster commonly available from places like model shops or maplins (i think)
Im probarbly talking rubbish but this is what id do
archie