Problem solved I believe, found these hubs that fit skateboard wheels and lock the center down to a 5mm shaft

http://www.technobotsonline.com/polo...5mm-shaft.html

Allows for inboard mounting , compared to the external mount that belts tend to require, most of the belt drives seem to interface with the wheels directly rather than a keyway on an axle.