You just need to keep the drill bit sharp. We drill quite alot of hardox with standard HSS drill bits, usually going too fast (takes too long to keep slowing the pillar drill down).
Mouldy wastes the tips of a few drill bit's but not too many . Just re-sharpen and carry on.
Just dont let them rub , keep loads of pressure on.