I use rubber mallets. They are OK. The metal ones seem to be the home wreckers lol.
Rubber mallets and some light taps don't do any damage. I always throw a nut on the end of something so I don't hit the threads just in case. Buuut yeah, 10 years wrenching never an issue with a rubber mallot.