I would go to a hardware store and purchase a tack cloth. It’s a flannel cloth treated with a sticky substance to remove dust from walls that have been newly sanded, so they can be primed and painted. It’s not wet, doesn’t leave a residue, and should remove any surface dust and dirt. It’s hard to suggest anything else without knowing what they were painted with, and if there’s a varnish on them or not.