No, just wipe them down to clean them. The primary function of primer is to seal the drywall or wood so it won’t absorb the more expensive paint. Priming an already painted surface only helps if the original paint is very dark, and you’re painting it a much lighter color, as it starts to lighten it up.