Well there are two ways to look at this. If you are wanting a really nice smooth finish, then yes you either need to sand down the ripple in the cloth, OR use a high build epoxy sandable primer or do a little of both things. I have used such a primer and you can easily fill in the cloth effect fairly easy to get that totally smooth finish. On the other hand, if that cloth look doesn't bother you, then spray a primer, and paint. It is totally up to your idea and wants. One thing I will add, if you go for the sleek smooth glossy finish, anything you can see or feel in the primer WILL show up in the final finish. Prep IS the number one thing to a quality great looking finish... JMHO!