yes JB is spot on, I went to Napa and got an aluminum wheel polish and emery cloth. I found even when going with the grain the emery cloth would leave scratches. Then I just used a polish and my microfiber towel and that did the trick.
glad to hear I am not the only OCD person in this forum.