Well you should get that stone cause occasionally it's useful. Drywall screen 80 grit or sandpaper is what I use to re rough it up.
Being your not sure what to use I'll tell you something to try, when you use the screen or paper, sand only in one direction. If you go back/forth you'll remove your ridges. Sand 9-3 n play 12-6