The brown chalk of old days is hard to find. What I see the most of is:
1- White Chalk
2- Red Chalk
3- Blue Chalk
4- Rain Chalk
I run my boxes with very light coat of white chalk, ( just started using rain chalk this season) the boxes I hunt really don't need any chalk to run. If I have to use chalk for the box to play I will get rid of that box.
But to kinda answer your original question is there a difference? Yes