I wore a confederate flag (rebel flag) tube top shirt and many people kept starring at me?

I have a confederate flag (rebel flag) tube top that one the front has the whole flag but on the back is is plain color. I went to the mall and everyone kept starring at my tube top - a few people whispered back and forth after looking at it but i don't know if it was the shirt or they just were whispering. I live in South Carolina so the rebel flag is seen EVERYWHERE where im from. but i went to the mall in Ohio (had a road trip) - did they think my shirt meant something racist?