Can i sue a business owner for calling me an asshole?

I was waLking in to a doctors appointment and as i was bringing in my scooter, the owner of another office next door came out and yelled at me about banging the door by accident. I asked him what he said because i had my headphones and he said that im going to break the door with my scooter. I said no im not and I apologized and said maybe you can help me hold the door open then and he said he is not my doorman and that i shouldnt be bringing this inside the building. And as he walked away he called me an asshole. There were two of his associates present but i doubt they will testify agains him. But im sure it was on camera and perhaps they have audio where You can heAr when he called me An asshole. I came back down to ask for his information and he dismissed me saying he wasnt going to give me anything and tried to deny him calling me an asshole. He asked mewhat i wanted to do since he wasnt giving me his info and to be honest i felt threatened. Now i dont feel comfortable attending my doctors appointments because of this man harassing and making me feel threatened. And i was also very offended and hurt by him calling me an asshole when i was actually very polite to him.