Does this man care how I feel?

I informed my boyfriend how uncomfortable I felt with him hiring a very promiscuous and flirtatious woman as his secretary. He yelled at me and stated, " Don't ever tell me what to do. It's all about business." He has told me over and over that there is nothing going on between he and this woman, but whenever she comes around, he pretends as though I don't exist and would literally leave the room. He is always staring at her in a lustful way. He gives me plenty of attention, but for some reason I have suspicions. Is he unfair, or am I being paranoid?