That sounds awful, the manager sounds like a knob! Hate it when you give conditions like when you can work, they agree then have a go! Can't believe they are paying someone to walk around, I mean if you can't even talk to customers what do they want someone for?
I'd quit