Of course you are controlling. You are not praising him for doing anything he wants to do. I'm quite sure most two year olds also feel controlled, too. They are notorious for being upset when their desires are thwarted by others.
I guess he hasn't figured,out that wandering has a price, whether the relatively low,price of feeling controlled (less free than before) or loss of the M.