He runs his own private army with a ton of loyalists. That's not as easy to push out a window and Putin knows it. On top of that, I wouldn't doubt for a minute that Putin at some level agrees with his complaints of Shoigu and Gerasimov.