They can handle your account but as long as the newtork isn't giving AMs "inside info" on where my traffic is coming from then bring it on...and if AMs are running offers they'll know better which ones are working, etc so they could share that advice with me so I can make more informed decisions instead of wasting time and resources "testing" offers.
You could also do stuff like AM vs Affiliate competitions where you can get a bonus $$$ if you outperform the AM in sales or whatever for a particular offer.
sounds retarded to me.