Have you considered the possibility he just built better links than you?
What kind of evidence do you have that he's somehow penalizing sites in front of him, other than assumption?
This. You have no way to prove that he got you penalized because IT'S NOT POSSIBLE.