I assume you mean over long periods of time...
After each posting run, do a link check. Save all found links out. When you have a new list or are hitting an old one, load it into the harvester, then do the import -> compare lists function and load up all your found links lists. The left over urls are the ones you've never hit before.