by mol » Wed Dec 23, 2015 7:15 pm
That's what I thought. But it doesn't crawl some webs (selected the crawlin website option), otheres/most yes perfectly. and then some new webs, like completely new it found hundred of internal crawled webs, that surprised me a lot... heard of something like this? ty