When nutch crawls a webpage say http://testurl.com which have three links in following order – Sample links- Firstlink.html Secondlink.html Thirdlink.html in logs it always result in random order - Sample logs - fetching http://Thirdlink.html -activeThreads=10, spinWaiting=10, fetchQueues.totalSize=98 -activeThreads=10, spinWaiting=10, fetchQueues.totalSize=98 fetching http://Firstlink.html -activeThreads=10, spinWaiting=10, fetchQueues.totalSize=97 -activeThreads=10, spinWaiting=10, fetchQueues.totalSize=97 fetching http://Secondlink.html activeThreads=10, spinWaiting=9, fetchQueues.totalSize=96 -activeThreads=10, spinWaiting=10, […]
The post In which order nutch crawls the link present on a webpage appeared first on BlogoSfera.
