Page 3 of 3 FirstFirst 123
Results 21 to 22 of 22

Thread: Boitho - distributed crawler

  1. #21
    Join Date
    May 2004
    Location
    Kent, UK
    Posts
    3,511
    Thanks runarb, I'll change my stats now, because they have only just started (mine that is) I added.

  2. #22
    NeoGen's Avatar
    NeoGen is offline AMD Users Alchemist Moderator
    Site Admin
    Join Date
    Oct 2003
    Location
    North Little Rock, AR (USA)
    Posts
    8,451
    Ah, so the crawled pages get full weight but the robots don't. Geez, that's so logical and it didn't even cross my mind! I was splitting the total weight by the parcels, no wonder it wasn't working. :P

Page 3 of 3 FirstFirst 123

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •