Results 1 to 5 of 5

Thread: Search engine

Hybrid View

Previous Post Previous Post   Next Post Next Post
  1. #1
    Join Date
    Jan 2005
    Location
    Sundsvall, Sweden
    Posts
    3,532

    Search engine

    Quote Originally Posted by alexc
    Ladies and Gentlemen,

    I am very happy to announce that new index with a grand total of over 1 billion unique web pages is now LIVE! The search engine is now actually distributed - it runs on 2 servers that search independently, this opens way to support for multiple search servers, thus increasing scalability of the search engine big time

    I expect some glitches with View Text/Rank when trying results that came from distributed index, I will fix them tomorrow.

    If you interested to see the difference between distributed and previous (619 mln) index then you can use the following command in search string: disable:dindex -- this would disable searching of the distributed index.

    So far I see very healthy increase in matches, inline with expectations.

    Congratulations to everybody - our hard work and patience resulted in what has got to be the first in the world search engine that hit scale of 1 bln pages and this is just start!
    Thank you guys for your hard work in MJ-12.

    Lagu :D
    Once an AMDuser always an AMD user

  2. #2
    NeoGen's Avatar
    NeoGen is offline AMD Users Alchemist Moderator
    Site Admin
    Join Date
    Oct 2003
    Location
    North Little Rock, AR (USA)
    Posts
    8,451
    Cool!! :D



    The 1st billion is always the hardest. Following billions will be a snap.
    Soon we'll have an alternative to Google! :D

  3. #3
    Join Date
    May 2004
    Location
    Kent, UK
    Posts
    3,511
    I'm in the search. So is my surname (but only a very small subset).


  4. #4
    AMDave's Avatar
    AMDave is offline Seeker of the exit clause Moderator
    Site Admin
    Join Date
    Jun 2004
    Location
    Deep in a while loop
    Posts
    9,658
    I just searched for myself and got
    Code:
    Error occured:
    
    System.OutOfMemoryException: Exception of type System.OutOfMemoryException was thrown.
    Guess I am too big for the server to handle
    Mum always said I'd get too big for my own boots
    . . . . . ___
    . . . . . . .\___/\______
    . . . . . . . \__AMD___\\__
    ---------------------------------------------

  5. #5
    Thanks Lagu - I was about to post here to thank for support of AMD users - your help is much appreciated guys, as you can see I do my best to ensure your contribution actually gets to be put to good use

    First billion is certainly the hardest - there will be many more added!

    AMDave: oops, you run into memory leak - search server leaks memory for every query, I need to fix this ASAP, hope today.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •