sirdf.com Forum Index sirdf.com
Search & Information Retrieval Development Forum
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Your own fulltext database

 
Post new topic   Reply to topic    sirdf.com Forum Index -> Making a search engine
View previous topic :: View next topic  
Author Message
Phoog
Newbie


Joined: 11 Dec 2005
Posts: 7

PostPosted: Thu Oct 19, 2006 2:33 pm    Post subject: Reply with quote

Hope you guys are still using this forum...

Im building on a news searchengine right now and need my own ranking algorithms so Im thinking about buildning my own fulltext/inverted index database. What is you experience with that?

Should I use a existing system like oracle or mysql and create my inverted index in that or should I build the database from scratch? Also, Im using Perl as programminglanguage.

The reason I want to build my own database for that is beacuse Im using another language so Im going to use a custom stemming algorithm and so on...

Anyone in here running a newssearch today?

Have a nice day!
/j
Back to top
View user's profile Send private message
runarb
Site Admin


Joined: 29 Oct 2006
Posts: 4

PostPosted: Sun Oct 29, 2006 2:51 am    Post subject: Reply with quote

If you can use a relational database like Oracle or MySQL depends on the number of pages you want to search.

Relational database isn’t really made for searching, but can handle some million of documents.

If you are planning to only index some tens of thousand of documents you can use a sql database. But if you are planning for more then 100 000 you probably should use an inverted index of some sort.

Have you looked on Plucene (http://search.cpan.org/dist/Plucene/lib/Plucene.pm) ? It is a Perl port of Lucene.
Back to top
View user's profile Send private message Send e-mail Visit poster's website
Display posts from previous:   
Post new topic   Reply to topic    sirdf.com Forum Index -> Making a search engine All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Powered by phpBB © 2001, 2005 phpBB Group