Search Results for "git:/git.code.sf.net/p/docfetcher/code"

...Details here: https://sourceforge.net/projects/kalimero/ WallPaper (alias crawlpaper) is a desktop changer (NOT a screensaver) which includes a web crawler for picture download, an audio stream ripper, an audio player, a mini mp3 tag editor,etc. Also included support for .zip and .rar files and an interface to the BerkleyDB code for small databases.

Restad is an indexing-querying tool for tagged documents. It uses a relational database for storage and querying. See the last news on the blog : https://sourceforge.net/p/restad/blog/ The Ruby first prototype can be found there : https://github.com/ymoreau/Restad

crowdspider is a multi-thread web crawler. crowdspider is (just) a web crawler, NOT an indexer. You have to write some code yourself in order to save pages or index them in a database.

MOVED: http://code.google.com/p/rssfilter/ Selects and/or rejects articles from RSS feeds based on keywords you supply. Runs in your taskbar! Originally intended to filter new content from scientific journals such as PRL or the arxiv (cond-mat, etc)

A full featured Internet search engine, specifically designed to power vertical search, enterprise search, or a knowledge area search. Can index 2.5 million documents per 24 hours on a single Dell server. Clean C++/STL code written from scratch.

Uni-wordsplit aimed to provide a unicode(lexical analysis/word splitter) system.Especially designed for CJK(China/Japan/Korea) users. The Code based on Mozilla-XPCOM code.

Larbin is a Web crawler intended to fetch a large number of Web pages, it should be able to fetch more than 100 millions pages on a standard PC with much u/d. This set of PHP and Perl scripts, called webtools4larbin, can handle the output of Larbin and p

It is basicly a program that can make you a search engine. It is a web crawler, has all the web site source code (in ASP, soon to be PHP as well), and a mysql database.