Norconex

Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for collecting, parsing, and manipulating data from the web or filesystem to various data repositories such as search engines.

Generic library shared between several projects.

Collector-related code shared between different collector implementations

Implementation of Norconex Committer for SQL (JDBC) databases.

Implementation of Norconex Committer for Neo4j.

Implementation of Norconex Committer for Microsoft Azure Search.

Autonomy IDOL implementation of Norconex Committer.

Solr implementation of Norconex Committer. Should also work with any Solr-based products, such as LucidWorks.

Amazon CloudSearch implementation of Norconex Committer.