crawle

Here are 2 public repositories matching this topic...

BaseMax / go-doc-bundler

A Go utility that crawls documentation websites and packages them into an offline bundle with full-text search capabilities. Built with Go's HTTP client and HTML parsing, featuring deterministic builds and content deduplication. A tool for bundling online documentation into offline, searchable archives.

search go golang documentation crawler docs document documents doc crawlers text-search go-crawler documentations crawle full-search crawler-go go-doc crawler-automation go-docs

Updated Jul 3, 2026
Go

michalboryczko / crawler-generator-agent

Star

Autonomous agent analyzes websites and generates production-ready crawling plans with validation datasets. Powered by a cutting-edge multi-agent orchestration architecture to discover site structure, extract optimal CSS selectors, and prepare comprehensive test suites.

agent scraper ai ai-agents crawle llm agentic-ai

Updated Jan 11, 2026
Python

Add this topic to your repo

To associate your repository with the crawle topic, visit your repo's landing page and select "manage topics."

Learn more