Open source file indexing & storage analytics powered by Elasticsearch
Open source enterprise search server for websites, files, and data
Lightweight .NET framework for fast web crawling and data scraping
A fast, high-level web crawling and web scraping framework
The unix-way web crawler
Python HTTP client with TLS and HTTP/2 fingerprint emulation support
Cross platform GUI tool for downloading videos from Bilibili sites
Python tool for crawling and extracting structured data from news site
Remote isolated browser API for security
Movie metadata scraper and organizer for media libraries and NFO
Open source Douyin crawler for collecting and downloading public data
Turn entire websites into LLM-ready markdown or structured data
Python crawler for collecting and downloading Sina Weibo user data
Realtime crawler for COVID-19 outbreak statistics from DXY data
Desktop tool for collecting and exporting Xiaohongshu post data
Open source web scraping system for automated data collection tasks
Fast CLI tool for cloning entire websites for local browsing offline
AI-ready web crawler that extracts and structures website content
High-performance Rust web crawler and scraper for large-scale data
Collection of Python web scraping scripts for data extraction tasks
Lighter, faster browser kernel of blink to integrate HTML UI in apps
Small event-delegation library for decoupling event binding and handli
A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama
Python crawler and API for downloading JMComic albums and images
A web scraping and browser automation library for Node.js