AST-based JavaScript reverse engineering and variable tracing toolkit
Async Python framework for fast and flexible web scraping spiders
Guide and resources for accessing and using the U3C3 BitTorrent site
Proxy crawler that aggregates, tests, and serves usable proxy nodes
Python tool for scraping search engine results from many providers
Collection of Python ecommerce and website crawler examples projects
Python crawler that downloads image galleries and analyzes titles
Python library to crawl and retrieve data from WeChat accounts
Distributed proxy IP pool for web crawlers using Scrapy and Redis
Asyncio-based Python framework for building fast web crawling spiders
Convert websites into structured APIs automatically with Python tool
Lightweight Java web crawler framework with jQuery-style extraction
Open source Search Engine and Enterprise Search