GitHub - ritikbhatt20/DarkSurf: A dark web crawler built with Python's asyncio for asynchronous crawling using TOR and I2P networks. It classifies content using Hugging Face algorithms and stores results in a Cassandra database.

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 27 Commits
nlp		nlp
webapp		webapp
.gitattributes		.gitattributes
.gitignore		.gitignore
analyse_data.py		analyse_data.py
analyse_data_cass.py		analyse_data_cass.py
async_crawl4.py		async_crawl4.py
async_crawl_i2p.py		async_crawl_i2p.py
both.py		both.py
cass.py		cass.py
cass2.py		cass2.py
categories.json		categories.json
categorize.py		categorize.py
clean.py		clean.py
comm_cassandra.txt		comm_cassandra.txt
config.py		config.py
crawler_constants.py		crawler_constants.py
dev-requirements.txt		dev-requirements.txt
i2p.py		i2p.py
install.bat		install.bat
main.py		main.py
nlp.py		nlp.py
requirements.txt		requirements.txt
tor.py		tor.py
tor_ip_utility.py		tor_ip_utility.py
utils.py		utils.py

About

A dark web crawler built with Python's asyncio for asynchronous crawling using TOR and I2P networks. It classifies content using Hugging Face algorithms and stores results in a Cassandra database.