hf-key-scraper/README.md

# hf-key-scraper

Scrape for OpenAI keys on Hugging Face.

This requires at least one Squid proxy to function. Define your proxies in `settings.py` -> `PROXIES`.

**To Run:** navigate to the `huggingface` folder and do `python3 crawl-search.py`. The `crawl-site.py` script crawls the entire site (doesn't really work).
Initial commit 2023-07-23 11:55:04 -06:00			`# hf-key-scraper`

final commit 2023-10-20 18:54:11 -06:00			`Scrape for OpenAI keys on Hugging Face.`

			This requires at least one Squid proxy to function. Define your proxies in `settings.py` -> `PROXIES`.
update readme 2023-10-20 18:56:34 -06:00
			To Run: navigate to the `huggingface` folder and do `python3 crawl-search.py`. The `crawl-site.py` script crawls the entire site (doesn't really work).