This repository has been archived on 2023-10-20. You can view files and clone it, but cannot push or open issues or pull requests.
hf-key-scraper/README.md

319 B

hf-key-scraper

Scrape for OpenAI keys on Hugging Face.

This requires at least one Squid proxy to function. Define your proxies in settings.py -> PROXIES.

To Run: navigate to the huggingface folder and do python3 crawl-search.py. The crawl-site.py script crawls the entire site (doesn't really work).