update readme
This commit is contained in:
parent
c13c224b36
commit
fb88806bc7
|
@ -3,3 +3,5 @@
|
||||||
Scrape for OpenAI keys on Hugging Face.
|
Scrape for OpenAI keys on Hugging Face.
|
||||||
|
|
||||||
This requires at least one Squid proxy to function. Define your proxies in `settings.py` -> `PROXIES`.
|
This requires at least one Squid proxy to function. Define your proxies in `settings.py` -> `PROXIES`.
|
||||||
|
|
||||||
|
**To Run:** navigate to the `huggingface` folder and do `python3 crawl-search.py`. The `crawl-site.py` script crawls the entire site (doesn't really work).
|
||||||
|
|
Reference in New Issue