crazy-file-server/todo.txt

- Use the Elastic delete pool to add new items to the database. Don't use the main pool because that slows everything down when a file crawl and Elastic are running at the same time
- on the client health page, show the time the initial crawl started


Later:
- Add a wildcard option to restricted_download_paths to block all sub-directories
- Add a dict to each restricted_download_paths item to specify how many levels recursive the block should be applied
- add a "last modified" to "sort" https://chub-archive.evulid.cc/api/file/list?path=/chub.ai/characters&page=1&limit=50&sort=folders
- add an admin endpoint to fetch the last n modified files.
reorganize admin crawl info json, clarify debug message 2024-01-23 15:11:15 -07:00			`- Use the Elastic delete pool to add new items to the database. Don't use the main pool because that slows everything down when a file crawl and Elastic are running at the same time`
rebuild 2023-12-13 14:49:04 -07:00			`- on the client health page, show the time the initial crawl started`

fix mior tihgs 2023-12-12 18:00:43 -07:00
fix download encoding, redo config passing, 2023-12-11 15:29:34 -07:00			`Later:`
Merge dev to master 2023-12-08 22:25:59 -07:00			`- Add a wildcard option to restricted_download_paths to block all sub-directories`
			`- Add a dict to each restricted_download_paths item to specify how many levels recursive the block should be applied`
fix download encoding, redo config passing, 2023-12-11 15:29:34 -07:00			`- add a "last modified" to "sort" https://chub-archive.evulid.cc/api/file/list?path=/chub.ai/characters&page=1&limit=50&sort=folders`
track running crawls and add an admin page, use basic auth for admin, reject crawl if already running for a path, limit max directory crawlers, fix some issues 2023-12-11 18:05:59 -07:00			`- add an admin endpoint to fetch the last n modified files.`