 Cyberes
|
665a2e8c18
|
reorganize admin crawl info json, clarify debug message
|
2024-01-23 15:11:15 -07:00 |
|
Cyberes
|
0469529f54
|
rebuild
|
2023-12-13 14:49:04 -07:00 |
|
Cyberes
|
e9db83f09b
|
move elastic sync to workers instead of threads, parallel elastic delete sync, reimplement partial elastic sync
|
2023-12-13 14:21:47 -07:00 |
|
Cyberes
|
d16eaf614e
|
fix mior tihgs
|
2023-12-12 18:00:43 -07:00 |
|
Cyberes
|
b5327e0c67
|
update todo
|
2023-12-11 19:12:00 -07:00 |
|
Cyberes
|
7078712bc3
|
track running crawls and add an admin page, use basic auth for admin, reject crawl if already running for a path, limit max directory crawlers, fix some issues
|
2023-12-11 18:05:59 -07:00 |
|
Cyberes
|
634f3eb8ea
|
fix download encoding, redo config passing,
|
2023-12-11 15:29:34 -07:00 |
|
Cyberes
|
4b9c1ba91a
|
Merge dev to master
|
2023-12-08 22:25:59 -07:00 |