Commit Graph

67 Commits

Author SHA1 Message Date
Cyberes 51d6f2dbf2 fix file listing when there are not files in a directory 2024-04-29 19:21:17 -06:00
Cyberes 9e35ee218c fix crash when trying handle a file as a directory 2024-04-12 21:40:26 -06:00
Cyberes 6001894b0b add retardcheck to zipstream 2024-03-25 15:42:54 -06:00
Cyberes ced920ceb9 fix minor oversight 2024-03-25 02:12:53 -06:00
Cyberes cccfe6fa1a improve elastic setup, add fields arg to search route, improve list endpoint page handling, fix some minor issues with elastic 2024-03-24 22:43:56 -06:00
Cyberes 6a5526ba3e add a query arg to the List endpoint used to determine what page a child item is on 2024-03-23 17:38:28 -06:00
Cyberes 933670c63a adjust json response, minor clean up 2024-03-23 17:38:02 -06:00
Cyberes fdd7f08b12 update readme 2024-03-23 17:37:16 -06:00
Cyberes 90fd31bf3a build script cleans dir 2024-03-17 20:49:49 -06:00
Cyberes c4d9316a05 add version to build script, minor readme change 2024-03-17 20:46:33 -06:00
Cyberes 6348f33658 update build script, string changes 2024-03-17 20:42:07 -06:00
Cyberes 56be07c0a7 rename config variable 2024-03-17 20:33:32 -06:00
Cyberes 6a7153b92b rename config variable 2024-03-17 20:32:12 -06:00
Cyberes b70c830d18 revert testing change, fix typo 2024-03-17 20:28:46 -06:00
Cyberes d622ec95e8 rename files 2024-03-17 20:19:51 -06:00
Cyberes 74206cd6e5 fix elastic workers, fix misc bugs 2024-03-17 20:19:36 -06:00
Cyberes c0faaab3f8 clean up directory crawler, fix active workers number, minor bugfixes 2024-03-17 18:03:18 -06:00
Cyberes 3f305b104b clear cached elastic data when sync is done, bug fix 2024-03-17 17:30:29 -06:00
Cyberes 9a450571bd redo error handling, bug fixes 2024-03-17 17:25:27 -06:00
Cyberes dc3b164520 use one elastic queue for add and delete jobs, use locks for global elastic variables, reject symlinks, code cleanup, move to go 1.22 2024-03-17 14:25:11 -06:00
Cyberes 92e55ca319 rename all modules to lowercase 2024-03-17 12:22:02 -06:00
Cyberes 8a21665e83 redo the job queue again and reorganize the workers 2024-03-17 12:18:22 -06:00
Cyberes 88fd63bfb9 add new config variable, minor qol 2024-03-17 09:58:20 -06:00
Cyberes 4200d4c710 redo all logging messages, minor qol 2024-03-15 22:20:10 -06:00
Cyberes 7fa7c362d5 use ResponseItem instead of CacheItem.item when doing http stuff 2024-03-15 19:29:00 -06:00
Cyberes 115bd60ec5 fix the mystery crash. fuck im retarded 2024-03-15 19:10:24 -06:00
Cyberes c73d17a2ec move a warning back to debug 2024-03-14 17:05:31 -06:00
Cyberes c19304c65f fix children directories not being added to parents, keep working on obscure exception, improve build script 2024-03-14 16:57:00 -06:00
Cyberes 8c76455b60 be careful when reading elastic response 2024-02-12 16:56:52 -07:00
Cyberes b8c30e87d7 tidy up panic debug, tidy build 2024-02-12 16:47:05 -07:00
Cyberes 669f320b81 it's called a BLACKlist, shut the fuck up 2024-02-04 00:39:07 -07:00
Cyberes 5c3a646918 add some info to exe 2024-02-03 20:05:48 -07:00
Cyberes e1e6e2cbc2 fix some data races 2024-02-03 19:46:07 -07:00
Cyberes 665a2e8c18 reorganize admin crawl info json, clarify debug message 2024-01-23 15:11:15 -07:00
Cyberes ba2747c186 fix a couple panics 2024-01-23 14:59:48 -07:00
Cyberes e000d29aa5 adjust admin crawls info 2024-01-23 12:31:23 -07:00
Cyberes 4a74b00d46 take into account the walk function when checking if a crawl is already running for a path 2024-01-23 12:23:24 -07:00
Cyberes 11edbeadc3 reorganize data on admin pages, adjust global vars 2024-01-23 12:10:03 -07:00
Cyberes 7004e3935c adjust logging, catch rare ResponseItem panic for later 2024-01-23 11:49:34 -07:00
Cyberes d925847734 fix kernal panic 2024-01-23 10:41:01 -07:00
Cyberes 3af85db036 fix wrong key being used for delete 2023-12-18 12:02:30 -07:00
Cyberes 39513ffc36 reorder some logic 2023-12-13 22:51:13 -07:00
Cyberes 0ee56f20e7 improve startup sequence, fix the elastic key format 2023-12-13 20:09:02 -07:00
Cyberes 0469529f54 rebuild 2023-12-13 14:49:04 -07:00
Cyberes cd4364436a minor cleanup 2023-12-13 14:43:57 -07:00
Cyberes 631844fb98 fix panic 2023-12-13 14:31:00 -07:00
Cyberes e9db83f09b move elastic sync to workers instead of threads, parallel elastic delete sync, reimplement partial elastic sync 2023-12-13 14:21:47 -07:00
Cyberes d16eaf614e fix mior tihgs 2023-12-12 18:00:43 -07:00
Cyberes 8d08f04a4f add crawl type indicator to admin status page 2023-12-12 17:52:03 -07:00
Cyberes a39b3ea010 reorganize 2023-12-12 17:30:47 -07:00