Commit Graph

21 Commits

Author SHA1 Message Date
Cyberes c1988263d6 fix path issues, clean up, try to exclude already downloaded pages 2023-10-27 18:59:58 -06:00
Cyberes a27aa18f40 download user files, clean up code 2023-10-27 18:04:07 -06:00
Cyberes 989a563b1d rename 2023-10-27 16:30:38 -06:00
Cyberes 652f04461b cleanup 2023-10-27 16:30:16 -06:00
Cyberes 9a67feefab update my stuff 2023-10-27 16:24:52 -06:00
Nafee Jan 0f34d8148f
Add a max folder name limit to prevent too long path names (#13)
* implement a max folder name size limit

* fix dicussion spelling
2023-05-10 14:36:11 -07:00
Matthew Foran a03d88b742
Bug fixes, better linux compatibility (#9)
* removed package-lock.json from repo

* added package-lock.json to .gitignore

* fixed typo, linux compatbility

* added quotes to url

* check if attempt is None

* reverted removing package-lock.json

Co-authored-by: Matthew Foran <matthewjforan@gmail.com>
2022-05-24 15:10:06 -06:00
dj346 e4a9bc6597
Added support to download canvas webpages (#7)
* fixed bug with loading cred yaml and added to gitignore

* added single file dependency

* Begun adding support for singlefile, added to classes and created new input. Also cleaned up code a bit.

* Created singlefile.py to download webpages.

* added function to download course home page.

* Added course home page downloading.

* Added downloading of assignment pages.

* Added downloading for the rest of the information

* Update README.md

* Update README.md

* Added checks to prevent redownloading of a page.

* Fixed bug with trailing periods, Fixed folder naming bug, Fixed bug where pages were being downloaded to cookies folder.

* Fixed some small issues, fixed comment and changed module folder name back to title

* Update README.md

* Fixed makeValidFilename back to makeValidFolderPath

resolves https://github.com/davekats/canvas-student-data-export/pull/7#pullrequestreview-852487782
2022-01-22 09:21:05 -08:00
17acres d9b6c66c33 Fix 66696c5 so folder paths work properly 2021-05-06 13:18:55 -04:00
17acres 63151c3075 Don't create user id subfolder for submissions if only 1 exists 2021-05-06 13:18:02 -04:00
17acres 66696c5733 Replace important invalid characters in filename strings with useful separators 2021-05-06 13:09:56 -04:00
17acres bcf362c46a Fix accidental commenting-out of features 2021-05-06 12:09:29 -04:00
17acres ad174fcbb5 Handle student-mode submissions and teacher-mode submissions the same
Treat submissions from the list of submissions from every student the same as submissions from a single individual user (student) so they are downloaded the same and processed. Before, it seems like it just didn't care to download submission attachments for single-student-account-only individual submissions. Now, handle both types the same. This means that there are a lot of single-element lists of submissions in the final output if the user is a student, but it makes the code simpler. Could clean up those lists later.

Also, display the different types of errors in fetching submissions.
2021-05-06 02:19:01 -04:00
17acres 2040415d1a Fix valid filename crashes, organize files more
1. Fixes issues where the program crashes because things like assignment names aren't valid filenames.
Makes the following improvements:
2. Stores assignment files in an "assignments" subfolder.
3. Doesn't make attachment directory if there are no attachments.
4. Organizes course files inside subfolders as created on Canvas (requiring the makeValidFolderPath function to sanitize the path but leave slashes)
2021-05-05 16:33:36 -04:00
alex-bellon 4866967140 Added error handling when getting submissions 2021-03-16 21:56:03 -05:00
Jason K. Moore 74e3f91436 Use attachement id to ensure unique downloads. 2020-07-08 14:59:14 -07:00
Jason K. Moore b6f787167f Print more info on attachments. 2020-07-08 14:20:35 -07:00
Jason K. Moore fa7e2f5046 Script seems to be working and downloading all submissions. 2020-07-08 13:51:04 -07:00
Jason K. Moore 2c54cbd18b Start of attachment storage. 2020-07-08 09:50:20 -07:00
Jason K. Moore 00ef66f3d6 Start of edits to download all submissions. 2020-07-07 21:33:49 -07:00
David Katsandres b96f3dcbc7 Add project files. 2019-08-15 22:38:16 -07:00