Commit Graph

40 Commits

Author SHA1 Message Date
Cyberes c1988263d6 fix path issues, clean up, try to exclude already downloaded pages 2023-10-27 18:59:58 -06:00
Cyberes fe96f19eca readme 2023-10-27 18:06:32 -06:00
Cyberes a27aa18f40 download user files, clean up code 2023-10-27 18:04:07 -06:00
Cyberes 76b2b6604e update readme 2023-10-27 16:48:16 -06:00
Cyberes 989a563b1d rename 2023-10-27 16:30:38 -06:00
Cyberes 652f04461b cleanup 2023-10-27 16:30:16 -06:00
Cyberes 9a67feefab update my stuff 2023-10-27 16:24:52 -06:00
dj346 941f675eae
Update README.md (#20)
Old "Get cookies.txt" was compromised and taken off the chrome extensions page. Important not to use "Get cookies.txt" and now use "Get cookies.txt Clean"
2023-10-05 07:13:50 -07:00
David Katsandres 959027be96 Remove GitHub Pages 2023-06-27 08:55:34 -07:00
Nafee Jan 0f34d8148f
Add a max folder name limit to prevent too long path names (#13)
* implement a max folder name size limit

* fix dicussion spelling
2023-05-10 14:36:11 -07:00
Matthew Foran a03d88b742
Bug fixes, better linux compatibility (#9)
* removed package-lock.json from repo

* added package-lock.json to .gitignore

* fixed typo, linux compatbility

* added quotes to url

* check if attempt is None

* reverted removing package-lock.json

Co-authored-by: Matthew Foran <matthewjforan@gmail.com>
2022-05-24 15:10:06 -06:00
dj346 e4a9bc6597
Added support to download canvas webpages (#7)
* fixed bug with loading cred yaml and added to gitignore

* added single file dependency

* Begun adding support for singlefile, added to classes and created new input. Also cleaned up code a bit.

* Created singlefile.py to download webpages.

* added function to download course home page.

* Added course home page downloading.

* Added downloading of assignment pages.

* Added downloading for the rest of the information

* Update README.md

* Update README.md

* Added checks to prevent redownloading of a page.

* Fixed bug with trailing periods, Fixed folder naming bug, Fixed bug where pages were being downloaded to cookies folder.

* Fixed some small issues, fixed comment and changed module folder name back to title

* Update README.md

* Fixed makeValidFilename back to makeValidFolderPath

resolves https://github.com/davekats/canvas-student-data-export/pull/7#pullrequestreview-852487782
2022-01-22 09:21:05 -08:00
David b82cccc54a
Merge pull request #6 from 17acres/master
Fix filepath-related crashes, organize files better, download single-student submissions, fix dependencies, etc.
2021-07-09 16:06:14 -07:00
17acres 16911fb8fb Fix formatting 2021-07-03 12:48:12 -04:00
17acres 02887beffe Update README to match change of directory names 2021-07-03 12:46:24 -04:00
17acres 114f8e95ea Add missing pyyaml dependency to lists 2021-07-03 12:44:56 -04:00
17acres d9b6c66c33 Fix 66696c5 so folder paths work properly 2021-05-06 13:18:55 -04:00
17acres 63151c3075 Don't create user id subfolder for submissions if only 1 exists 2021-05-06 13:18:02 -04:00
17acres 66696c5733 Replace important invalid characters in filename strings with useful separators 2021-05-06 13:09:56 -04:00
17acres bb0633a8e7 Gitignore default output directory 2021-05-06 12:46:17 -04:00
17acres bcf362c46a Fix accidental commenting-out of features 2021-05-06 12:09:29 -04:00
17acres ad174fcbb5 Handle student-mode submissions and teacher-mode submissions the same
Treat submissions from the list of submissions from every student the same as submissions from a single individual user (student) so they are downloaded the same and processed. Before, it seems like it just didn't care to download submission attachments for single-student-account-only individual submissions. Now, handle both types the same. This means that there are a lot of single-element lists of submissions in the final output if the user is a student, but it makes the code simpler. Could clean up those lists later.

Also, display the different types of errors in fetching submissions.
2021-05-06 02:19:01 -04:00
17acres 2040415d1a Fix valid filename crashes, organize files more
1. Fixes issues where the program crashes because things like assignment names aren't valid filenames.
Makes the following improvements:
2. Stores assignment files in an "assignments" subfolder.
3. Doesn't make attachment directory if there are no attachments.
4. Organizes course files inside subfolders as created on Canvas (requiring the makeValidFolderPath function to sanitize the path but leave slashes)
2021-05-05 16:33:36 -04:00
David Katsandres 577327f31a
Merge pull request #2 from alex-bellon/master
Added error handling when getting submissions
2021-03-18 16:57:03 -07:00
David Katsandres 2d6fb6b3c3
Merge pull request #4 from alex-bellon/requirements
Added python-dateutil to dependencies and created requirements.txt
2021-03-17 07:44:16 -07:00
David Katsandres 6b4959c189
Merge branch 'master' into requirements 2021-03-17 07:42:49 -07:00
David Katsandres 7c3308436d
Merge pull request #3 from alex-bellon/documentation
Added more information about credentials to README
2021-03-17 07:31:39 -07:00
alex-bellon 30dfe5166b Added python-dateutil to dependencies and created requirements.txt 2021-03-16 22:33:05 -05:00
alex-bellon 572660cce2 Added more information about credentials to README 2021-03-16 22:20:56 -05:00
alex-bellon 4866967140 Added error handling when getting submissions 2021-03-16 21:56:03 -05:00
David Katsandres a0be61b2ef
Merge pull request #1 from moorepants/all-assignments
Added ability to download all submissiosn from students and load credentials from file
2020-07-13 21:40:07 -07:00
Jason K. Moore 74e3f91436 Use attachement id to ensure unique downloads. 2020-07-08 14:59:14 -07:00
Jason K. Moore b6f787167f Print more info on attachments. 2020-07-08 14:20:35 -07:00
Jason K. Moore fa7e2f5046 Script seems to be working and downloading all submissions. 2020-07-08 13:51:04 -07:00
Jason K. Moore 2c54cbd18b Start of attachment storage. 2020-07-08 09:50:20 -07:00
Jason K. Moore 00ef66f3d6 Start of edits to download all submissions. 2020-07-07 21:33:49 -07:00
David Katsandres 03a42bf526
Update _config.yml 2020-03-10 15:38:57 -07:00
David Katsandres b0a938bb5c Trigger rebuild. 2019-08-15 23:02:08 -07:00
David Katsandres b96f3dcbc7 Add project files. 2019-08-15 22:38:16 -07:00
David Katsandres bba2abd0af
Initial commit 2019-08-15 22:36:39 -07:00