Commit Graph

92 Commits

Author SHA1 Message Date
daanelson 2695af9706 cog using common load fxn 2023-01-05 00:01:55 -08:00
Hayk Martiros 19fea1294b Update the integrations readme
Topic: cog_integration
2023-01-05 00:01:55 -08:00
Hayk Martiros 45d55e986c Cog integration
Support hosting on Replicate using the cog interface.

Continuation of: https://github.com/riffusion/riffusion/pull/26

Topic: cog_integration
2023-01-05 00:01:55 -08:00
Hayk Martiros 4bec0a40e0 Update hugging face space on push
Topic: hf_playground_action
2023-01-04 23:57:08 -08:00
Hayk Martiros bb5330699c Rename interpolation page
Topic: interpolation_rename
2023-01-04 22:54:33 -08:00
Hayk Martiros da177ec424 Audio splitter
Topic: audio_splitter
2023-01-04 22:49:29 -08:00
Hayk Martiros bfeb32792c Update readme for libsndfile
Topic: install_libsndfile
2022-12-29 11:48:44 -08:00
Hayk Martiros 9baf3d534f Try libsndfile1
Topic: install_libsndfile
2022-12-29 11:48:44 -08:00
Hayk Martiros a4740ac3ed Install libsndfile
Hopefully this allows the soundfile pip package to work, which provides
torchaudio with an audio backend.

Closes: #12

Topic: install_libsndfile
2022-12-29 11:48:44 -08:00
Hayk Martiros fae3e2c918 Add note to SpectrogramParams about torchaudio docs
Closes: #30

Topic: params_docs
2022-12-29 11:46:40 -08:00
Hayk Martiros ce8744897b Convert to three-channel if needed in spectrogram_from_image
Closes: #51

Topic: convert_three_channel
2022-12-29 11:33:09 -08:00
Hayk Martiros 89f3946155
Update README.md 2022-12-27 08:30:19 -08:00
Hayk Martiros d2e864b33e
Clean up README further 2022-12-27 08:11:50 -08:00
Hayk Martiros 0610a45e80 Improve interpolation playground
Topic: playground_improvements
2022-12-27 07:58:06 -08:00
Hayk Martiros f7288f8cd3 Disable compression by default, too slow
Topic: disable_compression
2022-12-27 07:57:52 -08:00
Hayk Martiros 266af6b3e0 Add detail to readme
Topic: readme_3
2022-12-27 07:57:15 -08:00
Hayk Martiros 7b55a966ba
Merge pull request #40 from riffusion/hayk.mart/revup/main/streamlit_app
Streamlit app for interactive use of the model
2022-12-27 00:43:07 -08:00
Hayk Martiros d7cbd5bc3e Wording
Topic: streamlit_app
2022-12-27 00:32:10 -08:00
Hayk Martiros 152192006e Add several streamlit demo pages
Topic: streamlit_app
2022-12-27 00:31:29 -08:00
Hayk Martiros 1335afb72f Add batch text to audio processing
Topic: streamlit_app
2022-12-27 00:24:40 -08:00
Hayk Martiros 420674148a Improve text to audio
Topic: streamlit_app
2022-12-26 21:03:30 -08:00
Hayk Martiros 39dc247a1d Streamlit app for interactive use of the model
Topic: streamlit_app
2022-12-26 20:01:27 -08:00
Hayk Martiros 04d72678b5
Merge pull request #37 from riffusion/hayk.mart/revup/main/github_actions_ci
Add CI with github actions
2022-12-26 18:37:07 -08:00
Hayk Martiros 089a04aa05 Remove test action
Topic: github_actions_ci
2022-12-26 18:28:18 -08:00
Hayk Martiros e8b99fabf9
Merge pull request #38 from riffusion/hayk.mart/revup/main/import_sorting
Enable ruff import sorting
2022-12-26 18:18:14 -08:00
Hayk Martiros 15241d415a Install avconv
Topic: github_actions_ci
2022-12-26 18:17:21 -08:00
Hayk Martiros e48ec2e103 Enable ruff import sorting
Topic: import_sorting
2022-12-26 18:12:02 -08:00
Hayk Martiros 3b0e7be2dc Add CI with github actions
Topic: github_actions_ci
2022-12-26 18:08:19 -08:00
Hayk Martiros d0fe85a4db
Merge pull request #36 from riffusion/hayk.mart/revup/main/clean_rewrite
Rewrite the codebase to be high quality
2022-12-26 17:50:51 -08:00
Hayk Martiros d820e1fecf Fix minor errors
Topic: clean_rewrite
2022-12-26 17:47:11 -08:00
Hayk Martiros 6a5f572374 Add a test that verifies ruff, black, and mypy all pass
This fels good!

Topic: clean_rewrite
2022-12-26 17:47:11 -08:00
Hayk Martiros dc4e2d8d64 Command line interface for common operations, plus tests
Add riffusion.cli tool for common operations. Add a test for
each one.

Topic: clean_rewrite
2022-12-26 17:47:11 -08:00
Hayk Martiros 52bec9575b Update python project configuration files
* Adds a pyproject.toml
* Update requirements and dev requirements
* Add a CITATION file
* Add details to the README

Topic: clean_rewrite
2022-12-26 17:47:11 -08:00
Hayk Martiros cbf473216b Greatly simplify the server and baseten integration
With the new clean module structure, make it so the two servers
share all the important code. This makes the baseten integration
very small and simple, and paves the way for more integrations.

Topic: clean_rewrite
2022-12-26 17:47:11 -08:00
Hayk Martiros 40a799a3d3 Remove old audio module
No longer needed, it's broken up into cleaner pieces.

Topic: clean_rewrite
2022-12-26 17:47:11 -08:00
Hayk Martiros 2fb1153ec8 Refactor RiffusionPipeline
* Bunch of cleanup and typing
 * Move prompt_weighting to be marked as external
 * Add helpers for loading the checkpoint and traced unet

Topic: clean_rewrite
2022-12-26 17:47:11 -08:00
Hayk Martiros 4c78e1a228 Add SpectrogramImageConverter and test
This class converts between spectrogram images and audio. Uses
SpectrogramConverter internally, which only deals with tensors.

Topic: clean_rewrite
2022-12-26 17:47:11 -08:00
Hayk Martiros 7d0e08711c Add SpectrogramConverter class and test
This class is a helper to convert between spectrogram tensors and
audio.

Topic: clean_rewrite
2022-12-26 17:47:11 -08:00
Hayk Martiros 3ab5087c7a Add test for image_util
Topic: clean_rewrite
2022-12-26 17:47:11 -08:00
Hayk Martiros 539aafde3e Pull out basic utilities into util package
Topic: clean_rewrite
2022-12-26 17:47:11 -08:00
Hayk Martiros 671cb5f05e Add spectrogram params
Topic: clean_rewrite
2022-12-26 17:47:11 -08:00
Hayk Martiros 8bdc92cc5a Add a unittest base class and some test data
Topic: clean_rewrite
2022-12-26 17:47:11 -08:00
Hayk Martiros b7cdb872a7 Rewrite the codebase to be high quality
This PR overhauls the codebase to move it from a hack to a proper
foundation to build upon.

Some of the changes:
 * Refactor code into modules and classes
 * More heavily lean on pydub as a great audio library
 * Introduce ruff, black, and mypy and make them pass
 * Test suite
 * Apple MPS support (with CPU fallback for unsupprted stuff)
 * Support stereo spectrogram images (prototype)
 * Support embedding parameters into image metadata as EXIF
 * Add tools for easily comparing parameters and running albations
 * Improve the readme

Topic: clean_rewrite
2022-12-26 17:42:46 -08:00
Hayk Martiros cae8a3892e Merge branch 'main' of https://github.com/hmartiro/riffusion-inference into main 2022-12-23 05:08:51 +00:00
Hayk Martiros 8349ccff59 Make traced unet optional and support custom checkpoints 2022-12-23 05:08:37 +00:00
Hayk Martiros 5eddf347c3
Merge pull request #34 from riffusion/readme/improve_install
Improve installation instructions
2022-12-22 20:51:48 -08:00
Hayk Martiros 19e31790da
Improve installation instructions 2022-12-22 20:51:27 -08:00
Hayk Martiros 40e1e51c6a
Change citation to article 2022-12-18 23:13:08 -08:00
Hayk Martiros 01e8a4774a
Merge pull request #16 from jagilley/main
Add image_from_spectrogram to audio.py
2022-12-18 22:58:01 -08:00
Jasper 66dbdb16ca
Scale by max value
Scale by max value to allow for processing 24- and 32-bit wavs
2022-12-16 22:12:39 -06:00