Commit Graph

32 Commits

Author SHA1 Message Date
Hayk Martiros 420674148a Improve text to audio
Topic: streamlit_app
2022-12-26 21:03:30 -08:00
Hayk Martiros 39dc247a1d Streamlit app for interactive use of the model
Topic: streamlit_app
2022-12-26 20:01:27 -08:00
Hayk Martiros e48ec2e103 Enable ruff import sorting
Topic: import_sorting
2022-12-26 18:12:02 -08:00
Hayk Martiros d820e1fecf Fix minor errors
Topic: clean_rewrite
2022-12-26 17:47:11 -08:00
Hayk Martiros dc4e2d8d64 Command line interface for common operations, plus tests
Add riffusion.cli tool for common operations. Add a test for
each one.

Topic: clean_rewrite
2022-12-26 17:47:11 -08:00
Hayk Martiros cbf473216b Greatly simplify the server and baseten integration
With the new clean module structure, make it so the two servers
share all the important code. This makes the baseten integration
very small and simple, and paves the way for more integrations.

Topic: clean_rewrite
2022-12-26 17:47:11 -08:00
Hayk Martiros 40a799a3d3 Remove old audio module
No longer needed, it's broken up into cleaner pieces.

Topic: clean_rewrite
2022-12-26 17:47:11 -08:00
Hayk Martiros 2fb1153ec8 Refactor RiffusionPipeline
* Bunch of cleanup and typing
 * Move prompt_weighting to be marked as external
 * Add helpers for loading the checkpoint and traced unet

Topic: clean_rewrite
2022-12-26 17:47:11 -08:00
Hayk Martiros 4c78e1a228 Add SpectrogramImageConverter and test
This class converts between spectrogram images and audio. Uses
SpectrogramConverter internally, which only deals with tensors.

Topic: clean_rewrite
2022-12-26 17:47:11 -08:00
Hayk Martiros 7d0e08711c Add SpectrogramConverter class and test
This class is a helper to convert between spectrogram tensors and
audio.

Topic: clean_rewrite
2022-12-26 17:47:11 -08:00
Hayk Martiros 539aafde3e Pull out basic utilities into util package
Topic: clean_rewrite
2022-12-26 17:47:11 -08:00
Hayk Martiros 671cb5f05e Add spectrogram params
Topic: clean_rewrite
2022-12-26 17:47:11 -08:00
Hayk Martiros 8349ccff59 Make traced unet optional and support custom checkpoints 2022-12-23 05:08:37 +00:00
Jasper 66dbdb16ca
Scale by max value
Scale by max value to allow for processing 24- and 32-bit wavs
2022-12-16 22:12:39 -06:00
Jasper 1c5caf77ac
Convert to RGB 2022-12-16 16:26:46 -06:00
Jasper 9ab8c0f105
added image_from_spectrogram to audio.py 2022-12-16 16:02:12 -06:00
Hayk Martiros cb518c548a Prototype prompt reweighting 2022-12-14 08:20:19 +00:00
Seth Forsgren 387b4da8ff updating mask image directory 2022-12-13 17:07:49 -08:00
Seth Forsgren 2fea921515 debug code 2022-12-13 16:21:39 -08:00
Hayk Martiros 55651db0fc to cuda 2022-12-13 06:55:07 +00:00
Hayk Martiros 79239a719d make server work 2022-12-13 06:43:46 +00:00
Seth Forsgren 37d975cea8 setting default checkpoint to hosted model 2022-12-12 22:16:45 -08:00
Seth Forsgren afa49af2b0 traced unet and disabled autocast, adding baseten.py 2022-12-12 22:01:47 -08:00
Hayk Martiros ae34fb388e Add support for cache (still disabled) 2022-11-28 00:06:12 +00:00
Hayk Martiros 511defae99 Provide clip duration and encode base64 prefix type 2022-11-27 21:55:42 +00:00
Hayk Martiros 7f27705f81 save JPEG instead of PNG 2022-11-26 19:24:50 +00:00
Hayk Martiros 09c789811f Add a step towards SSL support 2022-11-26 06:49:25 +00:00
Hayk Martiros 6e69c94277 Support masks 2022-11-26 06:48:52 +00:00
Hayk Martiros c17e428e45 Flask server for running it all 2022-11-26 00:15:56 +00:00
Hayk Martiros 83f9a527e3 spectrogram and waveform processing module 2022-11-26 00:15:15 +00:00
Hayk Martiros 5b2592153a RiffusionPipeline for img2img-aware interpolation
Inherits from the diffusers pipeline format.
2022-11-26 00:14:14 +00:00
Hayk Martiros baa56442e5 Describe data types 2022-11-26 00:13:29 +00:00