Notes2Audio

[patrickvonplaten]

Model/Pipeline/Scheduler description

https://github.com/magenta/music-spectrogram-diffusion

Very cool model that can transform notes to music.
Note: Requires translating the code from Flax to PyTorch.

Open source status

• The model implementation is available
• The model weights are available (Only relevant if addition is not a scheduler).

Provide useful links for the implementation

cc @cghawthorne

Also this might be interesting for @ArthurZucker . Happy to help here!

[nandwalritik]

Hi @patrickvonplaten I would like to take this up.

[patrickvonplaten]

Hey @nandwalritik,

I think @kashif and @ArthurZucker are already working on it here: #544 :-)

But if you would like to help, you could review the PR a bit or you @kashif and @nandwalritik maybe you could chat a bit

[kashif]

awesome @nandwalritik please send me an email kashif.rasul@gmail.com and I can show you what i did till now! Happy to pair up then!

[nandwalritik]

Yeah sure.