Neural audio jamming with MSPrior for RAVE using nn~ (Martsman dataset)

แชร์
ฝัง
  • เผยแพร่เมื่อ 13 ก.ย. 2024
  • MSPrior is a multi(scale/stream) prior model architecture for realtime temporal learning created by Antoine Caillon.
    In this video, I'm playing around with a prior model I created based on a RAVE model I trained on a selection of Martsman tracks. I'm using the nn~ object in Pure Data to load both RAVE and the MSPrior models.
    MSPrior on GitHub: github.com/cai...
    RAVE on GitHub: github.com/aci...
    nn~ on GitHub: github.com/aci...
    To train MSPrior on Colab, you can use this Jupyter notebook i've set up recently: github.com/dev...

ความคิดเห็น • 5

  • @tsdoihasdoihasdoih2493
    @tsdoihasdoihasdoih2493 ปีที่แล้ว +1

    wicked!!!!!!!!

  • @josepmcomajoncoses5118
    @josepmcomajoncoses5118 11 หลายเดือนก่อน +1

    amazing! Do you know of any prior model available for testing?

    • @martsm_n
      @martsm_n  11 หลายเดือนก่อน +1

      I'm not aware of any models that are publicly available. The training, however, is pretty straight forward, if you have a decent RAVE model and the dataset at hand. You can use this notebook: github.com/devstermarts/notebooks/blob/main/MSPRIOR_Training_Template--Colab.ipynb

    • @nilskakoseos8300
      @nilskakoseos8300 10 หลายเดือนก่อน

      There seems to be some bug, apparent in the preprocess cell: Traceback (most recent call last):
      File "/content/miniconda/bin/msprior", line 8, in
      sys.exit(main())
      File "/content/miniconda/lib/python3.9/site-packages/msprior_scripts/main_cli.py", line 28, in main
      app.run(module.main)
      File "/content/miniconda/lib/python3.9/site-packages/absl/app.py", line 308, in run
      _run_main(main, args)
      File "/content/miniconda/lib/python3.9/site-packages/absl/app.py", line 254, in _run_main
      sys.exit(main(argv))
      File "/content/miniconda/lib/python3.9/site-packages/msprior_scripts/preprocess.py", line 144, in main
      sampling_rate = rave_preprocessor.model.sr
      File "/content/miniconda/lib/python3.9/site-packages/torch/jit/_script.py", line 785, in __getattr__
      return super(RecursiveScriptModule, self).__getattr__(attr)
      File "/content/miniconda/lib/python3.9/site-packages/torch/jit/_script.py", line 502, in __getattr__
      return super(ScriptModule, self).__getattr__(attr)
      File "/content/miniconda/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1269, in __getattr__
      raise AttributeError("'{}' object has no attribute '{}'".format(
      AttributeError: 'RecursiveScriptModule' object has no attribute 'sr'

    • @martsm_n
      @martsm_n  10 หลายเดือนก่อน +2

      @@nilskakoseos8300 you might want to take this to the RAVE Discord channel or the MSPrior Repo on GitHub.