Transform the hidden states and attention patterns of language models into multi-layered musical compositions.
🍄 Inspiration
This project is inspired by the way mushrooms and mycelial networks in forests
connect plants and trees, forming a living web of communication and resource sharing.
These connections, can be turned into ethereal music.
Just as signals move through these hidden connections, transformer models also
pass hidden states and attentions across their layers. Here, those hidden
connections are translated into music, analogous to the forest's secret orchestra.
Features
Two compute modes: Full model (GPU) or Mock latents (CPU-friendly)
Multiple musical scales: From pentatonic to chromatic
Instrument presets: Orchestral, electronic, ensemble, and more