The problem is the reliance on midi but it shouldnt be hard to build a credible house music generator even with midi byt relying in midi music data for training wont get you something that sounds like a jimi hendrix. But doing automated dance music makes sense.
Very cool! I actually think Jazz improvisation would not be very hard to do:
One of the things you realize if you study jazz improvisation deeply, is that it isn't that random. Someone like Charlie Parker learned over 100 interesting riffs or patterns, then learned to play them in any key (transposing as necessary), and when improvising, transposes each into the chord the band is currently playing, and arranges them in a unique and interesting order.
Indeed, this is why many great Jazz musicians learn to improvise by transcribing solos of Charlie Parker, John Coltrane, etc, and learning their riffs in every possible key. Transposing is one of the best possible ways to learn to improvise, because it teaches you to listen and hear notes, as well as the patterns/riffs that everyone copies from each other.
There is even a great book called "Patterns for Jazz" that captures many of the most powerful riffs used by these musicians.
The really interesting thing about this is while most of the listening public assumes jazz is pure improvisation, much of it is copied riffs just rearranged in unique and interesting ways. I don't mean to detract from it; jazz is still a great musical style, but like all styles results from derivatives of previous works.
Mmmmm... that sounds like overfitting. That's not "attempting some singing", that's "playing back one of the things it trained on". Which really raises questions about the rest of what you hear, too; it seems like what is being produced is probably in some sense the "average" of the training data, rather than something able to generate new samples from it. But it's a very interesting "average" full of interesting information.
Since I wouldn't expect this to produce much else, I'm not being critical about the effort, just pointing it out so others understand what they are hearing. It was an interesting and worthy experiment that I wondered about myself.