The idea was not bad...
Experimenting with different 74HC logic chips and a shopping spree in an electronic components store got me thinking about a synthesizer or some kind of control board with a lot of hardware inputs for the user as known from music production.
Adding multiple leds, potentiometers (even linear, pressure sensitive ones) and the wiring just for those was a first step, then progress stalled.