Ah… got it. For some odd reason, changing to my own layerSlider in the layout block “Advanced layerSlider” didn’t work. If I removed that layout item and added it again, with the same settings, it all works.
Might be of interest to future users, because the behavior make no sense, must be a bug.