That reminds me of those neural network models that would learn to change themselves, a little like a ML algorithm that would learn about neural network that worked best.
I think google did something like this some years ago?
Neural Architecture Search with Reinforcement Learning[1]
This isn't really a unsupervised or self-supervised technique at all. It's a combination of supervised learning with reinforcement learning (which is a whole other thing too).
I think google did something like this some years ago?