Ah wait this need for a “come down” from stimulation might explain a lot of things for me.

If I’m coming down from a long day/walk/etc. the tiredness hits me, but if I don’t go to bed and fall asleep fast enough, even if I’m relaxing, then I will no longer be sleepy and will struggle to fall asleep.