Background play can't find "play next" button and won't work when phone is locked

Good catch – that’s exactly the case. I can repro this as well but skipping to the next video in queue on YT. I think that’s strong confirmation that the OS controls all this as you noted earlier and it’s implemented to only show the additional controls if a multiple videos/a queue is detected.