NewPipe skips and buffers video when brought in foreground after audio-only background play

[piramiday]

Checklist

• I am able to reproduce the bug with the latest version given here: CLICK THIS LINK.
• I made sure that there are no existing issues - open or closed - which I could contribute my information to.
• I have read the FAQ and my problem isn't listed.
• I have taken the time to fill in all the required details. I understand that the bug report will be dismissed otherwise.
• This issue contains only one bug.
• I have read and understood the contribution guidelines.

Affected version

0.28.0 and all previous versions

Steps to reproduce the bug

when watching some music videos from YT, I often lock the screen and carry on with my tasks, or put NewPipe in the background.
as a consequence, NewPipe correctly starts loading up only the audio and keeps reproducing music while blacking out the video stream.
once I reopen the app in the foreground, I always get stuttering and a very obnoxious split second pause while NewPipe reestablishes the video stream and buffers it out.

Expected behavior

NewPipe should move smoothly from audio only to video+audio.
if video buffering is necessary, video should start a few seconds later to avoid pausing.
anything should be done to try and avoid skipping, including having the user wait for the video stream.

Actual behavior

NewPipe pauses for a split second while it buffers the video stream, then carries on as normal.
the second or subsecond pause is very noticeable and severely impacts the UX.

Screenshots/Screen recordings

No response

Logs

No response

Affected Android/Custom ROM version

No response

Affected device model

No response

Additional information

No response

[AudricV]

This is handled by the player library we use, ExoPlayer, and not the app directly. We disable video and text track renderers when the app is in the background in order to save data usage. This phenomenon also happens everytime when you are using a service which only returns video streams with audio embedded and audio only streams, but it cannot be avoided in this case.

if video buffering is necessary, video should start a few seconds later to avoid pausing.

I don't think this is a good idea. With a very low speed connection, you may be still playing audio for potentially a very long time, which means that the video part which is being fetched could be already passed without being rendered.

NewPipe pauses for a split second while it buffers the video stream, then carries on as normal.

On my side there is almost no loading break, the video surface is black for 1 second or 2, so your connection speed plays a role in this behavior.

[piramiday]

for context, this happens to me at home with wifi and great signal on a fast connection.

so you don't notice any audio skip, at all? huh.

I guess all sort of things could happen with a really low-speed connection...
anyways, maybe this could be an option?

LMK if I should close this and chalk it off to my lan+devices, then.