[YouTube] Coordinating efforts on SABR implementation

[Stypox]

This issue is meant to coordinate efforts from contributors and gather information to implement YouTube's custom protocol for playback and downloading.

Instructions on how to approach this support for playback: #12248 (comment)

If you want to help with the implementation and have any questions, feel free to post them here or even better on our IRC/Matrix channel!

DO NOT REPORT #13320 AGAIN HERE! Only post RELEVANT DEVELOPER-FACING INFORMATION here. Other comments will be deleted.

[kwen1000]

I disabled Android System Webview and was able to get HD and 4K videos back. So, it seems like the issue is the browser integrity check introduced in v0.27.6.

[Stypox]

@kwen1000 here is why disabling the WebView makes NewPipe work again, and here is why that's not a real solution:

• If the WebView is available, NewPipe passes poTokens to NewPipeExtractor, and the extractor uses the WEB client to fetch results
• If the WebView is not available, the extractor uses the TVHTML5 client instead, which does not (yet) require poTokens, see here
• So, when you disable the WebView, you force the extractor to use the TVHTML5 client, and TVHTML5 currently still kind of works but:
  • it will probably start requiring poTokens too at some point, so we are just using it as a temporary fallback for when no WebView is available, but at some point this will not be possible anymore
  • YouTube is moving to SABR formats everywhere, and probably the TVHTML5 client will switch to them too at some point (the client already use them for playback)
• The reason why the WEB client is not working well anymore is not due to the poToken generation, which still works, but due to the fact that NewPipe cannot play the SABR-encoded video formats
• So the correct future-proof solution is to implement SABR support in the NewPipe player.

[Stypox]

Some information about the SABR format can be found here and here, as originally posted by @AudricV in #12126 (comment).

The extractor needs small changes to also extract SABR streams in the functions called by getItags(), and that should be quite simple.

Most of the changes need to be done on the NewPipe side, within the player folder, to implement the SABR format as a data source for the ExoPlayer. In particular, you would need to create a new data source like this one but customized for SABR.

Some more relevant information posted by @AudricV on the Matrix chat:

A custom DataSource should be enough, especially due to the workaround found to make SABR return video data only.
I don't have time to enter into details, but please note we use multiple YouTube clients (WEB and TVHTML5 for users without being able to provide poTokens) and multiple SABR URLs with different audio and video variants are be available (with multiple SABR configs).
For instance, MWEB (we don't use this client, this is for an example) returns audio stream 600, this is not the case on the WEB client, so trying to use stream 600 on WEB would result in a SABR error with WEB SABR config and URL (and I don't think using MWEB config on a WEB SABR URL would work)

@thefaboss I deleted your comment as to not clutter the thread for newcomers, but will reproduce it here:

I’ve just tried to disable Android System Webview, and yes, as kwen1000 sais, HD is back, even in download section \o/

Originally posted by @thefaboss in #12248

[Dakkaron]

Would it make sense to switch to TVHTML5 as a quick workaround until a proper solution is implemented?