File _service:download_url:2080.patch of Package gnome-shell

Overview Repositories Revisions Requests Users Attributes Meta

File _service:download_url:2080.patch of Package gnome-shell (Revision bb59d2dd05f72b938ac749b21e77e50a)

Currently displaying revision bb59d2dd05f72b938ac749b21e77e50a , Show latest

From ddc2e3791ba10295d2341fe7751cf2b346c83e29 Mon Sep 17 00:00:00 2001
From: =?UTF-8?q?Jonas=20Dre=C3=9Fler?= <verdre@v0yd.nl>
Date: Sun, 22 Jan 2023 19:29:23 +0100
Subject: [PATCH] screencastService: Add gstreamer pipelines for hardware
 encoding

Now that we have the pipeline fallback mechanism, we can add more
gstreamer pipelines, the generic preference goes like this:

1) Try h264 on hardware using VA-API, first using vapostproc to do
the color conversion using specialized hardware, then using the
color conversion shader. We're using the new va* instead of vaapi*
gst elements here, as those are maintained and should already be more
stable than the old ones.

2) Try h264 on hardware using nvenc for nvidia graphics cards, this
encoder should be quite stable, and the nvenc encoders are known to
work very well.

3) Try h264 on hardware using v4l2 for most ARM devices. This is using
the new v4l2sl (stateless) encoder, which is also actively maintained
and developed, and supporting all the modern devices.

4) Fall back to h264 software encoding using openh264. This is the least
problematic software encoder for h264, Fedora ships it in a
pre-installed repo and it can be enabled very easily. Most people should
have it enabled already to allow for decoding of h264 content. Unlike
vp8enc, this encoder is optimized for realtime and is really fast, it
outperforms the vp8 encoder by an order of magnitude and should allow
for smooth recordings even on older hardware.

5) Fall back to the two existing vp8 pipelines, these are the ones that
should work on all systems (including setups using software rendering
where no DMA buffers are available).

All the hardware encoder pipelines use capsfilters to enforce the use of
DMA buffers on the path from mutter to the color conversion, and from the
color conversion to the encoder. Using DMA buffers should ensure that
secondary GPUs are not used for the encoding when gnome-shell is running
on the primary GPU, potentially doing very slow copying of data. That's
only as long as mutter doesn't support explicit modifiers though, once
those are in, we need a different solution to make sure the internal GPU
is used.

The reason why mp4 was chosen as a container format over mkv is that mp4
can be played inside firefox and chromium, whereas mkv can't be played.
It's ensured that the mp4 file is still playable in case the recording
got cancelled by using the "first-moov-then-finalise" fragment-mode on
mp4mux.

This is a fairly conservative aproach, relying only on the h264 encoder.
Even though h264 is problematic from a patent perspective and often can't
be shipped by default, it still the best supported codec out there. The
software encoders and decoders are really fast, it's used everywhere on
the web, and it can be hardware decoded on almost any device out there.

Once AV1 is more popular and supported by more hardware, we should
probably move on to that, but for now h264 seems like the best tradeoff
in terms of stability, compatibility, and performance, even with the
patent issues around it. We're entering uncharted territories here
already, shipping hardware encoding on linux for a large range of
devices, so far this has only been done on tightly controlled embedded
platforms. We shouldn't make our lives even harder by shipping even more
rarely used encoders and formats.
---
 .../screencast/screencastService.js           | 47 +++++++++++++++++++
 1 file changed, 47 insertions(+)

diff --git a/js/dbusServices/screencast/screencastService.js b/js/dbusServices/screencast/screencastService.js
index d664a51b08..99646a3689 100644
--- a/js/dbusServices/screencast/screencastService.js
+++ b/js/dbusServices/screencast/screencastService.js
@@ -31,6 +31,53 @@ const DEFAULT_DRAW_CURSOR = true;
 const PIPELINE_BLOCKLIST_FILENAME = 'gnome-shell-screencast-pipeline-blocklist';
 
 const PIPELINES = [
+    {
+        id: 'hwenc-dmabuf-h264-vaapi',
+        fileExtension: 'mp4',
+        pipelineString:
+            'capsfilter caps=video/x-raw(memory:DMABuf),max-framerate=%F/1 ! \
+             vapostproc ! \
+             vah264enc ! \
+             queue ! \
+             h264parse ! \
+             mp4mux fragment-duration=500 fragment-mode=first-moov-then-finalise',
+    },
+    {
+        id: 'hwenc-dmabuf-h264-vaapi-glcolorconvert',
+        fileExtension: 'mp4',
+        pipelineString:
+            'capsfilter caps=video/x-raw(memory:DMABuf),max-framerate=%F/1 ! \
+             glupload ! glcolorconvert ! gldownload ! \
+             capsfilter caps=video/x-raw(memory:DMABuf) ! \
+             vah264enc ! \
+             queue ! \
+             h264parse ! \
+             mp4mux fragment-duration=500 fragment-mode=first-moov-then-finalise',
+    },
+    {
+        id: 'hwenc-dmabuf-h264-nvenc',
+        fileExtension: 'mp4',
+        pipelineString:
+            'capsfilter caps=video/x-raw(memory:DMABuf),max-framerate=%F/1 ! \
+             glupload ! glcolorconvert ! gldownload ! \
+             capsfilter caps=video/x-raw(memory:DMABuf) ! \
+             nvh264enc ! \
+             queue ! \
+             h264parse ! \
+             mp4mux fragment-duration=500 fragment-mode=first-moov-then-finalise',
+    },
+    {
+        id: 'hwenc-dmabuf-h264-v4l2',
+        fileExtension: 'mp4',
+        pipelineString:
+            'capsfilter caps=video/x-raw(memory:DMABuf),max-framerate=%F/1 ! \
+             glupload ! glcolorconvert ! gldownload ! \
+             capsfilter caps=video/x-raw(memory:DMABuf) ! \
+             v4l2slh264enc ! \
+             queue ! \
+             h264parse ! \
+             mp4mux fragment-duration=500 fragment-mode=first-moov-then-finalise',
+    },
     {
         id: 'swenc-dmabuf-h264-openh264',
         fileExtension: 'mp4',
-- 
GitLab

Places

File _service:download_url:2080.patch of Package gnome-shell (Revision bb59d2dd05f72b938ac749b21e77e50a)

Places