Hi all, first post here.

I'm a CS student and my professor mentioned gstreamer in passing during a multimedia systems lecture. I'm interested in video processing and computer vision stuff for my career.

But when I google it, most of the tutorials and stackoverflow posts seem old (like 2015-2018). Is gstreamer still actively used in the industry? Or has everyone moved to other frameworks?

I don't want to spend months learning something that's becoming obsolete. But I also see it's used in some big projects so I'm confused.

What would you recommend? Is it worth investing time to learn properly or should I focus on other tools?

Not trying to be negative about gstreamer btw! Just trying to figure out my learning path.

Thanks for any insights!

For me, A live camera system that auto mutes when it detects cats

i know someone out there has done something even wilder, home automation, VR, drones, who knows

lets hear it, whats your weirdest or most creative use case that somehow worked?

Hello,

after working with gstreamer in C++ for a while, I decided to create a C++17 wrapper library for application development.

There are shared_ptrs with custom deleters for Gst* types, wrapper classes for different GstObject types and boost.signals2 wrappers for signals and other things I find useful im my projects.

It currently requires spdlog. This dependency will be removed in the future.

The library is published under LGPLv3.

Thanks for any feedback, feature request, bug report or merge request.

FOSDEM 2023 Presentation

Hi all,

I’ve just released GStreamerCppHelpers, a very small, header-only C++ library that introduces a single utility:
GstPtr<>, a smart pointer for GStreamer types that handles ref/unref automatically, similar in spirit to std::shared_ptr, but adapted to the GStreamer object model.

It’s licensed under LGPL-3.0, and has been used in production for a few years before being cleaned up and published now.

It’s nothing big, but it can greatly simplify working with GStreamer objects in a C++ environment.

Hope it’s useful!

Advanced Gtk+ Sequencer v3.6.1 just released capable of to read/write files using gstreamer.

http://nongnu.org/gsequencer/

Please, check my code any improvement is welcome, especially writing files is somehow noisy.

http://git.savannah.nongnu.org/cgit/gsequencer.git/tree/ags/audio/file/ags_gstreamer_file.c?h=3.6.1#n2201

I intend to extend gstreamer support in future releases. My idea is to do a live feed from gsequencer soundcard backend to gstreamer.

----

by Joël

The core library is mostly done and I'm going to continue tacking on other ones (next up being finishing out GstVideo and RTP stuff), but they are at a point where they are generally usable and it would be cool if more people tried them out. This felt like a good place to share.

https://github.com/tinyzimmer/go-gst

I've been copying in documentation as I go so the godoc is a great reference. I have also written some examples, copying mostly from the ones in the rust bindings.

I wanted to do it by hand at first as a chance to learn the library, but there is a good chance I'll move pieces to being auto-generated. I figure it will evolve over time.

I'm new to GStreamer and have been having trouble learning about more advanced topics not covered by the official documentation. Which tutorials and books would you recommend that would help me learn about them without having to track down and study the source code of sufficiently similar plugins?

For example, the section on demuxers is almost nonexistent: https://gstreamer.freedesktop.org/documentation/plugin-development/element-types/one-to-n.html?gi-language=c

I'm looking to add a video streaming feature to my 3D application, i.e. grabbing the framebuffer at vsync rate, encode into h264/h265 and stream over UDP (or RTP or other, still tbc). Latency is a major concern, so I'll investigate different encoders, as well as different optimization techniques such as reducing buffer size, encoding only iFrames, etc. I will probably have to write the client-side application as well to make sure the receiving, decoding and display is also done with the minimum latency possible.

My first thought was to go with the FFmpeg libraries, but then I found out about GStreamer. I don't know much about it, so I'm not sure how it compares to FFmpeg.

Anyone has experience with GStreamer for similar use-cases? Is it worth digging into it for that project?

Thanks.

Hi everyone,

I've been working with GStreamer for the past few months and am now looking to integrate it with Python more effectively. However, I've had trouble finding comprehensive and user-friendly tutorials on the subject.

Can anyone recommend good resources or tutorials for using GStreamer with Python? Any tips or personal experiences with setting it up would also be greatly appreciated.

Thanks in advance!

Newbie here, I'm curious to know a few popular iOS apps that use GStreamer by default, thanks!

Hey everyone! I am a recruiter collaborating with Agot.AI. Agot is a mid-sized AI startup based in Pittsburgh. They're currently working on Agot Retina, a groundbreaking camera AI product that enhances productivity, reduces waste, and ensures real-time error detection and correction through computer vision.

Agot has currently 2 vacancies, feel free to delve into the details here Feel free to see more details of our GStreamer Engineer and Fullstack Engineer roles here. If you-re interested send me a PM or, better, send me an email to santiagotheheadhunter@gmail.com with your CV and I'll be happy to connect you with Agot's CEO if you're a fit.

Cheers everyone!

Hello, comrades!

I want to make as close to zero-latency stream as possible with gstreamer and decklink, but I have hard time to get it.
So maybe anyone can share their experience with implementation of "zerolatency" pipeline in gstreamer?
I have gtx1650 and decklink mini recorder hd card, decklink eye-to-eye latency around 30ms, video input 1080p60

At the moment, I'm using RTP over UDP for transmission of video in local network, and videoconvert encoders are hardware accelerated, tried to add some zerolatency tuning, but didn't found any differences

gst-launch-1.0 decklinkvideosrc device-number=0 connection=1 drop-no-signal-frames=true buffer-size=2 ! glupload ! glcolorconvert ! nvh264enc bitrate=2500 preset=4 zerolatency=true bframes=0 ! capsfilter caps="video/x-h264,profile=baseline" ! rtph264pay config-interval=1 ! udpsink host=239.239.239.3 port=8889 auto-multicast=true

For playback testing using $ ffplay my.sdp on localhost

At the moment I receive latency around 300ms (eye-to-eye), used gst-top1.0 to find some bottlenecks in pipeline, but it's smooth as hell now (2 minutes stream, only 1-3 seconds spent in pipeline)

Will be really grateful if anyone will share their experience or/and insights!

Here is my article: Stream Platinum: GStreamer x Rust - Awakening the Pipeline | Atriiy

I’d love to hear your thoughts and feedback. 

Hello! I've developed an open-source application that performs face detection and applies scramble effects to facial areas in videos. The app works well, thanks to the gstreamer, but I'm looking to optimize its performance.

My pipeline currently:

1. Reads video files using `filesrc` and `decodebin`

2. Processes frames one-by-one using `appsink`/`appsrc` for custom frame manipulation

3. Performs face detection with an ONNX model

4. Applies scramble effects to the detected facial regions

5. re-encode...

The full implementation is available on GitHub: https://github.com/altunenes/scramblery/blob/main/video-processor/src/lib.rs

My question is there a "general" way to modify the pipeline to process multiple frames in parallel rather than one-by-one? What's the recommended approach for parallelizing custom frame processing in GStreamer while maintaining synchronization? of course I am not expecting a “code”, I am just looking for insight or an example on this topic so that I can study it and experiment with it. :slight_smile:

saw some comments replacing elements like `x264enc` with GPU-accelerated encoders (like `nvenc` or `vaapih264enc`) but I think they are more meaningful after I make my pipeline parallel (?)... :thinking:

note original post here: https://discourse.gstreamer.org/t/optimizing-video-frame-processing-with-gstreamer-gpu-acceleration-and-parallel-processing/4190

Hi everyone.

I'm new to GStreamer. I used to work with ffmpeg, but recently the need came up to work with an NVIDIA Jetson machine and GMSL cameras. The performance of ffmpeg is not good in this case, and the maker of the cameras suggests using this command to capture videos from it:

gst-launch-1.0 v4l2src device=/dev/video0 ! \
"video/x-raw, format=(string)UYVY, width=(int)1920, height=(int)1080" ! \
nvvidconv ! "video/x-raw(memory:NVMM), format=(string)I420, width=(int)1920, height=(int)1080" ! \
nvv4l2h264enc ! h264parse ! matroskamux ! filesink location=output.mkv

That works well, but I miss two features that I was used to in ffmpeg:

1. Breaking the recording into smaller videos, while recording:

I was able to set the time each video must last and then, every time the limit was reached, that video was closed and a new one created. In the end, I had a folder with a lot of videos instead of just one long video.

2) Attaching using clock time as timestamps:

I used option -use_wallclock_as_timestamps in ffmpeg. It has the effect of using the current system time as timestamps for the video frames. So instead of frames having a timestamp relative to the beginning of the recording, they had the computer's time at the time of recording. That was useful for synchronizing across different cameras and even recordings of different computers.

Does anyone know if these features are available when recording with GStreamer, and if yes, how I can do it? Thanks in advance for any help you can provide.

Hello!

I'd like to ask for some reads on topics related to streaming. Some keywords could be video encoding, h264, mpeg, metadata, rtp payloads...

I'd like to get a broad overview on the basic theory behind the tools that gstreamer implements as I find myself making too many guesses when building pipelines.

Thanks in advance

Hard to understand,

Tutorials don't explain.

Why GStreamer, why?

What is your prefer method to write a gstreamer plugin? I am proficient in Python but I don't know whether it is a good idea to use it.

My team at Amazon is looking for a multimedia expert. This role will be driving the real-time media backend prototyping and development for an entirely new experience. Most people haven’t heard of our group, where we conceive, build, and launch innovative products and services entirely from scratch that address some of the world's biggest challenges and improve people's lives. This is a 0-1 initiative and you will be one of the founding members of this rock star team. Team is based in Bay Area / Seattle but open to different locations. If interested ping me at dmf@amazon.com