This might be my first editorial style post here. Fippo’s Is everyone switching to MoQ from WebRTC? started some threads on MoQ vs. WebRTC. I started to respond, but my responses quickly became too long so I decided to go even deeper with a post here. Fippo’s post shows hard data that Media over QUIC […]
The post WebRTC vs. MoQ by Use Case appeared first on webrtcHacks.
It is time for another edition of “Is everyone switching to…“. Cloudflare recently published a blog post about Media over Quic (MoQ) which made a number of statements about WebRTC that require some “clarification”. Let us start with that and look at MoQ and WebTransport after that. An odd understanding of WebRTC The blog post […]
The post Is everyone switching to MoQ from WebRTC? appeared first on webrtcHacks.
Earlier this month, OpenAI released the GA version of its realtime API. This includes many capabilities that the Beta didn’t have, including video support. I started out doing an update to the The Unofficial Guide to OpenAI’s Realtime WebRTC API I made for the Beta release last November. I discovered there were enough WebRTC updates […]
The post How OpenAI does WebRTC in the new gpt-realtime appeared first on webrtcHacks.
Audio jitter buffers are required 101 introductory material for understanding VoIP. libWebRTC’s audio jitter buffer implementation – the one in Chromium – is known as NetEQ. NetEQ is anything but basic. This is good from a user perspective since real-life networks conditions are often challenging. However, this means NetEQ’s esoteric code is complex and difficult […]
The post How WebRTC’s NetEQ Jitter Buffer Provides Smooth Audio appeared first on webrtcHacks.
OpenAI is utilizing WebRTC for its Realtime API! Even better, webrtcHacks friend and Pion founder Sean DuBois helped to develop it and agreed to a Q&A about the implementation. It is not often a massive WebRTC use case like this emerges so rapidly. In addition, Sean was extremely transparent about his work at OpenAI. In […]
The post OpenAI & WebRTC Q&A with Sean DuBois appeared first on webrtcHacks.
As Chad mentioned in his post last week, we have been diving into what OpenAI is doing with WebRTC. Over the last months, we actually did a full teardown and compared OpenAI’s Realtime API to what powers chatgpt.com. What intrigued us most was how to measure response latency. One of the key metrics for any […]
The post Measuring the response latency of OpenAIs WebRTC-based Realtime API appeared first on webrtcHacks.
EDITOR NOTE: OpenAI release the GA version of the Realtime API with WebRTC. This post covers the Beta version-only. The GA version is fully backward compatible and everything here is still accurate – just don’t mix approaches. I will have an gpt-realtime GA version update / version soon! OpenAI using WebRTC in its Realtime API […]
The post The Unofficial Guide to OpenAI’s (Beta) Realtime WebRTC API appeared first on webrtcHacks.
I have been updating a WebRTC in Open Source dataset derived from GitHub event data for 10 years now. I periodically update this to look for recent trends on WebRTC activity, popular repos, and new API usage. I hosted a live stream of my 2024 review back in December where Tsahi Levent-Levi joined to help […]
The post 2024 WebRTC in Open Source Review: A Quantitative Analysis appeared first on webrtcHacks.
Debugging WebRTC media issues, especially video, often requires access to the unencrypted RTP payloads. We talked about this back in 2017 already and had a great blog post on using the libWebRTC “video_replay” tool. While that post has aged remarkably well, video_replay has improved significantly, in particular since it is now possible to create the […]
The post Capture & Replay WebRTC video streams for debugging – video_replay 2025 update appeared first on webrtcHacks.
WebRTC’s peer connection includes a getStats method that provides a variety of low-level statistics. Basic apps don’t really need to worry about these stats but many more advanced WebRTC apps use getStats for passive monitoring and even to make active changes. Extracting meaning from the getStats data is not all that straightforward. Luckily return author […]
The post Power-up getStats for Client Monitoring appeared first on webrtcHacks.