Discussion
FFmpeg
gyan: Changelog:ffprobe -codec optionEXIF Metadata Parsinggfxcapture: Windows.Graphics.Capture based window/monitor capturehxvs demuxer for HXVS/HXVT IP camera formatMPEG-H 3D Audio decoding via mpeghdecD3D12 H.264 encoderdrawvg filter via libcairoffmpeg CLI tiled HEIF supportD3D12 AV1 encoderProRes Vulkan hwaccelDPX Vulkan hwaccelRockchip H.264/HEVC hardware encoderAdd vf_scale_d3d12 filterJPEG-XS parserJPEG-XS decoder and encoder through libsvtjpegxsJPEG-XS raw bitstream muxer and demuxerIAMF Projection mode Ambisonic Audio Elements muxing and demuxingAdd vf_mestimate_d3d12 filterxHE-AAC Mps212 decoding support (experimental)Remove the old HLS protocol handlerVulkan compute codec optimizationsswscale Vulkan supportLCEVC metadata bitstream filterAdd vf_deinterlace_d3d12 filterffprobe: only show refs field in stream section when reading framesProRes Vulkan encoderLCEVC parserLCEVC enhancement layer exporting in MPEG-TS
yboris: TIL: JPEG XS - an image and video codec that offers both visually and mathematically lossless quality for low latency implementations.Additionally, JPEG XS compressed content is indistinguishable from the original uncompressed content.https://en.wikipedia.org/wiki/JPEG_XS
iso1631: We use JXS when latency is critical. Most h24/265 decodes will have a 10 frame glass-glass delay, JXS drops that to 3 or 4, at a cost of bandwidth (our UHD jxs streams are 1.5gbit rather than 200mbit for hevc)
CharlesW: > Additionally, JPEG XS compressed content is indistinguishable from the original uncompressed content.It can be indistinguishable, as long as you stick with lossless or very low compression ratios. It falls apart at typical JPEG XL compression ratios.
pandaforce: Khronos published a post on the Vulkan compute codecs in FFmpeg: https://www.khronos.org/blog/video-encoding-and-decoding-wit...
bob1029: > gfxcapture: Windows.Graphics.Capture based window/monitor capture> This source provides low overhead capture of application windows or entire monitors. The filter outputs hardware frames in d3d11 format; use hwdownload,format= if system memory frames are required.This would strongly alter my plans if I were to develop an OSS Discord alternative. Chromium originally looked like a better core to start with largely due to its mature screen capture API. WebRTC is the other big thing, but there are other ways to do that. Native desktop apps (i.e., not browser based) are beginning to look much more compelling to me now.
pjc50: If you were doing this, consider cribbing from https://github.com/obsproject/obs-studio/tree/master/plugins... which offers a variety of solutions including some rather exciting looking process injection (called "game" there).I wonder if "entire chat app functions as OBS plugin" would work? Would solve the AV streaming side of the functionality.
voidUpdate: Isn't the point of JPEG to have lossy compression for your photos that still looks fine? As opposed to something like PNG, which has lossless compression
johntb86: "JPEG" is short for Joint Photographic Experts Group, an ISO/ITU group that creates a lot of imaging standards. The JPEG image format you're thinking of is only one of the formats they've created.
bydo: The Joint Photographic Experts Group manages many standards, generally each called "JPEG [something]". The one we most commonly call "JPEG" is just one of them.
ghgr: > Oh there's a new version of ffmpeg, I'll just quickly build it from source... no I can't wait I'll download the binaryhttps://www.youtube.com/watch?v=9kaIXkImCAM
shevy-java: Building ffmpeg itself from source is actually quite easy.The hardest part IMO is getting the necessary codecs to work; this can take a little while. If you know what audio and video codecs you want and need, and if you get them installed properly, then compiling ffmpeg is really simple and straightforward. It works almost always for me, and I have compiled ffmpeg from source for like +10 or even +15 years.For reference purposes, my current configure options are: ./configure --prefix=/usr/ --enable-gnutls --enable-gpl --enable-libmp3lame --enable-libaom --enable-libopus --enable-libspeex --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libxvid --enable-libx264 --enable-libx265 --enable-nonfree --enable-pthreads --enable-shared --enable-version3 --extra-libs=\"-ldl\" --disable-doc --disable-libopenjpeg --disable-libpulse --disable-static Probably more codecs could be added, and some options may not be necessary anymore (I changed this last ... years ago, too), but this works for the most part fairly well.One focus I have is mostly on a few .mp4 files, and for these I think you kind of want x264 x265 and so forth (I think one more codec from google too or so). But it is really quite trivial once you are past the codecs step. You can also start simple with just a few codecs, e. g. one good audio codec and one good video codec. One reason I like to have ffmpeg support many codecs is so I can use mpv, which in itself is really awesome; I like it more than vlc, which is also ok though.
junelee77: nice job
pjc50: Reading that it looks like the point of JPEG-XS is to have near-lossless compression for raw photo and video data while having extremely high throughput.
zamadatix: JPEG XS supports either near lossless or truly lossless encoding depending on encoder configuration.
edgarvaldes: One of the best open-source tools out there. I'm a frequent user of Plex, Jellyfin, Tunarr, local music files, etc. I use it weekly to extract subtitles, trim videos, convert music formats, and remove audio tracks. After writing the previous paragraph, I realized I've never donated to the project; it's time to change that.
altairprime: [delayed]