FFmpeg
FFmpeg running on Microsoft Windows | |
Original author(s) | Fabrice Bellard |
---|---|
Developer(s) | FFmpeg team |
Initial release | December 20, 2000[1] |
Stable release | 3.0 (February 15, 2016[2]) [±] |
Preview release | Git [±] |
Development status | Active |
Written in | C and Assembly[3] |
Operating system | Windows, OS X, and Linux; may be compiled for other OSes.[4] |
Platform | x86, ARM, PowerPC, MIPS, DEC Alpha, Blackfin, AVR32, SH-4, and SPARC; may be compiled for other desktop computers |
Type | Multimedia framework |
License |
LGPL 2.1+, GPL 2+ Unredistributable if compiled as such[5] |
Website |
ffmpeg |
FFmpeg is a free software project that produces libraries and programs for handling multimedia data. FFmpeg includes libavcodec, an audio/video codec library used by several other projects, libavformat, an audio/video container mux and demux library, and the ffmpeg command line program for transcoding multimedia files. FFmpeg is published under the GNU Lesser General Public License 2.1+ or GNU General Public License 2+ (depending on which options are enabled).[6]
FFmpeg is developed mostly on Linux, but can be compiled under most operating systems, including Mac OS X, Microsoft Windows, Android, iOS, as well as AmigaOS and MorphOS. Most computing platforms and microprocessor instruction set architectures are also supported, like x86 (IA-32 and x86-64), PPC (PowerPC), ARM, DEC Alpha, SPARC, and MIPS.[7]
The name of the project is inspired by the MPEG video standards group, together with "FF" for "fast forward".[8] The logo uses a zigzag pattern that shows how MPEG video codecs handle entropy encoding.[9]
History
The project was started by Fabrice Bellard[6] (using the pseudonym "Gérard Lantau") in 2000, and was led by Michael Niedermayer from 2004 until 2015.[10] Some FFmpeg developers were also part of the MPlayer project.
The project publishes a new release every three months on average. FFmpeg developers recommend that users compile the software from source using the latest build from their source code Git version control system.[11]
On January 10, 2014, two Google employees announced that over 1000 bugs had been fixed in FFmpeg during the previous two years by means of fuzz testing.[12] FFmpeg 2.5, released in December 2014, supports an MPEG-DASH muxer.[13]
Codec history
Two video coding formats with corresponding codecs and one container format have been created within the FFmpeg project so far. The two video codecs are the lossless FFV1, and the lossless and lossy Snow codec. Development of Snow has stalled, while its bit-stream format has not been finalized yet, making it experimental since 2011. The multimedia container format called NUT is no longer being actively developed, but still maintained.[14]
In summer 2010, Fiona Glaser, Ronald Bultje, and David Conrad of the FFmpeg Team announced the ffvp8 decoder. Through testing, they determined that ffvp8 was faster than Google's own libvpx decoder.[15][16] Starting with version 0.6, FFmpeg also supported WebM and VP8.[17]
In October 2013, a native VP9[18] and the OpenHEVC decoder, an open source High Efficiency Video Coding (HEVC) decoder, were added to FFmpeg.[19] In 2016 a native AAC encoder replaced the external VisualOn AAC encoder; FFmpeg 3.0 (nicknamed "Einstein" ) could be still built with the Fraunhofer FDK AAC.[20]
Components
Command line tools
- ffmpeg is a command-line tool that converts audio or video formats. It can also capture and encode in real-time from various hardware and software sources such as a TV capture card.
- ffserver is an HTTP and RTSP multimedia streaming server for live and recorded broadcasts. It can also be used to time shift live broadcasts.
- ffplay is a simple media player utilizing SDL and the FFmpeg libraries.
- ffprobe is a command-line tool to display media information (text, CSV, XML, JSON), see also Mediainfo.
Libraries
- libswresample is a library containing audio resampling routines.
- libavresample is a library containing audio resampling routines from the Libav project, similar to libswresample from ffmpeg.
- libavcodec is a library containing all of the native FFmpeg audio/video encoders and decoders. Most codecs were developed from scratch to ensure best performance and high code reusability.
- libavformat is a library containing demuxers and muxers for audio/video container formats.
- libavutil is a helper library containing routines common to different parts of FFmpeg. This library includes hash functions (Adler-32, CRC, MD5, RIPEMD, SHA-1. SHA-2, MurmurHash3, HMAC MD-5, HMAC SHA-1 and HMAC SHA-2), ciphers (DES, RC4, AES, AES-CTR, TEA, XTEA, Blowfish, CAST-128, Twofish and Camellia), LZO decompressor and Base64 encoder/decoder.
- libpostproc is a library containing older h263 based video postprocessing routines.
- libswscale is a library containing video image scaling and colorspace/pixelformat conversion routines.
- libavfilter is the substitute for vhook which allows the video/audio to be modified or examined between the decoder and the encoder. Filters have been ported from many projects including MPlayer and avisynth
Supported codecs and formats
Image formats
FFmpeg supports many common and some uncommon image formats.
The PGMYUV image format is a homebrewn variant of the binary (P5) PGM Netpbm format. FFmpeg also supports 16-bit depths of the PGM and PPM formats, and the binary (P7) PAM format with or without alpha channel, depth 8 bit or 16 bit for pix_fmts
monob, gray, gray16be, rgb24, rgb48be, ya8, rgba, rgb64be.
Codecs
In addition to FFV1 and Snow codecs, which were created and developed from within FFmpeg, the project also supports codecs from the following:
Group | Format type | Format name |
---|---|---|
ISO/IEC/ITU-T | Video | MPEG-1 Part 2, H.261 (Px64),[21] H.262/MPEG-2 Part 2, H.263,[21] MPEG-4 Part 2, H.264/MPEG-4 AVC, HEVC/H.265[19] (MPEG-H Part 2), Motion JPEG, IEC DV video and CD+G |
Audio | MP1, MP2, MP3, AAC, HE-AAC, MPEG-4 ALS, G.711 µ-law, G.711 A-law, G.721 (aka G.726 32k), G.722, G.722.2 (aka AMR-WB), G.723 (aka G.726 24k and 40k), G.723.1, G.726, G.729, G.729D and IEC DV audio | |
Subtitle | MPEG-4 Timed Text (aka 3GPP Timed Text) | |
Image | JPEG, JPEG-LS, JPEG 2000, PNG, CCITT G3 and CCITT G4 | |
EBU | Subtitle | Spruce subtitle (EBU STL) |
EIA | Subtitle | EIA-608 |
CEA | Subtitle | CEA-708 |
SMPTE | Video | SMPTE 314M (aka DVCAM and DVCPRO), SMPTE 370M (aka DVCPRO HD), VC-1 (aka WMV3), VC-2 (aka Dirac Pro), VC-3 (aka AVID DNxHD), VC-5 (aka Cineform) |
Audio | SMPTE 302M | |
Image | DPX | |
ATSC/ETSI/DVB | Audio | Full Rate (GSM 06.10), AC-3 (Dolby Digital) and Enhanced AC-3 (Dolby Digital Plus) |
Subtitle | DVB Subtitling (ETSI 300 743) | |
DVD Forum/Dolby | Audio | MLP / Dolby TrueHD |
Subtitle | DVD-Video subtitles | |
DTS, Inc | Audio | DTS Coherent Acoustics (aka DTS or DCA), DTS Extended Surround (aka DTS-ES), DTS 96/24, DTS-HD High Resolution Audio, DTS-HD Master Audio |
Blu-ray Disc Association | Subtitle | PGS (Presentation Graphics Stream) |
3GPP | Audio | AMR-NB, AMR-WB (aka G.722.2) |
3GPP2 | Audio | QCELP-8 (aka SmartRate or IS-96C), QCELP-13 (aka PureVoice or IS-733) and Enhanced Variable Rate Codec (EVRC. aka IS-127) |
World Wide Web Consortium | Video | Animated GIF |
Subtitle | WebVTT | |
Image | GIF | |
IETF | Audio | iLBC (via libilbc), Opus and Comfort noise |
International Voice Association | Audio | DSS-SP |
SAC | Video | AVS video |
Microsoft | Video | Microsoft RLE, Microsoft Video 1, Cinepak, Indeo (v2, v3 and v5),[21] Microsoft MPEG-4 v1, v2 and v3, Windows Media Video (WMV1, WMV2, WMV3/VC-1) and WMV Screen |
Audio | Windows Media Audio (WMA1, WMA2, WMA Pro and WMA Lossless), XMA (XMA1 and XMA2), MS-GSM and MS-ADPCM | |
Subtitle | SAMI | |
Image | Windows Bitmap, WMV Image (WMV9 Image and WMV9 Image v2) and DirectDraw Surface | |
Interactive Multimedia Association | Audio | IMA ADPCM |
Digital Video Interactive | Video | RTV 2.1 (Intel Indeo 2) |
Audio | DVI4 audio codec | |
RealNetworks | Video | RealVideo 1, 2, 3 and 4 |
Audio | RealAudio v1 – v10 | |
Subtitle | RealText | |
Apple | Video | Cinepak (Apple Compact Video), ProRes, Sorenson 3 Codec, QuickTime Animation (Apple Animation), QuickTime Graphics (Apple Graphics), Apple Video |
Audio | QDesign Music Codec 2 and ALAC | |
Adobe Flash Player (SWF) | Video | Screen video, Screen video 2, Sorenson Spark and VP6 |
Audio | Adobe SWF ADPCM and Nellymoser Asao | |
Aldus / Adobe | Image | TIFF |
Xiph.Org | Video | Theora |
Audio | Speex (via libspeex), Vorbis, Opus and FLAC | |
Subtitle | Ogg Writ | |
Sony | Audio | Adaptive Transform Acoustic Coding (ATRAC1, ATRAC3 and ATRAC3Plus)[21][22] and PSX ADPCM |
NTT | Audio | TwinVQ |
On2 / GIPS / Google | Video | Duck TrueMotion 1, Duck TrueMotion 2, Duck TrueMotion 2.0 Real Time, VP3, VP5,[21] VP6,[21] VP7, VP8, VP9[18] and animated WebP |
Audio | DK ADPCM Audio 3/4, On2 AVC and iLBC (via libilbc) | |
Image | WebP | |
RAD Game Tools | Video | Smacker video and Bink video |
DSP Group | Audio | Truespeech |
RenderWare | Video | TXD[23] |
Netpbm | Image | PBM, PGM and PPM |
MIT/X Consortium | Image | XBM and xwd |
Silicon Graphics | Video | Silicon Graphics RLE 8-bit video, Silicon Graphics MVC1/2 |
Image | Silicon Graphics Image | |
Sun Microsystems | Image | Sun Raster |
IBM | Video | IBM UltiMotion |
Avid Technology / Truevision | Video | Avid 1:1x, Avid Meridien, Avid DNxHD and DNxHR |
Image | Targa | |
Autodesk / Alias | Video | Autodesk Animator Studio Codec and FLIC |
Image | Alias PIX | |
Grass Valley / Canopus | Video | HQ, HQA, HQX and Lossless |
Industrial Light & Magic / Lucasfilm | Image | OpenEXR |
Mozilla Corporation | Video | APNG |
The default MPEG-4 codec used by FFmpeg for encoding has the FourCC of FMP4.
Container formats
- ASF
- AVI and also input from AviSynth
- BFI[24]
- CAF
- FLV
- GXF, General eXchange Format, SMPTE 360M
- IFF[25]
- ISO base media file format (including QuickTime, 3GP and MP4)
- Matroska (including WebM)
- Maxis XA[26]
- MPEG program stream
- MPEG transport stream (including AVCHD)
- MXF, Material eXchange Format, SMPTE 377M
- MSN Webcam stream[27]
- NUT[14]
- Ogg
- OMA[28]
- RL2[29]
- TXD[23]
- WTV
Pixel formats
FFmpeg supports many pixel formats.[30] Some of these formats are only supported as input formats, the command ffmpeg -pix_fmts
lists brief explanations. Example, as of 2015 the grayscale with alpha format ya16be
(corresponding to NetPBM PAM GRAYSCALE_ALPHA
in 32 bits) was not yet supported as output format.
Type | Color | Packed | Planar | Palette | |||
---|---|---|---|---|---|---|---|
Without alpha | With alpha | Without alpha | With alpha | Chroma-interleaved | With alpha | ||
Monochrome | Binary (1-bit monochrome) | monoblack, monowhite | - | - | - | - | - |
Grayscale | 8 / 16bpp | 16 / 32bpp | - | - | - | - | |
RGB | RGB 1:2:1 (4-bit color) | 4bpp | - | - | - | - | - |
RGB 3:3:2 (8-bit color) | 8bpp | - | - | - | - | - | |
RGB 5:5:5 (High color) | 16bpp | - | - | - | - | - | |
RGB 5:6:5 (High color) | 16bpp | - | - | - | - | - | |
RGB/BGR | 24 / 48bpp | 32[p 1] / 64bpp | - | - | - | 8bit->32bpp | |
GBR[p 2] | - | - | 8 / 9 / 10 / 12 / 14 / 16bpc | 8 / 12 / 16bpc | - | - | |
YUV | YVU 4:1:0 | - | - | (9bpp (YVU9))[p 3] | - | - | - |
YUV 4:1:0 | - | - | 9bpp | - | - | - | |
YUV 4:1:1 | 8bpc (UYYVYY) | - | 8bpc | - | (8bpc (NV11)) | - | |
YVU 4:2:0 | - | - | (8bpc (YV12))[p 3] | - | 8 (NV21) | - | |
YUV 4:2:0 | - | - | 8 (I420 aka YUV420P) / 9 / 10 / 12 / 14 / 16bpc | 8 / 9 / 10 / 16bpc | 8 (NV12) / 10bpc (P010)[p 4] | - | |
YVU 4:2:2 | - | - | (8bpc (YV16))[p 3] | - | (8bpc (NV61)) | - | |
YUV 4:2:2 | 8bpc (YUYV[p 5] and UYVY)[p 6] | - | 8 (I422 aka YUV422P) / 9 / 10 / 16bpc | 8 / 9 / 10 / 16bpc | 8 (NV16) / 10bpc (NV20 aka P210)[p 7] | - | |
YUV 4:4:0 | - | - | 8 / 10 / 12bpc | - | - | - | |
YVU 4:4:4 | - | - | (8bpc (YV24))[p 3] | - | (8bpc (NV42)) | - | |
YUV 4:4:4 | (10 (Y410) and 16bpc (Y416)) | 16bpc[p 8] | 8 (I444 aka YUV444P) / 9 / 10 / 16bpc | 8 / 9 / 10 / 16bpc | (8bpc (NV24)) | - | |
XYZ | XYZ 4:4:4[p 9] | 12bpc | - | - | - | - | - |
Bayer | BGGR/RGGB/GBRG/GRBG | 8 / 16bpc | - | - | - | - | - |
- ↑ RGBx (rgb0) and xBGR (0bgr) are also supported
- ↑ used in YUV-centric codecs such like H.264
- 1 2 3 4 YVU9, YV12, YV16, and YV24 are supported as rawvideo codec in FFmpeg.
- ↑ 16bpc (P016) is not supported
- ↑ aka YUY2 in Windows
- ↑ 10bpc (Y210) and 16bpc (Y216) are not supported
- ↑ 16bpc (P216) is not supported
- ↑ 8bpc (AYUV) is not supported
- ↑ used in JPEG2000
Note that FFmpeg still does not support IMC1-IMC4, AI44, CYMK, RGB Float, RGBE, Log RGB and such like. It also does not yet support ARGB 1:5:5:5, 2:10:10:10, or other "odd" BMP bitfield formats.
Supported protocols
- Open standards
- IETF FTP, TCP, UDP, UDP-Lite, Gopher, HTTP, RTP, RTSP, SDP
- SFTP (via libssh)
- HLS[31]
- Samba aka Server Message Block (via libsmbclient)
- MMS over TCP and MMS over HTTP
- Icecast protocol
- Proprietary
- Adobe RTMP, RTMPT, RTMPE, RTMPTE and RTMPS
- Can be compiled with the native support or using rtmpdumps librtmp library.
- RealMedia RTSP/RDT
Supported filters
Audio
|
|
Legal aspects
FFmpeg contains more than 100 codecs,[33] most of which use compression techniques of one kind or another. Many such compression techniques may be subject to legal claims relating to software patents.[34] Such claims may be enforceable in countries like the United States which have implemented software patents, but are considered unenforceable or void in countries that have not implemented software patents like in countries that are members of the European Union.
FFmtech Foundation
In June 2011 an election was organized to establish the board of FFmtech foundation,[35] a non-profit organization dedicated for managing donation funds. It was designed to offer reimbursement for expenses and work done to FFmpeg and Libav. However, according to FFmpeg developer Ronald Bultje the results have been doubtful.[36]
Projects using FFmpeg
FFmpeg is used by software such as VLC media player, xine, HandBrake, Plex, Blender, YouTube,[37] and MPC-HC;[38] it handles video and audio playback in Google Chrome,[38] and Linux version of Firefox.[39] Graphical user interface front-ends for FFmpeg have been developed, including Avanti,[40] and XMedia Recode. JavaCV, a Java wrapper for OpenCV, includes a supplementary Java wrapper for FFmpeg.[41]
FFmpeg is used by ffdshow, LAV Filters, GStreamer FFmpeg plug-in, Perian and OpenMAX IL to expand the encoding and decoding capabilities of their respective multimedia platform.
Forks
FFmbc
FFmpeg developer Baptiste Coudurier forked off FFmbc[42] from FFmpeg, as a tool customized for broadcast and professional usage. It is currently based on a 0.x branch of the FFmpeg master and therefore lacks features from newer releases.[43]
Libav
On March 13, 2011, a group of FFmpeg developers decided to fork the project under the name "Libav".[44][45][46] The event was related to a recent issue in project management, in which developers disagreed with the leadership of FFmpeg.[47][48][49]
See also
- MEncoder, a similar project
- Open source codecs and containers
References
- ↑ "Initial revision - git.videolan.org/ffmpeg.git/commit". git.videolan.org. 2000-12-20. Retrieved 2013-05-11.
- ↑ "Download FFmpeg". 2016-02-15. Retrieved 2016-02-16.
- ↑ "Developer Documentation". ffmpeg.org. 2011-12-08. Retrieved 2012-01-04.
- ↑ "Download". ffmpeg.org. FFmpeg. Retrieved 2012-01-04.
- ↑ FFmpeg can be configured to make it proprietary and unredistributable software because libfaac and libaacplus, two optional external libraries, are proprietary software and cannot be distributed under the terms of the GPL.
- 1 2 "FFmpeg License and Legal Considerations". ffmpeg.org. Retrieved 2012-01-04.
- ↑ "FFmpeg Automated Testing Environment". Fate.multimedia.cx. Retrieved 2012-01-04.
- ↑ Bellard, Fabrice (18 February 2006). "FFmpeg naming and logo". FFmpeg developer mailing list. FFmpeg website. Retrieved 24 December 2011.
- ↑ Steve Carlsen (1992-06-03). "TIFF 6.0 specification" (PS). Aldus. p. 98. Archived (PDF) from the original on 2004. Retrieved 2014.
Zig-Zag Scan
- ↑ Niedermayer, Michael. "[FFmpeg-devel] FFmpegs future and resigning as leader". Retrieved 2015-09-22.
- ↑ "ffmpeg.org/download.html#releases". ffmpeg.org. Retrieved 2015-04-27.
- ↑ FFmpeg and a thousand fixes; January 10, 2014; Google.
- ↑ Michael Niedermayer, Timothy Gu (2014-12-05). "RELEASE NOTES for FFmpeg 2.5 "Bohr"". VideoLAN. Retrieved 2014-12-05.
- 1 2 "NUT". Multimedia Wiki. 2012. Retrieved 2014-01-03.
- ↑ Fiona Glaser (2010-07-23), Diary Of An x264 Developer: Announcing the world’s fastest VP8 decoder, retrieved 2012-01-04
- ↑ FFmpeg Announces High-Performance VP8 Decoder, Slashdot, 2010-07-24, retrieved 2012-01-04
- ↑ "FFmpeg Goes WebM, Enabling VP8 for Boxee & Co". newteevee.com. 2010-06-17. Retrieved 2012-01-04.
...with VLC, Boxee, MythTV, Handbrake and MPlayer being some of the more popular projects utilizing FFmpeg...
- 1 2 "Native VP9 decoder is now in the Git master branch". Launchpad. 2013-10-03. Retrieved 2013-10-21.
- 1 2 "FFmpeg Now Features Native HEVC/H.265 Decoder Support". Softpedia. 2013-10-16. Retrieved 2013-10-16.
- ↑ FFmpeg (2016-02-15). "February 15th, 2016, FFmpeg 3.0 "Einstein"". Retrieved 2016-04-02.
- 1 2 3 4 5 6 "Changelog". FFmpeg trunk SVN. FFmpeg. 17 April 2007. Retrieved 26 April 2007.
- ↑ "ATRAC3plus decoder - git.videolan.org Git - ffmpeg.git/commit". git.videolan.org. 2013-12-28. Retrieved 2013-12-28.
- 1 2 "FFmpeg development mailing list". FFmpeg development. FFmpeg. 7 May 2007. Retrieved 24 December 2010.
- ↑ vitor (13 April 2008). "FFmpeg development mailing list". FFmpeg development. FFmpeg website. Retrieved 14 April 2008.
- ↑ vitor (30 March 2008). "FFmpeg development mailing list". FFmpeg development. FFmpeg website. Retrieved 30 March 2008.
- ↑ benoit (14 April 2008). "FFmpeg development mailing list". FFmpeg development. FFmpeg website. Retrieved 14 April 2008.
- ↑ ramiro (18 March 2008). "FFmpeg development mailing list". FFmpeg development. FFmpeg website. Retrieved 18 March 2008.
- ↑ banan (8 June 2008). "FFmpeg development mailing list". FFmpeg development. FFmpeg website. Retrieved 8 June 2008.
- ↑ faust3 (21 March 2008). "FFmpeg development mailing list". FFmpeg development. FFmpeg website. Retrieved 21 March 2008.
- ↑ "FFmpeg: libavutil/pixfmt.h File Reference - enum AVPixelFormat". FFmpeg Project. 2015-11-17. Retrieved 2015-11-18.
- ↑ van Kesteren, Anne (2010-09-01). "Internet Drafts are not Open Standards". annevankesteren.nl. Self-published. Retrieved 2015-03-22.
- ↑ How it works earwax.ca
- ↑ "Codecs list". ffmpeg.org. Retrieved 2012-01-01.
- ↑ "Legal information on FFmpeg's website". ffmpeg.org. Retrieved 2012-01-04.
- ↑ "[Ffmtech-board-election] FFmtech board elections". June 8, 2011. Retrieved 14 August 2015.
- ↑ "[Ffmpeg-devel-irc] ffmpeg-devel.log.20150814". August 14, 2015. Retrieved 15 August 2014.
- ↑ "Google’s YouTube Uses FFmpeg | Breaking Eggs And Making Omelettes". Multimedia.cx. 2011-02-08. Retrieved 2012-08-06.
- 1 2 "FFmpeg-based Projects". Ffmpeg.org. Retrieved 2012-01-04.
- ↑ "Firefox Enables FFmpeg Support By Default". Phoronix. 2015-11-15. Retrieved 2015-11-18.
- ↑ "Avanti: FFmpeg/Avisynth GUI". Retrieved 2011-08-17.
- ↑ "JavaCV". GitHub. 2015.
- ↑ "FFmbc".
- ↑ "Video Production Stack Exchange: What is the difference between ffmpeg and ffmbc now?".
- ↑ Libav project site, retrieved 2012-01-04
- ↑ Ronald S. Bultje (2011-03-14), Project renamed to Libav, retrieved 2012-01-04
- ↑ A group of FFmpeg developers just forked as Libav, Phoronix, 2011-03-14, retrieved 2012-01-04
- ↑ What happened to FFmpeg, 2011-03-30, retrieved 2012-05-19
- ↑ FFMpeg turmoil, 2011-01-19, retrieved 2012-01-04
- ↑ "The FFmpeg/Libav situation". blog.pkh.me. Retrieved 2015-09-22.
External links
|