Slashdot videos: Now with more Slashdot!

View

Discuss

Share

We've improved Slashdot's video section; now you can view our video interviews, product close-ups and site visits with all the usual Slashdot options to comment, share, etc. No more walled garden! It's a work in progress -- we hope you'll check it out (Learn more about the recent updates).

JimLynch writes "Did you know that nearly every video produced for Web viewing has been, at one point or another, in MPEG format no matter in what format the video is ultimately saved? According to Chris 'Monty' Montgomery, nearly every consumer device outputs video in MPEG format. Which means that every software video decoder has to have MPEG-licensed technology in order to process/edit video."
An interesting snippet: "But there's hope on the horizon. Besides the codecs and formats from the Xiph.Org Foundation, the new WebM format announced by Google in May will ideally provide consumers and developers with another alternative. Montgomery has thrown Xiph.Org support behind WebM, because Google's financial muscle (not to mention their free license) will have a real chance to break the hold MPEG-LA has on the market."

"Nearly every consumer device outputs video in MPEG format" - not really, since there's a LOT of devices outputting in MJPEG. At least "still" - since this way of saving video seems to be, for some time now, on its way out in newer ones.

Not saying that the situation isn't suboptimal anyway, of course. And TBH I'm not sure if WebM can change much - Microsoft (yes, them out of all companies...) VC-1 codec was probably also meant to bypass MPEG-LA; didn't really work well.

Of course it has worse compression...but "a really huge bitrate for lousy quality" goes too far. DV is, in its essence, very similar to MJPEG (the latter probably slightly better usually) - is DV really "lousy quality"? And with a "really huge bitrate" MJPEG might be really fine for most stuff.

That's beside the point of curse how it is on its way out; perhaps except in Nikon cameras, so far.

Of course it has worse compression...but "a really huge bitrate for lousy quality" goes too far. DV is, in its essence, very similar to MJPEG (the latter probably slightly better usually) - is DV really "lousy quality"? And with a "really huge bitrate" MJPEG might be really fine for most stuff.

That's beside the point of curse how it is on its way out; perhaps except in Nikon cameras, so far.

Don't get me wrong - there's a time and a place for MJPEG. But, DV is on of the trivially easy examples for showing how much better modern technologies perform, considering that HDV works in exactly the same bitrate and tape format, and squashes a *lot* more pixels into the image. HDV isn't even particularly modern technology -- just more modern than DV. When you eliminate tape's need for a constant bitrate and move to a modern file based workflow, many of the AVCHD devices pathologically conpress full 1080p HD into a much lower bitrate than DV while looking just fine for most uses. Seriously, if the AVCHD devices used a bitrate as high as DV, the quality of the output would start to compete with the more expensive professional gear.

Though, the real future is in something like RedcodeRaw. A codec that focuses on being very good at storing sample data from the sensor is one thing that apparently hasn't been much explored in open standards, but it would offer the best performance. When somebody comes out with a DSLR that shoots video in a high bitrate, well-documented sensor-oriented format, they'll own a lot of production overnight.

DV is basically a slightly altered MJPEG, and it's a pretty popular acquisition format. It's not the best quality, but I'd hardly call it lousy.

25 megabit for standard definition video is insanely high (most DVDs are 4-6 megabit), which is why it has good quality (and why it is almost never a "final" format, though it is great for editing, simply because it doesn't have inter-frame compression).

Motion JPEG is a good format when storing/transmitting the raw video data is beyond the hardware's capabilities (=often), but you want to do as little as possible post-processing. For example when shooting 30 second clips with a digital camera. Writing that to a memory card might be more power-efficient than including the electronics for an advanced video codec. Also that 'semi-raw' data is better material for post-processing (on PC for example) than video that's stronger compressed at the beginning.

For maximum compression, it is ineffective. For a device getting the images stored as you shoot and not paying MPEG-LA through the nose it's plenty effective. If you intend to use something other than MPEG as the final compression of the video MJPEG may be a superior intermediate format. For editing, MJPEG is certainly superior to MPEG.

MJPEG is insanely ineffective. It's no different from just a series of JPEG stills, without taking any advantage of frames being similar to each other.

Which makes it an ideal format for video editing. Yes, they give huge files, but then, today disk space is cheap, and it's not the form you distribute anyway. There's no problem if your currently edited film needs 100 GB. On the other hand, the less compression losses/artifacts you get in the intermediate steps, the better.

More bullshit linkbait blog articles from JimLynch. He's been banned from posting in the message bases on a couple other websites (ArsTechnica, Endgadget) due to repeatedly posting links to his poorly written, copy-and-paste blog articles to drive ad impressions. So how long will it take Slashdot to stop taking submissions from this leech?

Or I suppose if I buy a $9.95 "BE AN INTERWEBS MARKETING WIZARD" book at Borders, I can submit whatever crap I want on slashdot too?

Many people in the Free Software press seem to be putting a lot of faith behind WebM. There seems to be this belief that Google can come in and magically make the entire video codec situation go away. WebM might be able to find a home in a few niche markets, but the hopes that it will displace H.264? It's laughable.

I love Free Software, and generally strive to run as near to 100% Free as I can on my own systems. Yet even I can recognize that the video codec war is not one that will be winnable by fiat and propaganda. The critical-mass of users are those that are buying cameras that output H.264 today, and possibly various managers, that are going to be arguing "nobody got fired for using MPEG".

The video codec war is not winnable right now, but the container and codec implementation wars might be. Striving to replace Flash with x264/ffmpeg implementations in the browser is a huge win, and one that can be realistically accomplished. Sure, it'd be great if people used a free codec like Theora/WebM (make it a prominent option! advertise it!), but not supporting H.264 at all will have one effect, and it's not the one we Free Software advocates will like: people will see the player as broken, and move to alternatives that are "not broken". Your parents, boss, and other non-technical people don't care about the alphabet soup of codecs; they just care about "software that works".

So dodge the problem and make codecs an external, OS-level issue like they always have been, and win the battles that actually can be won.

Oh, and if you really want to make a political stand, here's an idea: instead of fighting stupid technical issues about what falls under the various MPEG patents with things that may or may not be infringing (WebM), fight the patent system itself. This whole stupid issue only exists because we stupidly allow software patents. That fight is way more important, and applies to a wide variety of topics, not just video.

Oh, and if you really want to make a political stand, here's an idea: instead of fighting stupid technical issues about what falls under the various MPEG patents with things that may or may not be infringing (WebM), fight the patent system itself. This whole stupid issue only exists because we stupidly allow software patents. That fight is way more important, and applies to a wide variety of topics, not just video.

Speaking of hopeless fights that are not winnable, how about that patent reform?

Flamebait? Moderators should learn the difference between "Flamebait" and "I do not agree!"

I'm actually undecided in this case. An important fact is that there are possibilities for Firefox to support H.264 without getting the license, by just delegating it to the OS (Windows will most probably have the codec installed; Linux users are usually aware of the problem and can decide themselves whether to install the codec). What they can't do is to support it directly in the browser. But I don't think users wou

The magic time we had when we could possibly have gotten patent reform is past. 10 years ago, this would have been something being done for a non-profit community. Today it would be a grant to Billion-dollar Red Hat and multi-Millionare Mark Shuttleworth, at the expense of inventors. It's going to be really hard to get that to fly politically.

The problem is that Open Source distributions can't license the patents and remain Open Source. So, this is going to be a real killer for Open Source if we let it happen.

The fact is, anyone can install a plugin to play any format they like, and most browser users will, so this is not a matter of whether Open Source browsers support it or not. But browser developers and Open Source projects should continue to lobby for Open codecs, simply to protect themselves from being written out of the market by IP restrictions.

Removing patents would only benefit RedHat? What about smart investors that want to compete in the future against cheap knockoffs from China, that totally ignore patents? This myth that patents are necessary (or even relevant) reeks of a limited, USA-centric point of view.

The problem is that Open Source distributions can't license the patents and remain Open Source.

Of course. Which is why the problem should be side-stepped, by leaving things to the OS. We successfully distribute MP3 support from internation

What browser came with flash? I'm just curious, because as far back as I can remember, it was a plugin that had to be downloaded... and certainly seems to be on any vanilla install of a modern browser...

I'm pretty sure either the IE 5 or 6 (or both) installers included Flash Player as one of the installable options which was visible under custom setup and enabled as part of the default IE install. Flash Player also does ship with non-OEM versions of Windows, I think XP ships with the Flash Player 8 ActiveX (check the "%WinDir%\Downloaded Program Files" directory). There are even Microsoft updates packages [microsoft.com] which update the Flash Player and are available on Windows Update. You might have seen the ActiveX not

Every software field is full of patents. Either you do you what you can and hope for the best, or else you quit writing software. Most people choose the former. This is not specific to video. There may be a few more patents there, but nothing that makes the field fundamentall different from others. Sure trying to get rid of patents entirely is nice, but if that the only strategy, we'd all be using 100% proprietary software today.

You are looking at it too short-term. If the "fight" was being called today and everyone's flash plugin was to magically disappear, you may be right (what about IE users?); but this is a more long-term affair.

In fact, I don't see a one-sided game at all, if Google play their cards right. And, Google does hold some major cards - YouTube, Android, OHA partners, Firefox (Opera and Chrome are not major), and WebM. MS will allow WebM with an optional codec install for IE which can be handled on youtube.com - "user, to play youtube videos we recommend you install this codec", or "to get most out of youtube... blah blah blah" - I don't know I'm not a marketing expert.

On the other side you'll have Safari (on iOS and OS X) and IE (partially, see above) who will support H.264. This is not exactly a clear-cut battle.

You'll also have recording devices like video cameras, cell phone cameras, etc., but as long as there's the Web in between those and significant part of the consumption of content most of the battle will be fought online, and relatively smaller portion offline.

But first, before any major moves, Google has to make WebM workable - i.e. fully optimized encoders, decoders, quality, etc.; then start making major moves towards its adoption. It seems to me like they are trying to make sure Flash (for video) hangs around long enough for them to accomplish this step. That's why, on the flip side, Apple would want to take out Flash as soon as possible.

Sure, but Chrome and Opera are not major players - I specifically said so in my previous post.

Ignore mobile support at your own peril.

I didn't say "ignore" - I said as long as there's the Web between production and consumption, bigger part of the battle will be fought there, not offline.

This is not even remotely relevant. It's important to us geeks...

It's relevant to the point where Google can't start marketing and "arm-twisting" if the technology is not ready for production; i.e. it is comparable (features, performance, etc.) with the closest competing products on the market.

The problem is that we need a lot of money to fight software patents. We'd need to out-lobby the BSA and all of its members or somehow get key players like Microsoft or IBM to decide to destroy half their patent portfolios.

Maybe we could do it by building a massive patent troll and suing the entire industry at once but I'd still expect that to require a couple dozen million Dollars at least.

Montgomery has thrown Xiph.Org support behind WebM, because Google's financial muscle (not to mention their free license) will have a real chance to break the hold MPEG-LA has on the market.

H.264 licensees include the manufacturers of damn near every piece of video hardware sold on this planet.

The full spectrum of product from theatrical production, cable, satellite and broadcast distribution. Security and Industrial video. Military applications. Home video. The video card. The video game console.

H.264 licensees include the manufacturers of damn near every piece of video hardware sold on this planet.

Just don't expect that whatever license they have covers the user... Giving people the ability to use their videos commercially without paying off the MPEG-LA yet another time just might be a competitive advantage.

The first term of the License runs through 2010, but the License will be renewable for successive five-year periods for the life of any Portfolio patent on reasonable terms and conditions...but for the protection of licensees, royalty rates applicable to specific license grants or specific licensed products will not increase by more than ten percent (10%) at each renewal.SUMMARY OF AVC/H.264 LICENSE TERMS [mpegla.com]

And all for the low, low price of messing with lawyers and an uncertain feature. Good you cleared up the myth that MPEG-LA was created to collect royalties, it's quite clear thet it only exists to make licensees feel good about the codecs they apparently never pay anything for. In fact camera manufacturers hide small print in the manuals about your lack of license for your own good...

If the chilling effect of the MGEG-LA patents can be broken, a) I'll be VERY surprised and b) some lawyers didn't do their job right. The only thing that would break them is a judge in a court saying that WebM (or something else) doesn't infringe, and that judgment being upheld through appeal after appeal. By the time a fight of that magnitude was fought to a finish and open source programs were judged "free and clear", the patents would probably be approaching expiration date anyhow. There is a GARGANTUAN financial incentive for these MPEG-LA folks to ensure that no possible video encoding scheme can be regarded as "in the clear". Even a lawsuit without merit is a chilling threat to a small project, and while Google is not small how many resources are they willing to commit to a fight to the finish?

Remember the debate on video in browsers? A lot of the commercial players wouldn't consider any codec that claimed to be patent-free. Was that because they didn't want the risk of an unknown patent appearing and causing trouble? Maybe, but why wouldn't that risk apply for the MPEG-LA codecs as well? They don't claim to cover EVERY relevant patent, just the ones in their portfolio. Do they think the patent-free claims are wrong? Much more likely, but if that's the case why not burst the bubble by identifying the specific infringements (and then insisting people pay up)? Did they want to ensure that they controlled the keys to online video in order to make money with the patent licenses? The cynical side of me tends to think this is the case, in which case no patent-free solution (however legitimate or undoubted) would have stood a chance.

There are of course technical arguments (h264 is very very good) but why not allow something basic as a "baseline" that everyone could have and target? Basic (ancient) MPEG should either be free or close to it, so why not give it the go-ahead as a baseline with h264 as the better option for browsers that support it? If a website doesn't want the bandwidth hit of supporting patent-free formats, fine - but at least the option to target ALL browsers would be there with basic MPEG if the site wanted to incur the costs.

The MERIT of the video format is almost irrelevant if we're talking about a fully free baseline standard. I view performance comparisons as pretty much moot, as long as we're not talking about something absurdly bad - modern bandwidth and computers can do a lot of decent video using only basic MPEG. Who cares if it is twice or three times the size of h264 for the same quality if EVERYONE can view it? Any free standard would break the hold, which is why I don't expect to ever see one accepted universally.

Any free standard would break the hold, which is why I don't expect to ever see one accepted universally.

Exactly, this already happened with JPEG.There were two entropy coding schemes defined in the standard : (patent free) static Huffman and (patent based) Arithmetic Compression. In order to implement Arithmetic Compression, you simply had to ***ask IBM for permission***. Nobody ever implemented arithmetic compression in JPEG, although the resulting files were about 10% smaller than when using Huffman. As long as the difference is not HUGE, everybody will stick with the free version...

File formats and compatibility are the biggest problem created by software patnets.

Patent trolls and silly patents get most media attention, but that's because they cause problems for mega corporations. Those same mega corporations are the ones using patents to impede free software and new companies. So there's lots of money being invested in redirecting public dissatisfaction away from the compatibility issue toward the trolls and silly patents issues.

The summary uses MPEG-LA and MPEG interchangeably, this is not correct.

MPEG-LA is not affiliated with MPEG, and so if every file were in "MPEG format" as the summary says, it wouldn't be much of an issue (especially to the MPEG-LA!). The concern is that at any given time nearly every video has once been in a format that is covered by the MPEG-LA patent pools.

As another note, has it not escaped slashdot that it is the same person saying this every time? It'd be great to see a notation "another article from t

Note that there is an interesting history here concerning the H.264 baseline. According to the JVT [itu.int] that created this baseline there was consensus to have this be "patent free" (or, more exactly, royalty free) :

Regarding Intellectual Property Rights (IPR) for the JVT codec, JVT has agreed to the following basicprinciples:

The JVT codec should have a simple royalty free “baseline” profile (both on the encoder anddecoder) in order to promote the wide implementation and use of the JVT codec. All implementationsshould have such a common baseline profile core, in order to allow minimal interoperability among allJVT codecs. The above requirement means that all technology applied in the baseline profile shallhave no IPR, expired IPR, or valid but royalty-fee-free IPR (according to Box 2.1 or 2.2.1 of the JVTPatent Disclosure form, as shown below).

Special, more advanced profiles of the JVT standard may contain patents per Box 2.2 of the JVTPatent Disclosure form (reasonable terms and conditions).

So, how (besides chutzpah) does MPEG-LA assert licensing rights for the H.264 baseline ? I don't know, but I have heard rumors that the San Diego Qualcomm case [broadcom.com] had something to do with it :

IRVINE, Calif., Aug 07, 2007 -- Broadcom Corporation (Nasdaq: BRCM), a global leader in semiconductors for wired and wireless communications, today announced that a San Diego federal court ruled yesterday that Qualcomm Incorporated (Nasdaq: QCOM) engaged in aggravated litigation misconduct and standards abuse with respect to two Qualcomm patents that relate to digital video technology. The court ruled that Qualcomm has thereby waived its rights to enforce all claims of the two patents and any continuations, continuations-in-part, divisions, reissues, or any other derivatives of those patents. The court also ordered Qualcomm to pay all of Broadcom's reasonable attorneys' fees, court costs, expert witness fees, travel expenses and any other litigation costs reasonably incurred by Broadcom in defending the patent infringement case that led to the rulings.

Citing the misconduct of Qualcomm's employees, witnesses, and counsel before, during and after trial, the court found that "Broadcom proved this to be an exceptional case by clear and convincing evidence based on (1) Qualcomm's bad faith participation in the H.264 standard-setting body, the Joint Video Team (JVT); and (2) the litigation misconduct of Qualcomm through its employees, hired outside witnesses, and trial counsel during discovery, motions practice, trial and post-trial proceedings." According to the court, "Qualcomm closely monitored and participated in the development of the H.264 standard, all the while concealing the existence of at least two patents it believed were likely to be essential to the practice of the standard, until after the development was completed and the standard was published internationally. Then, without any prior letter, email, telephone call, or even a smoke signal, let alone attempt to license Broadcom, Qualcomm filed the instant lawsuit against Broadcom for infringement of the '104 and '767 patents."

This experience seems to have left a bad taste in the mouth of the video standards industry concerning royalty free patents. This is shear speculation, but I also have to wonder if this has something to do with MPEG-LA's reluctance to date to charge royalties for the H.264 baseline.

> Did you know that nearly every video produced for Web viewing has been, at one point or another, in MPEG format no matter in what format the video is ultimately saved?

That's the whole idea with open standards. Did you know nearly every photograph has been, at one point or another, in JPEG format? Duh. All the camcorders make MPEG-4, which is a standardized QuickTime container. All the editors edit MPEG-4. All the players play MPEG-4. That is the whole idea with MPEG-4. That is why Apple gave the container away. Before MPEG-4, it was the QuickTime container that was universal in that same way. It was standardized not just to make it vendor neutral, but also because it was practical and possible to update media and tools and players that used QuickTime containers to use MPEG-4 containers. It's not practical to switch to another container. That would be like trying to replace Unix on the Internet. No, we cannot even switch to WebM. That would be a bigger project than the Great Wall of China. WebM is not even standardized.

The codecs are a separate issue from the container. There are licensing fees for some commercial use of H.264. In theory, H.264 could be displaced as the consumer codec by something like Google VC-8. However, in practice, the patents on H.264 will expire before that could happen, and VC-8 is vulnerable to submarine patents which are much worse than H.264's patent pool.

Professional content producers are going to continue to make H.264 because that's what is in all the tools, and consumers are going to continue to make H.264 because that's in all their still and video cameras, and they're going to upload it directly and share it directly from the devices without transcoding, and they're going to watch it on their smartphones and media players and tablets and set-top boxes which all have hardware H.264 decoding and which cannot support software codecs. And they're going to watch it on their PC's, which even though they can support software codecs, also have hardware H.264 decoding in their GPU's and so get 10 times the battery life playing H.264 as any other codec. All of the activity I just mentioned is totally 100% royalty-free. Even the professional creatives and producers pay no royalties at all. It's only the sellers of video like Apple with iTunes and the sellers of video encoders like Apple with QuickTime Pro that pay royalties, and the royalties are very small and cannot go up more than 10% every 5 years, and they do not go to patent trolls, they go directly to the people at many different organizations who created and standardized the codec.

So in short, no matter what your politics, you are I and everyone else is stuck with MPEG-4 containers, that is all that has existed since the dawn of digital video. They just used to be called QuickTime containers. They are not going away any more than Unix is going away. And no matter what your politics, we are all stuck with H.264, because that is what was deployed as the consumer standard for video codecs 10 years ago, and it has universal deployment and it's how most Web video is displayed today and for some years now, even if you view it in FlashPlayer. It's all of YouTube and iTunes, it's Netflix and Hulu. It's Canon SLR's and Flip camcorders and iPods and Droid phones. It's WebKit and IE9. It's Mac, Windows, and Ubuntu. The small costs associated with some commercial use of MPEG-4 H.264 (selling video, selling encoders) are well worth what we get for it.

You can have a copyrighted work with quite strict license conditions encoded in a free video format, or you can have some public domain stuff encoded in a heavily patent-encumbered video format. Also, if you write a video codec for a free video format, you still have the copyright on that code, and can impose arbitrary license conditions.