06.09.09

“Microsoft did sponsor the benchmark testing and the NT server was better tuned than the Linux one. Having said that, I must say that I still trust the Windows NT server would have outperformed the Linux one.”

Summary: Another manufactured ‘benchmark’ from Microsoft gets the wrath of rivals

ABOUT A month ago, 18 companies sued the Swiss government for dealing with Microsoft behind closed doors and signing expensive (probably overpriced) deals by completely excluding competition [1, 2, 3, 4, 5, 6, 7, 8, 9, 10]. This set an important legal precedence and IBM may be setting another one right now. Sadly, as far as the news is concerned, this story is only covered by a Microsoft spinner from Ziff Davis (they work with Microsoft [1, 2, 3, 4]). The author does not even bother giving voice to anyone from IBM’s side, so it’s virtually ghostwritten by Microsoft employees. The gist of the story is this:

IBM lawyers have contacted Microsoft about the “Who Knew?” site, which claims that customers will save money and get better performance by running WebSphere on Windows Server 2008, instead of on IBM operating systems.

The dispute here must be over deliberate deception. Microsoft has never any qualms about misrepresentation of facts and faking of benchmarks. See quote at the very top. “Get the Facts”, “Linux Personas”, "It's better with Windows", “[Vendor] recommends Vista” and other paid-for messages (advertisements) are disguised as “facts” or endorsements, so this is not acceptable. GNU/Linux is not the only victim .

“Microsoft has never any qualms about misrepresentation of facts and faking of benchmarks.”Let’s take VMware for example. It was a long time ago that Microsoft commissioned the Yankee Group to attack VMware’s business [1, 2]. Yankee consequently pulled the report (VMware did not accept this libelous attack), but Microsoft still hosted its copies of the propaganda it had paid for. Microsoft later proceeded to creating anti-VMware Web site/s. In a similar vain, Microsoft is using ACT to create pro-software patents Web sites in Europe.

When will this end and why does Microsoft still wonder if circles in IT distrust it, to say the very least? █

Share this post:These icons link to social bookmarking sites where readers can share and discover new web pages.

4 Comments

We have the corresponding platform software: for A (our platform sw) and for B (their platform sw).

We have the product being tested on each (in this case, it’s their server software).

The first step is to make sure we find an A so that it outperforms their B hardware. This is easy to do unless B is the fastest supercomputer on record. It isn’t, obviously, so we can definitely find an A that beats whatever B is. [Eg, a 4gighz x86 beats a 1gighz x86 from the same vendor.]

Each platform software performs about the same as the other under ordinary circumstances (or maybe ours is a bit worse). This means we will optimize extra for the occasion. This is easy to do by removing security and other tests. We can keep special task/process related memory objects around preinitialized in anticipation. We can simplify and speed up our scheduling. We can give the special process high priority to the CPU and to the filesystem (bypassing security checks, etc). We put everything else, including the GUI, into slow low priority mode. We turn kernel dynamic lists into static lists. Etc. Really, it is possible to optimize well for the occasion if we know the system will only be used for a specific purpose (to win in some benchmark). Also, the platform software we chose for their side is their generic platform software if possible (eg, their regular platform software not optimized for this benchmark).

So that is how we easily got the improved performance.

However, we need to control further context in order to pull off the coop. What about the price, right? After all, a supercomputer outperforms a pocket calculator, but people don’t buy supercomputers to compute tax at the restaurant. The context in this case is that the supercomputer is a LOT MORE expensive. We need to get the price of our “supercomputer” down to a competitive level.

Here is how we carry out this step. We work with the hardware partner. They develop an exclusive model that they will price near cost. We also give away our platform software at near cost (it’s a “special configuration” remember). Voila! We got our costs down because we and our partner have no intention to actually sell many of these models to actual customers.

So we kick their buttocks, and customers flock to our product.

Then…

The hardware model runs out quickly and a very slightly differently named/numbered hardware model is put in its place at a higher price.

Also, our platform software is changed back to normal, except that now, it actually doesn’t run their server software all that well in comparison to our own server software that competes with theirs (but which was not tested in the benchmark). It’s extremely easy to change platform software bits around so that one app that was favored is no longer favored and is actually handicapped. It’s also very difficult to catch this if third parties don’t have the source code. Also, for subtlety, this change in the platform can be achieved later on through one or more automatic online updates/patches.

Of course, the price of the platform software also goes up eventually, if not initially. Maybe its price goes up at the one year renewal or else when they exceed an artificially low user count. Or perhaps the price is raised transparently through the bundled software/service package “deal” the customer actually ended up buying. There are many ways to guide them into these higher priced options.

Profit.

Recap: We found better hardware, tweaked only our platform software to game the benchmark, and artificially lowered the price on this model in order to win the benchmark price comparison test. Then we switched this system with a regular one, threw in some more items, and modified the platform software (over time) to disfavor their application that we favored for the benchmark. Through this bait and switch we won the contract, and later by controlling the platform software, we disgraced their product to upsell our product in its place. We had the slightly worse software perhaps yet won and pulled in much more money than what they were advertising as their price tag. A full sleigh of hand.

This is dirty, absolutely. It’s deceptive. It’s anti-consumer and anti-competitive. It likely leverages monopolies later on in the upsell. It is perfectly within Microsoft’s capabilities to pull off. It would be consistent with Microsoft’s past behavior.

I’m not really surprised. Microsoft has run some really unbalanced “benchmarks” in the past, then hid their test configurations in the fine print of their ads.

One particular one that comes to my mind was from back in 2005 with Microsoft claiming their SQL Server was faster than Oracle 9i. The Windows machine ran four dual-core Opteron processors (eight cores) at 2.2 gHz and the Oracle machine ran four Itanium 2 processors (four cores) at 1.5 gHz.

The criminal enterprise known as Microsoft finds itself embarrassingly exposed in the courtroom, for the IRS belatedly (decades too late) targets the company in an effort to tackle massive tax evasions

A look at some of last week's patent news, with imperative responses that criticise corporate exploitation of patents for protectionism (excluding and/or driving away the competition using legal threats)

Vista 10 to bring new ways for spies (and other crackers) to remotely access people's computers and remotely modify the binary files on them (via Windows Update, which for most people cannot be disabled)