Commodity Switches Test Cisco's Mettle

Long the networking giant, Cisco now faces threats from all sides in the form of open-source options produced by vendors including Arista, Cumulus, and Pica8.

There's been a fair amount of buzz over Arista Networks' recent filing to go public, fueled by the notion that this might be the company that has what it takes to kick sand in Cisco's face.

No doubt, Arista is the real thing. The vendor has an enviable customer list that includes Microsoft (accounting for more than 20 percent of Arista's 2013 revenues), Citigroup, Comcast, and Facebook. But what distinguishes Arista, as Matthew Palmer of SDNCentral noted, is delivering a huge switch based on merchant silicon with a network operating system built on open-source Linux.

Aside perhaps from the ubiquitous software-defined networking (SDN), the big buzzwords in the infrastructure business lately are "merchant silicon" and "open-source software," terms that are the very opposite of what's associated with traditional network vendors. There undoubtedly is a comfort factor in the traditional soup-to-nuts model, in which a single vendor provides custom silicon, the box itself, and a proprietary operating system with all the features. But such a solution also results in customer lock-in. Want a new feature? You'll have to wait until the vendor adds it to its software stack.

To view Arista as a David going up against Goliath (or Darth Vader?) would be to miss the wider guerilla war that is underway. There is a whole array of vendors looking to upend the traditional model. Moreover, Arista as an SDN vendor supports the notion that the network control plane (brains) should be separate from the forwarding plane (muscle). But it is the more fundamental threat from merchant silicon-based switches that Cisco's John Chambers referenced when he pooh-poohed Arista to editors at Barrons but voiced great concern about bare-metal switches.

The threat to Cisco is not just from SDN but also from a combination of bare-metal switches and network operating systems based on open-source software, specifically Linux. Bare-metal switches, based on ASICs from companies such as Broadcom, Intel, Marvell, and Mellanox, are available from brand-name companies like Dell as well as ODMs (original design manufacturers) such as Accton, Foxconn, and Quanta.

In contrast to Arista's hardware, which is purpose built, bare-metal switches have opened the door to a new breed of independent network operating system vendors, such as Cumulus Networks and Pica8, both of which offer Linux-based network operating systems. That, in turn, allows customers to choose third-party, open-source, or commercial tools and applications.

These companies have generated a great deal of interest in enterprise IT even though both have targeted datacenter and cloud service providers. Cumulus has four ODM partners, including Dell, whose switches support Cumulus's Open Network Install Environment (which the vendor contributed to the Open Compute Project initiated by Facebook). Dell, interestingly, may be the first brand-name switch vendor to give customers the choice of network operating system.

Unlike Cumulus, which is in the business of licensing its network operating system, Pica8, while it licenses its software, also resells switches from its four ODM partners, ostensibly to ensure the quality of the switches. Pica8's announced customers include Baidu, NTT Communications, and Yahoo.

Any similarities between the two companies end there. While Pica8's network operating system supports OpenFlow, Cumulus does not, as network architect Jason Edelman noted in his blog. But he points out that might actually work to a customer's advantage because Cumulus and bare-metal vendor Big Switch Networks support the same switches, with the latter supporting OpenFlow in its switching software product.

Given the multidirectional threat to Cisco from SDN and bare-metal switches, it's understandable that the company appeared a bit schizophrenic in its Application Centric Infrastructure announcement, offering the new Nexus 9000 switches on both custom or merchant silicon. It's also selling the current Nexus 9000 with Cisco NX-OS, the operating system supported on Cisco 7000 and 6000 series switches, but will support a yet-to-be-released "enhanced" NX-OS built on Linux.

If that's not an endorsement, it sure seems like an acknowledgement that vendors like Arista, Cumulus, and Pica8 are onto something. The network equipment market is changing -- and fast.

Sam Masud has covered the telecom industry for more than two decades as an analyst and editor. He launched and was principal analyst for Frost & Sullivan's carrier infrastructure practice, and has held analyst positions at Heavy Reading and Synergy Research. Prior to becoming ... View Full Bio

"as Matthew Palmer of SDNCentral noted, is delivering a huge switch based on merchant silicon with a network operating system built on open-source Linux."

This actually describes many of the existing Cisco Nexus products including the Nexus 9000 series. Arista is just a smaller niche version of Cisco with better switch SW. They embraced merchant silicon earlier and use both Intel and Broadcom but Cisco uses merchant now. These are evolutionary steps to disaggregation with bare metal and a more opensource Linux platform. Matthew to his credit defines it in a little more detail.

In terms of Cisco's strategy, I think that the lock-in is coming to an end and Chambers knows it and wisely they are trying to switch to services similar to IBM. They are building their own Cloud to compete with Google and AWS, etc. I don't think that Cisco can execute on this plan but really what else can they try to do? The old gameplan isn't going to work for much longer.

Cisco Nexus-OS already is Linux based and all Nexus 9000 series ship with enhanced NX-OS btw, none run regular NX-OS AFAIK.

I believe that is what I implied in my article, which noted that Arista's hardware is purpose-built. Sorry if that was not clear because I agree that Arista is not in the same category as Cumulus or Pica8.

I wouldn't put Arista in the same category as Cumulus, Big Switch, etc. While Arista bases its switch OS on Linux, it also tightly couples its OS with its hardware. That's in direct contrast to Cumulus and others, where the whole appeal is a loose coupling: you can swap out the OS or the hardware if it doesn't meet your needs. I haven't heard Arista encouraging customers to buy its hardware to run with a different OS, or selling its OS for the white box market.

You'll get no argument from me. As for OpFlex, it's possibly another tactic by Cisco to protect is custom silicon. Customer lock-in with its hardware and operating system has worked for Cisco, but now the rules of the game are changing, and fast, and I'm skeptical whether the vendor can change its culture to the new realities.

I was being charitable and polite in describing Cisco as "bit schizophrenic."

By characterizing Cisco as "a bit schizophrenic" you're being charitable. There's clearly an internal battle being waged with two possible outcomes: Do sometihng dramatic (for Cisco) by abandoning the 'embrace and extend' mindset for reals and live on narrower margins, or become Microsoft.

I am not sure Chambers has what it takes to navigate this transition. Witness this from Seeking Alpha: "Cisco recently took another step towards fleshing out its SDN vision by unveiling its OpFlex protocol for interactions between SDN controllers and the hardware they manage. The company argues OpFlex is superior to the widely-embraced OpenFlow on account of supporting a greater level of networking intelligence, and preventing controllers from being a single point of failure."

Respondents are on a roll: 53% brought their private clouds from concept to production in less than one year, and 60% ­extend their clouds across multiple datacenters. But expertise is scarce, with 51% saying acquiring skilled employees is a roadblock.