Bing-powered Windows 8.1 heralds a better, smarter Microsoft

Deep integration is proof positive that the company is actually working together.

Microsoft's Bing search engine takes center stage in Windows 8.1. Windows 8 already shipped with a bunch of apps—things like News, Weather, and Sports—developed by the Bing team, using Bing services, but that's all they were: apps that ran on the operating system, rather than integral features of the operating system.

In Windows 8.1, Bing has a deeper integration. Some of this is immediately visible; other parts are more subtle. Together, they suggest that Microsoft is not the company it once was. It's a better one.

Bing now powers Windows 8.1's search. Head into the search charm (or invoke it directly, with Win-S, for Search), type a search term, and hit return, and you'll be taken to a full-screen search app. This will include relevant local hits (files, apps, and settings), but it goes a lot further than that, thanks to data taken from Bing.

Pretty much any search term will result in Web search results. This is the most obvious thing for Bing to do, of course, since at its heart it is a search engine; however, they're not the only thing that you can find.

Bing doesn't just index Web content. It tries to extract structured, meaningful information from Web pages, using this information to construct entities. Consider, for example, the search for Holly Willoughby I took a picture of here. Bing knows that "Holly Willoughby" is not merely a sequence of letters; it knows that it's the name of a particular person with an age, a place of birth, a picture, and a Wikipedia page. It knows that she's been in a number of specific TV shows, that there are videos that feature her, and that people who search for her often also search for her various co-presenters on the shows she's been in.

The search tool shows Web results alongside the structured entities. It has been reported that it will eventually show advertising along with these results, which will be an odd juxtaposition. On the one hand, it's normal for Web search results to show ads, and in principle, those ads can even be useful (especially for things like searches for products). On the other hand, I expect lots of people will argue that ads have no place in a commercial operating system.

These structured results (called "Search heroes" by Microsoft) can also link into applications. So the Holly Willoughby Wikipedia link doesn't take you to her Wikipedia entry on the Web; it takes you to the corresponding place in the Wikipedia app. If you don't have the app, you're prompted to install it.

This deep linking is currently at Microsoft's discretion. Bing knows which apps are popular and well-regarded, and will link to them when appropriate. There isn't, however, any way for an application to declare "I know about Movie entities," say, and have that show up in relevant searches automatically. This is different from Windows Phone, which does let apps declare that they understand certain kinds of information, ensuring that they get wired up to search results.

The search results are the most visible part of Bing's integration, but not the only part. As part of its modelling and analysis, Bing builds language models. These are then used to inform the autocomplete corrections that the Windows 8.1 soft keyboard uses. Bing knows the hot topics of the day and the names and places that people are talking and typing about, and it can adjust its language model data accordingly. Windows 8.1 then downloads this data daily. In this way, the keyboard behavior can change, albeit subtly, to stay current.

Microsoft isn't the only company to build this kind of search-driven, data-driven capability into its operating system. Windows 8.1 uses Bing in a reactive, user-directed way. Google has arguably gone a step further with Google Now. Google Now pulls data from, for example, appointments in your calendar to proactively show structured information that it assumes will be useful: weather, driving directions, that kind of thing.

Microsoft isn't doing that proactive searching just yet. Members of the Bing team tell us that the difficulty for this kind of system is proper handling of mistakes. If the system generates mistakes—for example, giving you useless driving directions explaining how to drive home, even though you've flown across the country for a week to go to a conference—then users will lose confidence in it and stop using it.

Both ensuring that those mistakes are rare and giving users a good way to fix mistakes remain challenging. To continue the example, users need to be able to tell the system, "I don't care about that set of driving directions" while still not disabling the ability to show directions in general.

Google building search-driven features into Android isn't surprising. It's what Google does. Microsoft building Bing-driven features into Windows shouldn't be surprising. But it is.

Microsoft has traditionally been a company that made internal divisions painfully visible to outsiders. In fact, this aspect of the company has become an object of ridicule: It's joked that the company's org chart has a bunch of divisions pointing guns at each other, such is their hostility to one another.

For example, the Office team pointedly refused to do anything to enable the core Office products (Word, Excel, PowerPoint, and Outlook), or do anything to support the Windows team's decade-long attempt to produce a tablet operating system. Even the very latest Office 2013 makes only minimal concessions to tablet usage.

A comment that an ex-employee posted on Ars in the wake of departure of Steven Sinofsky, former President of the Windows Division tells a similar story: good, popular products and teams were destroyed if they weren't serving the Windows division.

The Bing integration in Windows 8.1 is a sign that the company is working to put those days behind it. The Bing group's knowledge and expertise—collection and processing of vast amounts of data, extraction of semantic meaning—is being used to make another group's product—Windows—better. This is the approach Microsoft should have had all along: build the best products, regardless of which division or team was responsible for a particular piece of technology.

When Sinofsky left last November, there were widespread rumors that he'd been pushed out precisely because of difficulties in achieving this kind of collaboration. CEO Steve Ballmer wants Microsoft to be more collaborative as part of its transition to a "Devices and Services" company, and the rumors claim that Sinofsky was seen as an impediment to this.

There's some irony in that; Sinofsky himself is credited with saying "Don't ship the org chart;" that is, don't make internal divisions apparent in the shipping product, while being blamed for an apparent inability to overcome those same internal divisions.

Microsoft is believed to be planning an internal reorganization to further the "Devices and Services" ambitions. In the old Microsoft, this reorganization would be significant for employees and customers alike, as the structure of the organization would directly impact the design of its products.

But Windows 8.1 shows that it might not be such a big deal for anyone outside the company after all. The Bing integration in Windows 8.1 gives a hint that the collaboration and company-wide agendas that Ballmer wants to promote are already starting to materialize and are already yielding better products. The reorganization might formalize a new Microsoft that pulls together as one, but signs are that the hard work has already begun.

204 Reader Comments

Kissing Balmers and shareholders behind to the side how is this actually beneficial to the customer? Windows is becoming iOS. Closed down with MS exerting more and more control over it and at the same time by means of integration shutting out all other providers.

With some luck DoJ or EU will tell them where they can stick bing integration but I wouldn't bet my life on it.

But can I use it to find a specific .DLL file on the hard drive in less than 10 minutes?

On current versions of Windows, I found that using the "Everything" search engine (voidtools.com) kicks the shit out of Windows built in search engine. It's criminal that there is such a disparity in the speed.

These structured results (called "Search heroes" by Microsoft) can also link into applications. So the Holly Willoughby Wikipedia link doesn't take you to her Wikipedia entry on the Web; it takes you to the corresponding place in the Wikipedia app. If you don't have the app, you're prompted to install it.

Ah, excellent! I was thinking how much I missed the app-install-begging experience from my phone, it will be great to have desktop parity now!

Did Microsoft even have a choice, but to integrate Bing, if they wanted to compete with the likes of Android in the tablet space? But knowing Microsoft it is not going to be seemless but jarring and from the example in the article it sounds like it is.

On current versions of Windows, I found that using the "Everything" search engine (voidtools.com) kicks the shit out of Windows built in search engine. It's criminal that there is such a disparity in the speed.

+1 Everything. Great tool, very fast and easy to use. By design it can't search in the files' content, though. It would just be too good, if it did that, too.

A lot of commentors correctly bring about the anti-monopoly rules that could harm Microsoft in this way. The thing is that Microsoft can argue that they're not in a monopoly position any more. They can argue that as PCs ARE getting replaced by tablets and MS does NOT have a monopoly position in tablets, they can do as their competitors do and go on with integration.Google here has set a precedent. They did that kind of integration, they've reached 65% of the market share in phones and still nobody objected.What we see here is the creation of an oligopoly of 3 major vendors creating an environment where smaller companies can only create smaller apps or plugins within the confined kindergarten(s) created by those vendors.

Different target groups. We also don't know what will be the defaults of the bing-enabled search of Windows. Chances are that you'll be presented with the option the first time you use the app (as it the case of most MS-built apps during the last 3 years).

I'm somewhat conflicted on this. On the traditional desktop, I can see this as a bigger problem. For a tablet, especially RT-based ones, it's far more logical and relatively competitive with Android and iOS tablets. I'm using an RT tab, and it's really a good solution since the file system and desktop are intended to be less prominent. It's the same old, "because you can get to the desktop on RT, full functionality is required" issue that has plagued RT devices from the start.

I don't hate Bing. On one of my Android devices, it's even set up as as the default search provider.

And therein lies the difference. Does Windows 8.1 search allow you to set up your favorite search engine (no) or are you stuck with this (yes)? Because I don't want a full screen search monstrosity and I don't want my searches to go to the web when I'm looking for a file on my computer.

But can I use it to find a specific .DLL file on the hard drive in less than 10 minutes?

On current versions of Windows, I found that using the "Everything" search engine (voidtools.com) kicks the shit out of Windows built in search engine. It's criminal that there is such a disparity in the speed.

If your HD is indexed, and it takes more than a second or two for the default search to find a file by name, there's something a bit off about your windows install.

Different target groups. We also don't know what will be the defaults of the bing-enabled search of Windows. Chances are that you'll be presented with the option the first time you use the app (as it the case of most MS-built apps during the last 3 years).

if you choose "Customize Settings" the first time you log into a new Windows 8.1 install, you can turn it on or off.

All well and good that Microsoft is going to potentially display ads, now how long is it going to take for some rogue company to exploit that to install malware/crapware automatically, and create a nice, shiny, new Win8.1 powered botnet? Or to start selling Viagra or some other pharmaceutical of the day?

That's really the LAST thing I want to have my operating system showing me on a regular basis, plus it just allows all kinds of holes in the security of your computer. How is an AV system supposed to protect against malware when the underlying OS is designed from the ground up to serve (what could potentially be) damaging advertisements from companies with... less... than the best interests of the viewers in mind?

These structured results (called "Search heroes" by Microsoft) can also link into applications. So the Holly Willoughby Wikipedia link doesn't take you to her Wikipedia entry on the Web; it takes you to the corresponding place in the Wikipedia app. If you don't have the app, you're prompted to install it.

Ah, excellent! I was thinking how much I missed the app-install-begging experience from my phone, it will be great to have desktop parity now!