Reviews smartphones

How smartphone reviews really work

As a certified Guy Who Writes About Android™, I get asked plenty of questions. Whether it's device recommendations, app suggestions, or tech support requests, the stack of incoming inquiries never seems to run short.

What's interesting, though, is that for every question I see about what I cover, there's a question about how I cover it. Part of what I do is reviewing new devices - and as I've learned over the years, that's a process surprisingly shrouded in mystery and misconception.

Since we're on the brink of a busy few weeks for smartphone reviews, I thought now would be a prime time to pull back the curtains and offer a frank walk-through of how the phone-reviewing process actually works. After all, transparency's a good thing - and there's no reason you shouldn't understand what goes on behind the scenes of the reviews you read.

I should preface this by saying this is how do things. Other writers and publications may or may not always follow the same practices; I obviously can't speak for everyone. But as far as my reviews are concerned, this is how things work:

Step 1: Getting a review unit

How do I actually get my hands on a smartphone review unit - and how far in advance of its release do I get it? The simple answer is: It depends.

With some products, I (or more often, Barbara, my New York-based reviews editor) have what's called a pre-briefing in advance of a device's launch. It might take place in person (often in New York, as you might have guessed) or sometimes just via email or over the phone. We'll usually have to agree to an embargo beforehand, which merely means we won't publish anything or talk about having the device until a certain date and time. We'll then either get a review unit right then and there or be sent one soon thereafter.

Sometimes, there's no formal pre-briefing and I'll just get notified of review unit availability directly via email. (There's frequently still an embargo involved.)

And sometimes, I'll see reviews pop up at other publications before I've heard or received anything myself (always a lovely surprise!). Some of the time, that's because a company has opted to give early access to one particular outlet or a select group of sites. Other times, it's because the European or international arm of a company has launched a device and/or provided global review units before the company's U.S. division has handed out U.S.-specific models - a strange and slightly confusing practice, but one that happens more often than you'd think (including once this very week!).

In any of those cases, I might get a phone a few days or a few weeks before it's released. Or I might get no advance notice and scramble to snag one the day it's announced. There really is no universal standard from one manufacturer or even product to the next; every device is a new adventure.

Step 2: Living with the device

Call me crazy, but I like to actually live with devices for a while before reaching conclusions and making recommendations. There's certainly a place for quick-turn reviews and lab-driven analyses; they're just not for me. I'm far more interested in what a gadget is actually like to use in the real world, the way a normal person would use it - and to get a meaningful and well-rounded sense of that, I need to spend a fair amount of time using the thing around the clock in my day-to-day life.

That often means I'll end up publishing a review well after the aforementioned embargo time has passed - which is absolutely fine. An embargo just means you agree not to publish anything before that time, but there's nothing preventing you from publishing later. Every writer and publication has different priorities, but for me, being "FIRST!" generally isn't high on the list.

Once I receive a review unit, I put my own personal phone aside and prepare to move into the new device. It really only takes a matter of minutes to make any Android phone feel like home these days: I sign in, install a handful of essential apps, and set up the few things that still require manual configuration.

Thanks to Google Voice, calls and texts to my personal number come through to any device I'm using - even when it's a review unit with a temporary SIM card provided by the manufacturer. And since I use cloud-based services for almost everything in my life - contacts, calendar, email, music, even document editing - anything I might need is automatically synced and available on any phone I use, without any real effort on my behalf.

Top cell phone 2014

It's Interesting

Joe Danger is the first video game published by British independent developer Hello Games. It was released on the PlayStation Network in June 2010, after Hello originally chose to publish it exclusively with Sony Computer Entertainment. A "Special Edition" for Xbox...

Tweets

Thursday 24, December 2015 08:06 AMShadawn

@Shadawn: All these smart phones paired with this selfish, brainwashed, sorry excuse for the "next generation" of kids?

Saturday 26, December 2015 06:21 PMTia

@Tia: That sort of didn't make sense. But I'm just so fed up with "smart phones are ruining the next generation".