If you buy e-books from Amazon and want to engage in a bit of digital civil disobedience—by stripping the files’ DRM and making sure that Amazon can’t deny you access—we’re about to show you how. Yes, many parts of the Internet have known about this technique for some time now, but we feel that it bears mentioning again here.

Over the past week, the tech world has been abuzz with news that—surprise, surprise—Amazon can remotely wipe any Kindle, at any time, for effectively any reason. (The company did it before, ironically, with George Orwell’s 1984, back in 2009.)

This week’s case involves a Norwegian woman (Google Translate) named Linn Nygaard. She bought a Kindle in the United Kingdom, took it home to Norway, and bought UK e-books on the Kindle. This week, Amazon suddenly disabled her account, taking away her access to an e-book library of 40 books. That move was reversed (Google Translate) about 24 hours later, with access to her Kindle account restored.

"I have not heard anything from Amazon about this, except that I got a very strange phone [call] earlier from someone with a hidden number," Nygaard told Norwegian broadcaster NRK. "They claimed that they worked in Amazon.co.uk and would give me a new Kindle, but they would not talk to me about my account."

Many speculated that because she was buying content licensed for the UK from Norway, Nygaard somehow ran afoul of Amazon’s licensing deals. (For two years, my wife and I regularly bought e-books for our US-bought Amazon Kindle while we were living in Germany—I can’t believe that we just got lucky. More likely, Amazon turns a blind eye to most people who fall into this category.)

Many other websites also lamented that many digital retailers (Amazon, Apple, and plenty of others) are not selling digital goods, but rather license them. It's a distinction many Ars readers may already understand, but it's less apparent outside the ranks of the tech-savvy. (After all, those purchase buttons usually say BUY, not BUY A LICENSE.)

Fortunately, though, there’s an easy way to ensure you can avoid the same fate as Nygaard. By downloading a free and open-source e-book management app known as Calibre, and a corresponding plugin that cracks Amazon’s DRM encryption, you can convert any Kindle e-book into an iBook format, or pretty much any other format that you like.

We will offer this caveat, however: it’s quite possible the technique we’re about to outline violates not only Amazon’s Terms of Service, but the Digital Millennium Copyright Act as well. We are not advocating breaking the law, but we are demonstrating for non-American Kindle users how this technique can be used to safeguard against remote deletion tactics. Related laws may differ in countries around the world, so be sure to check your local situation if you’re unsure. In short, follow these instructions at your own risk.

Ex Calibre, electronica librae!

Zac West, a San Francisco-based iOS developer wrote up his instructions about a year ago. We used his directions on a Mac (although repeating the same trick on Windows is likely quite similar), and found they worked well transferring books to an iPad 3. But the program should allow you to load DRM-stripped books onto your Kindle, Nook, Nexus 7, or other device as well. Let’s dive right in:

You’ll need to download Calibre, which is available for OS X, Windows, and Linux. The software describes itself as a "free and open source e-book library management application developed by users of e-books for users of e-books."

Then, download the DeDRM plugin and unzip it. That’s the actual piece of code that, as the name implies, cracks Amazon’s DRM scheme. Once Calibre is installed, open its Preferences (under the File menu). At the bottom of the screen, in the lower left-hand corner, click "Plugins."

Then, "Load plugin from file," and choose the K4MobileDRM plugin’s zip file—it’s a zipped file inside of the DeDRM zipped file you downloaded. Don’t decompress this second file.

A note for Windows users: it might also be necessary to install both Python and the PyCrypto precompiled binary in order to be able to decrypt some e-books. The easiest way to get Python for this purpose is to download and install Active Python from here, and then get the matching version of PyCrypto from here (either 2.7 or 3.3, for 32-bit or 64-bit Windows, whichever is appropriate). Thanks to forum user krimhorn for the suggestion!

Now, be sure to download Kindle for Mac (or the Windows/Linux equivalent), and connect it to your Amazon account. (If you have the app already installed, go ahead and skip this step.) Download all your e-books—open them up from "Archived Items" in the top left of the app. Once done, your "Archived Items" count will go to zero and "Downloaded Items" should show a number greater than zero.

As West notes, Kindle e-books come in the MobiPocket format, while iBooks requires ePub, so we’re going to be converting from one to the other. On a Mac, open up ~/Library/Containers/com.amazon.Kindle/Data/Library/Application Support/Kindle/My Kindle Content/.

Note: this does require the Library file found under the "username" directory. An easy way to open that folder is by holding the Option key while clicking the "Go" menu in the Finder. (On Windows, you can find the "My Kindle Content" folder under My Documents.)

Now we have to drag the .azw files (each Kindle e-book) into Calibre—why not do them all?

Converting Books: the waiting game

Next, click "Convert books" in the app’s toolbar. When the "Bulk Convert" window pops up, make sure that EPUB is selected in the upper right corner of the screen. Then click the third item on the left-hand side, "Page Setup," and configure the output profile to whatever device you want to export to—we’re working with an iPad 3, so that’s what we chose. Similarly, choose Kindle as the input profile.

Click "OK" to begin the conversion. Depending on how many books you have, it may take a little while. Our 44 books, including some Lonely Planet travel guidebooks, took around 10 to 15 minutes. You can monitor Calibre’s progress by clicking the "Jobs" button in the lower right-hand corner.

On a Mac, Calibre defaults to creating its "Calibre Library" file under the username directory. If everything has gone correctly, you should have a bunch of sub-folders, organized by author’s name, complete with cover art and a converted file in EPUB format. Drag all of those folders directly into iTunes, which should open them all under "Books" (found in the upper left part of the app, between "Podcasts" and "Apps.") Then, when you sync Books with your iPad, you’ll have all your Amazon e-books for your own use in iBooks, safe from Amazon’s whims.

As West himself noted, these files are for your personal use only—they’re not meant to be distributed anywhere. Enjoy!

For those who are happy with the Kindle eReader, then set the output type to .mobi and you can then load the converted ebooks as "Books from another vendor"

Regardless of the output type, back up the newly deDRM'd books so that if something happens to the copy in use, they can be restored from the backup copy.

Personally I have an eBook directory tree in Dropbox so that my ebooks are synced to all my computers and iPod. This Dropbox directory is separate from the eReader libraries to avoid any problems that an eReader may cause either by intent or by accident. Remember deleting a file from a Dropbox shared folder deletes it from all of the other attached devices as soon as they update, so be careful.

Hopefully this will help some people out, it's great to see this type of information here.

BUT...

This is also one of the most irksome things about Ars. There are 100 times as many users of Windows, but Ars rarely presents cross-platform screenshots or steps using the vastly more common version. Even giant software like Photoshop is packed with Mac screenshots and details rather than those from the much better selling version. Windows is always the last resort, you'll see Linux screenshots before Windows if possible.

Secondly, DRM as a whole sucks as you just reminded us with that hilarious Library of Congress DMCA article. However, at least when we buy from Amazon we can view our books and magazines on any platform out there from phone to server regardless of operating system, even in a browser if necessary. Yet Apple is locked down, I can never get my books or magazines out of their ecosystem. Or can I? Sure, but nowhere is that more likely need mentioned in this article.

It's frustrating, but I've slowly moved the last of my Newsstand subscriptions over to Zinio. Unless you're subscribing to a Pixel Mags product you're likely locked in with any Newsstand subscription. There are probably some other exceptions, but there were a number of magazines Zinio didn't have at the time that I wanted and now I'm stuck with only iOS access to those back issues.

Kindle is cross platform. So is Zinio. And comiXology. The odd man out? Apple stuff. That's what should be receiving headline cracking articles.

We will offer this caveat, however: it’s quite possible the technique we’re about to outline violates not only Amazon’s Terms of Service, but the Digital Millennium Copyright Act as well. We are not advocating breaking the law, but we are demonstrating for non-American Kindle users how this technique can be used to safeguard against remote deletion tactics. Related laws may differ in countries around the world, so be sure to check your local situation if you’re unsure. In short, follow our instructions at your own risk.

Ars rarely presents cross-platform screenshots or steps using the vastly more common version.

I don't mind the screen shots when the view is basically the same (and it is, in the ones above), but providing specific information about Mac behavior while not providing the same for Windows just makes the article look poorly researched.

Whining about the 'mac-centric' nature of this hack is a bit persnickety.

I have Calibre on my Windows 7 PC, had it for a while, it's a great tool. I also have the Kindle for PC app from Amazon. There isn't much difference between those APPLICATIONS regardless of the -platform- you're running on.

Squealing 'ew, Mac' is therefore (unsurprisingly) inappropriate.

I thought it was a great article.

The underlying problem of geographical 'title lockdown' within the Amazon walled garden is a much thornier issue (especially for us Australians). When we are allowed to partake of the books, we pay a 30%-200% premium over the US prices.

With Audible (subscription based service, owned by Amazon) the available Spokebn Book library for Australians is something under 10% of the titles in the Audible store itself. (and more expensive too)

Since this store-restriction doesn't directly affect Americans, it's one of those invisible gotchas that's completely off 'most readers of ars' radar. Same for Newegg on the hardware front (they don't ship outside of the USA). It's hair-pullingly annoying.

Many speculated that because she was buying content licensed for the UK from Norway, that Nygaard somehow ran afoul of Amazon’s licensing deals. (For two years, my wife and I regularly bought e-books for our US-bought Amazon Kindle while we were living in Germany—I can’t believe that we just got lucky. More likely, Amazon turns a blind eye to most people who fall into this category.)

Blind eye indeed. Couldn't this be seen as a form of importing and hence all the usual taxes and duties?

Whining about the 'mac-centric' nature of this hack is a bit persnickety.

I have Calibre on my Windows 7 PC, had it for a while, it's a great tool. I also have the Kindle for PC app from Amazon. There isn't much difference between those APPLICATIONS regardless of the -platform- you're running on.

Squealing 'ew, Mac' is therefore (unsurprisingly) inappropriate.

Actually in this case it is rather appropriate.

The install process under Windows is not as straightforward as it is on the Mac.

The Readme for DeDRM wrote:

***This program requires that Python and PyCrypto be properly installed.***

Now, for a tech literate person that's not a particularly onerous thing. In fact, many of us probably have Python (though not necessarily the PyCrypto library) installed for various reasons. For individuals not tech literate (or developers) that step may represent a hurdle that makes them uncomfortable.

While having the actual Calibre instructions be the same for other OSes is fine; I agree that for the install side of DeDRM something should be said. Even if it's simply a link to the relevant installers and a platitude about installing something that may sound intimidating to inexperienced users/non-developers.

Or users can do the obvious and stop supporting retailers who provide licensing terms you don't agree with. If everyone just stopped buying amazon eBooks I bet their terms would change faster than superman in a phone booth.

Now I have to install pycrypto. Download, install. Needs python 2.6. I installed 2.7. Moreover, can't type anything in the text entry field pointing it to the location of my python install to see if 2.7 will work.

Is there a Japanese version of Ars Technica? If so, better check with the company's lawyers in case the (Japanese) legislation could deem this article illegal in Japan and could send some of Ars Technica's employees/contributors/moderators to jail.

Not Trolling btw, just noticed lately several articles all over the web about Japan declaring any form of DRM-skipping illegal and liable for time in jail.

I buy a lot of ebooks, on Amazon and other sites, and I always stripe the DRM out of them and convert them to ePub. (Even stuff I purchase from trusted DRM-free publishers like Baen books.)

The reason for it is I can't stand the mobi format, nor the kindle software (I read on my PC, due to visual impairment, it's the only way I can), I prefer using a plug-in for Firefox to view the ePubs in the browser, I also use calibre to double space the paragraphs (seriously what the hell is up with single spacing them? Imagine how unreadable Ars would be if they used tabbed indenting and single spaced paragraphs!) to make reading easier on me.

DRM sucks, it doesn't work, and it just plain gets in the way of legitimate use.

This is also one of the most irksome things about Ars. There are 100 times as many users of Windows, but Ars rarely presents cross-platform screenshots or steps using the vastly more common version. Even giant software like Photoshop is packed with Mac screenshots and details rather than those from the much better selling version. Windows is always the last resort, you'll see Linux screenshots before Windows if possible.

The authors show the versions that they have. The apps look identical except the close/maximize/minimize buttons " _ + x " are the streetlight as with most apps. There are hundreds of sites that talk about multi platform apps and only show Windoze versions, get over it.

Gear~Up wrote:

Could we get a Windows guide, for the other 95% of us?

Your complaint is with the developer of a specific app, take it up with them not Ars writers which told you were to get the tools and how to use them not how to get them to run. It is not their fault Windows does not bother to install one of the most widely used programming languages.

Hopefully this will help some people out, it's great to see this type of information here.

BUT...

This is also one of the most irksome things about Ars. There are 100 times as many users of Windows, but Ars rarely presents cross-platform screenshots or steps using the vastly more common version. Even giant software like Photoshop is packed with Mac screenshots and details rather than those from the much better selling version. Windows is always the last resort, you'll see Linux screenshots before Windows if possible.

Part of the appeal of Kindle books for me is that it saves your place and automatically syncs it between multiple devices. This is a boon for someone like me, who regularly switches between the actual Kindle, phone app, and PC version to read my books. I've toyed with .mobi and .epub conversions before, but I'm actually okay with Amazon's relatively non-invasive DRM.

The DMCA does not prohibit DRM stripping (also known as circumvention). What it prohibits is the distribution of tools to strip DRM. Interestingly, it does not prohibit the creation of the DRM-stripping tools, either. So the person who created the plugin violates the DMCA when he distributes it (not when he creates or uses it). However, you do not violate the law when you download the tool to use one your own, so long as you do not give it to anyone else.

It should be noted that it is still likely a violation of Amazon's policies and the license you are given to use the book.

Or users can do the obvious and stop supporting retailers who provide licensing terms you don't agree with. If everyone just stopped buying amazon eBooks I bet their terms would change faster than superman in a phone booth.

This is always an option, and one that people often overlook.

If you can't get something on the terms you want it, do without it. If that were a common behavior, you'd better believe that publishers would change those terms to be more suitable. This applies equally to DRM'd games.

Instead - because we have to have things immediately - we decide the tradeoff is worth it (if we're even aware of the tradeoff to begin with). That means we're sending a clear message to the people selling DRM-laden content: this is ok. We can live with this.

Or users can do the obvious and stop supporting retailers who provide licensing terms you don't agree with. If everyone just stopped buying amazon eBooks I bet their terms would change faster than superman in a phone booth.

This is always an option, and one that people often overlook.

If you can't get something on the terms you want it, do without it. If that were a common behavior, you'd better believe that publishers would change those terms to be more suitable. This applies equally to DRM'd games.

Instead - because we have to have things immediately - we decide the tradeoff is worth it (if we're even aware of the tradeoff to begin with). That means we're sending a clear message to the people selling DRM-laden content: this is ok. We can live with this.

That's a point I've given up repeating - getting content, either legally or illegally, shows demand for more of the same. The business perspective of that is that if the illegals can be made legal, profits will rise accordingly, and that's why we have DRM, etc. People approve of DRM by purchasing content. Removing it is irrelevant.

Honestly DRM is why whenever possible I still buy a physical version of media. I'd love to stop wasting resources on paper books but I read books many years after I've bought them and I don't trust DRM to work a decade or two later. I have an e-reader and actually quite enjoy it but it only gets to see library epubs, creative commons works, or out of copywrite novels.

Or users can do the obvious and stop supporting retailers who provide licensing terms you don't agree with. If everyone just stopped buying amazon eBooks I bet their terms would change faster than superman in a phone booth.

That is the incorrect step if you wish to stop supporting DRM.

The DRM is set by the publisher asking Amazon to include DRM.

I have books I put up for sale through Kindle. I left the DRM option unchecked. That's really all it is, a check box.

Publishers wouldn't put their books on Amazon at all without DRM for the most part.

If you stop buying books through Amazon because they have to offer DRM, you're not really punishing the people that are putting the DRM on the books. It would have zero effect whatsoever on Amazon's terms. If Amazon's terms, did, by some miracle, change, then their selection would be devoid of bestsellers.

How do we make things change, then? We stop buying all bestsellers and put major publishers out of business, because that is far more likely than them deciding to remove DRM. So, not a great chance.

Meanwhile, those authors and and publishers that do add their books to Amazon without DRM make use of the DRM-free tag.

We will offer this caveat, however: it’s quite possible the technique we’re about to outline violates not only Amazon’s Terms of Service, but the Digital Millennium Copyright Act as well. We are not advocating breaking the law, but we are demonstrating for non-American Kindle users how this technique can be used to safeguard against remote deletion tactics. Related laws may differ in countries around the world, so be sure to check your local situation if you’re unsure. In short, follow our instructions at your own risk.

This is interesting. Like the US, Australia has DRM legislation. Under a simplistic reading of Australian law it is illegal to break eBook DRM. (I think the law was poorly drafted and breaking these systems is legal under one of the exceptions, but there is no good case law in the area. I'm not a lawyer and this is not legal advice.) It is also illegal to make or distribute the tools for breaking DRM. Furthermore, it is illegal to publish "detailed instructions on matter of crime". See http://www.bannedinoz.com/ for an example of this. That's right folks - Australia only has freedom of 'political' speech, not freedom of speech in general. Even that is only 'implied' rather than specifically stated by our constitution.

Which suggests that publishing this information is illegal in Australia and could get Ars added to the, voluntary, blacklist that ISPs run. You could be in the illustrious company of dentists and school canteen operators...

"Everywhere people are hurting one another, the planet is rampant with injustices, whole societies plunder groups of their own people, mothers imprison sons, children perish while brothers war. O, woe."

Those of you complaining about the platform chosen need to find something to do, you obviously have too much time on your hands if the OS in the screenshot within an article running you through steps that's the same for all is what irks you.

It's not the screenshot that irks us, it's the fact that the description and method shown doesn't work on other platforms. You'd know this if you were capable of reading the comments before posting your own self-absorbed opinion.

Quote:

That said, it makes sense that they'd supply the screen shots that look the best, and OS X is prettier, regardless of how you feel about the OS.