Amazon have misused the DMCA to demand takedown of a file called azw-0.1.zip. Since I have both the archive file and a Kindle, and have used both together, I can explain what’s really going on. Hopefully this will clear up some of the misinformation floating around.

The code in the disputed zip file is written in Python. It calculates the Mobipocket PID for your Kindle, based on the serial number written on the back. You can then provide this PID to any e-book store that sells e-books in DRMed Mobipocket format. They can sell you encrypted Mobipocket e-books, and you can then run a second Python script which flips a flag in the e-book file, making it readable on your Kindle. (The flag is just one that says “This is encrypted for Kindle”; no encryption is broken.)

This works because Amazon bought Mobipocket a few years ago, and used their DRM scheme and e-book format as the basis of the Kindle’s e-book format. The basic Mobipocket format is pretty simple. It’s HTML inside a Palm OS PDB database. That’s it. The DRM just adds a layer of encryption.

So, why are Amazon upset about this?

One theory is that they don’t want Kindle owners buying books anywhere other than Amazon.com. Well, if that’s the case, they’re playing a losing game, because Fictionwise (recently purchased by Barnes & Noble) sells e-books in DRM-free Mobipocket format, which you can just drag-drop onto your Kindle.

A second theory is that Amazon don’t want people to be able to create DRM-encumbered e-books for Kindle themselves, bypassing whatever fees Amazon may be charging for the service. I don’t know how true that may be, as I have no interest in creating DRM-encumbered anything, so I’ve never investigated how much Amazon charges.

My personal theory is that the real reason Amazon don’t want people finding out their Kindle’s Mobipocket PID is a fear that people will then find out how to decrypt their DRM-encumbered Mobipocket books.

And indeed, there is a completely different set of Python scripts floating around on the web that will decrypt a Mobipocket e-book given the PID used to encrypt it. This shouldn’t be a surprise to anyone; DRM is fundamentally flawed. Clearly the e-book reader software has to have all the information necessary to decrypt the book so that it can show it to me. That being the case, it’s inevitable that the decryption code will be reverse-engineered if enough people are motivated enough to do so.

But make no mistake: the azw-0.1 files do not break any copy protection or reveal any secret codes. They just calculate the PID of your Kindle, based on the serial number that’s written right on the back of the device in plain sight. They are interoperability tools, and the DMCA explicitly allows for interoperability tools. I suspect that the EFF could take on this case and win easily.

While I’m writing, here’s a quick summary of a few Kindle myths that I see repeated a lot in coverage of the story:

  • The Kindle traps you into buying everything from Amazon.

    Not true. Even if the azw scripts were illegal, you could still buy as much DRM-free content as you liked, load it directly onto the Kindle via USB, and never use the wireless connection to Amazon at all. As mentioned above, you can buy DRM-free e-books in Kindle-ready Mobipocket files from Fictionwise.

    It’s like the iPod: you may be stuck with a single vendor for DRM-encumbered content, but you can buy your DRM-free content from anywhere. Personally, I intend to buy as little DRM-crippled content as possible, and hope that Amazon gets the message.

  • The Kindle uses proprietary e-book format.

    As mentioned above, the Kindle’s native format is a trivial variation on Mobipocket format, which is HTML inside a Palm PDB database. The open-source mobiperl tools will pack and unpack .mobi and .azw files.

    As Mobipocket’s FAQ points out, the HTML extensions and metadata are based on an open industry standard.

    Also, there are free tools from Mobipocket for creating e-books. They’re Windows-only, however, and don’t seem to work under WINE.

  • You have to get all your content onto your Kindle by sending it to Amazon.

    Wrong. The Kindle mounts as a hard drive, using Storage Class USB. No drivers are required on Windows, Mac or Linux. Your library of books appears in a folder called “documents”. They’re just .azw and .mobi files. You can drag more books into the folder in Mobipocket or ISO-8859-1 text format, and the Kindle will display them.

    If you want to read PDFs, you have three options. One is to e-mail the PDF to your Amazon Kindle e-mail address; Amazon will convert it and it will appear wirelessly on your Kindle, at a cost of 10 cents. The second option is to e-mail the PDF to your free Kindle conversion e-mail address, and have Amazon e-mail it back in mobi/azw format for you to load onto your Kindle via USB. The third option is to use free tools to convert the PDF to mobi yourself, in which case Amazon need never see what’s in your PDF.

    From my own experiments, it appears that Amazon are using the open source pdf2edit on their back end as the conversion tool. Either that, or they’re using something which has exactly the same formatting conversion quirks.

I will allow myself to buy an Amazon Kindle. But first, I must read all the books on my "books to read" shelf.

Except "Infinite Jest", the size of which makes it a prime candidate for e-book reading.

Please create the following Java MIDP application for my phone:

When you run the application and take a picture of a barcode using the phone’s camera, it decodes the barcode, and adds the item to my Amazon wish list or some other Amazon list of my choice.

If Amazon doesn’t carry the item, it should add an “unrecognized item with UPC code xxxxx” item instead.

Thanks.

P.S. Please don’t try to patent it.

I just picked up some more Christmas music from the Amazon MP3 store. For all that I like the iTunes Music Store, the Amazon MP3 store is better in every way.

First off, the selection is far, far better. I say that because I don’t buy DRM I can’t easily remove, so the iTMS’s rather anemic selection of “iTunes Plus” albums compares badly to Amazon’s library.

Secondly, there’s the format issue. For all that 256kbps AAC is theoretically better than 256kbps MP3, in practice I tend to encode with LAME’s standard preset, which averages less than 256kbps and is practically indistinguishable from CD in my personal testing. I think it’s easy to be too picky about digital audio. If I could approach my vinyl-buying self of 1983 and offer him his record library in 160kbps MP3s on an iPod, he’d leap at the chance. So given that the quality is good enough, I’d rather have MP3s I can play anywhere than AAC files I can only play most places.

Amazon have the convenience angle sorted too. In fact, it’s a little bit too convenient–it’s one click to buy an album once you install their downloader. The downloader automatically files everything neatly in folders by artist and album, and adds the tracks to iTunes when it’s done.

But enough about the technical jiggery-pokery. The actual music is what counts. First of all I picked up the Vince Guaraldi Trio’s album of music from A Charlie Brown Christmas. I’m not a jazz fan, and I’m not a big fan of the TV adaptation of Peanuts either, but somehow the soundtrack is perfect.

Next I picked up a couple of Cocteau Twins Christmas singles from a compilation. This is where digital downloads really shine–I can buy two songs for 89¢ each rather than a 4-CD compilation I don’t want.

I then went looking for quirky Christmas music, and found Tis The Season For Los Straitjackets.  I already have a Tijuana Brass Christmas album and a two different Moog Christmas albums. I’m kinda disappointed that Señor Coconut hasn’t tried his hand at a Kraftwerk Christmas album yet.  Ah well, at least there’s the 8bits of Christmas.

Also in my collection are Mark Mothersbaugh’s Joyeux Mutato, and the Illegal Art A MUTATED CHRISTMAS release. Plus, of course, a hefty dose of bootleg/mashup Christmas tracks downloaded from the web.

If anyone has any other recommendations for quirky but listenable Christmas albums, please post ’em.

Dear Amazon,

You’re so almost there with your new Kindle e-book. There are just a few minor details you need to fix to get me on board.

First of all, you need Mac support, and preferably Linux support as well, both for content creation and for reading books. There’s really no excuse for not having reader support, as you have a working Mobipocket reader in Java that will run on Mac and Linux, you just haven’t taken the time to package it up properly. The creation tools ought to be a pretty simple task to port too; a command line version would be fine. I don’t even care if it can’t apply DRM; I just want a way to be able to package up free text.

Secondly, you need to either drop the DRM, or drop the price of the books. Let’s consider a real example here. I’m about to start reading Charlie Stross’s The Atrocity Archives.

Let’s get one thing straight here: because there’s DRM, I can’t sell the book when I’m done with it, which breaks the first sale doctrine. Therefore, you’re not actually selling e-books, you’re renting them to me for an indefinite period of time, a bit like Netflix does with DVDs. I’d respect you more if you admitted that.

Anyhow, If I go the Kindle route, it’s $9.99 for the book.

Suppose I go the paper route instead. I can pick up a new copy on amazon.com marketplace for $12 plus $4 shipping = $16. When I’m done reading it, I can sell it for $9 second hand. Total cost to me = $7.

So the Kindle is more expensive, and I can’t actually buy the books. That to me is a poor deal.

Oh, sure, Kindle prices include network bandwidth… but with paper books, I had to include the cost of physically shipping dead tree across the country, and I still came out ahead. If you can’t beat the paper book price-per-reading, you’re doing something seriously wrong.

We’ve all watched the music industry flail around overcharging for DRM-burdened files and get nowhere. Learn from their mistakes. Drop the DRM, or drop the book prices to $5 or so (comparable to a DVD or video game rental, plus some markup to cover network costs) and I’ll order my Kindle tomorrow.

Update: Of course, if you gave me the Kindle for free, I’d use it to buy books from you, and look on the extra cost as a convenience fee.