November, 2007


27
Nov 07

Mozilla & Firefox Market Share

This is a super-long post, so I’ll start with the punchlines:

  • We think there are at least 125,000,000 Firefox users in the world right now, give or take. That represents a doubling since Firefox 2 was released a little over a year ago, and significant growth in every country.
  • At Mozilla we view market share as an important quantitative metric that can help us ask smarter questions and build better products, but it’s only one of many
  • We have systems here that tell us approximate number of daily users, and use that information to inform much of what we do.

This is the first of many posts that I’d like to write (and see others write) about the data that we’re seeing about how people use the web. I’ll come back to some of the basic concepts frequently, as they’re building blocks for some of the ways we look at the world.

One of the most interesting things about Mozilla is figuring out how we’re doing, and where to focus and spend time. We look at many indicators; some of the most important are things like the health of addons.mozilla.org, the volume and quality of community contributions to our platform and products, and the vitality of Mozilla-related discussions in the blogosphere. 2 other more numerical indicators that we track are Firefox market share (sliced a number of different ways) and the raw number of users of Firefox.

Lots of people report market share for Firefox — it’s a succinct indicator of momentum in the market and with users, and makes a great headline to report that we’re eating IE’s share worldwide, or have exceeded 30% in Germany, or have tripled our share in China this year. And by any account, our market share everywhere is growing — extremely quickly in places like Spain and China and Brazil, somewhat more moderately in the US and Japan — but growing in every locale around the world.

But let’s go back a step: Mozilla (in all forms, including the Foundation, the Corporation, etc) is a public benefit endeavor, with the primary mission of keeping the Internet open and participatory. So why would we care about market share, something that’s traditionally associated with shall-we-say less mission-oriented motivations? In my view there are at least 3 basic reasons that we care (and probably many more):

  • It’s one indicator for how we’re doing, how people like the products that we offer, and how well we’re communicating. Not the only indicator; not the most important; but a significant indicator, nonetheless.
  • It helps us ask questions that let us support our mission better. Including these (but there are many, many more):
    • Why is our market share so high in Europe compared to the US?
      (50% higher, and more in some countries) Understanding why some countries exhibit higher usage than others can provide pointers to how to build a more relevant product for more users, and how to communicate about the product.
    • Why are so many people in China using the English version of Firefox?
      (as much as 20%) Is it just that people use English for business? Is there some perceived difference? Understanding this can help us make both our Chinese language version better and even potentially our English language version for folks using it in China.
    • Where can we use market share most effectively to help the spread of Web standards? (everywhere but Korea, for the moment)
  • We believe Firefox is a superior product, and so we want as many people as possible to use it, or at least know there’s a choice. While I’m happy that there’s increased innovation in the browser space lately, I think that Firefox has the very best blend of features, extensibility, and simplicity, not to mention the fastest security patching in the industry, by a longshot.

But market share reports have issues. The most basic issue is that there’s no way to really represent the complexity and the dynamism of the global Web — it’s just too big, with too many things changing too rapidly. Different studies have different biases: some are oriented towards early adopters (like W3Schools, who reports Firefox at 36%), some (like XitiMonitor) will bias towards European properties, and currently all studies undercount or neglect usage in Asia, South America and Africa (all admittedly tricky to characterize usage in). Don’t misunderstand: all of these studies are extremely useful and help understand what’s happening around the world. I’m just asserting that it’s very important to understand the limits of particular studies and the assumptions that are baked in.

We also look to data from individual sites to help us understand Firefox usage. Historically we’ve skewed very high on techie sites and early adopter sites — for many Silicon Valley startups Firefox use represents well over half their traffic for a significant part of their early life. Conversely, we’ll tend to see lower-than-average Firefox usage on some of the more mass market populations. It’s been hard for us to share this type of data broadly because of the idiosyncratic nature of what we see, and because most of this type of data is shared with us with the understanding that we’ll not republish. But on the whole, the data that we’re seeing shows Firefox at something like 19-20% worldwide on sites that we consider mainstream.

There’s another, subtler issue here: most of these measures are in page views, not users. (This makes sense, as by and large, the thing that folks are trying to track is market share of web properties, not the applications that you use to get to them.) As hard as it is to get an accurate read on worldwide traffic numbers for Firefox, it’s even harder to figure out the relationship between page views and users. We have some intuitions here, supported by anecdotal evidence, that Firefox users look at more pages and do more searches than typical users, but nothing that I’d actually call science.

So in addition to these indicators, we also use our own systems to get a sense of the number of actual Firefox users there are in the world (using each language version).

At present, we believe there are at least 125,000,000 Firefox users in the world, give or take.

Here’s how we get to that number. Firefox uses a system that we call AUS (Application Update Service) to keep itself up-to-date with security patches & such. Around once a day, Firefox will ping Mozilla servers to see if there’s a new update available, and if there is, it’ll present an option to users to download and install it. (AUS really deserves a longer posting — the ping is non-identifiable, respecting user privacy, and is one of the major reasons that the Firefox user base, as large as it is, is nearly all using the most recent, patched version at any given time.)

We count those pings, categorized by language version of Firefox, so we have a rough indication for any given day about how many instances of Firefox were running. (It’s decidedly rough — part of that is algorithmic, part of it is due to Firefox running in enterprises behind firewalls or other complex topologies, and part of it is usage based, depending on how people start and stop the application.) It’s rough, but it’s close, and we’ve kept track of the numbers over the past couple of years, since we released Firefox 1.5 (the first Firefox that included AUS). We call these Active Daily Users, and it’s a measure of the successful pings in a given day. Here’s a chart of Active Daily Users over the last year, since we released Firefox 2 at the end of October 2006:

Firefox AUS Since FX2

What that says is that averaged over a 7 day period, we’ve gone from 23M Active Daily Users in October 2006 to 42M a couple of weeks ago. (And we actually hit 48.8M yesterday, an all-time high that shows continued strong growth over the last few months.)

To get from the ADU number to our whole worldwide number of users, measured in terms of uniques in a given month, like most every web site does, we multiply ADU by 3. So for a couple of weeks ago, with 42M ADUs, we compute that we have something in excess of 126M unique monthly users.

This is a conservative multiplier (we think it could be more like 3.5) that we’ve gotten to by doing some of our own experiments, piecing together data we’ve received from sites who have done their own calculations, and then really testing them against the best common sense top-down tests we can. Here’s one: take our estimate of monthly users (126M) and divide by the whole number of Internet users in the world (Internet World Stats puts the current at 1.2B)  — you end up with about 10.5%, which is lower than most reports of our global traffic share. You can do a bunch of mental gymnastics from there to account for higher-page-views-than-average for typical Firefox users, an overcounting of usage worldwide, etc — but for our purposes here at Mozilla, we use a multiplier of 3 to approximate the number of worldwide Firefox users.

But, really, the absolute number of users around the world is less important than the trending. Are more people finding their way to Firefox? (yes!) How about in Brazil? (yes again) What happens over holidays? (people don’t use their computers as much — yay!) What happens when we do security updates? (usage goes down as anti-virus software updates get propagated, but recovers over the following week or 2)

Phew. That was a longer post than I thought it would be. More to come on topics like the annual autumn surge in usage, huge growth in China and Spain this year, and others.


27
Nov 07

The Decline of Reading

As anyone around me can attest, I’ve been a little bit obsessed with Amazon’s Kindle lately. I’m interested in most everything about it — the form factor, the publishing industry, the readability, the tactile loss of books, the comparisons to the iPod economy — on and on. I’ve also been thinking a lot about Sunnyvale’s 50 year old library and our electorate’s reluctance to build a new one. And on a personal level I’ve been noting that while when I used to travel I’d read several books each trip, increasingly I’m watching videos and listening to music instead. And then I read a book called The Terror Presidency, by Jack Goldsmith, former top lawyer at OLC and the guy who overturned the infamous “torture memo” — and was reminded how seldom we see long-form arguments anymore — that we most often get our news and public discourse in headlines, Daily Show gags, and the front page of the Times while waiting in line at Starbucks.

Anyway, I’ve been worried about reading of late — both my own (although I’m still doing fine, and have about a half dozen books to blog soon), and our society’s. The National Endowment for the Arts just published a collection of studies which indicates some bad news on this front. A few bits:

  • Less than one-third of 13-year-olds are daily readers, a 14 percent decline from 20 years earlier. Among 17-year-olds, the percentage of non-readers doubled over a 20-year period, from nine percent in 1984 to 19 percent in 2004.
  • On average, Americans ages 15 to 24 spend almost two hours a day watching TV, and only seven minutes of their daily leisure time on reading.
  • Literary readers are more likely than non-readers to engage in positive civic and individual activities – such as volunteering, attending sports or cultural events, and exercising.

Disquieting for me, at best.


20
Nov 07

more thoughts on kindle; missing the point

I’m reading more and more reviews of the new Amazon Kindle that I think are missing the point. A few more thoughts here:

– I’m a very heavy reader — I’ll buy/read/skim between 100 and 200 books a year, give or take.

– I have a lot of books in my house — thousands, easily. And they’re heavy, take up a lot of space, and are made from a lot of trees.

– I like the physical nature of books and magazines for a few different reasons. I use books that I’ve purchased but haven’t read like a “to do” list of what to read next. Sometimes books take me a year or two to get around to reading, but their presence on my “unread” bookshelf reminds me that I’m interested in it. I also sometimes like looking at my favorite books on my bookshelf, sometimes rereading them. I like the physicality & visual nature of magazines better than I like the physicality of individual books.

– While I don’t always re-read books — and, in fact, nearly never do — I love loaning them out. I don’t generally care whether I get them back, except in a few special cases.

– When I travel anywhere, I always take at least 2 books with me — one fiction and one non-fiction — and often take 1 or 2 more, depending on my mood. They’re heavy.

– While Amazon isn’t my favorite store (they used to be, but now I find them more like Wal-mart in attitude than I’d like), I do end up buying most of my books from there.

That stuff is all background — here are my thoughts now:

– I’m going to get a Kindle. I’ve been dying for an easy-to-use ebook with titles that I read. I need to check more closely, but think that something like 80% of the books on my “to read” shelf are available. That’s a new development. In particular, the 3 ~1,000 page books on my shelf (the new Halberstam on Korea, the new Winik on the 1780s, and the new Follet on the Middle Ages) are available.

– I think they’re taking the exact playbook from Apple/iPod/iTunes Store, and it’s crappy, on the whole. For one thing, there’s no mass of unprotected ebooks like there was unprotected mp3s — so you’re locked into Amazon’s store much more than the iTunes store, even. Really sucks. Crappy that you can’t share at all, loan them to others, print them. And unlike music, there’s no good way to rip the books that you have, putting them into your library.

– The pricing is an absolute breakthrough, and could do to the publishing industry what iTunes pricing has done to music and (hopefully) videos. That’s fantastic.

– To folks who have said that iPhones/iPods/music players are just as good: not a chance. Luminous LCD screens are not like eInk, which has the optical properties of paper. Not a chance that I could read a hundred or two hundred pages at a time on an LCD screen, but very doable with eInk.

– It’s absolutely ugly as hell. No getting around it. Very unfetching.

– I’m starting to understand why they put on a keyboard — for buying and searching, mostly — but think it’s not a completely necessary component. I’d prefer a smaller device or a larger screen. But we’ll see.

– I’m not sure the wireless was necessary. I tether my various iPods to my computer all the time – and since I only get a few books a week, that would work fine.

Bottom line, though: this isn’t the ultimate eReader — absolutely, and of course. But it will make my own life a lot better in many ways, and I don’t mind not having the physical books — and I actually like it. I hope that this evolves in a less proprietary way than, say, video, where we’re all screwed, but think that this offering is a first step in that direction.


19
Nov 07

kindle

well, i think i’m asking for a kindle for christmas. i’ve been dying for an e-reader for a while now — i carry sooooo much extra poundage around when i travel — always 2 or 3 books, just in case my mood changes, i finish the one i’m reading, etc. so this is a really welcome development.

2 things stand out: (1) pricing — at $9.99 or less, ebooks are finally at a price advantage (the way that they should be) — with a $400 kindle price, i’ll recoup that investment after buying about 40 books, or what i do in a year, more or less, and (2) title availability — i’ll do a scan of my “to read” bookshelf when i get home, but first glance suggests that 80% of what i read is already available on Amazon. pretty good.

it’s not perfect, i think. first of all, it’s incredibly ugly. ugh. second, i don’t think my books, on the whole, really need a keyboard. whatever. the wireless is neat, but as my canuck friends pointed out, it’s US-only, which is a bit of a drag. (although, to be honest, this is a theoretical bad thing to me, but not really a practical one.)

other things: screen looks like it probably could be bigger; don’t think their $13.99 NYT monthly subscription will compete with, um, free on the web. their ability to view .docs and .pdfs is dumb — you have to pay amazon to translate them into kindle format. bah.

so far it’s looking at lot like apple/iphone/itunes. super-great functionality, great pricing, completely closed technology & stack, locking you to this vendor.

i’ll say this: my media consumption habits are changing very very quickly now, across the board. if we can get this stuff to evolve more like the web and less like wireless carrier locked environments, life will be really good. pretty big if, though. (actually, i think it’s a “when,” not an “if,” but a with a potentially long timeline.)


15
Nov 07

The Gum Thief, by Douglas Coupland


One of my favorite authors, but I didn’t really care for this book too much. Coupland is one of the best writers in the world at point of view — this story, like Hey Nostradamus, which I liked a lot — is written from many, many different points of view. The way he does it is amazing — craft is in evidence here for sure. Lots of points of view within points of view (i.e. characters writing from other characters’ points of view). But at the end of the day, I didn’t care much about the characters, so the book was a disappointment for me. Hopefully next time.