Crowdsourcing

Crowdsourcing the Book Review Process: Follow Up

Two words: Thank you! Two more: You rock! Excuse me if I gush, but the response to my little experiment was, quite literally overwhelming. I haven't counted up the number of requests for review copies of Crowdsourcing, but it easily exceeds 150. And I have good news! My US publisher, Crown Business, was so impressed by the reaction that they've agreed to donate additional books to make sure that everyone who has requested a copy will receive one. So keep those requests coming! And to salt the mine, I'll also endeavor to sign each and every copy.

In the meantime, this has made fulfillment a bit of a challenge. It's one thing to throw a few dozen books into envelopes and toss them in the mail bin. It's quite another to sort through a few hundred requests. I'd hoped to send out the books today, but it looks like they'll be going out early next week instead. Rest assured, however, they'll be on their way soon.

Most importantly (for my purposes, at least), I think we now have a solid basis to judge the efficacy of this little experiment. I've received book reviews in some major publications, including the London Times, the Financial Times, the Miami Herald, the Philadelphia Inquirer and, to my great delight, a very positive notice in this week's issue of Business Week. The reviews certainly helped sales, but none drove the kind of spike that publishers like to see. The question that will presumably be answered in the coming month is whether this grassroots approach—leveraging the long tail of reviewers—will have a greater or lesser impact than the mass media.

In Search of the Long Tail: Crowdsourcing the Book Review Process

Today I received an amusing email:

Dear Mr.Howe,
How are you today? I hope you are doing great! I just saw a copy of your book at Barnes & Noble. I read the inside cover and thought you're really onto something and would like to buy it, however I'm getting laid off at the end of the week. I was wondering if you had an extra copy you don't need that you can mail me one to my house. I would really appreciate it a lot.
I hope to find a job soon.
Signed, Christopher Aguirre

My initial thought was, "Sorry about your job buddy, but actually, well, no. I sell these books of mine. It's how my publisher makes money." But as it happens I just received a few dozen copies of the Crowdsourcing Book on Tape. These come on top of a few dozen copies of the UK edition of the book, which arrived on top of my stack of unused galley copies and finished hardbacks of the US edition. In other words, I'm swimming in copies of a book bound for the pulping machine. Which gave me an idea.

The whole point of giving away advance copies is to generate buzz and, ideally, press. We identify individual writers and bloggers we think will be interested in reviewing the book. Then we send them a book, unbiden, and hope for the best. But if you think about it, this is a pretty antiquated system, and neglects the long, long tail of reader-bloggers that are really responsible for driving a book's popularity. Why not turn this equation on its head, and ask the crowd whether they'd like to review the book?

So that's what I'm going to do. While supplies last, I'm willing to send you a copy of the US, UK or audio version of the Crowdsourcing book. All you need to do is post a comment containing your address, a link to your Website and your good faith testament that you do intend to read and review the book, and I'll zip one off to you. **UPDATE: You must provide an URL to an existing blog, or otherwise specify what forum in which you'd like to review the book. We’re crowdsourcing the book review process, not the book reading process, which is, if you think about it, pretty crowdsourcey already.**

And yes, I did send a book to Christopher. Let's all wish him luck with his job search.

Chapter 8: What the Crowd Creates: How the One Percent Is Changing the Way Work Gets Done

We have a deadline! I have to file all the comments for the book a week from Friday. Expect the next postings to come fast and furious. Once again: I'm posting excerpts from my book on crowdsourcing to Crowdsourcing.com in order to elicit comments about its content from readers. The most trenchant of those comments will be gathered into an appendix that will be published as a chapter in the book. Here's the last sections—the denouément, if you will—to Chapter Eight:The Price of Being a Pioneer

The Price of Being a Pioneer

If I sound sympathetic to the predicament Current TV faced in its first forays into crowdsourcing, it’s because I spent the first half of 2007 making the same mistakes. In that time I helped run an experimental journalism project called Assignment Zero, an attempt to use crowdsourcing to conduct an extensive, far-reaching journalistic investigation. It was a pioneering effort and it’s true what they say about pioneers: They’re the ones with arrows in their backs. In the end, I came to think of Assignment Zero as a highly satisfying failure. On one hand we failed to meet our optimistic goals; on the other hand, by charging heedlessly into uncharted territory, we learned a great deal about how the crowd can come together to create great journalism. The basic principles behind successful crowdsourced journalism aren’t much different than those behind successful crowdsourced television or photography.

Assignment Zero was a joint effort between Wired and NewAssignment.Net, the experimental journalism initiative started by New York University journalism professor Jay Rosen. In early 2006 Rosen began conceiving of a journalism project that would involve both professional and amateur contributors. But Rosen needed funding to staff up with the professionals he would need. Later that year he flew to San Francisco to meet with Evan Hansen, the editor-in-chief of Wired.com. Newly acquired by Condé Nast, Wired.com was looking to experiment broadly and boldly, particularly in the realm of so-called “citizen journalism.” It was a fortuitous meeting, and together the two created Assignment Zero, indicating the nascent character of citizen journalism. The aim was to have a crowd of volunteers write the definitive report on how crowds of volunteers are upending established businesses, from software to encyclopedias and beyond. We would use the crowd, in other words, to cover crowdsourcing. Having coined the term in a June 2006 Wired article, I was brought in as a consultant. We launched in March 2007 with the intention of producing 80 feature articles—enough to fill a dozen magazines—over the course of 12 weeks. The result, we wrote when launching the project, would be "the most comprehensive knowledge base to date on the scope, limits and best practices of crowdsourcing." We would post the features on NewAssignment.Net, and run a selection of the best stories on Wired.

Chapter 8: The Interlude ... User-Generated Content in History

The wonderful thing about writing a book (It's nice to know that sentence has appeared more frequently in this blog than, "The awful thing about writing a book") is that there's no one to tell you not to devote a few thousand words to idle speculation. A big theme in the Crowdsourcing Book is that the rise of amateurism is hardly some unprecedented effect of our current techno-historical moment, but in fact the manifestation of a universal human impulse that our current array of technologies just happens to serve. In other words, as much as things change, so they stay the same. I explore this in several parts of the book, including this bit from Chapter Eight:

Before You Know Where You're Going, You Have to Know Where You've Been

There was a time when almost all culture would have been considered “user-generated content.” Earlier I noted that many of the greatest artistic and scientific achievements were made by people we would now call amateurs. But even this observation diminishes the contributions made by the forgotten part-time poets and Sunday painters who created glorious, if ultimately ephemeral, works that were valued in their day, even if only by their close circle of acquaintances.

Before the rise of mass reproduction—the era in which photography, film, the phonograph, and the radio gave rise to the commoditization of cultural products— there was far less of a distinction between audience and creator. The centuries preceding the industrial era were characterized by a more complex and interactive relationship between creators and their audiences. New musical compositions were distributed as sheet music, which could then be interpreted according to regional preference and individual whim. In what was still a largely agrarian society, popular entertainment of the Victorian era took the form of regional theaters, church sermons, Saturday dances, and all manner of parlor games. Entertainment was a private—or at most a regional—affair comprised of people entertaining one an- other. There were very few cultural products that we would describe as “hits” by today’s standards.

This changed quickly and dramatically with the rise of modern technologies such as the phonograph, the radio, and the cinema. The mass production and distribution of culture required—indeed enforced—a more passive form of consumption. A division emerged between culture producers and culture consumers. Viewed in this historical light, the explosive growth in user-generated content is less a new phenomenon than a sign that the im- pulse to interact meaningfully with our media—to participate in its creation—never went away. The Internet—the very architecture of which enforces decentralization— created a natural stage for a participatory approach to media production and consumption. Indeed, the booming genre of online “fan fiction,” in which readers craft new plotlines to everything from Star Trek to Harry Potter, is just a modern manifestation of the ancient, oral tradition of storytelling, in which each teller reinterprets the story.

Long before the emergence of the World Wide Web in 1994, the Internet took the form of a many-to-many communication vehicle, first through e-mail and then through Usenet groups, which were simple, all-text fore- runners of the sorts of discussion forums one can find on nearly any community website or in a venue like Yahoo groups. Naturally, the first people to use the Web were those already familiar with the Internet, so early web- sites followed a similar model, which again prized the contributions—even if these consisted, as they do today, of mostly overheated opinions—of the individual. On the Internet, the least-visited blogs and the largest corporate marketing site occupy the same cultural real estate: both are just one click away.

More than just an effective cost-cutting strategy, crowdsourcing holds the potential to spawn for an economy in which we aren’t all forced into predetermined categories, where boys with high math scores aren’t routed toward engineering schools and girls with fanciful approaches to their science projects aren’t cheerfully encouraged to focus on the humanities. In the summer of 2006 I spent a few days wandering around the moveable punk-rock feast known as the Warped Tour. This is no mere subculture; the Warped Tour is attended by close to a million people each year. Above and beyond being a showcase for scores of mostly unknown rock bands, the Warped Tour provides space for a bustling cultural commerce that operates out of kiosks and tents constructed around the fringes of the stages themselves. I’m not sure any experience before or since has given me quite as much faith in the future of mankind. Many of the musicians here also wrote books of poetry, or ran little tattoo parlors, or operated websites. The point is that these kids didn’t feel a need to describe themselves as a practitioner of one craft as opposed to another. They made stuff be- cause it turned them on. Those kids have a message for all the lawyers who like to paint and the painters who like to conduct backyard bird counts and the computer programmers who like to teach and the teachers who like to program: The future has a place for you. In the future, we will all be dilettantes.

Chapter 7-What the Crowd Knows: Collective Intelligence in Action, Cont.

Amsterdam: Wow. The Dutch know their crowdsourcing. I spoke yesterday to an audience of 350. I wanted to know who I was dealing with. I'm pretty accustomed to speaking to people who've never even heard of the term before. "Who's heard of Threadless.com?" I ask. Almost every hand goes up. That's okay, I figure, Threadless is an international sensation at this point. "Who's heard of InnoCentive?" Now I've got them. Outside of the sciences, almost no one I talk to has heard of InnoCentive. Two hundred hands shoot up. I was impressed, and a little intimidated. That said, the program was a smash, from my perspective anyway. The audience asked detailed, provocative questions and my hosts were gracious, witty and incredibly generous, treating me to a dinner both wonderful and wonderfully leisurely, in the proper European manner. But now I'm back, and so, I hope, are you. Below please find the continuation of Chapter Seven:

Marketocracy: Collective Intelligence Improvised

Think of TJ White as the argument for diversity, personified. In 1999 not many investors would have picked White as a candidate to manage their portfolios. Up to that point White had spent his life accumulating a lot of experience doing very little. He was an unremarkable student at his Midland, Texas high school. He signed up for an unremarkable six-year stint in the US Navy, followed by another six-year stint in Colorado pursuing what he calls his “second childhood,” working a series of jobs meant only to “support a lifestyle” that revolved around skiing and gold prospecting. He excelled at neither. One morning late that year White woke up, looked out at the parking lot outside his one-bedroom apartment and had a moment of clarity. “I was a loser. I was 30, and I had nothing. No skills, no college, no career.”

A few days after New Year’s Day 2000 White moved to Dallas, and the puzzle pieces started falling into place. He quickly found a job at a Home Depot not far from his house. “The manager was ex-Navy, and we hit it off,” White recalls. A few weeks after that he met the woman who would become his wife, at a get together of the Tall Texans of Dallas. “I stumbled across the Website when I first moved to Dallas,” explains White. “I’m six-foot-two, and Cheri’s six-foot-two. We got serious pretty quickly.”

Chapter 7-What the Crowd Knows: Collective Intelligence in Action, Cont.

I'm in a mad dash for the airport. Palo Alto speaking gig today, then Amsterdam tomorrow, then all the way back to LA next week. This would all be terribly thrilling if I was 27. At 37 it's exhausting. Still fun. But exhausting.

Great comments from the peanut gallery, including a few deserved dressing down (How do I expect to elicit comments when I don't respond to them. I'd blame kids and book, but believe I may have played that card too often already.) At any rate, here's the continuation of Chapter Seven.

Investing in the Future—Prediction Markets

In 1988 the civil rights activist Jesse Jackson shocked the nation by winning the Democratic primary race in Michigan, an outcome that neither polls nor political insiders had anticipated. At the University of Iowa, a handful of political scientists and economists had a very pragmatic reaction to the failure of the polls to predict Jackson’s victory: They decided to build a better system for predictions. Over the course of the next several months, and well in time for the general election between George H. W. Bush and Michael Dukakis, they created the Iowa Political Stock Market. Investors could buy up to $500 in securities that paid out according to the share of the popular vote each candidate received. Shares were priced between $0.00 and $1.00, and were paid out in full. If you snatched up Bush shares when they were running at 55 cents, you’d have made 45 cents for every share you purchased.

By November the results came in. The average error among all the major exit polls in the general presidential election that year was 2.5 percent. Not bad. But the Iowa Political Stock Market did much, much better, predicting the outcome to within one-tenth of a percent. “While the laws of statistic govern opinion polls,” said Robert Forsythe, one of the market’s creators, “the invisible hand of Adam Smith makes political markets work .”

Chapter 7-What the Crowd Knows: Collective Intelligence in Action

Whereas Chapter 6 explored the theory of collective intelligence, Chapter 7 looks at how collective intelligence is being employed in real-life crowdsourcing examples.

In the late fall of 2004 Karim Lakhani, a PhD candidate at MIT’s Sloan School of Management, was suffering from a common affliction among graduate students.  “I hit that point where I just couldn’t stand to spend any more time on my own dissertation,” recalls Lakhani. He’d been analyzing how innovations emerge in open source software, but after four years of work, he was burnt out. It was time for an extended vacation. “I stopped everything and read Neal Stephenson’s Baroque Cycle.” Stephenson’s trilogy is a work of historical fiction about the Age of Enlightenment in Europe, and it made a big impact on Lakhani. “It’s all about the establishment of the Royal Society and the dawn of rational thinking about the world and the invention of calculus.” By Lakhani’s lights, the Baroque Cycle was a narrative history of innovation.

One passage in particular caught Lakhani’s attention. Stephenson related the true story of the longitude prize. In 1714 the British established a commission offering 20,000 pounds (roughly $6 million today) to anyone who could solve the mystery of longitude. The Royal Navy’s inability to measure lateral progress across the oceans had resulted in the loss of untold numbers of ships and their cargoes, causing a serious drain on government finances. “The top scientific minds of that time, including Isaac Newton, had tried to find a device that could determine longitude, and none succeeded,” notes Lakhani. The solution—a clock that operated with superb accuracy, even during the rigors of an overseas voyage—was developed by John Harrison, an uneducated cabinetmaker from Yorkshire. “I read that and thought, ‘Huh. Kind of like open source. Someone poses a problem and all sorts of random, strange people show up and say I’ve got an answer for you, and it’s never the one you’d anticipate.” The longitude prize constitutes the earliest known example of crowdcasting—broadcasting a problem to the widest possible audience in the blind hope that someone, somewhere—maybe even a Yorkshire cabinetmaker—will come up with a solution.

Chapter 6: The Most Universal Quality—Why Diversity Trumps Ability, Cont.

When A Crowd Isn’t a Crowd

Diversity is essential to animating the collective intelligence that emerges in models like the MATLAB contest, but the existence of diversity isn’t enough. It must also be maintained. Get enough people together—be it in a bar or a chat room—and a mysterious dynamic kicks in. People either accentuate their differences and polarize into opposing camps, or they downplay their differences altogether in order to reach a consensus. Both phenomena have the same net effect: the diversity within the crowd is diminished. Humans have evolved over many millennia into highly social creatures. In many circumstances, our ability to reach an amicable agreement meant the difference between life and death: “A mammoth is charging. Shall we run or poke him with our spears?” But when collective intelligence is in play, as it is in such crowdsourcing models as information markets and problem-solving networks, consensus is an undesirable outcome.

In 2004 James Surowiecki published The Wisdom of Crowds: Why the Many Are Smarter than the Few and How Collective Wisdom Shapes Business, Economies, Societies and Nations. The title of Surowiecki’s book is a winking reference to Charles Mackay’s 1841 classic, Extraordinary Popular Delusions & the Madness of Crowds , a stern indictment of the herd mentality that lead to such disasters as the Dutch tulip mania. (Needless to say, the term crowdsourcing owes a debt to both authors.) While theories of group intelligence pre-dated Surowiecki’s book by decades, and in fact had recently come back into vogue in fields as disparate as sociology and business management, The Wisdom of Crowds captured the popular imagination in a way no other work on the subject ever had. The book contained an array of persuasive examples in which the crowd proved itself wiser than its smartest member. How did a crowd of fairgoers in rural England guess the weight of a prize-winning steer within one pound? How did a classroom of students guess the number of jelly beans in the jelly bean jar? How did the audience for the game show Who Wants to Be a Millionaire consistently beat the experts? Through the wisdom of crowds. Such anecdotes have acquired an almost magical patina, entering the collective imagination and becoming fodder for cocktail conversation and water cooler discussion. Unfortunately they were shorn of Surowiecki’s careful analysis.

Urgent Appeal! Crowdsourcing.com in Search of the Crowd

Let's call a spade a spade: I'm a terrible blogger. Or at least, I've found the demands of a (young) family and (merciless) book to be incompatible with the kind of constant attention a healthy blog requires. The predictable response is that traffic fell off last year while I concentrated my efforts on the book at the expense of the blog.

While I look forward to putting the blog back on the front burner in a few weeks when I've given my publisher final changes to my book, that will be too late to make my own little crowdsourcing experiment a success (For late arrivals, this consists of publishing excerpts of the book on this blog, then collecting the most incisive, witty and informative of the resulting comments in an appendix that will be published in my upcoming Crowdsourcing Book). The problem: Too few comments and, more to the point, too few commenters. This is a shame because I'm confident that given enough eyeballs this limited but, to my mind, significant act of crowdsourcing would constitute a nifty new model of book publishing. Why, in this age of instantaneous publishing, should critics wait until the publication of the book to make their views known? Wouldn't the reader be better served by being able to encounter multiple viewpoints in one handy volume? Or at least that's my three-quarter-baked idea.

At any rate, I'm not only asking you to start reading and writing on crowdsourcing.com, but also to spread the word. I know at least a few of my regular readers write influential blogs of their own. If you support my effort or even—especially—if you think my ideas deserve a good old fashioned literary beat down, lend me a hand.

Chapter 6: The Most Universal Quality—Why Diversity Trumps Ability

I'm out of town visiting family this week, but stole a few minutes away at the local library to post Chapter 6. This chapter begins the second section of the book, which explores Crowdsourcing in action (as opposed to the first section of the book, which is devoted to the conditions that made crowdsourcing possible-nay-inevitable. For anyone just tuning in, I'm hoping to collect critical comments on these excerpts, which will then be published in an appendix in the crowdsourcing book due out this July.

Chapter 6

“There were never in the world two opinions alike, any more than two hairs or two grains. Their most universal quality is diversity.”        — Michel de Montaigne

Looking for a diversion one winter evening in 1995, Caltech professor Scott E. Page built a computer model in which “artificial agents”—little computer programs that interact according to rules written into their computer code—tried to solve a difficult problem. Such computer simulations are helpful to economists because they provide a controlled environment in which to test how humans, that most unpredictable of species, interact in complex systems like financial markets.

Page ran his simulation using two groups of agents. One was meant to represent the best and the brightest possible solvers—we’ll call this the Mensa group. The other group was composed of agents with a wide variation of problem-solving ability—some of the agents were talented, but many were not. It was as if he’d stopped by the faculty lounge at a mid-tier university and culled out everyone wearing brown socks. To Page’s great surprise, the brown socks outperformed the Mensa agents. As a random collection of mathematicians could hardly be expected to outperform Mensa’s best minds, Page decided to fiddle with his simulation, changing the rules by which the agents interacted. He got the same result. Still incredulous, he rewrote the program in a different computer language. The brown socks still won, over and over and over again. Page wanted to know why.

What began as a study break blossomed into a decade-plus research project, culminating, in 2007, with a book entitled, “The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools, and Societies.” By applying logical rigor and mathematical precision to collective intelligence, Page has created a theoretical framework to explain why groups often outperform experts. Why did the brown socks beat the Mensa agents so consistently? The brown socks weren’t as talented as the Mensa members, but they had something better: Diversity.