I've worked on, or tried to work on, six crowdsourced journalism projects prior to Assignment Zero. Here are brief accounts of these projects, along with my evaluations of their strengths and weaknesses and an overall evaluation for each.
(This assemblage is by no means well-rounded; it contains no high-profile - and highly successful - investigations involving Department of Justice document dumps, male escorts or Munchausen by Internet cases.)
1. DeLay Rule Exit Poll
2. DeLay Rule Exit Poll Sequel
3. Bayosphere
4. Polling Place Photo Project
5. Earmarks Project
6. No More Blather*
-------------------------------------------------------------------------------
1. The DeLay Rule Exit Poll
November 2004
The DeLay Rule Exit Poll project was perhaps the first crowdsourced journalism project instigated by a popular blogger. After the House Republican Caucus had decided - via a voice vote, thus circumventing accountability - to change their rules in order to permit the Speaker of the House to keep his post even if indicted*, Joshua Micah Marshall of Talking Points Memo asked his readers to help compile a record of how their congressmembers had voted on this change; he asked them to contact their Republican representative's office, ask how the Rep. had voted, and report back, either by email or here at the Daily Delay.
This was a straightforward, clearly specified, easily 'chunked' project, with a clear, accountability-enhancing goal: exposing which representatives had taken a questionable action, one characterized by Rep John Dingell (D-MI) as facilitating "a work release program for the ethically challenged." *
Marshall's readers responded in droves, and the collected results were compiled into a database; information was registered from contacts with 170 Republican congressmen, of which 86 were willing to give straight yes-or-no answers.
What went well:
As the Daily DeLay Exit Poll post's 138 comments make clear, this project engaged readers, who held Congressmembers' feet to the fire and put on the record valuable information that would otherwise have remained hidden.
What didn't:
* Data gathering was low tech and potentially haphazard: results were apparently gathered from email, from comments at the Daily Delay, and from comments at Daily Kos.
* The data "scoring" in the results was not fully consistent: my congressman's vote was scored as "unknown" rather than "refused", although his office had reportedly been unwilling to give an answer.
* The accumulated results ended up on three different webpages at three different URLs: a defunct page at PC Action Fund, and two pages still functional as of May 2007, at USDLogic.com and CampaignMoney.org.
* It's not clear whether or how one can add newly acquired data to the results.
(But updating would become a can of worms if, as seems likely, each site contains its own copy of the data.)
Factors likely affecting participation:
Plus: This project had:
* a clear, desirable goal with partisan, ethics-enhancing consequences;
* clear and simple steps to contribute;
* a clear way to report contributions.
How the project could have been better:
Archiving the results at a site with a curator and continued maintenance; any project involving gathering information for posterity becomes more valuable when it:
* enables continued data gathering, if the results are currently incomplete
* ensures that a permalink to the results won't undergo linkrot; the data should remain available at that URL.
What I didn't contribute:
When my congressman finally revealed his vote in February of this year*, I wanted to add it to the database but could not find a way to do so.
Overall outcome: Success
-------------------------------------------------------------------------------
2. The DeLay Rule Exit Poll - The Sequel
April 2006
Sixteen months after his original DeLay Rule Exit Poll, Marshall proposed a sequel project, revisiting the DeLay Rule and tacking on some questions regarding the Ethics Committee purge*:
"Over at TPMmuckraker.com, we're going to be posting links to which members of the House GOP caucus voted for the DeLay Rule. We're also going to be posting constituent letters various members of Congress wrote supporting the DeLay Rule and seeing whether they still stick by what they said.
...Relatedly, there's the purge of the Ethics Committee and the change in the ethics rules (both to protect DeLay).
Where does your Republican member of Congress stand on those questions now?
Don't know? Why not give them a call?
Did they support the purge of the ethics committee in January 2005?
Did they vote for the DeLay Rule in November 2004? ...
We've got a list of what they told their constituents then. What are they saying now?
Join in. You can play from home."
What went well:
* It was an interesting idea, building on a previous successful project.
What didn't:
* To my knowledge, results were not published.
Factors likely affecting participation:
Minus: Insufficiently clear specifications - both for collecting the data, and for reporting it.
How the project could have been better:
* More clarity
* Follow-up posting of the results, and perhaps memory-jogging reminders/requests for readers to help, might have increased participation and the value created by participating.
What I didn't contribute:
* Inability to get answers from my congressman's office made it difficult to participate in this project.
Overall outcome: Learning experience
-------------------------------------------------------------------------------
3. Bayosphere
Spring 2005
Bayosphere was designed as a different type of crowdsourced journalism project: a venue, not a coordinated effort. It was to be a site for citizen journalist reports on subjects "of, by and for the Bay Area" and for discussing related topics with others.
What went well:
The idea was fresh and new; it blazed new ground.
What didn't:
* The site was unfocused and the content unedited; while the content was billed as journalism relating to the Bay Area, in practice it was all over the map, both in geography and in quality.
* The participants were largely left without guidance; questions about doing journalism often went unanswered.
* Content was unedited.
Factors likely affecting participation:
Minus: There was no real benefit to joining the site; it was basically a blogging platform and discussion forum only.
How the project could have been better:
More structure, a narrower focus, and more editorial support for contributors.
(also see Dan Gillmor's Bayosphere postmortem, and an excellent followup by Hillary Johnson.)
What I didn't contribute:
I had wanted to write up a story on a partisan talk radio show host's faulty reliance on a partisan-funded magazine's misrepresentation of physicist Douglas Osheroff's views regarding the shuttle foam issues on space shuttle Columbia, but did not follow through with it. Had Bayosphere had an editor who I could consult with, I likely would have gone forward with the story.
Overall outcome: Learning experience
-------------------------------------------------------------------------------
4. The Polling Place Photo Project
November 2006
Last fall's Polling Place Photo project was a pilot crowdsourced journalism project initiated by William Drenttel of Design Observer. Sponsored by AIGA, Design for Democracy and NewAssignment.net, and promoted on PressThink, it enlisted the 'crowd' to post photos of their polling place, and fill out survey questions about their voting place and experience.
When introducing the Polling Place Photo Project at the Huffington Post, Jay Rosen laid out NewAssignment.net's role in this project:
"...we're not executing it; AIGA and Drenttel are. We're consulting on it, and it's testing a part of our model. NewAssignment will help explain the project, and follow up by getting a journalist--a writer or critic--to assess the results."
What went well:
People posted photos and filled out the survey. In February Drenttel wrote "the site has...become a valuable archive of visual and documentary evidence", and in May he reported via email that "[roughly] 600 people contributed photographs with almost every state being represented".
[In a recent email he added:
"...the project has led to some other journalism[:]
My article on voting in religious places on Design Observer.
An article in Aperture's [upcoming] Fall issue with 27 photos used.
]
What didn't:
Presumably due to a time crunch imposed by the impending election, the site design had some issues; submitting photos was awkward, the survey questions weren't always up to describing reality adequately, and there didn't seem to be a way to get a "big picture" view of the results.
Rosen reports that the intended followup assessment of this project has not yet occurred.
Factors likely affecting participation:
Plus: Rather than trying to pull people in completely "from scratch", the project enlisted members of an existing social network, the design professionals of AIGA. Apparently it worked well: the report of 600 contributors is impressive.
[William Drenttel isn't so sure that the "existing social network" aspect was significant: "In fact, we reached far beyond AIGA, and pollingplacephotoproject.org has close to 300 links tracked by Technorati."]
Minus: The project had a late start; Drenttel reports that it was launched only a week before the election, and didn't make the Huffington Post for until four days before the election.
Minus: Due to competing demands on people's attention, it's likely the project didn't get the "outside" publicity it would have received under more typical conditions.
How the project could have been better:
* A more user-friendly interface for submissions
* David Weinberger had suggested that much of the site's value could - at least in theory - have been obtained with less effort by leveraging off of Flickr, with its existing huge pool of contributors. Had this been possible, it would likely have ensured wider participation and perhaps made it easier for a visitor to get a feel for the "big picture" results. But apparently it was't possible: at the time William Drenttel had reported, "Yes, this could have been done at Flickr, and we reached out to them to collaborate and heard nothing back." He also cited a design consideration: "Ultimately, tags are not the same as data. We wanted to know zip code, time of day, length of time waiting, etc. A basic data set offers a better way to research photos than random tags."
[In a recent email Drenttel added:
"I want to emphasize how wrong I think David Weinberger is about having done this simply in Flickr. On Flickr, "voting" turns up 39,548 pictures, but I can't find pictures from my town or neighborhood unless they are tagged correctly. This is a case of the large number of photos (the success of crowdsourcing) leading to almost meaningless filler: too much data. In fact tags against this volume of pictures are virtually useless, they are so generic: polling, place, vote, voting, election, pollingplace, mypollingplace, decision2006. Voting does not get you vote. decision2006 leads to primarily one photographer, a Canadian."
]
What I contributed:
Photos of my polling place and of absentee voting.
Overall outcome: Mixed
-------------------------------------------------------------------------------
5. Earmarks project
Summer/Fall 2006
A brainchild of Porkbusters, the goal of the Earmarks Project was to find out as much as possible about who and what was behind the earmarks in the 2006 Health and Human Services appropriations bill - who had sponsored them, who they were going to, and what sort of lobbying or other connections they were associated with. This project was well publicized and supported; PressThink lists the other Earmarks Project partners as "the Sunlight Foundation, Citizens Against Government Waste, Porkbusters, and the Examiner Newspapers, along with Club for Growth, Human Events Online, The Heritage Foundation, Tapscott’s Copy Desk - and you, should you choose to be involved."
What went well:
The collaboration among sites with diverse readership set the stage for people of all political perspectives to join in.
Some participants - most notably "Mrs. Panstreppon" - uncovered and posted intriguing connections.
What didn't:
Participation was low.
From what Mrs. Panstreppon and I could see, people of all political perspectives did not join in; conservatives seemed to be occupied elsewhere.
The findings sat unused; while the Examiner had asked its readers to report their findings by email, and the Sunlight Foundation had provided a comments section for their readers' raw reports from the field, at no point was there any visible follow-up about the bill or the earmark reports, nor aggregation of the findings.
Mrs Panstreppon termed this project "a good idea but poorly executed."
Factors likely affecting participation:
Minus: At least one congressman's office staff was not forthcoming with answers when asked about earmarks he had sponsored; other citizen journalists probably would have encountered this problem as well, particularly given the recent Examiner report of getting the runaround when trying to find who had sponsored earmarks from the recently released OMB-compiled database of Congressional earmarks for 2005.
Minus: This crowdsourcing project likely cut against the motivations of its natural pool of participants. Empirically, the online subgroup most motivated to participate in an organized crowdsource project seems typically to be those individuals who would most support Health and Human Services spending; so asking them to expose expenditures and potentially harm the lawmakers who'd requested them, shortly before a pivotal election, was asking a lot.
Minus: Even had the project's goal not gone "against the grain" of its constituents, it still wasn't compelling relative to its competition: protecting our wallets seems lackluster when compared to protecting our democracy.
How the project could have been better:
The pre-election timing, while uncontrollable, was unfortunate.
While the low participation was likely unavoidable, perhaps the project could then have been scaled down into a model pilot project, and then given top-notch support, namely:
* support for contributors, particularly when they ran up against difficulties like stonewalling legislators;
* leveraging contributors' efforts by compiling and following up on their findings; which in turn would encourage future participation. As it was, Earmarks Project standout Mrs. Panstreppon was surprised to find that "no one seemed to actually want to do something about the boondoggle".
What I contributed:
Two earmarks probably sponsored by my congressman, with their associated lobbyists.
Overall outcome: Learning experience
-------------------------------------------------------------------------------
6. No More Blather - Submit tough questions for politicians
October 2006
No More Blather received a plug from NewAssignment.net's David Cohn last fall; this website provided a venue for publicizing questions sidestepped by our elected officials, to increase the questions' visibility in the hope that someone - perhaps the submitter, perhaps someone else - who got the opportunity would ask them.
What went well:
The goal was a noble one; and the website is still online.
What didn't:
This site apparently got little publicity, and has received few contributions.
Factors likely affecting participation:
* Minus: Lack of publicity
* Minus: It's also possible that there truly isn't much demand for this functionality; perhaps the vast majority of citizens want to tell their representatives, not ask them.
How the project could have been better:
It might not have needed its own website, if the functionality could be implemented in distributed fashion using Don Marti's "Questions for" tags (which ideally would then be followed by "Interview with" tags...)
What I contributed:
Two questions for my congressman.
(I have not attempted to pursue getting answers to these questions.)
Overall outcome: Learning experience
-------------------------------------------------------------------------------
5/28/07



