Saturday, February 03, 2007

Citing Wikipedia

A NY Times story last week noted that judicial opinions increasingly cite Wikipedia as a source of facts, although mostly for background or tangential information. A few courts, however, have cited Wikipedia as a factual source on more central questions. The article raises three principal objections to such citations. None, it seems to me, is persuasive.

First, the article notes that citations of Wikipedia are ephemeral because entries change. Someone looking for a source a year or more after the opinion cited it might find something substantially different. For example, the link above to the NY Times story will go dead after the Times removes it from its complimentary site, per its policy of charging for older articles.

Well, so what? As Larry Lessig points out in the Times story, it's easy to create permanent caches of any webpage at any given time for future reference by using Webcite. (Check it out. It's very cool.) Moreover, while Lessig's point makes sense for most web pages, it's not even necessary for Wikipedia, which includes a "history" feature for each entry, so one can look up an earlier version if needed.

The second objection is the obvious one: Wikipedia is the product of sometimes anonymous volunteers who may not have any special expertise. Therefore it's just not reliable. This would be a good objection if it were true, but it isn't. A 2005 study in Nature found that Wikipedia is about as accurate as the Encyclopedia Britannica, although Britannica claims that the study was flawed (as detailed here.) Even if Wikipedia isn't quite as accurate as Britannica, over time it will become more so, as the market for Britannica disappears. (Can you imagine getting a young student a set of encyclopedias in the way that kids in my generation were given them as gifts?) Moreover, even right now there are undoubtedly hundreds of sources that are less accurate than Wikipedia that courts routinely cite. Take, for example, judicial precedents from many years ago that were based on information that is now hopelessly out of date.

A third objection is that once Wikipedia becomes a source for judicial decisions, litigants and lawyers will try to game the system by writing their own entries. This simply can't work given the open-source nature of Wikipedia. For example, a few days ago, in an effort to demonstrate the truthiness of knowledge, Stephen Colbert urged his viewers to edit Wikipedia to state that the population of elephants has tripled in the last ten years. (In fact, elephants are highly endangered.) This worked for a few seconds, whereupon the page reverted to the accurate version, and re-reverted each time a Colbertista made the change again. (You can read the changes in the History tab.)

The real objection to citations of Wikipedia thus appears to be a kind of doctrinaire epistemology in which knowledge only counts as such if certified by certified experts. But if the wisdom of a sufficiently large crowd turns out to be better, on average, than the wisdom of experts, then there is no good reason to insist on the latter.

17 comments:

Neil H. Buchanan said...

How do we know that Wikipedia is as accurate as expert knowledge unless we have a reliable source of expert knowledge? And if we have such a source, shouldn't courts cite it rather than having faith that Wikipedia will probably, usually get it right ... eventually ... with occasionally changes back and forth?

Caleb said...

Of course, if Wikipedia IS correct as often as any other encyclopedia, we might have fuel to prefer Aristotle's argument for the wisdom of the multitude over Plato's philosopher king.

Derek said...

There are a number of good solutions to the vandalism problem. My favorite is here: http://www.everytopicintheuniverseexceptchickens.com/

Michael C. Dorf said...

In answer to Neil's question, the Nature study took 40 randomly selected subjects, then gave experts in the field the Wikipedia article on the subject and the Britannica article on the subject, without identifying the source, and asked them to spot errors. The results were comparable. So why not just cite Britannica? Because it will go out of business soon enough. And why not cite the primary experts? Well, that's a lot of work, and also, if you're not an expert, you may have a hard time identifying one. For example, you might think that John Hodgman is an expert on, well, just about anything.

Amos Blackman said...

While I am a big fan of the democratization of knowledge (both generally and Wikipedia specifically), I nonetheless empathize with the discomfort many feel at relying on it. For example, I don't think judges would have cited Wikipedia in 2001, or if they had, I question whether Professor Dorf would have been endorsed it. Any information provider must undergo a maturation period, during which users of the information shift from being majority skeptical to majority trusting. I think we're uncomfortable with Internet sources because few have survived this maturation process, and for most of us, prior to the Internet, we weren't around to witness the maturation of the more traditional sources we rely on.

To test my theory, consider the following passage:

"Defendant's exhibit indicates that out of thirty-two songs found which contain the phrase 'holla back,' nine songs repeat 'holla back' in the same rhythmic pattern used in 'Holla Back' and 'Young N,' four songs predate the release of plaintiff's song, and five songs were released in the same year as plaintiff's song. The appearance of the phrase 'holla back' in the Urban Dictionary further supports defendant's contention that the phrase is common and therefore unprotectable.[FN5]

"FN5. As cited in the defendant's exhibit 6, the Urban Dictionary is an online dictionary which allows users to create and submit definitions of slang words and phrases for publication 'Holla back' is defined as a 'term [that] can be used as a goodbye greeting or when ending a conversation or at the end of trying to prove a point.' See http://www.urbandictionary.com/define.php?term=holla+back&f=1."

Boone v. Jackson, No. 03 Civ. 8661, 2005 WL 1560511, at *4 (S.D.N.Y. July 1, 2005) (emphasis added).

Do you really believe that citing Urban Dictionary supports the Defendant's claim?

egarber said...

I think the problem is that there's no barometer to test the credibility behind any particular wikipedia entry. If a mainstream press outfit or university research center reports something, there is a natural vetting process -- we know who wrote it, and those folks bear the burden of answering doubts about their work. That whole dynamic tends to regulate the quality of information.

As beautiful as populist web forums are, there simply is very little barrier to entry. This creates giant cracks (imo). On wiki, how does a Court know it's citing valid informationvs. a contaminated version of it?

Anil Kalhan said...

Mike -- does the report this week about Microsoft paying a blogger to "correct" Wikipedia entries in any way change your view? Or is your response to that basically like Colbert's ("Boo hoo, comrade!")?

Michael C. Dorf said...

In response to Anil's question, basically yes: The Microsoft effort was detected. I don't disagree that Wikipedia could eventually become inaccurate if the ratio of hackers and vandals to altruistic netizens goes up enough. But if that doesn't happen, I have high hopes for Wikipedia. (Not that i'm about to cite it in my own academic work!)

Anonymous said...

情趣用品,情趣用品,情趣用品,情趣用品,情趣用品,情趣用品,情趣,情趣,情趣,情趣,情趣,情趣,按摩棒,跳蛋,充氣娃娃,情境坊歡愉用品,情趣用品,情人節禮物,情惑用品性易購

免費A片,AV女優,美女視訊,情色交友,免費AV,色情網站,辣妹視訊,美女交友,色情影片,成人影片,成人網站,A片,H漫,18成人,成人圖片,成人漫畫,情色網,日本A片,免費A片下載,性愛

A片,色情,成人,做愛,情色文學,A片下載,色情遊戲,色情影片,色情聊天室,情色電影,免費視訊,免費視訊聊天,免費視訊聊天室,一葉情貼圖片區,情色,情色視訊,免費成人影片,視訊交友,視訊聊天,視訊聊天室,言情小說,愛情小說,AIO,AV片,A漫,av dvd,聊天室,自拍,情色論壇,視訊美女,AV成人網,色情A片,SEX

情趣用品,A片,免費A片,AV女優,美女視訊,情色交友,色情網站,免費AV,辣妹視訊,美女交友,色情影片,成人網站,H漫,18成人,成人圖片,成人漫畫,成人影片,情色網


情趣用品,A片,免費A片,日本A片,A片下載,線上A片,成人電影,嘟嘟成人網,成人,成人貼圖,成人交友,成人圖片,18成人,成人小說,成人圖片區,微風成人區,成人文章,成人影城,情色,情色貼圖,色情聊天室,情色視訊,情色文學,色情小說,情色小說,臺灣情色網,色情,情色電影,色情遊戲,嘟嘟情人色網,麗的色遊戲,情色論壇,色情網站,一葉情貼圖片區,做愛,性愛,美女視訊,辣妹視訊,視訊聊天室,視訊交友網,免費視訊聊天,美女交友,做愛影片

av,情趣用品,a片,成人電影,微風成人,嘟嘟成人網,成人,成人貼圖,成人交友,成人圖片,18成人,成人小說,成人圖片區,成人文章,成人影城,愛情公寓,情色,情色貼圖,色情聊天室,情色視訊,情色文學,色情小說,情色小說,色情,寄情築園小遊戲,情色電影,aio,av女優,AV,免費A片,日本a片,美女視訊,辣妹視訊,聊天室,美女交友,成人光碟

情趣用品.A片,情色,情色貼圖,色情聊天室,情色視訊,情色文學,色情小說,情色小說,色情,寄情築園小遊戲,情色電影,色情遊戲,色情網站,聊天室,ut聊天室,豆豆聊天室,美女視訊,辣妹視訊,視訊聊天室,視訊交友網,免費視訊聊天,免費A片,日本a片,a片下載,線上a片,av女優,av,成人電影,成人,成人貼圖,成人交友,成人圖片,18成人,成人小說,成人圖片區,成人文章,成人影城,成人網站,自拍,尋夢園聊天室

Anonymous said...

A片,A片,情色,情色,A片,A片,情色,情色,A片,A片,A片下載,做愛,成人電影,.18成人,日本A片,情色小說,情色電影,成人影城,自拍,情色論壇,成人論壇,情色貼圖,情色,免費A片,成人,成人網站,成人圖片,AV女優,成人光碟,色情,色情影片,免費A片下載,SEX,AV,色情網站,本土自拍,性愛,成人影片,情色文學,成人文章,成人圖片區,成人貼圖

美女交友,AIO交友愛情館,AIO,成人交友,視訊交友網,視訊交友,拓網交友,PC交友,視訊交友90739,交友,情色交友,聊天室交友,辣妹視訊,視訊辣妹,美女視訊,視訊美女,情色視訊,日本AV,免費視訊聊天,視訊聊天,AV女優,AV,視訊聊天室,視訊,免費視訊,情人視訊網,本土自拍,自拍,AVDVD,SEX,微風成人,微風論壇,微風成人區,成人網站,成人,成人電影,嘟嘟成人網,成人貼圖,成人影片,成人圖片區,成人圖片,18成人,成人小說,成人影城,成人文章,成人論壇,愛情公寓,情色論壇,情色,色情聊天室,色情,情色貼圖,情色文學,色情小說,情色小說,寄情築園小遊戲,色情遊戲,情色電影,情色網,做愛,UT聊天室,聊天室,聊天,哈拉聊天室,豆豆聊天室,尋夢園聊天室,聊天室尋夢園,080苗栗人聊天室,苗栗人聊天室,080中部人聊天室,080聊天室,中部人聊天室,柔情聊天網,6K聊天室,小高聊天室,上班族聊天室,免費A片,A片,成人聊天室,一夜情聊天室,情色聊天室,色色網,免費AV

Anonymous said...

免費A片, ut聊天室, AV女優, 美女視訊, 免費成人影片, 成人論壇, 情色交友, 免費AV, 線上a片, 日本美女寫真集, 同志聊天室, 聊天室交友, 成人文章, 成人圖片區, 色情網站, 辣妹視訊, 美女交友, 微風成人區, 色美媚部落格, 色情影片, 成人影片, 成人網站, 免費A片, 上班族聊天室, A片,H漫, 18成人, a漫, av dvd, 一夜情聊天室, 微風成人, 成人圖片, 成人漫畫, 情色網, 日本A片, 免費A片下載, 性愛, 成人交友, 嘟嘟成人網, 嘟嘟成人網, 成人貼圖, 成人電影, 成人, 中部人聊天室, 080中部人聊天室, 成人貼圖, 成人小說, 成人文章, 成人圖片區, 免費成人影片, 成人遊戲, 微風成人, 愛情公寓, 成人電影, A片, 情色, 情色貼圖, 情色文學, 做愛, 成人遊戲, 成人影城, 色情聊天室, 色情小說, 一葉情貼圖片區, 情色小說, 色情, 寄情築園小遊戲, 色情遊戲, 成人網站, 麗的色遊戲, 色情網站, 成人論壇, 情色視訊, 情色電影, aio交友愛情館, 言情小說, 愛情小說, 色情A片, 情色論壇, 自拍, 癡漢, , 俱樂部, 豆豆聊天室, 聊天室, 色情影片, 視訊聊天室, 免費視訊聊天, 免費視訊, 視訊交友90739 情人視訊網影音視訊聊天室 免費視訊聊天室 視訊聊天 視訊交友 美女視訊 視訊美女 視訊 免費視訊 免費視訊聊天 視訊聊天室 辣妹視訊 一夜情 色情a片 aio交友愛情館 情色電影 情色視訊 色情遊戲 色情 情色小說 一葉情貼圖片區 色情小說 色情聊天室 情色交友 成人論壇 成人網站 色情網站 情色論壇 小高聊天室 女同志聊天室 6K聊天室 080苗栗人聊天室 080聊天室 聊天室尋夢園 UT男同志聊天室 男同志聊天室 尋夢園聊天室 UT聊天室 聊天室 豆豆聊天室 A片 成人電影 成人貼圖 嘟嘟成人網 美女交友 本土自拍 成人交友 成人影片http://ssff01.3b8mm.com/

Unknown said...

不動産
合宿 免許
網頁設計
ショッピング枠 現金化
クレジットカード 現金化
キャッシング
幼児教室
名刺

Anonymous said...

TheWorld of Kung fu Gold seems also important. His only since ancient immutable law. WoKf gold in the game is just like the money in the life. It is different of the buy World of Kung fu Gold online in the game world. You can have cheap World of Kung fu Gold to update your weapons. And the World of Kung fu money should be more and more.

Anonymous said...

a片,成人網站,美女交友,美女視訊,a片,成人網站,美女交友,美女視訊,a片,成人網站,美女交友,美女視訊,聊天室,美女視訊,聊天室,美女視訊



成人網站,成人影片,av女優,h漫,成人網站,成人電影,a片,色情,成人影片,色情,成人電影,色情,h漫,成人影片,成人電影,免費A片,色情,成人電影,成人影片,免費A片,色情,成人網站,情趣用品,免費A片,成人網站,色情,a片,成人影片,情色,免費A片,微風成人,情色,成人影片,微風成人,av女優



成人網站,色情網站,av女優,色情,成人網站,成人影片,成人電影,av女優,a片,成人網站,成人網站,成人網站,成人影片,av女優
色情,h漫,sex,情色,a片,成人網站,成人影片,av女優,色情
h漫,sex,情色,辣妹視訊,080視訊聊天室,美女交友
情色視訊,哈啦聊天室,ut聊天室,聊天室



美女交友,美女交友,美女交友,視訊辣妹,視訊辣妹,視訊辣妹,視訊聊天室,視訊聊天室,視訊聊天室,成人交友,成人交友,成人交友,視訊美女,視訊美女,視訊美女,聊天室,聊天室,聊天室



成人網站,av女優,成人網站,a片,成人影片,成人電影,h漫,成人電影,色情,成人影片,色情,免費A片,成人影片,免費A片,情色,微風成人
美女交友,美女交友,視訊辣妹,視訊辣妹,視訊聊天室,視訊聊天室,成人交友,成人交友,視訊美女,視訊美女,聊天室,聊天室
美女交友,美女交友,美女交友,視訊辣妹,視訊辣妹,視訊辣妹,視訊聊天室,視訊聊天室,視訊聊天室,成人交友,成人交友,成人交友,視訊美女,視訊美女,視訊美女,聊天室,聊天室,聊天室



a片,成人網站,av女優,h漫,成人影片,免費a片,情趣用品,色情,微風成人,情色,sex,成人電影,聊天室,美女交友,辣妹視訊,視訊聊天室,成人交友,美女視訊,聊天室,美女交友,辣妹視訊,視訊聊天室,成人交友,美女視訊,成人網站,情色,情趣用品,色情,sex,免費a片,h漫,av女優,成人影片,a片,微風成人,成人電影聊天室,美女交友,辣妹視訊,視訊聊天室,成人交友,美女視訊,聊天室,美女交友,辣妹視訊,視訊聊天室,成人交友,美女視訊,成人電影,成人網站,情色,情趣用品,色情,sex,免費a片,h漫,av女優,成人影片,a片,微風成人,聊天室,美女交友,辣妹視訊,視訊聊天室,成人交友,美女視訊,聊天室,美女交友,辣妹視訊,視訊聊天室,成人交友,美女視訊



a片,a片,a片,a片,a片,av女優,av女優,av女優,av女優,成人網站,成人網站,成人網站,成人網站,h漫,h漫,h漫,h漫,成人網站,成人網站,成人網站,成人網站,免費A片,免費A片,免費A片,免費A片,成人影片,成人影片,成人影片,成人影片,成人電影,成人電影,成人電影,成人電影,免費A片,免費A片,免費A片,免費A片,成人電影,成人電影,成人電影,成人電影,色情,色情,色情,色情,成人影片,成人影片,成人影片,成人影片,成人影片,微風成人,微風成人,微風成人,微風成人,色情,色情,色情,色情,情趣用品,情趣用品,情趣用品,色情,色情,色情,色情,成人影片,成人影片,成人影片,成人影片,情色,情色,情色,情色,打卡鐘,跳蛋,持久液,色情網站,黃金回收,借錢,植牙,牙醫,成人網站,成人影片,av女優,色情,h漫,情色,sex,黃金價格,黃金,黃金買賣,黃金存摺,鑽石價格,鑽石回收,鑽石買賣,當舖,辣妹視訊,080視訊聊天室,美女交友,情色視訊,哈啦聊天室,ut聊天室,聊天室,打卡鐘,火鍋吃到飽,創業加盟,賺錢,吃到飽麻辣鍋

Anonymous said...

酒店喝酒,禮服店,酒店小姐,制服店,便服店,鋼琴酒吧,兼差,酒店兼差,酒店打工,伴唱小姐,暑假打工,酒店上班,日式酒店,ktv酒店,酒店,酒店公關,酒店小姐,酒店兼差,酒店上班,酒店打工,禮服酒店,禮服店,酒店小姐,酒店兼差,寒暑假打工,酒店小姐,台北酒店,禮服店 ,酒店小姐,酒店經紀,酒店兼差,寒暑假打工,酒店小姐,台北酒店,禮服店 ,酒店小姐,酒店經紀,酒店兼差,寒暑假打工,酒店小姐,台北酒店,禮服店 ,酒店小姐,酒店經紀,酒店兼差,寒暑假打工,台北酒店,禮服店 ,酒店小姐,酒店經紀,酒店兼差,寒暑假打工,酒店小姐,台北酒店,禮服店 ,酒店小姐,酒店兼差,寒暑假打工,酒店小姐,台北酒店,禮服店 ,酒店小姐,酒店經紀,酒店兼差,寒暑假打工,酒店小姐,台北酒店,禮服店 ,酒店小姐,酒店經紀,酒店兼差,寒暑假打工,酒店小姐,台北酒店,禮服店 ,酒店小姐,酒店經紀,酒店兼差,寒暑假打工,酒店小姐,台北酒店,禮服店 ,酒店小姐,酒店經紀,酒店兼差,寒暑假打工,酒店小姐,禮服店 ,酒店小姐,酒店經紀,酒店兼差,寒暑假打工,酒店小姐,禮服店 ,酒店小姐,酒店經紀,酒店兼差,寒暑假打工,酒店小姐,禮服店 ,酒店小姐,酒店經紀,酒店兼差,寒暑假打工,酒店小姐,禮服店 ,酒店小姐,酒店經紀,酒店兼差,寒暑假打工,酒店小姐,禮服店 ,酒店小姐,酒店經紀,酒店兼差,寒暑假打工,酒店小姐,經紀 彩色爆米花,經紀人 彩色爆米花,酒店傳播,酒店經紀 彩色爆米花,爆米花,童裝,童裝拍賣,童裝大盤,童裝寄賣,童裝批貨,酒店,酒店,童裝切貨,酒店,GAP童裝,酒店,酒店 ,禮服店 , 酒店小姐,酒店經紀,酒店兼差,寒暑假打工,招待所,酒店小姐,酒店兼差,寒暑假打工,酒店上班,暑假打工,酒店公關,酒店兼職,酒店經紀

Anonymous said...

www.eshooes.com .
www.pumafr.com.
www.myshoess.com.

www.eshooes.com .
www.pumafr.com.
www.myshoess.com.
[url=http://www.pumafr.com]puma shoes[/url]
[url=http://www.eshooes.com]chaussures puma[/url]
[url=http://www.myshoess.com]nike air max ltd[/url]

Anonymous said...

酒店經紀人, 菲梵酒店經紀, 酒店經紀, 禮服酒店上班, 酒店小姐兼職, 便服酒店經紀, 酒店打工經紀, 制服酒店工作, 專業酒店經紀, 合法酒店經紀, 酒店暑假打工, 酒店寒假打工, 酒店經紀人, 菲梵酒店經紀, 酒店經紀, 禮服酒店上班, 酒店經紀人, 菲梵酒店經紀, 酒店經紀, 禮服酒店上班, 酒店小姐兼職, 便服酒店工作, 酒店打工經紀, 制服酒店經紀, 專業酒店經紀, 合法酒店經紀, 酒店暑假打工, 酒店寒假打工, 酒店經紀人, 菲梵酒店經紀, 酒店經紀, 禮服酒店上班, 酒店小姐兼職, 便服酒店工作, 酒店打工經紀, 制服酒店經紀,,