Wikipedia Accountability Article

[Joe Beaudoin Jr.]

This is an article/op-ed piece I'm currently writing regarding how Wikipedia can better its accountability. I want some reactions and thoughts to it before I submit it.

It's in draft form right now, but all the general ideas are there.

So be brutally honest and rip away!

- Joe

--------

Creating an Accountable Wikipedia
by Joe Beaudoin Jr.

Wikipedia, for those of us who haven't heard about it, is the "Web 2.0" poster child of our time. Depending on who you ask, it was either founded solely by Jimbo Wales (of Bomis.com fame) or Wales co-founded it with Larry Sanger, who's pet project is now an encyclopedia with "gentle expert oversight" called Citizendium.

Regardless of its somewhat torrid past history, Wikipedia is the the well-known and hotly debated "encyclopedia that anyone can edit". Many charges have been leveled against Wikipedia, raising appropriate questions as to its accuracy and, more over, the conduct of those who edit it. A quick Google News search will doubtless bring to you the cacophony of dissenting voices from critics and supporters alike. (As corollary to that, a search of names, places, or events will produce a Wikipedia article covering that subject as one of the top results.)

The well-documented problems with Wikipedia, which will not be gone through in mirthless detail here, stem from its contributors. Everything from the John Siegenthaler scandal to the "Essjay scandal" stems from an inherent problem within how Wikipedia allows people to contribute. Moreover, there's the laissez faire way Wikipedia tends to leave its editors to their own devices, which itself is the biggest double edged sword that Wikipedia has in its arsenal.

This is the hole in the dike that the little Dutch boy can no longer put his finger in to hold back the water. And we're seeing the cracks and deficiencies in the construct, all stemming from the lack of proper accountability.

As all things do, this lack of proper accountability has a history behind it.

Back when Wikipedia first started, the issue before the nascent project was to create content. The easiest and quickest way to do this was to just simply allow anyone to edit, and basically hope that whatever was thrown together stuck to the big electronic cork board.

Have you ever seen the bulletin boards at the entrance and exits of your local Wal*Mart plastered with advertisements, fliers, and missing persons notices? Apply that concept to a website and, presto, you have the beginnings of Wikipedia. As with the bulletin board, anyone can contribute, and remove your content at the same time someone else adds something. And you won't even notice it's gone.

Moreover, the lofty, hazy-eyed idealists grabbed on to the sales pitch and began to espouse the "free encyclopedia that anyone can edit" slogan to recruit people. They didn't see beyond the language, nor the ramifications of using such vague and expansive terminology... otherwise they would have realized that they were just creating a massive problem for themselves later on. The publicity of creating a "free encyclopedia that anyone can edit" has now also become the mission statement of Wikipedia as well.

Sounds very "cool", doesn't it? Or is it "da bomb". I do forget.

However, just think for a moment. What does "anyone" mean? Without looking at a dictionary, how would you define that in your own words?

"Anyone" means any person from every walk of life, every corner of the planet, regardless of race, religion, creed, or education can submit, modify, and remove content as they will.

Now the first thing that may come to mind is the "wow" factor. And if your an honest, wide-eyed optimist armed with information and the ability to compose sentences and paragraphs, this probably appeals to you. The "credential shtick" is no longer the big deal it was, and, well, you finally have a place to congregate with others of your ilk and debate the finer points of quantum theory or whether any of the 9/11 conspiracy theories have any merit.

Except that, if you look at the world through bloodshot eyes (or cloudy-eyed optimism), you forgot the full meaning of "anyone". The other side of the coin, as it were, that shows us the darker side of the human race: the unethical, the immoral, the dishonest.

The one that will lie, cheat, and subtly convert a well written article into something other than the truth, giving us a pack of lies or something that looks, on the surface, to be truth. And I'm not taking about "vandals" who blank pages, add derogatory comments, or assault contributors with the eloquence of a school yard bully.

Which leads us to the necessity of finding a means to separate the wheat from the chaff...

If you look through Wikipedia, you'll see a breadth of documentation that highlights the duties of administrators, in addition to policies, procedures and guidelines all Wikipedians are supposed to adhere to. Some of them make sense. Others look like they've been ripped from an computer programmer's manual.

So Wikipedia does have an internal structure and a SOP that they follow, created or modified as needed, with such modifications ratified by consensus. We may liken it to another living document which is amended and corrected as needed: the United States Constitution. So they have a toolbox and an assembly of literature to fall back upon...

Except who ensures that this Wikipedia SOP is adhered to?

Well, Wikipedia has an honor system. Contributors can whistle-blow on other contributors (or even "administrators" and "bureaucrats", high level custodians for the project) by simply messaging an administrator, setting up a "Request for comment" on users, or going through a set-up mediation process.

Of course, again, we're talking about process and roles. Not about the people who are behind the processes and occupy the roles.

So how are these people hired or promoted to fill these roles?

[Continued in following post.]

[Joe Beaudoin Jr.]

[Continued from above.]

We know now that they are basically hired off the street without even so much as a cursory interview. Sure, they can slap something up on their user page that looks like a biography, but do we really know who these people are?

No.

So how does one then get "promoted" in a business (and Wikipedia is very much a business in its own right) such as Wikipedia?

Well, like anyone who wants to get promoted, you need to work for it. You need to prove yourself under fire, by dealing with people who may not see eye-to-eye with you, or want to include (or dramatically change) articles which you've worked on to suit their own world-view. You need to prove it by writing articles, editing them, and even "vandal fighting" and doing the household chores, such as participating in the "Articles for Deletion" process.

Then you are promoted based off your work, since it has now sold you to others. The promotion is done not by any figurehead, but rather a group of active contributors who essentially vote to support or oppose your nomination. This process is identified as a "request for adminship", which is laid out here. [include link]

A similar process is done for bureaucrats, appropriately called a "request for bureaucratship", which are people who have a few more tools on their belt, basically renaming users, authorizing automated programs called bots, and promoting contributors to the vaunted rank of "administrator". As for how they directly affect the content of Wikipedia:

"[T]hey are expected to exercise judgment in changing user names, and ensure that the bot policies are followed when granting bot status to a user. They are expected to be capable judges of consensus, and are expected to explain the reasoning for their actions on request and in a civil manner."

Now there are criteria that are met and questions asked, very much like an interview. These are the basic questions that are asked to potential administrators:
1. What admin work do you intend to take part in?
2. What are your best contributions to Wikipedia, and why?
3. Have you been in any conflicts over editing in the past or have other users caused you stress? How have you dealt with it and how will you deal with it in the future?
All questions that tackle what contributors and the higher ups view to be of importance, including a competency question. Also, people are capable of adding their own questions, should they feel the need.

However, you can ask a thousand questions to an applicant, and still come up with a lump of coal, even if you believe it to be a diamond.

Which brings me back to the "Essjay scandal" I brought up briefly beforehand. Essentially, Essjay went through the same process that I've described above, although it's slightly changed over time. On his user page, he wrote this biography on his "professional life":
I am a tenured professor of theology at a private university in the eastern United States; I teach both undergraduate and graduate theology. I have been asked repeatedly to reveal the name of the institution, however, I decline to do so; I am unsure of the consequences of such an action, and believe it to be in my best interests to remain anonymous.

I hold the following academic degrees:

* Bachelor of Arts in Religious Studies (B.A.)

* Master of Arts in Religion (M.A.R.)

* Doctorate of Philosophy in Theology (Ph.D.)

* Doctorate in Canon Law (JCD)
He also never revealed his name, which is a fairly common occurrence on Wikipedia; people more often than not refer to other contributors by their usernames.

However, when he became an administrator, mediator, and bureaucrat, he continued to make people believe he was a "tenured professor" with degrees in religious studies and canon law.

Due mostly to his work on Wikipedia, he became a model citizen of Wikipedia, and was interviewed by Pulitzer Prize-winning journalist Stacy Schiff of The New Yorker, to whom Essjay repeated the above information. After that, he became a high profile member of the community, which lead to his job to a salaried spot in Wikia, a for-profit company run by Jimbo Wales.

Of course, when he was promoted and settled into his new job, that's when things began to unravel. The truth came when he himself wrote a jarringly different biography on his Wikia page; his name was Ryan Jordan, he was twenty-four years of age (not the thirty he previously claimed), and neither held any advanced degrees from an accredited university nor has taught in any professional capacity.

Yes, so Jordan was now outed as a deceitful editor. A liar of the highest degree. Every act, edit, and decision he made during his tenure at Wikipedia was now questioned by his fellow peers, who descended upon him like vultures, despite his enablers inside the trifecta: Wikipedia, Wikimedia, and Wikia. Initially, Wales himself defended him, claiming that his deceit was an attempt to protect his identity online.

Whether Wales knew the whole truth or not, really, is irrelevant to his claims. As a leader, he is fully responsible and answerable for every facet and every act committed by the people under him.

The sad part of that incident is that it, as well as the egg on Wales' face, could have been avoided with a well-used tool called a background check.

Background checks are done by employers to determine the claims of their potential employees. A business will, without fail, check references and their legal status as a resident of the United States of America before hiring someone.

Either Wales did not perform a background check before hiring him on as a salaried employee, or did. I'm going to go ahead and "assume good faith" that he didn't, since the opposite would make Wales and company complicit in Jordan's unethical behavior.

(Before I continue, I should note that I tried to do a search for "background check" and could not find one Wikipedia guideline, policy or procedure to verify claims of its members. Additionally, I did come across an article on the subject -- an article that has been marked for "cleanup" since December 2006.)

The damning point to be made here is that Wikipedia's higher ups lack accountability. Administrators, bureaucrats, trustees and members of the Foundation apparently don't check the credentials of their employees -- and, no, do not make the mistake of thinking that they are not "employees". They are employees by their very definition and, regardless of whether or not they work pro bono, and should be treated as such.

This is not to say that every single contributor should have their backgrounds verified. This is an unrealistic request as background checks are costly and time consuming affairs when done in bulk. Thus, background checks should be done on the people at the top (Wikimedia Board of Trustees and hired employees), then work their way down the mediators, bureaucrats, and administrators on a priority scale.

Should if they refuse to submit, then they don't get the job. Very clean cut and dry, like a business.

It is painfully evident that Wikipedia has a consumer confidence issue; academics, students and people capable of critical thinking a wary of it, and justifiably so. Despite the PR that claims that Wikipedia is just as accurate as Encyclopedia Brittanica, the fact remains that there will always be that shadow of a doubt hanging over Wikipedia's head due to the lack of accountability. And accountability cannot be held if you're only targeting a villain hiding behind a Guy Fawkes mask, or a mere Wikipedia account.

Verifying the identities and credentials of the high profile contributors, the movers and shakers of Wikipedia, is the start of earning the peoples' trust. Otherwise, Wikipedia and its runners should just admit they are nothing more than another wannabe fansite; and that is, admittedly, an insult to wannabe websites.

[Steelviper]

Why did "Essjay" need credentials?

Obviously he was having to make some edits that couldn't be justified through citations alone, and he felt he needed the latitude that an expert in the field would be granted.

Why would you need to verify my credentials?

I wouldn't have any problem with a background check personally, but why would you be running one on me in the first place. I claim no credentials that would justify my edits being treated any differently than anybody else. I don't have a PhD in Galacticology, (or even a BS in that relatively new field) and I'm not a member of the production staff. Therefore every edit I make should have the same weight as any other non-production staff member. Granted, my established history should probably give me some benefit of the doubt regarding vandalism type edits, but in the final accounting each of my edits should be just as grounded in canon as the next.

Who needs their credentials verified?

I can see that anybody claiming credentials that would make them "above the law" (or at least less subject to citation) would need to be validated. Similar to the way that members of the production staff are verified here at BW. Anything they say becomes potential source material, and therefore doesn't require any external citation. These are extremely valuable resources, but obviously that's a power that could be abused by a masquerader. I don't know if Wikipedia formally recognizes any credential that grants you that degree of power. I don't have detailed knowledge of the incidents, but I imagine the claimed credentials function more informally, being used to bully people when citations can't make their argument for them. I'm not even sure that verified credentials would be a good thing in the Wikipedia model. If Professor Joe Schmoe claims that the Earth is the center of the universe, and has a PhD in astrophysics, astronomy, etc., does his word trump a fifth grader who can cite a school textbook? Granted, the lack of recognition of expertise can lead to frustrating situations for people who really do know what they're talking about. Laypeople can quote outdated or erroneous published works at them all day and keep their edits, while the expert will be silenced even though they know (due to being intimately familiar with the field) that those edits are wrong.

Just Wikimedia have the common sense to run background checks on their employees?

Of course. These people are going to represent you. Online, in media interviews, wherever they go. Making sure that the 40 year old Phd isn't actually a 14 year old will help prevent the "face" of your organization look so suspect. I just don't know whether the average B-Crat or Sysop should be given enough latitude to even justify a background check.

[Sgt_Smiles]

--------EDITED FOR STUPIDITY---------
nevermind did not read all of thread.

[Steelviper]

http://slashdot.org/articles/07/09/23/1340207.shtml

[Joe Beaudoin Jr.]

I took note of these things a few days ago.

There's a site on wikimedia that goes over the proposals for the quality issues:

http://quality.wikimedia.org/wiki/

I also posted a brief recommendation on making Wikipedia more Debian-like, here:

http://quality.wikimedia.org/wiki/Talk:Portal#Make_it_more_Debian_like....3F

[Joe Beaudoin Jr.]

I've done some revisions and updates to the article, which can be seen here:

http://www.associatedcontent.com/article/483123/creating_an_accountable_and_trustworthy.html