{"id":1686,"date":"2009-08-30T14:10:03","date_gmt":"2009-08-30T22:10:03","guid":{"rendered":"http:\/\/www.alevin.com\/?p=1686"},"modified":"2009-08-31T06:47:22","modified_gmt":"2009-08-31T14:47:22","slug":"agile-social-incentives","status":"publish","type":"post","link":"https:\/\/www.alevin.com\/?p=1686","title":{"rendered":"Agile social incentives"},"content":{"rendered":"

A poster at Codexon<\/a> wrote a blog post bragging about the way he took advantage of the points system on Stack Overflow<\/a>, the programming Q&A site. Reflecting on Adrian Chan’s recent post<\/a> about the weaknesses of structured, game-like incentives in social media, I more-than-half-expected a situation where griefers<\/a> were gaming the points system and messing up the community. I found something else instead. <\/p>\n

Stack Overflow is a community for programmers to ask and answer questions. It has a detailed reputation system designed to reward participation and high quality responses. For those unfamiliar with the site, the points system well thought out with respect to the behavior it’s trying to foster really geeky<\/a>, and rewards those who are feel motivated and amused by thinking quantitatively about the ways their constructive participation gains them more status and powers on the site. The design of the site and its reputation system hits all four attributes in Peter Kollock’s taxonomy of social motivations as cited by Joshua Porter<\/a>: reputation, reciprocity (you can see who responds to whom), efficacy (it’s intended to reward fast and good answers), and attachment to group.<\/p>\n

The reputation troll bragged about his techniques for racking up reputation points: answering quickly, regardless of the quality of response; downrating comments that are ahead of you, and using formatting to make your points stand out. <\/p>\n

In the comments to the post itself, a good number of commenters called him out for obnoxious behavior, despite the poster’s insistence that he was merely gaming the system for his own entertainment and to point out its weaknesses. One example: “But isn\u2019t that missing the point? I use SO and gathered some (+2000) rep but my main goal is to provide answers to actual questions and not to abuse the achievement system.” It was mildly encouraging in that the comments thread didn’t reveal a throng of trolls outing themselves for self-serving anti-social behavior. But it was only mildly encouraging. The overall tone in the conversation on the poster’s site was one of frustration that the poster is willing to go through the trouble to decrease the quality of information for the community in order to gain an essentially pointless reward.<\/p>\n

Even more interesting was the “meta conversation”<\/a> on the Stack Overflow site itself. There, participants analyzed the troll’s behavior and identified what about the reputation gaming tactics were actually destructive to the community. In practice, posting a quick low-quality response is not that harmful, since other people quickly comment with better quality responses that get up-rated, and the original low-quality comment will float down below the fold. On the whole, adding formatting and images to posts is a good thing, since the visual emphasis makes the content easier to understand. <\/p>\n

The one thing that site participants saw as truly harmful was the strategic downvoting of others’ comments in order to have one’s one comments increase in value. Jeff Atwood, aka @codinghorror<\/a>, the site’s lead developer, commented on this point, saying this is the one thing they are considering changing the algorithm to discourage. <\/p>\n

In reaction to the griefer, you can see the community assessing its own practices and identifying an area to improve. The developer with the power to make changes is participating in the conversation and resolving to make changes to protect against the problem. Watching the StackOverflow community react to an antisocial participant suggest something that is as important in a social system as any particular rule or feature – the ability to evolve the rules.<\/p>\n

One of the agile practices that the Socialtext development team uses is the retrospective. We produce software in two week iterations. At the end of each two week period the team reviews the iteration – how people feel about it, what worked well, what needs improvement, and we identify items to improve. For example, we observed that the review of stories for the upcoming iteration had a tendency to fall through the cracks. So we tweaked the use of wiki page tags, which serve as a lightweight workflow reminder to identify when a story is in good enough shape for review. <\/p>\n

What’s important here is not the specific process we use, or the specific improvement the process, but the ability of the team to reflect, identify a problem, make a change to address the problem, and assess whether the solution is working. It does help to use lightweight tools that can easily be changed, e.g. define a tag that can be applied when a story needs review. Unlike the StackOverflow community, our team does not calculate and display the team’s metrics on an individual basis – we’re striving for team goals to deliver software that meets customer’s needs, when we said we’d do it. So we look at the team data explicitly, and handle individual variance informally. The point is that we have a system to fit the culture, and we can evolve the system to address problems.<\/p>\n

So, in response to Chan’s post, it may matter less what sort of feedback system is used – implicit or explicit, numeric or social – and it matter’s more that the community itself is able to change the rules.<\/p>\n","protected":false},"excerpt":{"rendered":"

A poster at Codexon wrote a blog post bragging about the way he took advantage of the points system on Stack Overflow, the programming Q&A site. Reflecting on Adrian Chan’s recent post about the weaknesses of structured, game-like incentives in social media, I more-than-half-expected a situation where griefers were gaming the points system and messing … Continue reading “Agile social incentives”<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[4,20],"tags":[],"class_list":["post-1686","post","type-post","status-publish","format-standard","hentry","category-books","category-social-software"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/prDRq-rc","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.alevin.com\/index.php?rest_route=\/wp\/v2\/posts\/1686","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.alevin.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.alevin.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.alevin.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.alevin.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1686"}],"version-history":[{"count":12,"href":"https:\/\/www.alevin.com\/index.php?rest_route=\/wp\/v2\/posts\/1686\/revisions"}],"predecessor-version":[{"id":1708,"href":"https:\/\/www.alevin.com\/index.php?rest_route=\/wp\/v2\/posts\/1686\/revisions\/1708"}],"wp:attachment":[{"href":"https:\/\/www.alevin.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1686"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.alevin.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1686"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.alevin.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1686"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}