<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Matt Keally&#039;s Blog &#187; info</title>
	<atom:link href="http://www.keally.org/tag/siteinfo/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.keally.org</link>
	<description>Life of the ABD grad student...</description>
	<lastBuildDate>Sat, 10 Dec 2011 02:55:19 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.2.1</generator>
		<item>
		<title>FeedMod: Quantifying news feed contributions of Facebook friends</title>
		<link>http://www.keally.org/2011/01/17/feedmod-quantifying-news-feed-contributions-of-facebook-friends/</link>
		<comments>http://www.keally.org/2011/01/17/feedmod-quantifying-news-feed-contributions-of-facebook-friends/#comments</comments>
		<pubDate>Mon, 17 Jan 2011 18:19:30 +0000</pubDate>
		<dc:creator>Matt</dc:creator>
				<category><![CDATA[development]]></category>
		<category><![CDATA[general]]></category>
		<category><![CDATA[facebook]]></category>
		<category><![CDATA[info]]></category>
		<category><![CDATA[isp]]></category>
		<category><![CDATA[Running]]></category>
		<category><![CDATA[site]]></category>
		<category><![CDATA[socialnetworking]]></category>
		<category><![CDATA[statistics]]></category>
		<category><![CDATA[webdevelopment]]></category>
		<category><![CDATA[work]]></category>

		<guid isPermaLink="false">http://www.keally.org/?p=1386</guid>
		<description><![CDATA[Previously, I proposed FeedMod, a Slashdot-style moderation system for Facebook to weed out all the garbage posts while allowing the interesting stuff to stand out.  After a basic implementation and a month of gathering data, I present some results.  Through post moderation, I quantify the contribution of each Facebook friend to my news feed and [...]]]></description>
			<content:encoded><![CDATA[<p><a href="http://www.keally.org/2010/12/08/introducing-feedmod-clean-out-your-facebook-news-feed/">Previously</a>, I proposed FeedMod, a <a href="http://slashdot.org">Slashdot</a>-style moderation system for Facebook to weed out all the garbage posts while allowing the interesting stuff to stand out.  After a basic implementation and a month of gathering data, I present some results.  Through post moderation, I quantify the contribution of each Facebook friend to my news feed and identify the Facebook friends who provide the most positive and negative contributions.  Such information can quickly identify which friends to &#8220;defriend&#8221; and which to pat on the back for their good posts.  Such a moderation system will also allow for fine grained filtering of the Facebook news feed to provide a more enjoyable news feed experience.</p>
<p>While Facebook provides a &#8220;like&#8221; button to indicate approval of news feed posts, there is no indication that this feature is used to filter news feed content.  Facebook does provide an option to block news feed posts of designated friends, but this is a very coarse grained filter.  More recently, <a href="http://www.facebook.com/notes/facebook-data-team/whats-on-your-mind/477517358858">Facebook presented an interesting analysis of news feed posts</a>.  This study identifies post topics that are more likely to be &#8220;liked&#8221; or commented on by friends as well as identifying post topics that are correlated with high friend  counts.  While the Facebook study analyzes post content, it only compares against metrics inherent to Facebook itself, such as &#8220;likes&#8221; per post, number of comments per post, age of posters, and friend counts.  The study neither attempts to quantify the news feed topic preferences of Facebook users, nor does it attempt to identify a Facebook user&#8217;s best or worst friends based on friends&#8217; news feed posts.</p>
<h2>Design</h2>
<p>As previously mentioned, the main idea is for each FeedMod user to moderate each news feed post in a manner similar to Slashdot post moderations.  Each news feed post is assigned a moderation which consists of an integer value score and descriptor string.  For this experiment, I chose the following moderations:</p>
<p><strong>
<table id="wp-table-reloaded-id-1-no-1" class="wp-table-reloaded wp-table-reloaded-id-1">
<thead>
	<tr class="row-1 odd">
		<th class="column-1">Value</th><th class="column-2">Descriptor</th><th class="column-3">Examples</th>
	</tr>
</thead>
<tbody>
	<tr class="row-2 even">
		<td class="column-1">-2</td><td class="column-2">Troll</td><td class="column-3">Rants or politically charged arguments;  I really can't stand these, hence the -2</td>
	</tr>
	<tr class="row-3 odd">
		<td class="column-1">-1</td><td class="column-2">Spam</td><td class="column-3">Advertisements, such as requests to attend an event, donate money, or to come to a friend's place of business to buy something</td>
	</tr>
	<tr class="row-4 even">
		<td class="column-1">-1</td><td class="column-2">Redundant</td><td class="column-3">Endless duplicate announcements, typically on holidays and birthdays</td>
	</tr>
	<tr class="row-5 odd">
		<td class="column-1">-1</td><td class="column-2">Indifferent</td><td class="column-3">Stuff I really don't care about, such as random song lyrics or sports posts about teams that I don't follow</td>
	</tr>
	<tr class="row-6 even">
		<td class="column-1">-1</td><td class="column-2">Unintelligible</td><td class="column-3">Something posted out of context, usually by someone with whom I'm out of touch</td>
	</tr>
	<tr class="row-7 odd">
		<td class="column-1">0</td><td class="column-2">Normal</td><td class="column-3">I assign my posts to this, otherwise I use it rarely</td>
	</tr>
	<tr class="row-8 even">
		<td class="column-1">+1</td><td class="column-2">Funny</td><td class="column-3">Self explanatory, but I found myself only using it when I was about to fall out of my chair laughing</td>
	</tr>
	<tr class="row-9 odd">
		<td class="column-1">+1</td><td class="column-2">Insightful</td><td class="column-3">Anything that gives insight into the highlights of a friend's life or a well formed argument on a topic</td>
	</tr>
	<tr class="row-10 even">
		<td class="column-1">+1</td><td class="column-2">Informative</td><td class="column-3">Usually updates on what someone is doing</td>
	</tr>
	<tr class="row-11 odd">
		<td class="column-1">+1</td><td class="column-2">Inquisitive</td><td class="column-3">Someone posing a question to his or her friends</td>
	</tr>
	<tr class="row-12 even">
		<td class="column-1">+2</td><td class="column-2">Interesting</td><td class="column-3">Usually news articles or a post about something I hadn't heard of or thought about before (these posts are the best, hence the +2)</td>
	</tr>
</tbody>
</table>
</strong></p>
<p>By moderating the status updates of all of my Facebook friends, I am then able to assign a score to each friend based on those moderations.  I can even moderate status update comments made by friends and non-friends alike.  The score, similar to Slashdot&#8217;s &#8220;karma,&#8221; is created by summing the moderation values for all of a friend&#8217;s posts.  In this way, I can see the balance of how positive or negative a friend&#8217;s posts tend to be.  The advantage of this method is that friends with a large number of good or bad posts will stick out.</p>
<h3>Implementation and Facebook API</h3>
<p>My original idea was to use the Facebook API to modify the news feed and allow me to moderate friends&#8217; posts.  A month ago when I started this, I had no experience with the Facebook API and did not know if it would even allow me to do such a thing.  While I did achieve what I wanted in being able to moderate friends&#8217; posts, I can say conclusively that the Facebook API is seriously lacking.  I have two major issues with the API: 1) an inability to customize the Facebook  website, forcing developers to reinvent the wheel for even the smallest applications, and 2) limited access to information easily accessed on  the main Facebook website.</p>
<p>What I really wanted to do was to be able to modify the existing Facebook news feed and insert a moderation select list next to each status update.  When a FeedMod user selected a moderation, the post-moderation pair would be stored in a database.  Unfortunately, Facebook does not allow developers to modify any portion of the Facebook website, including the news feed.  It would be much easier if Facebook allowed this since I wouldn&#8217;t have to recreate the entire news feed.  This lack of customization is a serious barrier to developers who have an idea for a simple application that makes use of the existing Facebook website.</p>
<p>The Facebook API does, however, allow you to query status updates and friend information for use on your own website.  What I learned was that apps within Facebook are actually remote websites running within an iframe on the main Facebook website.  Unfortunately, Facebook limits the information you can get: news feed items are restricted to status updates, links, videos, and photos &#8212; you cannot retrieve time ordered taggings, newly added friends, profile picture updates, and likes, among other things.</p>
<h3>Interface</h3>
<p>While I found the Facebook API disappointing, I was able to recreate the Facebook news feed on my own webserver, using the Facebook PHP toolkit.  Finally, with a database backend to store moderations, I was able to produce a customized news feed with the ability to moderate friends&#8217; posts:</p>
<div id="attachment_1393" class="wp-caption aligncenter" style="width: 629px"><a href="http://www.keally.org/wp-content/uploads/2011/01/feedmod_main-e1295288838705.jpg"><img class="size-full wp-image-1393  " title="FeedMod News Feed" src="http://www.keally.org/wp-content/uploads/2011/01/feedmod_main-e1295288838705.jpg" alt="" width="614" height="270" /></a><p class="wp-caption-text">News Feed with Moderation Select Lists</p></div>
<p>To the right of each status update, I included a select list to moderate the post.  I also display the current moderation total for the friend, the friend&#8217;s moderated post count, and the percentile rank out of all friends (the friend with the most negative moderation total is 0%, the most positive is 100%).  This way, at a quick glance it is easy to see how many good or bad posts a friend has made to date.</p>
<p>I also created a statistics page, which ranks friends by the number of posts as well as lists of the top ten best and worst friends based on their moderation totals.  I also breakdown the moderation total and display the leaders of each moderation attribute (for example, who has the most &#8220;spam&#8221; posts).</p>
<h2>Evaluation</h2>
<p>After finishing the implementation, I then moderated posts for a month and now present an analysis of the results.  During a one month period, I moderated over 2,000 posts with 250 individual posters.  Some other interesting tidbits:</p>
<ul>
<li>67% of my friends posted at least once within this one month period</li>
<li>64% of all moderated posters were friends; the remaining are non-friends commenting on a friend&#8217;s post</li>
<li>93% of all moderated posts were made by friends</li>
</ul>
<p>Here is a breakdown of all moderated posts by their assigned attributes:</p>
<div id="attachment_1396" class="wp-caption aligncenter" style="width: 560px"><a href="http://www.keally.org/wp-content/uploads/2011/01/moderationSum-550.png"><img class="size-full wp-image-1396 " title="Moderation Breakdown" src="http://www.keally.org/wp-content/uploads/2011/01/moderationSum-550.png" alt="" width="550" height="385" /></a><p class="wp-caption-text">Moderation attributes by percentage of all moderated posts.</p></div>
<p>From the figure, a clear majority of posts are positive, while 35% are negative.  Out of all negative posts, the &#8220;indifferent&#8221; and &#8220;unintelligible&#8221; categories are used the most.  On the whole, I find most posts that I don&#8217;t like to be something I don&#8217;t care much about (and don&#8217;t want to read) or something that I don&#8217;t understand (usually it&#8217;s something taken out of context), hence the pervasiveness of the &#8220;indifferent&#8221; and &#8220;unintelligible&#8221; categories.  The &#8220;informative&#8221; category dominates the positive posts, followed by &#8220;insightful&#8221; and &#8220;interesting.&#8221;  My experience is that a significant number of posts (almost 40% to be exact) are status updates announcing what a particular friend is doing.  While most of these are mundane, I don&#8217;t really find them to be bothersome, hence the positive score.</p>
<p>Next, we look at how many posts each Facebook friend created during my one month evaluation:</p>
<div id="attachment_1398" class="wp-caption aligncenter" style="width: 560px"><a href="http://www.keally.org/wp-content/uploads/2011/01/postCountCdfUser-550.png"><img class="size-full wp-image-1398" title="Distribution of Posts per Friend" src="http://www.keally.org/wp-content/uploads/2011/01/postCountCdfUser-550.png" alt="" width="550" height="385" /></a><p class="wp-caption-text">Most friends post very little, but a few post all the time.</p></div>
<p>This figure shows the number of posts made by each friend that posted at least once.  A little less than 40% of my friends posted once, while about 3% posted more than 40 times in the past month.  One friend posted almost 120 times, or roughly four times per day!  Clearly, my news feed is dominated by posts from the same handful of friends.</p>
<p>Next, we look at the distribution of moderation scores across all of my Facebook friends:</p>
<div id="attachment_1399" class="wp-caption aligncenter" style="width: 560px"><a href="http://www.keally.org/wp-content/uploads/2011/01/postSumCdf-550.png"><img class="size-full wp-image-1399" title="Moderation Distribution" src="http://www.keally.org/wp-content/uploads/2011/01/postSumCdf-550.png" alt="" width="550" height="385" /></a><p class="wp-caption-text">Most of my friends have slightly positive moderation scores.</p></div>
<p>This figure shows that most of my Facebook friends (the ones that posted at least once) have a slightly positive moderation total. Since most of my friends do not post very much, the lack of extreme scores makes sense.  A small number of friends have very bad or very good scores &#8212; 3% have have a total less than -6 and another 3% have a total score greater than +20.  Those 3% that have the worst scores clearly stand out from the majority  of my friends and are definitely good candidates for defriending.   Conversely, the top 3% go a long way in keeping my news feed enjoyable.</p>
<p>Lastly, we look at both post count and moderation total:</p>
<div id="attachment_1400" class="wp-caption aligncenter" style="width: 560px"><a href="http://www.keally.org/wp-content/uploads/2011/01/postCountSum-550.png"><img class="size-full wp-image-1400" title="Post Quantity vs. Quality" src="http://www.keally.org/wp-content/uploads/2011/01/postCountSum-550.png" alt="" width="550" height="385" /></a><p class="wp-caption-text">Friends that post more tend to be more positive, but there are some outliers.</p></div>
<p>Here, we see the quantity and quality of posts made by each Facebook friend.  Some friends have identical (post count, moderation total) values, hence the z-axis indicating the number of overlapping friends.  Like the previous two figures, this shows that most friends have slightly positive moderation totals and low post counts.  It also appears as though friends with higher post counts tend to be more positive.  However, there are some friends that buck the trend and have very negative scores for relatively high post counts (as identified previously, these are the ones that should be defriended).</p>
<h2>Conclusions and Future Work</h2>
<p>After struggling with the limitations of the Facebook API, I was able to implement a moderation system for Facebook news feed posts. This moderation system quantifies the contributions of each friend to the news feed and clearly identifies the friends with very good and very bad posts.  Using this system, it is possible to filter the news feed based on friends&#8217; moderation scores as well as filter the news feed based on previous moderation of similar content.  It is also possible to extend the moderation system across a user&#8217;s social network, identifying friends whose posts are well liked by everyone.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.keally.org/2011/01/17/feedmod-quantifying-news-feed-contributions-of-facebook-friends/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Infographics: How reliable are they?</title>
		<link>http://www.keally.org/2010/01/12/infographics-how-reliable-are-they/</link>
		<comments>http://www.keally.org/2010/01/12/infographics-how-reliable-are-they/#comments</comments>
		<pubDate>Wed, 13 Jan 2010 03:44:04 +0000</pubDate>
		<dc:creator>Matt</dc:creator>
				<category><![CDATA[general]]></category>
		<category><![CDATA[info]]></category>
		<category><![CDATA[internet]]></category>
		<category><![CDATA[opinions]]></category>
		<category><![CDATA[rant]]></category>
		<category><![CDATA[socialnetworking]]></category>
		<category><![CDATA[statistics]]></category>

		<guid isPermaLink="false">http://www.keally.org/?p=1068</guid>
		<description><![CDATA[With the social media flood comes a torrent of infographics, most of which focus on presentation instead of information.  It reminds me of the &#8220;mediaglyphics&#8221; in yet another Neal Stephenson novel: The Diamond Age.  In the futuristic novel, mediaglyphics are used by corrupt governments and broadcast media to inform and entertain a mostly illiterate population.  [...]]]></description>
			<content:encoded><![CDATA[<p>With the social media flood comes a torrent of infographics, most of which focus on presentation instead of information.  It reminds me of the &#8220;mediaglyphics&#8221; in yet another Neal Stephenson novel: The Diamond Age.  In the futuristic novel, mediaglyphics are used by corrupt governments and broadcast media to inform and entertain a mostly illiterate population.  Infographics aren&#8217;t much different: they blast the reader with colorful line graphs, maps, and pie charts to present an implicit and oversimplified argument.</p>
<p>I&#8217;ve found many of these infographics to be packed with spelling and grammatical errors.  For example, try to find the error in this <a href="http://www.visualeconomics.com/where-is-americas-debt/">visualization of U.S. debt holders</a>.  With enormous font sizes and few words, any spelling or grammatical error really stands out.  Such easily identifiable problems make me question the integrity of the statistics (and implicit arguments) these infographics present.  Where did the data come from and how reliable are the sources?  Many infographics do not provide references, so how am I to know that it isn&#8217;t just some ten year old kid making this stuff up?  What if multiple sources produce conflicting results?  In such cases, it&#8217;s almost guaranteed that the infographic creator just picked the result/data that best furthered his or her argument.  Lastly, what information is not presented?  When reading an infographic, I always wonder if I am seeing the whole picture.  With so little information actually presented, I have no doubt that most of these infographics leave out plenty, especially stuff that hurts the creator&#8217;s argument.</p>
<p>I admit that infographics pique my interest in a subject to which I haven&#8217;t given much thought.  However, with minimal content and questionable integrity, they may be no more than <a href="http://en.wikipedia.org/wiki/Chartjunk">chartjunk</a>.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.keally.org/2010/01/12/infographics-how-reliable-are-they/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Reinstalling&#8230;</title>
		<link>http://www.keally.org/2009/12/12/reinstalling/</link>
		<comments>http://www.keally.org/2009/12/12/reinstalling/#comments</comments>
		<pubDate>Sun, 13 Dec 2009 03:45:55 +0000</pubDate>
		<dc:creator>Matt</dc:creator>
				<category><![CDATA[info]]></category>
		<category><![CDATA[site]]></category>

		<guid isPermaLink="false">http://www.keally.org/?p=1036</guid>
		<description><![CDATA[After being fed up with the firmware of the network appliance that runs this blog, I wiped everything and installed Debian. Until I get everything sorted out, stuff isn&#8217;t going to work quite the way it should.]]></description>
			<content:encoded><![CDATA[<p>After being fed up with the firmware of the network appliance that runs this blog, I wiped everything and installed Debian. Until I get everything sorted out, stuff isn&#8217;t going to work quite the way it should.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.keally.org/2009/12/12/reinstalling/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
	</channel>
</rss>
<!-- WP Super Cache is installed but broken. The path to wp-cache-phase1.php in wp-content/advanced-cache.php must be fixed! -->
