<?xml version="1.0" encoding="UTF-8"?>
<!-- generator="wordpress/2.1.3" -->
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	>

<channel>
	<title>The Data Mine Shaft</title>
	<link>http://datamineshaft.com/blog</link>
	<description>Telling Stories About People Through Data.  Updated Each Thursday.</description>
	<pubDate>Fri, 22 Aug 2008 05:10:40 +0000</pubDate>
	<generator>http://wordpress.org/?v=2.1.3</generator>
	<language>en</language>
			<item>
		<title>If the Shoe Overfits&#8230; Part One</title>
		<link>http://datamineshaft.com/blog/if-the-shoe-overfits-part-one</link>
		<comments>http://datamineshaft.com/blog/if-the-shoe-overfits-part-one#comments</comments>
		<pubDate>Fri, 22 Aug 2008 05:10:40 +0000</pubDate>
		<dc:creator>Dave</dc:creator>
		
		<category><![CDATA[MBTI]]></category>

		<guid isPermaLink="false">http://datamineshaft.com/blog/if-the-shoe-overfits-part-one</guid>
		<description><![CDATA[<p>(This is part one of a two-part series on criticism of MBTI personality theory.  In part one, I set the stage and cover some basic criticisms.  In part two, I&#8217;ll cover some in-depth criticisms and wrap things up.</p>
<p>I&#8217;ve written about the Myers-Briggs (MBTI) personality test in this blog in the past here, and in two parts here and here.  As such, this post assumes you have a basic knowledge of MBTI theory.  If you&#8217;re not familiar with MBTI tests, that post is a decent place to start.)</p>
<p>I&#8217;ve read a large number of books about MBTI personality <span class="read-more"><a href="http://datamineshaft.com/blog/if-the-shoe-overfits-part-one">...</a></span></p>]]></description>
			<content:encoded><![CDATA[<p><em>(This is part one of a two-part series on criticism of <a href="http://en.wikipedia.org/wiki/Myers-Briggs_Type_Indicator">MBTI</a> personality theory.  In part one, I set the stage and cover some basic criticisms.  In part two, I&#8217;ll cover some in-depth criticisms and wrap things up.</em></p>
<p>I&#8217;ve written about the <a href="http://en.wikipedia.org/wiki/Myers-Briggs_Type_Indicator">Myers-Briggs</a> (MBTI) personality test in this blog in the past <a href="http://datamineshaft.com/blog/a-post-with-personality">here</a>, and in two parts <a href="http://datamineshaft.com/blog/the-next-step-part-one">here</a> and <a href="http://datamineshaft.com/blog/the-next-step-part-two">here</a>.  As such, this post assumes you have a basic knowledge of MBTI theory.  If you&#8217;re not familiar with MBTI tests, <a href="http://datamineshaft.com/blog/a-post-with-personality">that post</a> is a decent place to start.)</p>
<p>I&#8217;ve read a large number of books about MBTI personality theory, mostly on the <a href="http://en.wikipedia.org/wiki/Keirsey_Temperament_Sorter">Keirsey variant</a> championed by psychologist David Keirsey.  (I&#8217;m starting to think I should start my own book club or something.)  I&#8217;ve read hundreds of emails on the INFJ (a particular MBTI type) <a href="http://www.infj.org/archive/infj-list.html">mailing list</a>.  And I even went as far as to take the MBTI Step II test at my own expense.  I&#8217;m both interested in and a fan of MBTI testing in general.</p>
<p>But something&#8217;s always bothered me about it.  In the first paragraph of my first post on MBTI I said, &#8220;&#8230;most of the [personality] tests seemed like pseudoscience gobbledygook to me&#8230;so for years I never paid them any mind.&#8221;  Ever since then I&#8217;ve always had my doubts on how accurate and reliable personality tests were.  After much reading and deliberation, I eventually settled on MBTI as being the best, but even then, I only accepted the Keirsey temperament version of the test.</p>
<p>And almost from the get-go, I mostly only spoke about Keirsey&#8217;s four main temperaments - &#8220;Artisans&#8221;, &#8220;Guardians&#8221;, &#8220;Idealists&#8221;, and &#8220;Rationals&#8221; - as opposed to the full 16-type treatment.  Four dimensions of 16 personality types, to me, has always seemed way too specific for something as malleable and vague as someone&#8217;s personality.</p>
<p>Fortunately, if you read <a href="http://www.keirsey.com/">Keirsey&#8217;s website</a> (and his books), he seems to feel much the same way I do.   On his site, the first thing you&#8217;ll probably see is a succinct summary of his four temperaments.  And here&#8217;s a quote from Keirsey himself in <a href="http://www.amazon.com/Please-Understand-Temperament-Character-Intelligence/dp/1885705026">&#8220;Please Understand Me II&#8221;</a>, the updated version of his seminal book on temperament theory:  &#8220;I soon found it convenient and useful to partition Myers&#8217;s sixteen types into four groups&#8230;&#8221;  I&#8217;m more inclined to agree with him and the four types he saw (&#8221;Artisans&#8221;, &#8220;Guardians&#8221;, &#8220;Idealists&#8221;, and &#8220;Rationals&#8221;) rather than with Myers&#8217;s four types (which are somewhat different).</p>
<p>For those who don&#8217;t already know, Keirsey&#8217;s four types are easily explained by example.  Here&#8217;s what I wrote on this topic <a href="http://datamineshaft.com/blog/a-post-with-personality">earlier</a> (&#8221;People Patterns&#8221; being an introductory book on temperament theory):</p>
<p>&#8220;The best example in &#8216;People Patterns&#8217; is from The Wizard of Oz. The Cowardly Lion is the Artisan looking for courage, Dorothy is the Guardian looking to go home, the Tin Man is an Idealist looking for a heart, and the Scarecrow is a Rational looking for a brain. Whichever character you identify with most (if any) is probably your Keirsey temperament.</p>
<p>If you need a more contemporary example, you can use the houses in Harry Potter. Slytherin are Artisans, Hufflepuff are Guardians, Gryffindor are Idealists, and Ravenclaw are Rationals.&#8221;</p>
<p>And thus those are the four basic personality temperaments.  (Unless you think &#8220;The Wizard of Oz&#8221; is <a href="http://en.wikipedia.org/wiki/Political_interpretations_of_The_Wonderful_Wizard_of_Oz">secretly about William Jennings Bryan</a> or something.)  You&#8217;ll notice that Keirsey (as well as Myers and Briggs) studiously avoids any perjorative judgments about personality types in most of his writings.  They are all usually described in neutral or even optimistic terms.  This is because MBTI theory is more of a tool for personal exploration than evaluation.  Also, I think having negative claims about certain personality types is both presumptuous and counter-productive.  (I think Keirsey would agree.)</p>
<p>However, are personality tests like horoscopes, then?  Are MBTI personality types so vague and optimistic that they suffer from the <a href="http://en.wikipedia.org/wiki/Barnum_effect">&#8220;Forer effect&#8221;</a>?  (The Forer effect is the semi-well-known phenomenon of people tending to identify with vague generalities if for some reason they believe these generalities apply specifically to them, especially if these things are positive.)</p>
<p>In my experience with MBTI tests this hasn&#8217;t been true.  I feel pretty strongly about being a &#8220;Rational&#8221; and reading about the other types just reinforces this in my mind.  Here&#8217;s what Wikipedia <a href="http://en.wikipedia.org/wiki/Myers-Briggs_Type_Indicator">has to say</a>:</p>
<p>&#8220;Skeptics criticize the terminology of the MBTI as being so vague as to allow any kind of behavior to fit any personality type, resulting in the Forer effect, where an individual gives a high rating to a positive description that supposedly applies specifically to them[22][23]. However, the descriptions offered for the 16 psychological types are often quite detailed and specific, unlike the &#8216;vague and general personality descriptions&#8217;[28] that characterize the Forer effect. For example, David Keirsey[29] examined how the four temperaments differ in terms of language use, intellectual orientation, educational and vocational interests, social orientation, self image, personal values, social roles and even characteristic hand gestures. Keirsey went on to describe the hierarchy of intellectual roles played by each of the four types within each temperament, resulting in sixteen unique descriptions which, unlike the Forer effect, rely not on the universal traits that make human beings the same, but on the specific traits that make human beings different from one another.&#8221;</p>
<p>What do people who take the test (other than me) have to say about it, then?  From the same Wikipedia article:</p>
<p>&#8220;When people are asked to compare their preferred type to that assigned by the MBTI, only half of people pick the same profile.[26] Critics also argue that the MBTI lacks falsifiability, which can cause confirmation bias in the interpretation of results.&#8221;</p>
<p>That&#8217;s not a great statistic.  However, that&#8217;s for people testing for the same 4-letter type as before (i.e. one of the 16 personality types).  My argument, though, is that 16 types is too many.  More on that later.  As for <a href="http://en.wikipedia.org/wiki/Confirmation_bias">confirmation bias</a>, that&#8217;s a common criticism, and one not easily dismissed.  </p>
<p>Confirmation bias is the simple idea that we are much more likely to observe and pick out evidence supporting our views rather than evidence that suggests otherwise.  And it&#8217;s pervasive.  One particularly compelling book about confirmation bias is <a href="http://www.fooledbyrandomness.com/">Nassim Taleb&#8217;s</a> <a href="http://www.amazon.com/Black-Swan-Impact-Highly-Improbable/dp/1400063515">&#8220;The Black Swan&#8221;</a> (and, to a lesser extent, his other book <a href="http://www.amazon.com/Fooled-Randomness-Hidden-Chance-Markets/dp/0812975219/ref=bxgy_cc_b_text_b">&#8220;Fooled by Randomness&#8221;</a>).  One of the biggest themes of &#8220;The Black Swan&#8221; is that confirmation bias is harmful and widespread.</p>
<p>It&#8217;s obvious I take Taleb seriously since I <a href="http://datamineshaft.com/blog/not-normal">wrote a post</a> on his book and I include him in my sidebar.  My response to him, in the case of personality tests, would be that I, like many others, am often a victim of confirmation bias.  But I&#8217;m aware of that fact and I try to stay vigilant.  The fact that MBTI theory usually never strays into pejorative territory will always make its personality profiles prone to confirmation bias (since you&#8217;re always much more likely to identify with neutral and positive statements about yourself).  However, as I&#8217;ve said, I think the benefits of this approach outweigh the negatives, especially if you&#8217;re on watch for confirmation bias.  (Is this statement itself a product of confirmation bias?  Wait, that&#8217;s too skeptical even for me&#8230;)</p>
<p>I should also mention that the MBTI test is <a href="http://en.wikipedia.org/wiki/Boolean_logic">boolean</a>, or as they call it in the jargon, &#8220;modal&#8221;.  That means each question on MBTI tests has only 2 answers, each of which tests one of the four dimensions of personality.  While this approach often feels constricting and forced (it doesn&#8217;t allow for shades of gray on particular questions), modal tests should suffer less from the Forer effect, since they force you into clear yes-and-no answers.</p>
<p>There&#8217;s something about the MBTI test that concerns me even more than confirmation bias, though.  Since this post is getting a bit lengthy, I&#8217;ll cover that next time.  Stay tuned!</p>
]]></content:encoded>
			<wfw:commentRss>http://datamineshaft.com/blog/if-the-shoe-overfits-part-one/feed/</wfw:commentRss>
		</item>
		<item>
		<title>Word Play</title>
		<link>http://datamineshaft.com/blog/word-play</link>
		<comments>http://datamineshaft.com/blog/word-play#comments</comments>
		<pubDate>Fri, 15 Aug 2008 12:00:44 +0000</pubDate>
		<dc:creator>Dave</dc:creator>
		
		<category><![CDATA[Linguistics]]></category>

		<category><![CDATA[Data Sharing]]></category>

		<category><![CDATA[Visualization]]></category>

		<guid isPermaLink="false">http://datamineshaft.com/blog/word-play</guid>
		<description><![CDATA[<p>The other day I happened to come across a nifty new feature on the data sharing site &#8220;Many Eyes&#8221; called &#8220;Wordles&#8221;.  As you may know from my last post, I&#8217;ve already written about Many Eyes before (here and here) as well as another data sharing site, Swivel, here.</p>
<p>But Wordles are something new: highly customizable tag clouds.  Many Eyes already has tag cloud functionality, of course; I was an especially big fan of their tag cloud comparsion tool.  But tag clouds don&#8217;t have the best reputation.  Some people outright hate them.  And the people at Many <span class="read-more"><a href="http://datamineshaft.com/blog/word-play">...</a></span></p>]]></description>
			<content:encoded><![CDATA[<p>The other day I happened to come across a nifty new feature on the data sharing site <a href="http://services.alphaworks.ibm.com/manyeyes/home">&#8220;Many Eyes&#8221;</a> called <a href="http://manyeyes.alphaworks.ibm.com/blog/2008/08/05/welcoming-wordle-to-many-eyes/">&#8220;Wordles&#8221;</a>.  As you may know from my last post, I&#8217;ve already written about Many Eyes before (<a href="http://datamineshaft.com/blog/eyes-on-the-prize-part-one">here</a> and <a href="http://datamineshaft.com/blog/eyes-on-the-prize-part-two">here</a>) as well as another data sharing site, <a href="http://www.swivel.com/">Swivel</a>, <a href="http://datamineshaft.com/blog/i-swivel-data">here</a>.</p>
<p>But Wordles are something new: highly customizable <a href="http://en.wikipedia.org/wiki/Tag_cloud">tag clouds</a>.  Many Eyes already has tag cloud functionality, of course; I was an especially big fan of their <a href="http://manyeyes.alphaworks.ibm.com/blog/2008/04/01/a-cloud-of-comparisons/">tag cloud comparsion tool</a>.  But tag clouds don&#8217;t have the best reputation.  <a href="http://www.dougma.com/archives/57">Some people</a> outright hate them.  And the people at Many Eyes admit they&#8217;re a bit of a &#8220;toy&#8221;.  (A toy for nerds, anyway.)  Why bother adding another tag cloud tool, then?</p>
<p>Here&#8217;s what Many Eyes has to say about the issue: &#8220;People have reported finding value beyond entertainment in creating these word clouds. Teachers have used Wordles in classrooms as conversation catalysts; others have created them to express their identities, and scholars have used them to visualize the output of statistical explorations of texts.&#8221;  So obviously they&#8217;re novel at visualization.  Let&#8217;s look a little deeper, though.</p>
<p>One thing you can use Wordles for is to analyze texts you&#8217;re already familiar with.  In fact, I thought you could use them as a sort of <a href="http://en.wikipedia.org/wiki/CliffsNotes">&#8220;Cliffs Notes&#8221;</a> for blog posts.  To test this idea, I took four sample posts of mine (<a href="http://datamineshaft.com/blog/a-post-with-personality">1</a>, <a href="http://datamineshaft.com/blog/mind-the-gap">2</a>, <a href="http://datamineshaft.com/blog/field-study-the-mall">3</a>, and <a href="http://datamineshaft.com/blog/double-trouble">4</a>) and made Wordles of all of them: <a href="http://services.alphaworks.ibm.com/manyeyes/view/Sq22ZPsOtha65UkuUOsbP2~">1</a>, <a href="http://services.alphaworks.ibm.com/manyeyes/view/Sq22ZPsOtha6IUk84ZsbP2~">2</a>, <a href="http://services.alphaworks.ibm.com/manyeyes/view/Sq22ZPsOtha6TUUeTxsbP2~">3</a>, and <a href="http://services.alphaworks.ibm.com/manyeyes/view/Sq22ZPsOtha6gUEOE2tbP2~">4</a>.</p>
<p>If you want to experiment along with me, feel free to read those posts first, if you haven&#8217;t.  Then, try looking at each of those visualizations and seeing how well they summarize those posts.  Alternately, you could try just looking at my Wordles first and see how they do (especially if you&#8217;ve already read them).  I&#8217;ll give you a short break here, if you need it.</p>
<p><a href="http://www.youtube.com/watch?v=prHZ9ihnOs8">INTERMISSION</a></p>
<p>Back to our regularly scheduled programming.  Personally I found Wordles worked fairly well as an &#8220;emotional Cliffs Notes&#8221; for a post.  I&#8217;m not sure you get a lot of analytical content out of these things, but it seems like the major concepts and the overall &#8220;feel&#8221; of a post are conveyed quite well by a Wordle.  If <a href="http://www.worth1000.com/default.asp">a picture is worth a thousand words</a>, I&#8217;d say a Wordle is worth a few hundred.  Wordles definitely hit the highlights of jargon-heavy posts like <a href="http://datamineshaft.com/blog/a-post-with-personality">1</a>.  They also did a good job at giving you the gist of new technology posts like <a href="http://datamineshaft.com/blog/mind-the-gap">2</a>, which are often highly focused.  Lastly, I think Wordles captured the feel of cuter, human-interest style posts like <a href="http://datamineshaft.com/blog/field-study-the-mall">3</a> and <a href="http://datamineshaft.com/blog/double-trouble">4</a> quite well.</p>
<p>I don&#8217;t know if I could tell you exactly what a blog post was about after seeing a Wordle for it, but I could probably tell you the major concepts and how important they were, relatively speaking, and I&#8217;d also probably have a rough idea about the post&#8217;s topic.  Seems like a good thing to look at just before or just after reading a post proper, either to prepare you beforehand or reinforce what you&#8217;ve just seen.  Wordles are kind of like an artistic way of taking notes, I guess.</p>
<p>Of course, I wrote all those posts, so perhaps my objectivity is lacking.  Maybe I already knew those posts too well to give an accurate account of what Wordles can do.  To account for this, I decided to make a Wordle for something I knew intimately (but didn&#8217;t write) and a Wordle for something I only had a vague idea about to compare. </p>
<p>For something I knew intimately, I used <a href="http://www.whysanity.net/monos/sleepyhollow2.html">Lady Van Tassel&#8217;s ending monologue</a> from the climax of the movie <a href="http://www.imdb.com/title/tt0162661/">&#8220;Sleepy Hollow&#8221;</a> (directed by Tim Burton).  I don&#8217;t quite know why, but I&#8217;m semi-obsessed with this movie.  Actually, I probably do know.  After several years, I figured out the movie involved an almost stereotypical love story between - in MBTI personality theory terms - a Rational (Ichabod Crane) and an Idealist (Katrina Van Tassel).  (Also, I love the science/religion dichotomy and Tim Burton in general, too.)  If you want some background on MBTI theory, feel free to check out my post about it <a href="http://datamineshaft.com/blog/a-post-with-personality">here</a>.</p>
<p>The main point, though, is that I know &#8220;Sleepy Hollow&#8221; well.  I know it so well that after the third or fourth viewing (I&#8217;ve seen the movie over 20 times) I found a plot hole shortly after the monologue in question, which I found out was fixed in the <a href="http://www.imsdb.com/scripts/Sleepy-Hollow.html">original script</a>, but was later changed for reasons I can&#8217;t understand.  (The idea that Lady Van Tassel can, without explanation, return to Sleepy Hollow and collect her inheritance after every other heir has died and she herself was presumed dead is totally preposterous.  So much for her plan.  It&#8217;s not obvious the first time you watch it, though.)</p>
<p>As for something I knew less well, I used Lyndon Johnson&#8217;s <a href="http://www.famousquotes.me.uk/speeches/Lyndon_B_Johnson/1.htm">&#8220;Great Society&#8221; speech</a>.  Lyndon Johnson&#8217;s been on my mind ever since I started playing the excellent board game <a href="http://www.boardgamegeek.com/game/27708">Making the President</a>, which simulates the <a href="http://en.wikipedia.org/wiki/John_F._Kennedy">1960 presidential election</a> between Kennedy and Nixon.  (Johnson, of course, was Kennedy&#8217;s vice president.)  Knowing roughly what the &#8220;Great Society&#8221; was, I had the vaguest idea what the speech was about, but it&#8217;s nothing I really studied.</p>
<p>I made Wordles for both speeches <a href="http://services.alphaworks.ibm.com/manyeyes/view/Sq22ZPsOtha62VEXJVtbP2~">here</a> and <a href="http://services.alphaworks.ibm.com/manyeyes/view/Sq22ZPsOtha6FV~R1ptbP2~">here</a>.  Again, feel free to try this experiment along with me.  (And leave a comment about your experience, if you&#8217;re so inclined.)</p>
<p><a href="http://www.youtube.com/watch?v=nvbmITNo8zc">INTERMISSION</a></p>
<p>I must say, Wordles definitely gave me the gist of both posts and really conveyed the emotional content well.  All the right words were really popping out, and whether I knew the content beforehand or not, the Wordles seemed to do the job admirably.  </p>
<p>For example, you can easily see the most important happenings, names, and events in the <a href="http://www.whysanity.net/monos/sleepyhollow2.html">Sleepy Hollow monologue</a>.  And in <a href="http://www.famousquotes.me.uk/speeches/Lyndon_B_Johnson/1.htm">Lyndon Johnson&#8217;s speech</a>, the biggest concepts and buzzwords really jump out at you.  Word frequency, when done well, really does seem to work like an &#8220;emotional Cliffs Notes&#8221;.  </p>
<p>Of course, you can make Wordles that focus more on style, at the expense of content.  I purposely used only four distinct colors and horizontal orientations for words so that the words were as clear as possible.  If you use different color shadings and orientations, everything gets a little harder to read, but it might look cooler.  I also purposely chose a <a href="http://en.wikipedia.org/wiki/Serif">serif</a> font so that the words would be spaced farther apart and be maximally clear.  Normally, a <a href="http://en.wikipedia.org/wiki/Sans-serif">sans-serif</a> font is better to read online (as mentioned in that Wikipedia link) due to less on-screen clutter, but in the particular case of Wordles serifs appear to actually <em>reduce</em> the clutter, since words can appear anywhere in relation to each other, often near the serifs.  I also chose the calm default colors, since they have a lot of contrast without being &#8220;loud&#8221;.</p>
<p>The customization is definitely something that can be a problem - you can easily make text that&#8217;s downright unreadable if you want. There&#8217;s some other issues I had with Wordles as well; I&#8217;ll admit that Many Eyes has definitely improved the uploading interface since the last time I used it (uploading is often one of the worst parts of these data-sharing websites), but still, I often found myself going back to the source to read the data I uploaded because it was hard to read on the site, and the interface was a bit clunky.  And the uploading process is still not something &#8220;your Grandma could do&#8221;, in the words of the <a href="http://databasin.org/cbi/info/aboutPage">Data Basin</a> folks.  And though it&#8217;s a small thing, for some reason Wordle also gives you semi-random settings each time you make a Wordle.  I&#8217;d much rather have it remember the settings I used last time, or at least have a default option or something.  </p>
<p>The worst thing I found, though, was the showstopping Firefox 3 bug in the Wordle application.  It will often, without warning, crash Firefox 3 upon loading.  That&#8217;s bad.  Especially since I have almost never had this happen on any other page in any recent release of Firefox.  It&#8217;s happened to me at least 15-20 times, so I know it&#8217;s not a fluke.  And it&#8217;s apparently happened to <a href="http://databasin.org/cbi/info/aboutPage">other people</a> as well.  I don&#8217;t know what&#8217;s causing this, but hopefully they fix it soon.  (Wordle crashed Firefox the last time I made a visualization, actually.  It caused me to lose part of this post.  OK, deep breath, exhale.  Deep breath, exhale&#8230; that&#8217;s better.)</p>
<p>But I don&#8217;t want to be too negative.  I think Wordles are actually pretty cool, and if you use my method (I&#8217;m sure there are others) or some of the uses mentioned by Many Eyes, maybe they&#8217;re more than just &#8220;a self-described &#8216;toy&#8217;&#8221;.  Obviously, the next logical step is tag cloud comparisons for Wordles, right?  Well, actually, <a href="http://services.alphaworks.ibm.com/manyeyes/view/S5OhhPsOtha6mUUWq7zkP2~">I&#8217;m not sure</a> that&#8217;s the best idea.</p>
]]></content:encoded>
			<wfw:commentRss>http://datamineshaft.com/blog/word-play/feed/</wfw:commentRss>
		</item>
		<item>
		<title>Slow Movin&#8217; MCs Is Waiting for the Editin&#8217;</title>
		<link>http://datamineshaft.com/blog/slow-movin-mcs-is-waiting-for-the-editin</link>
		<comments>http://datamineshaft.com/blog/slow-movin-mcs-is-waiting-for-the-editin#comments</comments>
		<pubDate>Fri, 15 Aug 2008 04:05:53 +0000</pubDate>
		<dc:creator>Dave</dc:creator>
		
		<category><![CDATA[Uncategorized]]></category>

		<guid isPermaLink="false">http://datamineshaft.com/blog/slow-movin-mcs-is-waiting-for-the-editin</guid>
		<description><![CDATA[<p>Tonight&#8217;s post is ready to go, but my brother won&#8217;t be able to edit it until late.  So, I&#8217;ll just put it up early this morning.  Sorry about that.  The semi-relevant title of this post is from the Wu-Tang rapper GZA&#8217;s song &#8220;Duel of the Iron Mic&#8221;.  Be back in a few hours! <span class="read-more"><a href="http://datamineshaft.com/blog/slow-movin-mcs-is-waiting-for-the-editin">...</a></span></p>]]></description>
			<content:encoded><![CDATA[<p>Tonight&#8217;s post is ready to go, but my brother won&#8217;t be able to edit it until late.  So, I&#8217;ll just put it up early this morning.  Sorry about that.  The semi-relevant title of this post is from the Wu-Tang rapper GZA&#8217;s song <a href="http://www.lyricsfreak.com/g/genius/duel+of+the+iron+mic_20058974.html">&#8220;Duel of the Iron Mic&#8221;</a>.  Be back in a few hours!</p>
]]></content:encoded>
			<wfw:commentRss>http://datamineshaft.com/blog/slow-movin-mcs-is-waiting-for-the-editin/feed/</wfw:commentRss>
		</item>
		<item>
		<title>Flight of Fancy</title>
		<link>http://datamineshaft.com/blog/flight-of-fancy</link>
		<comments>http://datamineshaft.com/blog/flight-of-fancy#comments</comments>
		<pubDate>Fri, 08 Aug 2008 00:47:18 +0000</pubDate>
		<dc:creator>Dave</dc:creator>
		
		<category><![CDATA[Uncategorized]]></category>

		<guid isPermaLink="false">http://datamineshaft.com/blog/flight-of-fancy</guid>
		<description><![CDATA[<p>Well, this week I&#8217;ll be out-of-town for the third straight weekend in a row.  The last two weekends I&#8217;ve been able to post despite this, but it&#8217;s finally all catching up with me.  I also have to pack more than usual this week, and get up super early for a flight.  I got about halfway through a post this week but I&#8217;m just running out of time.  Sorry folks, you&#8217;ll have to wait until next week.</p>
<p>In the meantime, feel free to check out this Google Tech Talk I came across.  (I talked about Google Tech <span class="read-more"><a href="http://datamineshaft.com/blog/flight-of-fancy">...</a></span></p>]]></description>
			<content:encoded><![CDATA[<p>Well, this week I&#8217;ll be out-of-town for the third straight weekend in a row.  The last two weekends I&#8217;ve been able to post despite this, but it&#8217;s finally all catching up with me.  I also have to pack more than usual this week, and get up super early for a flight.  I got about halfway through a post this week but I&#8217;m just running out of time.  Sorry folks, you&#8217;ll have to wait until next week.</p>
<p>In the meantime, feel free to check out this <a href="http://video.google.com/videoplay?docid=-3667324198527754733&#038;q=data+mining+%22Google+Tech+Talks%22+duration%3Along+(site%3Avideo.google.com+OR+site%3Ayoutube.com)&#038;hl=en">Google Tech Talk</a> I came across.  (I talked about <a href="http://www.google.com/research/video.html">Google Tech Talks</a> in <a href="http://datamineshaft.com/blog/geography-lesson">last week&#8217;s post.</a>)  It&#8217;s a class on Data Mining, taught by a Stanford professor at Google.  Since he works there, he figured he&#8217;d just repeat the same lectures at Google (!) minus all the tests and such.  </p>
<p>Anyway, it seems like a pretty cool class (if you&#8217;re into data mining, anyway) that goes over the basics of using <a href="http://www.r-project.org/">R</a> and various data mining concepts.  For someone like me that could use some more exposure to this stuff, it seems like a Godsend.  I already bought the book for the class and I plan to watch all the lectures and do the exercises when I can.  Good times!</p>
]]></content:encoded>
			<wfw:commentRss>http://datamineshaft.com/blog/flight-of-fancy/feed/</wfw:commentRss>
		</item>
		<item>
		<title>Geography Lesson</title>
		<link>http://datamineshaft.com/blog/geography-lesson</link>
		<comments>http://datamineshaft.com/blog/geography-lesson#comments</comments>
		<pubDate>Fri, 01 Aug 2008 04:34:25 +0000</pubDate>
		<dc:creator>Dave</dc:creator>
		
		<category><![CDATA[Data Sharing]]></category>

		<category><![CDATA[Geography]]></category>

		<guid isPermaLink="false">http://datamineshaft.com/blog/geography-lesson</guid>
		<description><![CDATA[<p>Geography was not my strong suit in school; it required lots of memorization about a lot of faraway places I&#8217;d never been to in the 6th grade.  To make matters worse, geographical names for countries and cities change all the time.  Seemed kind of silly to my pre-teen self.</p>
<p>At some level, though, I realized the utility in it.  I undertook to learn what I could, which was usually just their names along with some other odd fact here and there (&#8221;Burma&#8217;s main export is jute&#8221;, etc.).  Some years later, in college, I found out much more <span class="read-more"><a href="http://datamineshaft.com/blog/geography-lesson">...</a></span></p>]]></description>
			<content:encoded><![CDATA[<p>Geography was not my strong suit in school; it required lots of memorization about a lot of faraway places I&#8217;d never been to in the 6th grade.  To make matters worse, geographical names for <a href="http://en.wikipedia.org/wiki/Myanmar">countries</a> and <a href="http://en.wikipedia.org/wiki/Bombay">cities</a> change <a href="http://en.wikipedia.org/wiki/Geographical_renaming">all the time</a>.  Seemed kind of silly to my pre-teen self.</p>
<p>At some level, though, I realized the utility in it.  I undertook to learn what I could, which was usually just their names along with some other odd fact here and there (&#8221;Burma&#8217;s main export is jute&#8221;, etc.).  Some years later, in college, I found out much more about these countries through the wonders of <a href="http://www.economist.com/">&#8220;The Economist&#8221;</a> magazine.  (Not to be confused with <a href="http://www.theeconomist.com/">&#8220;theeconomist.com&#8221;</a>, which is a simple, odd little page dedicated to Alan Greenspan.)  Despite its name, &#8220;The Economist&#8221; is about more than just economics - it&#8217;s most often about politics, actually, which is how Nelson Mandela <a href="http://www.youtube.com/watch?v=s90O1d2EEyU">got away with</a> reading about world affairs for years when he was in jail.</p>
<p>Anyway, having some context and history lessons about different countries around the world really did wonders for my geography knowledge.  Now I can tell you that Pakistan is to the Northwest of India, as well as having been a part of it in the past, and I can tell you that Lithuania is one of the three <a href="http://en.wikipedia.org/wiki/Baltic_states">Baltic States</a> in Northern Europe.  My siblings and I are a quarter Lithuanian, and thus we have a sort of fascination with the country.  Our unusual surname (&#8221;Younskevicius&#8221;) is an Anglicized Lithuanian last name.  (It should probably be &#8220;Januskevicius&#8221; instead.)  That means that, given its status as an odd American/Lithuanian hybrid, almost no one can ever say it right, which in turn has led our family to develop a number of unusual coping techniques.  (&#8221;Younski&#8221;, &#8220;Y&#8221;, &#8220;YY&#8221;, and even &#8220;Young&#8221; - especially helpful for pizza delivery.)  </p>
<p>However, every once in a long while, someone says our name perfectly.  They often follow that with a question like, &#8220;Your name&#8217;s Lithuanian, right?&#8221;  (Most people have no clue.)  After I finish looking astonished, I usually nod my head.  One person even informed me that all last names ending in &#8220;-ius&#8221; are Lithuanian.  You can use that fun fact to surprise the <a href="http://en.wikipedia.org/wiki/Joe_Jurevicius">next Lithuanian you might meet</a>.</p>
<p>But enough about names.  It&#8217;s merely my long-winded way of saying that geography never came easily to me, and that for the geographically-challenged out there reading this post, you have my sympathy.  </p>
<p>Even I have my limits.  <a href="http://en.wikipedia.org/wiki/Geographic_information_system">Geographic Information Systems</a> (GIS) have always seemed a bit scary and hard to follow to me.  I first came across GIS through reading the entire Bureau of Labor Statistics&#8217; <a href="http://www.bls.gov/oco/">Occupational Outlook Handbook</a> (OOH), which was an intense and time-consuming process, to say the least.  (I wrote about the experience of reading it here in an <a href="http://datamineshaft.com/blog/working-toward-your-goal">earlier post</a>.)</p>
<p>In the OOH (how&#8217;s that for a fun acronym?) I read about people whose entire job was to use, analyze, and report using GIS.  They&#8217;re called <a href="http://www.bls.gov/oco/ocos040.htm">Geographic Information Specialists</a> (also GIS, which is also different from <a href="http://images.google.com/">this GIS</a>, resulting in a spectacular case of <a href="http://www.imc.org/ietf-calendar/archive1/msg00412.html">acronym collision</a>).  They&#8217;re related to surveyors, cartographers, and photogrammetrists.  By the way, I use photogrammetrists as my stock anecdote for jobs I read about in the OOH.  They have a weird, technical-sounding name, and no one ever seems to know what they do.  (Another great trivia question.)</p>
<p>I read up a bit on what you have to study and know to be a GIS and, frankly, it seemed a bit daunting even to my data nerd self.  Since then I&#8217;ve had the job in the back of my mind, coming up every now and again when I heard snippets about them and the data they use.  I&#8217;ve seen them at work in cool applications like <a href="http://earth.google.com/enterprise/earth_enterprise.html">Google Earth</a>, but that was as far as it went.</p>
<p>Until today, when my long-time buddy Dan sent me <a href="http://www.youtube.com/watch?v=LpC_S6V6l2g">this Youtube link</a>.  (Dan also helps with the technical aspects of the site, which is invaluable - thanks Dan!)  That video is one of Google&#8217;s fascinating <a href="http://www.google.com/research/video.html">&#8220;tech talks&#8221;</a>.  (I just found out about them today.)</p>
<p>Anyway, the video is about getting people to share their research data, with a research project they&#8217;re developing called <a href="http://databasin.org/">&#8220;Data Basin&#8221;</a>.  Data Basin is a site for uploading, sharing, visualizing, and commenting on GIS conservation-related data.  You can read more about their goals <a href="http://databasin.org/cbi/info/aboutPage">here</a>.  Basically, they want to improve access to these data and make it easier to share and work with.  </p>
<p>It&#8217;s an amicable goal.  Having run this blog for over a year now, I already see how hard it can be to get at the data I want at times, even if it&#8217;s publicly available.  Us &#8220;data vultures&#8221; can have it hard.  Sometimes you have to pay for the data, sometimes you have to <a href="http://en.wikipedia.org/wiki/Web_scraping">scrape</a> to get it, and sometimes, well, you just can&#8217;t get the data at all.  </p>
<p>Other sites like <a href="http://services.alphaworks.ibm.com/manyeyes/app">&#8220;Many Eyes&#8221;</a> and <a href="http://www.swivel.com/">&#8220;Swivel&#8221;</a> have a similar goal to Data Basin and are also about sharing data.  (I wrote about Swivel <a href="http://datamineshaft.com/blog/i-swivel-data">here</a> and Many Eyes <a href="http://datamineshaft.com/blog/eyes-on-the-prize-part-one">here</a> and <a href="http://datamineshaft.com/blog/eyes-on-the-prize-part-two">here</a>.)  The difference is that Data Basin is still in an alpha phase and is more highly specialized.  That makes it an interesting contrast to the other data-sharing websites that are already live and have a greater diversity of data.</p>
<p>It also means I can&#8217;t upload any data to test and play with, as I normally would in situations like this.  (&#8221;Learning by doing&#8221; is one of my mantras, as long-term readers of this blog already know.)  The best you can do is <a href="http://databasin.org/">take a tour of the site</a> instead.  However, in watching that <a href="http://www.youtube.com/watch?v=LpC_S6V6l2g">Data Basin tech talk</a>, I learned a number of other interesting things which piqued my interest.  Having used other data-sharing websites, I knew what to look for, and a few questions came up in my mind as I watched.</p>
<p>The first thing I wondered is how easy the data would be to upload.  I knew from using Many Eyes and Swivel that uploading data and getting it in the format you want can be a pain in the neck (to put it mildly).  Sure enough, someone asked about this, and the presenters confirmed that the data upload is the &#8220;scariest&#8221; part of the site.  (They even specifically named Many Eyes and Swivel as models to emulate.)</p>
<p>As they mention, Data Basin&#8217;s uploading tools are mostly geared toward their main partners in the <a href="http://www.consbio.org/about">Conservation Biology Institute</a>.  They mention, however, that they won&#8217;t consider themselves a success until the uploading tools are more user-friendly.  Just accepting comma-separated value (CSV) files isn&#8217;t enough; you have to make it so &#8220;your grandma&#8221; can cut-and-paste data from Excel into the site and have it work.  Anyway, I think it&#8217;s interesting hearing the Data Basin people talk about these concerns at such an early stage of development.</p>
<p>Apparently I wasn&#8217;t the only one intimidated by GIS data, either.  One of the main presenters, a Ph.D-educated woman named Tasha, had the same problems.  (I couldn&#8217;t find her bio online anywhere so I&#8217;m not going to try and spell her last name.  Mine gets butchered enough, so I know the feeling.)  She said that it took easy-to-use visualization tools like Data Basin for her to make some use out of GIS data, something she&#8217;d never done before.  Thus, when the site goes live, maybe I&#8217;ll be able to use GIS data for something more than cursory curiosity (i.e. Google Earth).  We&#8217;ll see.</p>
<p>I also learned a little about Data Basin&#8217;s developers, <a href="http://www.rhizalabs.com/about-us/">Rhiza Labs</a>.  Apparently one of their main aims is to implement a database under the <a href="http://en.wikipedia.org/wiki/Information_Commons">Information Commons standard</a>.  (Check the second &#8220;external link&#8221; at the bottom of the page for an extremely thorough description of the idea, in PDF format.)  Rhiza Labs, they said, is implementing a peer-to-peer version of this standard by creating a data storage cloud.  The idea is that the same bits of data would be shared, redundantly, across many different computers.  Thus, you have a data &#8220;cloud&#8221; that you can easily propagate data through and query as you wish.  And the architecture is open-source, or at least will be at some point.  Pretty cool.</p>
<p>As an aside, I appreciate Data Basin&#8217;s conservation-oriented focus, too.  Years ago, I used to volunteer for beach cleanups, and I distributed information about ecological causes from time to time as well.  Conservation has always been a topic close to my heart.  At work, I have the most plants in my office by far, and most of them are live.  (Quick tip: I find the <a href="http://en.wikipedia.org/wiki/Lucky_bamboo">&#8220;Lucky Bamboo&#8221;</a> plant does the best out of any inside plant. There&#8217;s a reason you always see it in cube farms.)  Data Basin&#8217;s aim to bring reluctant researchers and hot-headed advocates together is a good thing, I think.  The researchers crave recognition and the advocates need data, but, as the presenters mention, they don&#8217;t often talk to each other.  (That&#8217;s been my personal experience as well.)</p>
<p>So Data Basin has some new ways of doing things, but they still have some growing pains to work out in their alpha phase.  They might manage to get me over my aversion to using GIS data, and maybe they&#8217;ll even help the planet in the long run.  But the real question is, &#8220;Will they help me get to know geography better?&#8221;  Considering that I often mix up which countries are in Scandinavia, and the Red Sea with the Mediterranean Sea, maybe not.  My 6th grade geography teacher would not be impressed.  If you&#8217;re reading this, Mr. Tuttle, one day I&#8217;ll remember Iran is to the right of Iraq, and not the left.  One day.</p>
]]></content:encoded>
			<wfw:commentRss>http://datamineshaft.com/blog/geography-lesson/feed/</wfw:commentRss>
		</item>
		<item>
		<title>Happiness is&#8230;?, Part Two</title>
		<link>http://datamineshaft.com/blog/happiness-is-part-two</link>
		<comments>http://datamineshaft.com/blog/happiness-is-part-two#comments</comments>
		<pubDate>Fri, 25 Jul 2008 01:41:50 +0000</pubDate>
		<dc:creator>Dave</dc:creator>
		
		<category><![CDATA[Work]]></category>

		<category><![CDATA[Religion]]></category>

		<category><![CDATA[Happiness]]></category>

		<guid isPermaLink="false">http://datamineshaft.com/blog/happiness-is-part-two</guid>
		<description><![CDATA[<p>(This post is part two of a two-part series on the book &#8220;Gross National Happiness&#8221; by Arthur Brooks and, therefore, an analysis of what kind of people are happy and why.  Part one mostly presented the data and objections to that data.  Part two will suggest what to do, given the data and possible responses to the material.  Reading part one is essential to understanding this post, so if you haven&#8217;t, I strongly recommend doing so first.)

The most important thing to remember while reading this post is the last paragraph from the end of the introduction to <span class="read-more"><a href="http://datamineshaft.com/blog/happiness-is-part-two">...</a></span></p>]]></description>
			<content:encoded><![CDATA[<p><em>(This post is part two of a two-part series on the book &#8220;Gross National Happiness&#8221; by Arthur Brooks and, therefore, an analysis of what kind of people are happy and why.  <a href="http://datamineshaft.com/blog/happiness-is-part-one">Part one</a> mostly presented the data and objections to that data.  Part two will suggest what to do, given the data and possible responses to the material.  Reading <a href="http://datamineshaft.com/blog/happiness-is-part-one">part one</a> is essential to understanding this post, so if you haven&#8217;t, I strongly recommend doing so first.)<br />
</em><br />
The most important thing to remember while reading this post is the last paragraph from the end of the introduction to <a href="http://www.amazon.com/Gross-National-Happiness-Matters-America/dp/0465002781/ref=pd_bbs_1?ie=UTF8&#038;s=books&#038;qid=1216938644&#038;sr=8-1">&#8220;Gross National Happiness&#8221;</a>, which I repeat here in its entirety:</p>
<p>&#8220;Writing this book meant opening myself up to the possibility - and indeed, the reality - that much of what I always thought about how to be happier or how to make America a happier place was wrong.  I found some of the truths about happiness to be extremely surprising, and even uncomfortable.  But I am convinced that what I found is right, whether I like all of it or not.  This is not a book of philosophy or conjecture.  I leave theories about happiness largely to others.  Instead, I go where the data take me when I write about happiness in America and how we can get more of it.  On that basis, you will hear a story - sometimes a controversial one - about who is happy, who isn&#8217;t, why it matters, and how we as a nation can do better.  This story has changed my mind about many things.  It just might change yours, too.&#8221;</p>
<p>After reading Brooks&#8217; book, I felt much the same way.  I also felt my mind had changed.  (I am definitely a data-driven creature when I can be.)  Allow me then, for the purposes of this post, to assume that the data and conclusions in his book are mostly true.  Even if this is not the case, it&#8217;s the only way to analyze what he wrote (and hence to write the rest of this post).</p>
<p>The point of his book, more or less, was that conservatives of all stripes (social, economic, religious and otherwise) are happier than their counterparts.  The gulf between the two groups in happiness is wide - anywhere from 10 to 40 percent - depending on exactly which dimension(s) they&#8217;re more conservative on.</p>
<p>First, let&#8217;s see what Brooks&#8217; response to this information is.  Here is what he said at the end of his last chapter, again quoted here in its entirety:</p>
<p>&#8220;If you asked me how you could be happier and I told you to vote Republican or go to church, you might justifiably tell me to go jump in a lake.  But if I told you to give to charity, I would be giving you excellent advice.  Everybody can give, and give more, <em>today</em>.  Each and every one of us can afford to dig a little deeper - whether into our wallets or into our free time.  So <em>give</em> - write a check, volunteer, donate the things you no longer need (or even better, things you still do need).  And remember: I&#8217;m not trying to lecture you on how to be a better person - just a happier one.&#8221;</p>
<p>Sounds like good advice to me.  Anyone can give to charity, right?  Yet we know from the relevant research that conservatives out-give liberals by an astonishing margin.  Is the problem simply that liberals don&#8217;t know how happy charity can make them?  I doubt it.  Probably a bigger problem is that liberals (being more collectivist) expect the government to step in for them and handle these charitable situations through the machinery of the state.  This is part of what it means to be liberal.  Socialism - perhaps the <a href="http://en.wikipedia.org/wiki/Socialism_in_the_United_States">most extreme version</a> of liberal political doctrine - takes state management and intervention to be an <a href="http://en.wikipedia.org/wiki/Socialism">article of faith</a>, not an optional sideline.</p>
<p>So we are faced, then, with a semi-absurd choice: liberalism vs. happiness.  Or are we?  Perhaps we could suggest, <a href="http://datamineshaft.com/blog/happiness-is-part-one#comment-765">as a commenter did</a> in part one, that happiness is a product of your political affiliation, not a cause.  Indeed, this is a compelling criticism, and one not easily dismissed.  Do the less happy among us, then, have legitimate grievances that need to be addressed before they can be happier, and therefore more conservative?</p>
<p>It&#8217;s easy to see that previous (and in some ways, current) American <a href="http://en.wikipedia.org/wiki/Outgroup_(sociology)">&#8220;outgroups&#8221;</a> like women, blacks, and the poor <a href="http://en.wikipedia.org/wiki/Democratic_Party_(United_States)">all tilt Democratic</a> and more liberal.  Many of them have legitimate grievances too.  White men, perhaps the most privileged group in American society, are (for the most part) <a href="http://en.wikipedia.org/wiki/Republican_Party_(United_States)">staunchly conservative</a>.  That is, they have the most to gain from the status quo and keeping things that way.  Black people, in contrast, are some of the people most likely to be unhappy in America.</p>
<p>But for some reason, the same numbers of blacks are as likely to be &#8220;very happy&#8221; as whites.  Poorer conservatives are a lot happier than you might guess, often much happier than poorer liberals and almost on a par with their richer conservative counterparts.  (As they often say, they&#8217;re &#8220;rich in spirit&#8221;.)  Strikingly, women are <em>more</em> likely to be happy than men as well.  Where are their grievances?  If these happy people have them, it sure doesn&#8217;t seem to bother them much.</p>
<p>The truth is, some of them are Democratic and liberal for other reasons, at least in part.  Women are more likely to be compassionate towards others (and thus liberal), blacks may vote Democratic for historical reasons, and poor people may feel like Democratic reforms will benefit them the most.</p>
<p>We&#8217;re back then to the absurd choice.  There appears to be not just an association, but a full-on direct correlation between how happy you are and how conservative you are.  Furthermore, your level of conservatism appears to be the cause, at least in part, of how happy you are.  What to do?  Being a socially liberal, single, agnostic myself, these statistics still haunt me.</p>
<p>But should they?  Perhaps Aristotle was wrong (along with countless others, including Brooks).  Perhaps <a href="http://en.wikipedia.org/wiki/Eudaimonia">happiness</a> is not the only goal in life.  Looking at the data, this is the only reasonable conclusion I can come up with.  Everyone says they want to be happy, but can this be true?  Or are they misguided as to what actually makes them happy?  Given how accurate self-reports of happiness are, I doubt it.</p>
<p>Perhaps we think liberalism, in all its forms, can serve a greater goal.  It&#8217;s obviously a force for change and for improving our lives, if not our moods.  Obama is perfectly right to <a href="http://www.obamaforchange.com/">emphasize change</a> in times like these.  A record number of Americans <a href="http://www.cbsnews.com/stories/2008/04/03/opinion/polls/main3992628.shtml">think our country is on the wrong track</a>, which neatly corresponds with <a href="http://wwwtmrcom.blogspot.com/2008/05/polls-show-democrat-senate-gains.html">a huge Democratic shift</a> in the electorate.  (The same was true in the &#8217;60s, another huge period of social change.)  Democrats are pissed off and want to do something about it.  It&#8217;s great that Obama is pushing a more positive message, but really Democrats are pushing upheaval.  The positivity is window dressing.</p>
<p>Thus, there is the choice.  But not between liberalism and happiness; it&#8217;s between <em>change</em> and happiness.  And it&#8217;s a fragile balancing act.  <a href="http://en.wikipedia.org/wiki/History_of_the_Soviet_Union_(1985-1991)">Too much change</a> and we&#8217;re unhappier than we need to be.  <a href="http://en.wikipedia.org/wiki/Japanese_asset_price_bubble">Too little change</a> will eventually make us unhappy, because we&#8217;re not making any progress, and perhaps scourges like recession, inflation, disease, and a lack of flexibility can cause us problems.</p>
<p>The same goes for extremism.  Extreme liberalism is socialism or communism.  Extreme conservatism is perhaps <a href="http://en.wikipedia.org/wiki/Fundamentalism">fundamentalist</a> totalitarianism.  In practice, either extreme means an extreme lack of political freedom, and citizens of nations with any of those forms of government are much less happy than the U.S., especially as they tilt further to one extreme or the other (which is shown in &#8220;Gross National Happiness&#8221;).</p>
<p>Better, then, to have the Democratic/Republican ebb and flow that happens every few years.  This gradual back-and-forth shifting helps to provide the best of both worlds, without going too far either way.  It also reduces the inevitable government <a href="http://en.wikipedia.org/wiki/Political_corruption">waste, apathy, and inefficiency</a> that goes along with long stints in power.  (Epitomized these days by people like Alaskan senator Ted Stevens and his <a href="http://www.washingtonpost.com/wp-dyn/content/article/2005/10/22/AR2005102201040.html">&#8220;bridges to nowhere&#8221;</a>).  This political competition keeps everyone on their toes.  New ideas get a chance to be heard.</p>
<p>Therefore the obvious question is, &#8220;Where do you fit on the happiness/change spectrum?&#8221;  This will probably largely determine your political affiliation.  And it&#8217;s not a static thing, of course.  You may very well change your political affiliation as you grow older and your needs and priorities change.  (And it will probably be in a more conservative direction, if you look at demographic statistics and the fact that <a href="http://www.slowdownfast.com/blog/will-you-get-happier-as-you-grow-older/">people generally get happier as they age</a>.)  Regardless, the happiness research should give you a better window into <em>why</em> you prefer one or the other.  </p>
<p>Me, I&#8217;m starting to value happiness more and more, so I&#8217;m starting to give up some of my preference for change in the process.  Being a white male, perhaps it was inevitable.  And maybe, if you&#8217;re more liberal, you should tell me to &#8220;go jump in a lake&#8221;.  <a href="http://en.wikipedia.org/wiki/Sheryl_Crow">Sheryl Crow</a> once sang &#8220;a change will do you good&#8221;.  I never did like that song&#8230;</p>
]]></content:encoded>
			<wfw:commentRss>http://datamineshaft.com/blog/happiness-is-part-two/feed/</wfw:commentRss>
		</item>
		<item>
		<title>Happiness is&#8230;?, Part One</title>
		<link>http://datamineshaft.com/blog/happiness-is-part-one</link>
		<comments>http://datamineshaft.com/blog/happiness-is-part-one#comments</comments>
		<pubDate>Fri, 18 Jul 2008 03:59:39 +0000</pubDate>
		<dc:creator>Dave</dc:creator>
		
		<category><![CDATA[Work]]></category>

		<category><![CDATA[Religion]]></category>

		<category><![CDATA[Happiness]]></category>

		<guid isPermaLink="false">http://datamineshaft.com/blog/happiness-is-part-one</guid>
		<description><![CDATA[<p>(This week&#8217;s post is the first in a two-part series on what makes people happy, why, and what to do about it.  The first part, as usual, is an explanation and summary of the relevant data.  The second part will suggest ways, in light of these data, to be happier.)</p>
<p>Happiness is a big deal to me.  I&#8217;ve read a couple of books on the topic already, and both were quite enlightening.  The first, &#8220;Stumbling on Happiness&#8221; (Daniel Gilbert), was about how bad we were at predicting how happy things will make us.  The second, &#8220;The <span class="read-more"><a href="http://datamineshaft.com/blog/happiness-is-part-one">...</a></span></p>]]></description>
			<content:encoded><![CDATA[<p><em>(This week&#8217;s post is the first in a two-part series on what makes people happy, why, and what to do about it.  The first part, as usual, is an explanation and summary of the relevant data.  The second part will suggest ways, in light of these data, to be happier.)</em></p>
<p>Happiness is a big deal to me.  I&#8217;ve read a <a href="http://www.amazon.com/Stumbling-Happiness-Daniel-Gilbert/dp/1400077427/ref=pd_bbs_sr_1?ie=UTF8&#038;s=books&#038;qid=1216339733&#038;sr=1-1">couple</a> of <a href="http://www.amazon.com/How-Happiness-Scientific-Approach-Getting/dp/159420148X/ref=pd_bbs_sr_2?ie=UTF8&#038;s=books&#038;qid=1216339733&#038;sr=1-2">books</a> on the topic already, and both were quite enlightening.  The first, &#8220;Stumbling on Happiness&#8221; (Daniel Gilbert), was about how bad we were at predicting how happy things will make us.  The second, &#8220;The How of Happiness&#8221; (Sonja Lyubomirsky) was about how much of our happiness is under our control (about 40%) and how we can use that to be happier.</p>
<p>But neither of those books tell us <i>who</i>, in fact, is happier.  They&#8217;re mainly concerned with the reader. Thus, the obvious question: do happy people have anything in common, and why?  That&#8217;s the main question answered by another book I just finished reading, <a href="http://www.amazon.com/Gross-National-Happiness-Matters-America/dp/0465002781/ref=pd_bbs_sr_1?ie=UTF8&#038;s=books&#038;qid=1216340002&#038;sr=1-1">&#8220;Gross National Happiness&#8221;</a> by Arthur C. Brooks.  It&#8217;s the third book I&#8217;ve read on happiness so far, and like the others, it doesn&#8217;t disappoint.</p>
<p>Brooks suggests that happy people do actually have a number of things in common, and what they share might surprise you.  Let&#8217;s not get ahead of ourselves, though.  What does Brooks mean by &#8220;happiness&#8221;?  Well, <a href="http://www.thehappyguy.com/define-happiness.html">whatever people want it to mean</a>, really.  (Try not to roll your eyes.)  That is, the studies Brooks cites rely on self-reported levels of happiness.  Some studies ask people once; others ask them more than once, or even throughout a day, how happy they are.  (Reminds me of the <a href="http://www.usatoday.com/money/advertising/adtrack/2004-02-22-track-verizon_x.htm">&#8220;Can you hear me now?&#8221;</a> Verizon ads.  &#8220;Are you happy now?&#8221;)  You might wonder, though: are self-reports of happiness accurate?  Another study showed that your friends will generally say that you are as happy as you self-report, so it&#8217;s likely that self-reports of happiness are in fact correct.</p>
<p>What do the data on happiness say, then?  Certainly not what Brooks or I suspected, at the very least.  Let me warn you, I&#8217;m about to delve into some <a href="http://careerplanning.about.com/od/workplacesurvival/tp/work_talk.htm">sensitive and difficult topics</a> here.  Like Brooks, I urge you to simply look at what the data say and save the reactions for later on if you can.  (I plan to address these concerns more in part two.)</p>
<p>There are four basic points.  Conservatives (Republicans) often say they&#8217;re much happier than liberals (Democrats).  Religious people often say they&#8217;re much happier than secular folk.  People who like their jobs often say they&#8217;re much happier than those who don&#8217;t.  Married people often say they&#8217;re happier than singles (and the divorced/widowed/cohabiters).  And those four things are very much found together instead of by themselves, so they often have a multiplier effect one way or the other.  If you&#8217;re like me and Brooks, these are shocking findings (except for maybe the one about jobs).</p>
<p>I had the same opinion Brooks did.  I figured that these socially conservative folk were unhappy in general (or at least moreso than social liberals), and that they simply believed these things because of the status quo, or to keep other people in line.  But it turns out that if you&#8217;re socially conservative, you&#8217;re also much, much more likely to be happy than if you are not.  I&#8217;m willing to admit I was wrong here.  It&#8217;s a refreshing viewpoint, actually.</p>
<p>Allow me to give you some background.  In case you haven&#8217;t figured it out, I am (or was) socially liberal, <a href="http://en.wikipedia.org/wiki/Agnosticism">agnostic</a>, and single. This, as I have come to find out, is a singularly <i>bad</i> recipe for being happy.  (I&#8217;m actually happy at work, though.)  Thanks to the two previous books on happiness, I&#8217;ve gone a long way towards increasing my personal happiness.  (It takes work, believe it or not.)  But &#8220;Gross National Happiness&#8221; showed me that I&#8217;m simply running against the wind.  It&#8217;s like trying to pedal faster in first gear.  Far better to switch gears first.  It&#8217;ll make your effort much more worthwhile.</p>
<p>I haven&#8217;t been very specific, though.  Here&#8217;s some specific happiness figures:</p>
<p>- 44% of conservative or very conservative people say they&#8217;re &#8220;very happy&#8221; vs. 25% of liberal or very liberal people<br />
- 9% of conservatives say they aren&#8217;t too happy vs. 18% of liberals<br />
- 50% of religious conservatives say they are very happy; 5% say they are not too happy<br />
- 22% of secular liberals say they are very happy; 22% say they are not too happy<br />
- Three times as many married conservatives as secular liberals say they are very happy</p>
<p>- A conservative who is in the same circumstances as a liberal (except for political orientation, obviously) is 10% more likely to say they are very happy<br />
- 43% of religious people (the faith in question doesn&#8217;t matter) say they are very happy vs. 23% of secular people<br />
- 42% of married Americans say they are very happy vs. 23% of never-married Americans, 20% of widowers, 17% of the divorced, and 11% of those who are separated (but not divorced)<br />
- A married person who is in the same circumstances as someone who is single (except for marital status) is 18% more likely to say they are very happy<br />
- A person who&#8217;s satisfied with their job, but is otherwise in the same circumstances as someone who is not satisfied is 28% more likely to say they are very happy</p>
<p>And so on.  I think those are some striking and overwhelming facts, some of which may be counterintuitive, at least for some folks.  (Guess the phrase &#8220;ball and chain&#8221; is often more bluster than anything.)  Brooks goes on to detail many more statistics as well (too many to cover here).  Conservatives give a lot more to charity, and those who give to charity are much more likely to say they&#8217;re very happy.  People who find <a href="http://en.wikipedia.org/wiki/Flow_(psychology)">&#8220;flow&#8221;</a> (an uninterrupted state of focused high productivity, also known as &#8220;being in the zone&#8221;) are much more likely to be satisfied with their work and say they&#8217;re very happy.  Conservatives are much more likely to have kids than liberals, and they often have more of them.  (Kids make you less happy, actually, but this effect is dwarfed by many of the others.)  Political extremists (on both sides) are much more likely to say they are very happy than moderates.  Finally, money <a href="http://en.wikipedia.org/wiki/Can't_Buy_Me_Love">has a small effect</a> on how happy you say you are.  &#8220;Gross National Happiness&#8221; is a font of great data like this.  I&#8217;ve merely hit the highlights and provided a sample of the other tidbits.</p>
<p>At this point, you might dismiss these findings, especially if you have a strong liberal bent like myself.  Again, like Brooks, I ask you to look at the data.  You might respond, then, by saying <a href="http://www.imdb.com/title/tt0387808/">&#8220;ignorance is bliss&#8221;</a> and these conservatives are ignorant.  Brooks doesn&#8217;t address this question.  He&#8217;s not trying to say whether it&#8217;s &#8220;right&#8221; that conservatives are happier.  He thinks that&#8217;s for the reader to decide.  As for me, I&#8217;ll wait until part two to address this point more fully.</p>
<p>You might also say that conservatives are deluded in how happy they are, or feel pressure to lie about it.  If so, their friends (some of whom may not be conservative at all) must be deluded or feel pressured too, because they often say a person is as happy as the conservatives themselves self-report (as I mentioned before).</p>
<p>Another counter-argument is that while we might be happy, people in other (often more liberal) countries are happier.  The data don&#8217;t bear that out, though.  The U.S., in almost every study, is either the happiest or one of the happiest nations on Earth.  Those countries that are more liberal, secular, like their jobs less/work less/take less vacation, and those countries where people marry less say they are much less happy than the U.S., usually in proportion to the difference in their responses from ours.  (Cuba and Japan, for example, say they are much less happy than the U.S.)</p>
<p>I first stumbled on this research some months ago, but I&#8217;d only scratched the tip of the iceberg.  It has haunted me - in a good way - ever since.  Now I know why.  The data (and my own experiences) seem to back up the claims of conservatives.  That leaves me (and maybe you) in a quandary.  However, it&#8217;s too much to try and deal with this in this post.  Thus, I&#8217;ll attempt to address this more next week in part two.  See you then!</p>
]]></content:encoded>
			<wfw:commentRss>http://datamineshaft.com/blog/happiness-is-part-one/feed/</wfw:commentRss>
		</item>
		<item>
		<title>Stimulating Conversation</title>
		<link>http://datamineshaft.com/blog/stimulating-conversation</link>
		<comments>http://datamineshaft.com/blog/stimulating-conversation#comments</comments>
		<pubDate>Fri, 11 Jul 2008 03:48:56 +0000</pubDate>
		<dc:creator>Dave</dc:creator>
		
		<category><![CDATA[Government]]></category>

		<guid isPermaLink="false">http://datamineshaft.com/blog/stimulating-conversation</guid>
		<description><![CDATA[<p>Unless you live under a rock (or outside the US) you&#8217;ve probably heard about the &#8220;Economic Stimulus Act of 2008&#8243;.  If you made at least a little money (but not too much) last year and paid some taxes, you&#8217;re entitled to between 300 and 1,200 dollars, depending on how many children you have and such.  Apparently the last checks go out tomorrow, unless the early start on stimulus checks has affected those dates.  You can figure out how much you&#8217;re supposed to get here.</p>
<p>If you&#8217;re up on your taxes, student loans, and child support, that is <span class="read-more"><a href="http://datamineshaft.com/blog/stimulating-conversation">...</a></span></p>]]></description>
			<content:encoded><![CDATA[<p>Unless you live <a href="http://forum.wordreference.com/showthread.php?t=572080">under a rock</a> (or outside the US) you&#8217;ve probably heard about the <a href="http://en.wikipedia.org/wiki/Economic_Stimulus_Act_of_2008">&#8220;Economic Stimulus Act of 2008&#8243;</a>.  If you made at least a little money (but not too much) last year and paid some taxes, you&#8217;re entitled to between 300 and 1,200 dollars, depending on how many children you have and such.  Apparently the last checks <a href="http://consumerist.com/369302/check-out-the-irss-economic-stimulus-payment-calculator">go out tomorrow</a>, unless the <a href="http://www.iqwolf.org/fortune/economic-stimulus-payments-going-out-a-week-early.html">early start on stimulus checks</a> has affected those dates.  You can figure out how much you&#8217;re supposed to get <a href="http://www.irs.gov/app/espc/">here</a>.</p>
<p>If you&#8217;re up on your taxes, student loans, and child support, that is.  If not, the IRS will take those amounts out of your check first.  That might cause you <a href="http://www.9news.com/money/article.aspx?storyid=95531&#038;catid=344">not to get a check at all</a>.  If you or someone you live with doesn&#8217;t have a social security number, you <a href="http://www.mercurynews.com/ci_9191044?nclick_check=1">won&#8217;t be getting a check either</a>, which apparently leaves out some resident aliens and military families.</p>
<p>I guess <a href="http://www.chron.com/disp/story.mpl/business/5876184.html">it&#8217;s OK if you&#8217;re dead</a>, though.  As long as you met the requirements in 2007, you&#8217;re getting a check.  Well, your next of kin is, anyway.  (But you&#8217;re probably not reading this post either, unless you&#8217;re a comic book character or something.)  And if you&#8217;re a dead resident alien who made over $100,000 in &#8216;07, I don&#8217;t know what to tell you.  I&#8217;m just confused.  But then again, you probably have bigger problems at this point.</p>
<p>Whatever you do, if you don&#8217;t get your check right away, don&#8217;t fall for one of the <a href="http://mainstreet.com/dont-fall-victim-stimulus-check-scam">stimulus check scams</a> that have been floating around.  And pray the last two digits in your Social Security Number are low (which are the basis for when you&#8217;ll get your check).</p>
<p>Me, I&#8217;m more concerned about what people are spending their checks on.  I can tell you I did my part.  I purchased the Xbox 360 game <a href="http://www.amazon.com/Rock-Band-Bundle-X360/dp/B00154ENQW/ref=sr_1_1?ie=UTF8&#038;s=electronics&#038;qid=1215739955&#038;sr=1-1">&#8220;Rock Band&#8221;</a>, a <a href="http://www.amazon.com/JVC-SUDH1-Surround-Headphone-Adaptor/dp/B000ETBZ5G">surround sound headphone adapter</a> (I actually got the Japanese version), and a bunch of wacky &#8220;Rock Band&#8221; accessories like a <a href="http://www.amazon.com/Stage-Stands-MS7510-Mic-Pro/dp/B000E5T3YK/ref=sr_1_1?ie=UTF8&#038;s=electronics&#038;qid=1215740034&#038;sr=1-1">mic stand</a>, <a href="http://www.amazon.com/Electronic-Arts-Rock-Wireless-Guitar/dp/B000TT2D20/ref=pd_bbs_sr_2?ie=UTF8&#038;s=videogames&#038;qid=1215740119&#038;sr=8-2">wireless guitar</a>, <a href="http://www.amazon.com/Pacific-Drums-DW-DT700-Throne/dp/B0002E528E/ref=pd_bbs_sr_1?ie=UTF8&#038;s=musical-instruments&#038;qid=1215740087&#038;sr=8-1">drum throne</a>, <a href="http://www.rockbanddrumpads.com/rock-band-drum-community.html">drum pads</a>, and a <a href="http://omegapedal.com/">replacement bass drum pedal</a>.  (OK, I love &#8220;Rock Band&#8221;.  So sue me.)</p>
<p>I guess I wasn&#8217;t the only one.  Apparently quite a few people <a href="http://blog.videogamepricecharts.com/2008/06/people-bought-video-games-with-their.html">bought video games</a> with their stimulus checks.  </p>
<p>So there&#8217;s that.  What else did people buy?  Well, the same stuff they always buy, it seems, but more of it.  I didn&#8217;t see any one big summary on the topic, but I found plenty of sites where people talk about what <em>they</em> did.  Here&#8217;s a short list of what else I found:  <a href="http://answers.yahoo.com/question/index?qid=20080710125459AAW5t80">paying down debt</a> (very common), <a href="http://www.youtube.com/watch?v=iNUI04mywMo">donating to Obama</a> (and presumably other politicians), <a href="http://money.cnn.com/2008/06/12/news/economy/retail_sales/index.htm?section=money_topstories">buying retail products in general</a>, and of course, <a href="http://news.yahoo.com/s/usnw/20080702/pl_usnw/president_bush_boosts_porn_industry_with_economic_stimulus_plan__according_to_aimrco">pornography</a>. (Different kind of stimulus happening there, I think.)</p>
<p>That&#8217;s not including the more unusual expenditures.  You can find some of them on the obviously-named site <a href="http://www.howispentmystimulus.com/posts/view/553">&#8220;How I Spent My Stimulus.com&#8221;</a>.  My favorite was the guy that used his check to <a href="http://www.howispentmystimulus.com/posts/view/553">pay part of his $7,500 bail</a>.  Apparently it was one of the favorites of the guy who runs the site too, as you can read about <a href="http://www.kcra.com/money/16514753/detail.html">here</a>.  If you read that link, you can also see what I think the real purpose of the site is: the author is writing a book about the user entries.  More power to him, I say.  Making money off how other people spent theirs has an excellent hint of irony to it.  And hopefully his book will give us a better idea of all the different things people used their rebate for.</p>
<p>In the end, I don&#8217;t really know what people have spent or will spend their stimulus checks on.  The gist of what I read is that people spent their checks on a great variety of things.  But they most often seemed to spend checks on stuff they already wanted, and on common expenses like bills, debt, consumer goods (especially electronics), food, gas, medicine, health care, and the like.  However, it did seem like the checks were spent most often on luxuries and one-offs like TVs and nice parties.  That&#8217;s just a guess, though.  Last time we had a stimulus package, people certainly <a href="http://www.philadelphiafed.org/files/wps/2007/wp07-34.pdf">used a big chunk of it</a> to pay down debt, but that was in better times (2001) so people might think differently now.</p>
<p>I suppose some people also saved their checks.  I read on various sites that people were socking away some or all of the rebate, but somehow I doubt it.  And <a href="http://www.economist.com/opinion/displaystory.cfm?story_id=11707471">some people</a> even think we&#8217;ll save 90% of our checks.  It&#8217;s not what we did last time, however, and I&#8217;m not buying it.  (Though to be fair, they may be including paying down debt as saving.)  Americans are some of the <a href="http://www.inrich.com/cva/ric/search.apx.-content-articles-RTD-2008-06-11-0093.html">worst savers in the world</a>, and we&#8217;ve had a zero or even negative personal saving rate for quite some time.  Though <a href="http://linkinghub.elsevier.com/retrieve/pii/S1053535705001071">how the government frames the stimulus</a> matters, in a case like this the stimulus seems more like an unexpected bonus, and thus will probably be spent (as mentioned in the previous link).  It seems like the best Americans can do is just pay down debt we already have, and <a href="http://www.creditcards.com/spend-federal-stimulus-rebate.php">even that is questionable</a>.  The American consumer seems down, but maybe not out yet.</p>
<p>What if you don&#8217;t know what to do with your check?  Presumably, some people have saved their check by default and don&#8217;t know what to spend it on yet.  Well, everyone from <a href="http://www.wallstreetfighter.com/2008/05/wal-mart-wants-your-stimulus-check-real.html">Wal-Mart</a> to <a href="http://www.lockergnome.com/blade/2008/05/14/dell-wants-that-stimulu-check-from-you/">Dell</a> wants your money, and some of them will go to extreme lengths to get it, from cashing your check for free to crazy sales.</p>
<p>Of course, you might just think a <a href="http://boundrationality.blogspot.com/2008/02/save-your-money-why-stimulus-check-is.html">stimulus check is a bad idea</a> and decide to save it in the end.  If people can hate free money delivered to their doorstep, I guess they can hate anything.  There&#8217;s no doubt the money you get will make you better off, unless you decide to <a href="http://www.theonion.com/content/news_briefs/economic_stimulus_check">burn it for heat</a>. Then there&#8217;s not much anyone can do for you, I&#8217;m afraid.</p>
]]></content:encoded>
			<wfw:commentRss>http://datamineshaft.com/blog/stimulating-conversation/feed/</wfw:commentRss>
		</item>
		<item>
		<title>War is Hell</title>
		<link>http://datamineshaft.com/blog/war-is-hell</link>
		<comments>http://datamineshaft.com/blog/war-is-hell#comments</comments>
		<pubDate>Fri, 04 Jul 2008 04:49:09 +0000</pubDate>
		<dc:creator>Dave</dc:creator>
		
		<category><![CDATA[Books]]></category>

		<category><![CDATA[War]]></category>

		<guid isPermaLink="false">http://datamineshaft.com/blog/war-is-hell</guid>
		<description><![CDATA[<p>Recently my twin brother (and Ed-itor) Ed turned me on to an excellent book called &#8220;What Every Person Should Know About War&#8221;, by Chris Hedges.  Hedges is a long-time foreign correspondent for the New York Times, and his goal was to write an unglamorous, no-nonsense, meticulously researched book on the facts of war.  (He&#8217;s covered many wars in the past, and was even captured for a week in Iraq.)  The book is quite short at 120 pages (I&#8217;m not including the extensive notes), terse, and has &#8220;very few adjectives&#8221;.  If you&#8217;re looking for the latest spy <span class="read-more"><a href="http://datamineshaft.com/blog/war-is-hell">...</a></span></p>]]></description>
			<content:encoded><![CDATA[<p>Recently my twin brother (and Ed-itor) Ed turned me on to an excellent book called <a href="http://www.amazon.com/gp/product/0743255127/ref=cm_cr_pr_product_top">&#8220;What Every Person Should Know About War&#8221;</a>, by Chris Hedges.  Hedges is a long-time foreign correspondent for the New York Times, and his goal was to write an unglamorous, no-nonsense, meticulously researched book on the facts of war.  (He&#8217;s covered many wars in the past, and was even captured for a week in Iraq.)  The book is quite short at 120 pages (I&#8217;m not including the extensive notes), terse, and has &#8220;very few adjectives&#8221;.  If you&#8217;re looking for the <a href="http://www.google.com/products?q=latest+spy+thriller&#038;ie=UTF-8&#038;oe=utf-8&#038;rls=org.mozilla:en-US:official&#038;client=firefox-a&#038;um=1&#038;sa=X&#038;oi=product_result_group&#038;resnum=1&#038;ct=title">latest spy thriller</a>, this is probably not the book for you.</p>
<p>But if you&#8217;re hungry for plenty of real, down-to-Earth statistics about war (and other related topics), it&#8217;s probably up your alley.  There&#8217;s no real narrative to the book, other than the chapter organization; the entire book is in a simple question-and-answer format.  It&#8217;s more like reading a FAQ than a book, which seems to give the book just the neutral no-nonsense tone Hedges was looking for.  Given its length and how utilitarian most of the language is, the book probably won&#8217;t take you longer than a few hours to read anyway.  Thus, even if you have a passing interest in the material, it might be worth your while.</p>
<p>Despite its low-key presentation, many eye-popping facts line the book&#8217;s pages.  This book is not for the faint of heart.  Many of the facts in Hedges&#8217; book are about death, injury, psychiatric disorders, and various other difficult topics.  If topics like these bother you, you may want to stop here or start skimming ahead if/when things the subject matter starts to get unpleasant for you.</p>
<p>With that out of the way, allow me to give you a little more of my background.  First, my late father served in the Navy (he didn&#8217;t die in the service, though).  He served in the Navy because he viewed it as safer than the other services.  That fact was also borne out by Hedges&#8217; book: infantry roles are by far the most dangerous.  My dad volunteered so that he wouldn&#8217;t be drafted into something worse for far longer, so he was never too into the job.  Ironically, after he got out of the service he vowed to never work on weapons systems, an astonishing feat given that he worked for a defense contractor for the rest of his life.</p>
<p>His Navy experience was before I was born, so it wasn&#8217;t very &#8220;real&#8221; to me.  The only thing I knew is that my dad could tie a killer knot.  (Tying knots is an important naval skill, obviously.)  He used to tie <a href="http://en.wikipedia.org/wiki/Hangman's_noose">a hangman&#8217;s knot</a> on our <a href="http://en.wikipedia.org/wiki/Tetherball">tetherball</a> pole out back.  The tetherball rope or even the tetherball itself would <em>always</em> break before the knot came out.  Considering the nylon ropes we used were pretty thick and lasted for months, that&#8217;s no mean feat.</p>
<p>The closest I ever got to the military was <a href="http://en.wikipedia.org/wiki/High_school_wrestling">wrestling in high school</a>.  We had an ex-military assistant coach, if I remember correctly; I know he used to wear army shirts all the time, anyway.  Many of the same tenets you learn on the wrestling mat are the same as in <a href="http://en.wikipedia.org/wiki/Recruit_training">boot camp</a>, and I always had short, high-and-tight haircuts after I left wrestling.  Also like boot camp, there&#8217;s a real sense of camaraderie that develops on your team as you go through such extreme experiences as <a href="http://www.grapplearts.com/How-to-Cut-Weight.html">cutting weight</a> and <a href="http://www.ehow.com/how_2191504_run-suicides-agility-training-exercises.html">running suicides</a>.  And since wrestling is a team sport but you&#8217;re on your own every match, letting down your teammates is a huge deal (like with a real unit).  I&#8217;ve even heard that the military gives preferential treatment to wrestlers, but I couldn&#8217;t find a source for that.</p>
<p>Thus, though neither I nor my dad were much of military men, I probably at least have a little idea about military culture, values, and training.  With that in mind, I&#8217;d like to reflect on some of the more striking statistics in &#8220;What Every Person Should Know About War&#8221;.  I&#8217;ll cover the highlights in mostly the same order as the book, with an eye towards their extensively-researched data (this is a data blog, after all).</p>
<p>The second question listed in the book is striking enough:  &#8220;Has the world ever been at peace?&#8221;  &#8220;Of the past 3,400 years, humans have been entirely at peace for 268 of them, or just 8 percent of recorded history,&#8221; a pretty striking answer to be sure.  The rest of the book follows in the same style, and on topics no less important.</p>
<p>Another interesting statistic is that &#8220;between 65 and 85 percent of the American public will support a military action when it begins&#8221;, but by the end of the Korean and Vietnam wars, support was closer to 30 percent.  That just goes to show that people are always much more gung-ho before a war, when the death and destruction aren&#8217;t fresh in people&#8217;s minds.  Furthermore, those same supporters are extremely bad at estimating how wars will turn out, as otherwise many of them probably never would&#8217;ve offered their support in the first place.  To be fair, World War II and the Gulf War had at least 77 percent support the entire time.  So there may be such a thing as a <a href="http://en.wikipedia.org/wiki/Just_war">&#8220;just war&#8221;</a>, but we should be far more selective about going to war than we&#8217;ve been in the past.</p>
<p>Another powerful fact from the book is that many more civilians than soldiers die in wars, and this ratio is getting much worse as wars increasingly move into cities.  I wonder how that fact might change people&#8217;s support for war, knowing that the bullets they&#8217;re paying for have a much greater chance of hitting a non-combatant than in the past.</p>
<p>With gruesome stats like these, why would people enlist to begin with?  Surprisingly, the most common reasons given are education funding and job training. (1/3 of people cite each of these as a reason.)  Granted, I doubt there&#8217;s a box you can check called &#8220;I like killing people&#8221;, but apparently this is also a reason why a minority of people sign up.</p>
<p>Of course, not everyone wants to enlist.  Here&#8217;s a list of a few of the crazy things people have commonly done to dodge the draft in Vietnam:  inhaling enough dust to give them an asthma attack, chopping off a thumb joint (!), staring at the sun to partially blind themselves, pricking their arms to fake heroin needle scars, and literally shooting themselves in the foot.  I don&#8217;t know about you, but I&#8217;d rather endure the jeers and claim that I was gay or a conscientious objector or <em>anything</em> else before I&#8217;d shoot myself in the foot or chop off my thumb joint.  Thankfully they&#8217;ve never had a draft in my lifetime, so I don&#8217;t have to worry about resorting to such extreme measures.  If I had to enlist, I figure I&#8217;d just do what my dad did and go for a more low-key job, where my technical skills would be more useful to the army anyway.</p>
<p>And hey, some people actually prefer military life.  &#8220;Black soldiers are twice as likely as whites to perceive racial discrimination in the military, though a majority of black soldiers say race relations are better in the military than in civilian life.&#8221;  Blacks are also more likely to see the military as a career and much less likely to be jailed than their black civilian counterparts.  Who knew the military was so egalitarian?</p>
<p>Then again, maybe there&#8217;s still some biases.  97 percent of armies worldwide (and 91 percent of the U.S.) are made up of men.  An astonishing &#8220;78 percent of women and 38 percent of men reported sexual harassment&#8221;.  Given that there are so few women in the military, that means there&#8217;s probably a bunch of military men out there sexually harassing women <em>and</em> men.  The Marines have it the worst.  A jaw-dropping 86 percent of female Marines reported sexual harassment and 9 percent reported being raped or attempted rape.  (By the way, less than 7 percent of military women report any harassment by civilians.)  Sheesh.</p>
<p>Guess it shouldn&#8217;t surprise me, then, that 70 percent of men in the Gulf War said that &#8220;not having the opposite sex around caused them &#8216;quite a bit&#8217; of or &#8216;extreme&#8217; stress&#8221;, which was the number one cause of stress cited overall.  (Of course this was due in part to the modesty of Saudi women.)  How to cope?  Well, in Vietnam there were estimates that 35 to 75 percent of our troops smoked marijuana, though this has gone down a lot in recent years due to random drug tests.</p>
<p>Another way soldiers cope is by simply acclimating.  Hodges&#8217; book describes one soldier that learned to sleep through the demolition of numerous ammo dumps in Iraq, which he could <em>feel</em> as well as hear.  I don&#8217;t think earplugs are gonna quite cut it in a situation like that.  Reminds me of my friend Gary, who learned to accept constant panic attacks that felt like heart failure.  He told me &#8220;you can get used to almost anything&#8221;.  Maybe that&#8217;s true.</p>
<p>One thing you can&#8217;t get acclimated to, however, is weapons of mass destruction.  Hodges&#8217; book calmly describes cluster bombs that can cover 50,000 square meters (bigger than two football fields) and are &#8220;the tactical equivalent of short-range nuclear weapons&#8221;.  No wonder people find unexploded cluster bombs years later, and that many countries <a href="http://www.fcnl.org/weapons/clusterlanding/clusters_landing9.htm">have officially banned their use</a> (though not the U.S.).</p>
<p>Even worse than that, though, are nuclear weapons themselves.  Hodges&#8217; book describes what should be done with &#8220;fatally irradiated soldiers&#8221;.  Apparently such people can have as many as several weeks to live before their bodies give up.  (Maybe that&#8217;s what happened in the movie <a href="http://en.wikipedia.org/wiki/Crank_(film)">&#8220;Crank&#8221;</a>?)  The recommendation given is to pump them full of as much medicine and painkillers as possible, allowing them to keep fighting as long as they can.  I can&#8217;t even imagine how I would feel if I absolutely knew I only had weeks to live, totally doped up, sitting in a trench with an M16 in my hand.  That sounds like the kind of thing movies are made out of, yet this is official policy.  Wow.</p>
<p>Of course, the military has actually used (and continues to use) modified versions of video games like Doom, Battlezone, and Microsoft Flight Simulator to train soldiers.  (Ironically, Microsoft Flight Simulator is one of the few non-violent flight simulators out there.)  I can&#8217;t imagine that Battlezone, <a href="http://en.wikipedia.org/wiki/Battlezone_%281980_video_game%29">a video game made in 1980</a>, ever looked much like a battlefield, but I guess that&#8217;s all they had to train with 30 years ago, so they had to make do.</p>
<p>All that training might not be enough, though.  Apparently as a soldier you had a greater chance of becoming a &#8220;psychiatric casualty&#8221; than being killed in every major war of the 20th century.  You&#8217;re more likely to lose your mind than your body, that is.  Some reports have even suggested that more Vietnam vets committed suicide after the war than were killed in action, a proposition I find deeply unsettling.</p>
<p>More unsettling than that, though, is the use of torture in wartime.  Apparently the most effective forms of torture are thought to be threatening loved ones, mock executions, and rape and other forms of sexual assault.  (Waterboarding isn&#8217;t mentioned, though supposedly virtually everyone <a href="http://www.vanityfair.com/politics/features/2008/08/hitchens200808">cracks under the technique</a> in under 30 seconds.)  Despite their effectiveness, however, information from torture is supposedly not credible.  The idea is that, under duress, people will say anything to get you to stop.</p>
<p>Worst of all, of course, is death.  No book on the reality of war would be complete without talking about it, and I would be remiss to leave such talk out of this post, even though the reality can be disturbing to read about.  &#8220;What Every Person Should Know About War&#8221; claims very matter-of-factly that when you die, &#8220;&#8230;you will feel your consciousness swiftly wind down.  It will not flip from on to off, like a light, but rather will gradually disappear, like a match burning out.&#8221;  (According to those who were clinically dead and brought back to life, that is.)  Life, it appears, comes in degrees.  Soldiers&#8217; last words are often calling out to their mothers, their wives, or their girlfriends.  I have no idea if this is the same for civilians, but I wouldn&#8217;t be shocked if it were.  (Unless you&#8217;re <a href="http://en.wikipedia.org/wiki/Citizen_kane">William Randolph Hearst</a>, I guess.)</p>
<p>After the war, if you were raped or lost a spouse/child in the war, Hodges&#8217; claims you will never recover fully from it.  While I have never had either of these traumatic events happen to me and I don&#8217;t seek to trivialize them in any way, what I know from happiness studies says the opposite.  Books like <a href="http://www.amazon.com/How-Happiness-Scientific-Approach-Getting/dp/159420148X">&#8220;The How of Happiness&#8221;</a> and <a href="http://www.amazon.com/Whos-Been-Sleeping-Your-Head/dp/0465037666">&#8220;Who&#8217;s Been Sleeping in Your Head&#8221;</a> talk about trauma and how people deal with it.  One theme they mention is that people are often much more resilient under stress than they think.  </p>
<p>To me it seems like the most important factor in recovery is whether you&#8217;re a pessimist or an optimist.  <a href="http://www.spring.org.uk/2005/07/optimists-recover-more-quickly-after.php">Studies often show</a> that optimists frequently recover from such trauma faster, more thoroughly, and with less stress than pessimists.  (The same is true for many illnesses as well.)  The most I can relate here is from the death of my own father from brain cancer.  It was a depressing and heartbreaking experience, but never one that I would say I could never fully recover from.  While I haven&#8217;t forgotten about him, at some point I moved on and ceased to grieve.  Maybe my own optimism helped in this, I don&#8217;t know.</p>
<p>I&#8217;m reminded of a passage in Dale Carnegie&#8217;s <a href="http://en.wikipedia.org/wiki/How_to_Win_Friends_and_Influence_People">&#8220;How to Win Friends and Influence People&#8221;</a>, where a man talks about counseling recently disabled kids.  He mentions that many kids are traumatized and sad when they first find out they&#8217;re disabled, but that most are back to normal in a few days or weeks and are playing and acting like other kids.  Thus, humans are a hardier species than some of us think.  (Or is this just my optimistic bias showing through?  You be the judge.)</p>
<p>And that&#8217;s about it.  But despite talking a lot about the horrors of war, I&#8217;d like to end this post on an upbeat note.  You might sum up the overall point of this post as this: war is hell and should never be entered into lightly, but a lot of us can take the heat if need be.  As for me, I&#8217;ll stick to playing first person shooters.  <a href="http://en.wikipedia.org/wiki/Doom_(video_game)">Doom</a> was one of my favorite games, after all.  If we ever have to face imps, revenants, and demons on the battlefield, they know who to call.</p>
]]></content:encoded>
			<wfw:commentRss>http://datamineshaft.com/blog/war-is-hell/feed/</wfw:commentRss>
		</item>
		<item>
		<title>Running on Empty</title>
		<link>http://datamineshaft.com/blog/running-on-empty</link>
		<comments>http://datamineshaft.com/blog/running-on-empty#comments</comments>
		<pubDate>Fri, 27 Jun 2008 03:13:10 +0000</pubDate>
		<dc:creator>Dave</dc:creator>
		
		<category><![CDATA[Uncategorized]]></category>

		<guid isPermaLink="false">http://datamineshaft.com/blog/running-on-empty</guid>
		<description><![CDATA[<p>I apologize, folks.  As I&#8217;ve been doing all too often lately, I have to delay tonight&#8217;s post until the weekend or next week.  I have to work on a personal project that&#8217;s every bit as involved as anything I&#8217;ve done for the site.  Starting next week the posting schedule should be more regular, though. <span class="read-more"><a href="http://datamineshaft.com/blog/running-on-empty">...</a></span></p>]]></description>
			<content:encoded><![CDATA[<p>I apologize, folks.  As I&#8217;ve been doing all too often lately, I have to delay tonight&#8217;s post until the weekend or next week.  I have to work on a personal project that&#8217;s every bit as involved as anything I&#8217;ve done for the site.  Starting next week the posting schedule should be more regular, though.</p>
]]></content:encoded>
			<wfw:commentRss>http://datamineshaft.com/blog/running-on-empty/feed/</wfw:commentRss>
		</item>
	</channel>
</rss>
