<?xml version="1.0" encoding="utf-8"?>
<feed xmlns="http://www.w3.org/2005/Atom"
xmlns:thr="http://purl.org/syndication/thread/1.0">
<link rel="alternate" type="text/html" href="http://www.pbs.org/idealab/2008/07/coder-journalist-governments-should-open-up-their-data005.html" />
<link rel="self" type="application/atom+xml" href="http://www.pbs.org/idealab/atom.xml" />
<id>tag:www.pbs.org,2009:/idealab//31/tag:dipsy.pbs.org,2008:/idealab_test_blogs//31.4487-</id>
<updated>2009-10-19T21:48:06Z</updated>
<title>Comments for Coder-journalist: Governments Should Open Up Their Data</title>
<subtitle>Idea Lab is a group blog by innovators who are reinventing community news for the Digital Age.</subtitle>
<generator uri="http://www.sixapart.com/movabletype/">Movable Type 4.24-en</generator>
<entry>
<id>tag:dipsy.pbs.org,2008:/idealab_test_blogs//31.4487</id>
<link rel="alternate" type="text/html" href="http://www.pbs.org/idealab/rss2/redir/idealab/2008/07/coder-journalist-governments-should-open-up-their-data005.html" />
<link rel="service.edit" type="application/atom+xml" href="http://blogs.pbs.org/mediashift/mt4/mt-atom.cgi/weblog/blog_id=31/entry_id=4487" title="Coder-journalist: Governments Should Open Up Their Data" />
<published>2008-07-10T05:13:02Z</published>
<updated>2009-01-05T22:15:37Z</updated>
<title>Coder-journalist: Governments Should Open Up Their Data</title>
<summary>Ryan Mark, one of the first two winners of our journalism scholarships for computer programmers, wonders why it&apos;s so hard to get usable government data. I wrapped up my second quarter of journalism school and my daily reporting class a couple of weeks ago. Learning firsthand what goes into a simple news article gave me a new-found respect for the work that&apos;s required. Making call after call, leaving messages with people who will never call you back, and then taking notes while paying attention to what somebody is saying is quite a difficult way to spend a day. The Internet...</summary>
<author>
<name>Rich Gordon</name>
<uri>http://www.linkedin.com/in/richgordon</uri>
</author>

<category term="Education" />

<category term="Government &amp; Politics" />

<category term="Technology" />

<content type="html" xml:lang="en" xml:base="http://www.pbs.org/idealab/">
<![CDATA[<span class="mt-enclosure mt-enclosure-image" style="display: inline;"><a href="http://www.pbs.org/idealab/RyanMark-2-200pxwide.html" onclick="window.open('http://www.pbs.org/idealab/RyanMark-2-200pxwide.html','popup','width=200,height=289,scrollbars=no,resizable=no,toolbar=no,directories=no,location=no,menubar=no,status=no,left=0,top=0'); return false"><img src="http://www.pbs.org/idealab/assets_c/2007/12/RyanMark-2-200pxwide-thumb-200x289.jpg" width="200" height="289" alt="RyanMark-2-200pxwide.jpg" class="mt-image-right" style="float: right; margin: 0 0 20px 20px;" /></a></span><em>Ryan Mark, one of the first two winners of our journalism scholarships for computer programmers, wonders why it's so hard to get usable government data.</em><br />
<p>I wrapped up my second quarter of journalism school and my daily reporting class   a couple of weeks ago. Learning firsthand what goes into a   simple news article gave me a new-found respect for the work that's required.   Making call after call, leaving messages with people who will never call you   back, and then taking notes while paying attention to what somebody is saying is   quite a difficult way to spend a day.</p>
<p>The Internet makes a lot of the job   much easier that I can imagine it used to be, but I still ran into some basic   roadblocks that no amount of global communications technology can breach. </p>
<p>I wrote a   story about information systems in nursing homes at the end of May, and in the   course of my research I had to make use of Medicare and Illinois Medicaid   data.
Medicare has a comprehensive online resource of most if not all the   nursing homes in the United States, along with metrics such as  size, whether they   accept Medicare or Medicaid, and if they've had  citations from regulatory   agencies. The data was on the Medicare site, but it wasn't easy to work with. </p>
<p>All I   wanted was a list of nursing homes in Cook County, Illinois, that accepted   Medicaid, ordered by the number of residents the homes had, from smallest to largest. </p>
  <p>Anybody who has worked with a database or Excel knows that this   shouldn't be difficult but  Medicare's <a href="http://www.medicare.gov/NHCompare/">web interface</a> wasn't built to handle a   complex request. No problem, I thought. The site offers a way around this: you can download their database! </p>
  <p>But it's in Microsoft Access   format.</p>
   <p>Since I use a Mac, to access this 'public' information, I needed   to install Windows XP and Access on my MacBook. I was lucky I had Windows   installed already and an old copy of Office 2003 Professional lying around, and   still remembered how to use Access. </p>
  <p>It only took me a few hours to   generate my list of 20 nursing homes.</p>
  <p>Why couldn't have they put the data   in a text file? Access can save tables to a text file. I could have used Open   Office, Apple's Numbers or Excel, and I could have viewed it on my Mac or on   Linux. I could have written a new web page with tools to work with the data, the   tools that the Medicare site couldn't provide. I could have uploaded it to <a href="http://services.alphaworks.ibm.com/manyeyes/app">Many   Eyes</a>.</p>
  <p>And Medicare does a better job with its data than the Illinois   <a href="http://www.hfs.illinois.gov/">Department of Healthcare and Family Services</a> does with Medicaid information. </p>
  <p>The   Illinois Medicaid website has <a href="http://www.hfs.illinois.gov/costreports/">lists of <span class="caps">PDF </span>files</a> for each nursing home that receives   Medicaid in the state. It's a wealth of information, but it's very difficult to   write a program to pull useable information out of those files.</p>
  <p>If you   don't feel like wading through hundreds of <span class="caps">PDF </span>files, you call the <span class="caps">DHFS'</span>smedia   department and talk to a nice woman named Penny. You tell her the zip codes,   date range and what kind of numbers you want, and she calls back in a day or   two.</p>
  <p>Most of this data should be transparent and easily accessible. I   shouldn't have to call up the media department to get numbers. It's our   government, so the data should be ours, where it's not protected by privacy   laws.</p>
  <p>There are people working on getting government agencies to provide   information in a usable format. From talking to Adrian Holovaty briefly at the   recent Future of Civic Media Conference, the folks at <a href="http://www.everyblock.com">Everyblock</a> deal with these   problems on a regular basis. Everyblock, along with other interested   organizations have put together the <a href="http://resource.org/8_principles.html">8 Principles of Open Government Data</a>.   Organizations like the <a href="http://www.sunlightfoundation.com/">Sunlight Foundation</a>,   and programs such as <a href="http://www.sunshineweek.org">Sunshine Week</a> are trying to   bring more attention to government transparency, and doing it in a web-friendly way.</p>
  <p>I think government agencies should focus on  getting data out   there in a standardized format, and I would venture to guess that in many cases   they will need help implementing that standardized format.</p>]]>

</content>
</entry>

<entry>
<id>tag:dipsy.pbs.org,2008:/idealab_test_blogs//31.4487-comment:41621</id>
<thr:in-reply-to ref="tag:dipsy.pbs.org,2008:/idealab_test_blogs//31.4487" type="text/html" href="http://www.pbs.org/idealab/rss2/redir/idealab/2008/07/coder-journalist-governments-should-open-up-their-data005.html"/>
<link rel="alternate" type="text/html" href="http://www.pbs.org/idealab/rss2/redir/idealab/2008/07/coder-journalist-governments-should-open-up-their-data005.html#comment-41621" />
<title>Comment from Benjamin Melançon on 2008-07-10</title>
<author>
<name>Benjamin Melançon</name>
<uri>http://mlncn.com/</uri>
</author>
<content type="html" xml:lang="en" xml:base="http://mlncn.com/">
Related Content &#8482;


Citizen Media Law Project: New York Legislature Passes Open Records and Open Meetings Reforms

</content>
<published>2008-07-10T11:22:43Z</published>
</entry>

<entry>
<id>tag:dipsy.pbs.org,2008:/idealab_test_blogs//31.4487-comment:41622</id>
<thr:in-reply-to ref="tag:dipsy.pbs.org,2008:/idealab_test_blogs//31.4487" type="text/html" href="http://www.pbs.org/idealab/rss2/redir/idealab/2008/07/coder-journalist-governments-should-open-up-their-data005.html"/>
<link rel="alternate" type="text/html" href="http://www.pbs.org/idealab/rss2/redir/idealab/2008/07/coder-journalist-governments-should-open-up-their-data005.html#comment-41622" />
<title>Comment from Amanda on 2008-07-10</title>
<author>
<name>Amanda</name>
<uri>http://www.gothamgazette.com</uri>
</author>
<content type="html" xml:lang="en" xml:base="http://www.gothamgazette.com">
That state law is a step forward, but it doesn&apos;t quite address the kind of openness that Ryan is talking about.  We&apos;ve been grappling with similar issues at Gotham Gazette -- New York City actually has a six year old law that requires documents to be posted electronically but they&apos;re almost universally provided as PDFs, and sometimes these are giant PDFs that contain scanned images of tables of data. 

At the state level I could ask for another format, but there is no good reason the city and state (or Medicaid) can&apos;t post that data in a universally readable format alongside their PDFs.
</content>
<published>2008-07-10T13:02:51Z</published>
</entry>

</feed>