{"action":"created","issue":{"url":"https://api.github.com/repos/demand-driven-open-data/ddod-intake/issues/56","repository_url":"https://api.github.com/repos/demand-driven-open-data/ddod-intake","labels_url":"https://api.github.com/repos/demand-driven-open-data/ddod-intake/issues/56/labels{/name}","comments_url":"https://api.github.com/repos/demand-driven-open-data/ddod-intake/issues/56/comments","events_url":"https://api.github.com/repos/demand-driven-open-data/ddod-intake/issues/56/events","html_url":"https://github.com/demand-driven-open-data/ddod-intake/issues/56","id":147590844,"number":56,"title":"Aggregate machine-readable provider network directories and drug formularies into tabular format","user":{"login":"dportnoy","id":2925801,"avatar_url":"https://avatars.githubusercontent.com/u/2925801?v=3","gravatar_id":"","url":"https://api.github.com/users/dportnoy","html_url":"https://github.com/dportnoy","followers_url":"https://api.github.com/users/dportnoy/followers","following_url":"https://api.github.com/users/dportnoy/following{/other_user}","gists_url":"https://api.github.com/users/dportnoy/gists{/gist_id}","starred_url":"https://api.github.com/users/dportnoy/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dportnoy/subscriptions","organizations_url":"https://api.github.com/users/dportnoy/orgs","repos_url":"https://api.github.com/users/dportnoy/repos","events_url":"https://api.github.com/users/dportnoy/events{/privacy}","received_events_url":"https://api.github.com/users/dportnoy/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/demand-driven-open-data/ddod-intake/labels/Owner:%20HHS-CMS","name":"Owner: HHS-CMS","color":"006b75"},{"url":"https://api.github.com/repos/demand-driven-open-data/ddod-intake/labels/STATE:%20Waiting%20on%20user","name":"STATE: Waiting on user","color":"fbca04"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":20,"created_at":"2016-04-11T23:59:33Z","updated_at":"2016-04-17T23:28:09Z","closed_at":null,"body":"#### Putting out a call to those interested in making an impact by contributing to public data projects...  Looking for somebody to create a new public dataset (and accompanying source code).\r\n\r\n### Background\r\nIn November 2015, the Centers for Medicare & Medicaid Services (CMS) enacted a new regulatory requirement for health insurers who list plans on insurance marketplaces. They must now publish a machine-readable version of their provider network directory and drug formulary, publish it to a specified JSON standard, and update it at least monthly.  This data has just recently become accessible to the public.  Some of its uses can be found in the [Bayes Impact hackathon \"prompts\"](http://bayeshack.org/health-and-human-services.html) or in [at least 7 DDOD use cases](http://hhs.ddod.us/wiki/Concept:_Group_use_cases_for_provider_registry).\r\n\r\n### Challenge\r\nWhile these newly available datasets can significantly benefit consumer health applications and be used in a range of healthcare analytics, the current format doesn't lend itself to doing so.  \r\n* First, while there is a single \"Machine-readable URL PUF\" seed file, the actual data is scattered throughout thousands of URLs.\r\n* Second, for analytics and aggregate operations, it would be beneficial to convert the JSON schema into a tabular data format.\r\n\r\n### Request\r\n\r\nWrite code that does the following:\r\n\r\n1. Crawls the URLs starting with the [\"Machine-readable URL PUF\"](http://download.cms.gov/marketplace-puf/2016/machine-readable-url-puf.zip) seed file found on this page: https://www.cms.gov/CCIIO/Resources/Data-Resources/marketplace-puf.html.\r\n    *  (As of  3/1/2016, there are 636 plan URLs, 23,711 provider URLs and 1,662  formulary URLs.)\r\n1. Converts the data from the JSON schema (https://github.com/CMSgov/QHP-provider-formulary-APIs) into a tabular format with the same fields.\r\n    * (There may be some challenges converting multiple independent array fields from JSON to a tabular row.)\r\n1. Aggregates the results into CSV or text delimited text files, such that we have files for: Plans, Providers, and Formularies.\r\n\r\nRun the code and let us know where to find the resulting files.  We should be able to find a good home for them, so that they enjoy widespread use.\r\n\r\n\r\n#### If you can do this, you’ll be an official Open Data Hero!  (Spandex optional.)"},"comment":{"url":"https://api.github.com/repos/demand-driven-open-data/ddod-intake/issues/comments/211128096","html_url":"https://github.com/demand-driven-open-data/ddod-intake/issues/56#issuecomment-211128096","issue_url":"https://api.github.com/repos/demand-driven-open-data/ddod-intake/issues/56","id":211128096,"user":{"login":"marks","id":34566,"avatar_url":"https://avatars.githubusercontent.com/u/34566?v=3","gravatar_id":"","url":"https://api.github.com/users/marks","html_url":"https://github.com/marks","followers_url":"https://api.github.com/users/marks/followers","following_url":"https://api.github.com/users/marks/following{/other_user}","gists_url":"https://api.github.com/users/marks/gists{/gist_id}","starred_url":"https://api.github.com/users/marks/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/marks/subscriptions","organizations_url":"https://api.github.com/users/marks/orgs","repos_url":"https://api.github.com/users/marks/repos","events_url":"https://api.github.com/users/marks/events{/privacy}","received_events_url":"https://api.github.com/users/marks/received_events","type":"User","site_admin":false},"created_at":"2016-04-17T23:28:09Z","updated_at":"2016-04-17T23:28:09Z","body":"Jeff- if I can just get delimited files, I can take care of loading it for ya. Sounds like kaggle is top priority for this event though ;)\n\n\n--\nMark Silverberg\n(m) 512 826 7004\nhttp://twitter.com/skram\n\n> On Apr 17, 2016, at 7:18 PM, BAP-Jeff <notifications@github.com> wrote:\n> \n> David,\n> \n> I think I can take on all the above but may need a little help with the Deck. Do you have a template you want to use - Powerpoint, Google, ??\n> \n> I can produce the files tonight/tomorrow and upload them probably tomorrow.\n> \n> @dportnoy give me the details on the kaggle stuff\n> @marks let me know where to drop the files for Socrata\n> \n> David, did you want to reserve any slides for ...\"Issues we found in the data\" or does that diminish the good vibes?\n> \n> Jeff\n> \n> —\n> You are receiving this because you were mentioned.\n> Reply to this email directly or view it on GitHub\n> \n"}}