{"action":"created","issue":{"url":"https://api.github.com/repos/Unidata/unidata-usercomm/issues/2","repository_url":"https://api.github.com/repos/Unidata/unidata-usercomm","labels_url":"https://api.github.com/repos/Unidata/unidata-usercomm/issues/2/labels{/name}","comments_url":"https://api.github.com/repos/Unidata/unidata-usercomm/issues/2/comments","events_url":"https://api.github.com/repos/Unidata/unidata-usercomm/issues/2/events","html_url":"https://github.com/Unidata/unidata-usercomm/issues/2","id":179632711,"number":2,"title":"Clean-up/revamp RTstats","user":{"login":"dopplershift","id":221526,"avatar_url":"https://avatars.githubusercontent.com/u/221526?v=3","gravatar_id":"","url":"https://api.github.com/users/dopplershift","html_url":"https://github.com/dopplershift","followers_url":"https://api.github.com/users/dopplershift/followers","following_url":"https://api.github.com/users/dopplershift/following{/other_user}","gists_url":"https://api.github.com/users/dopplershift/gists{/gist_id}","starred_url":"https://api.github.com/users/dopplershift/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dopplershift/subscriptions","organizations_url":"https://api.github.com/users/dopplershift/orgs","repos_url":"https://api.github.com/users/dopplershift/repos","events_url":"https://api.github.com/users/dopplershift/events{/privacy}","received_events_url":"https://api.github.com/users/dopplershift/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":3,"created_at":"2016-09-27T22:32:33Z","updated_at":"2016-09-28T14:41:29Z","closed_at":null,"body":""},"comment":{"url":"https://api.github.com/repos/Unidata/unidata-usercomm/issues/comments/250186849","html_url":"https://github.com/Unidata/unidata-usercomm/issues/2#issuecomment-250186849","issue_url":"https://api.github.com/repos/Unidata/unidata-usercomm/issues/2","id":250186849,"user":{"login":"vgensini","id":14943946,"avatar_url":"https://avatars.githubusercontent.com/u/14943946?v=3","gravatar_id":"","url":"https://api.github.com/users/vgensini","html_url":"https://github.com/vgensini","followers_url":"https://api.github.com/users/vgensini/followers","following_url":"https://api.github.com/users/vgensini/following{/other_user}","gists_url":"https://api.github.com/users/vgensini/gists{/gist_id}","starred_url":"https://api.github.com/users/vgensini/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vgensini/subscriptions","organizations_url":"https://api.github.com/users/vgensini/orgs","repos_url":"https://api.github.com/users/vgensini/repos","events_url":"https://api.github.com/users/vgensini/events{/privacy}","received_events_url":"https://api.github.com/users/vgensini/received_events","type":"User","site_admin":false},"created_at":"2016-09-28T14:41:29Z","updated_at":"2016-09-28T14:41:29Z","body":"Daryl,\n\nSounds great! That would be a fantastic contribution. \n\nI am willing to assist in the git repo, especially for task three. I would like to see matplotlib/plotly used to make interactive maps that play nice with your JavaScript. \n\nBest,\n\n--\nDr. Vittorio (Victor) A. Gensini\nAssociate Professor\nMeteorology\nCollege of DuPage\n425 Fawell Blvd.\nGlen Ellyn, IL 60137\nOffice: Berg Instructional Center 3503\nph: +1 (630) 942-3496 \nhttp://weather.cod.edu/~vgensini\n\n> On Sep 28, 2016, at 8:24 AM, daryl herzmann <notifications@github.com> wrote:\n> \n> rtstats is a wonderful service provided by Unidata to help IDD members monitor their LDM feed volumes and latency. This service runs on a server at Unidata and does the following (known to me) functions:\n> \n> runs a LDM accepting EXP rtstats products from the world\n> processes these rtstat files into netcdf files that store the data\n> has various cron scripts that do maintenance on these netcdf files\n> has a manually produced/maintained table of IP/hostnames to lat/lons for spatial plotting\n> has a website that provides various GEMPAK based visualizations of the data\n> Most of the code that does the above is very old and needs to be replaced/updated with modern tooling that does not rely on GEMPAK.  So I volunteered at the fall 2016 Unidata usercomm meeting to lead an effort to revamp the rtstats service and provide some enhanced functionality that would hopefully benefit the community.\n> \n> My initial implementation thoughts are:\n> \n> Process the raw rtstats files into a PostgreSQL backend and remove netcdf usage\n> create matplotlib scripts that directly replicate the current website functionality and maintain current URIs (this would not be a major effort and could be eliminated later if OK by community)\n> use GeoIP to do IP to lat/lon conversion, perhaps there are better / more Free alternatives?\n> https only for the website with letsencrpyt\n> If I can produce successful results for the initial implementation, a solicitation would be sent out on the ldm-users email list informing them of this work and asking for comments/ideas for new tooling they would like to see. My initial idea on new services includes:\n> \n> create JSON(P) emitting web services that would provide stats back to the community / drive new interactive webapps\n> create interactive / javascript web browser based plotting tools that use the above web services\n> create a web service that would emit data suitable for various monitoring packages, like nagios to consume. This would allow sites to point their local monitoring at this service and set up alerting for when necessary. (This idea is somewhat vague and may be dumped later...)\n> create a dashboard for Unidata to monitor the health of the IDD\n> create a dashboard for local sites to monitor their deployment\n> Currently, rtstats runs on a physical host with some SSD drives to help it handle the load. The goal would be to move this to a VM and not need the speed of SSDs to make things work. I would like this VM to run RHEL/centos 7.\n> \n> So my initial tasks are:\n> \n>  contact Unidata to request a LDM feed from their rtstats system\n>  define a schema and create a python parser to dump data into the database\n>  create matplotlib based replacements of the current website plots\n>  create PHP(?) based replacements of the HTML summary pages\n> At the moment I will be doing this work in my rtstats git repo. I am curious to see how many pain will be found with the initial tasks and that will likely dictate how much excitement I have with adding new services.\n> \n> Comments and offers to help are welcome!\n> \n> —\n> You are receiving this because you are subscribed to this thread.\n> Reply to this email directly, view it on GitHub, or mute the thread.\n> \n"}}
{"actor":{"display_login":"vgensini"}}