{"action":"closed","issue":{"url":"https://api.github.com/repos/opencivicdata/scrapers-us-municipal/issues/111","repository_url":"https://api.github.com/repos/opencivicdata/scrapers-us-municipal","labels_url":"https://api.github.com/repos/opencivicdata/scrapers-us-municipal/issues/111/labels{/name}","comments_url":"https://api.github.com/repos/opencivicdata/scrapers-us-municipal/issues/111/comments","events_url":"https://api.github.com/repos/opencivicdata/scrapers-us-municipal/issues/111/events","html_url":"https://github.com/opencivicdata/scrapers-us-municipal/issues/111","id":158567520,"number":111,"title":"Agenda items not preserved when two scrapers collect same event","user":{"login":"patcon","id":305339,"avatar_url":"https://avatars.githubusercontent.com/u/305339?v=3","gravatar_id":"","url":"https://api.github.com/users/patcon","html_url":"https://github.com/patcon","followers_url":"https://api.github.com/users/patcon/followers","following_url":"https://api.github.com/users/patcon/following{/other_user}","gists_url":"https://api.github.com/users/patcon/gists{/gist_id}","starred_url":"https://api.github.com/users/patcon/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/patcon/subscriptions","organizations_url":"https://api.github.com/users/patcon/orgs","repos_url":"https://api.github.com/users/patcon/repos","events_url":"https://api.github.com/users/patcon/events{/privacy}","received_events_url":"https://api.github.com/users/patcon/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2016-06-05T18:33:04Z","updated_at":"2016-06-05T18:41:12Z","closed_at":"2016-06-05T18:41:12Z","body":"I have one scraper that scrapes all events scheduled in the legislative session, and another that runs for collecting details about recently passed and upcoming events (for which agendas are just being published).\r\n\r\nSo essentially:\r\n1. **`events-incremental`.** quick nightly scrape that builds events with agendas around the current date, and\r\n2. **`events-full`.** another scraper for the full schedule, that doesn't touch agendas.\r\n\r\nI am seeing that if `events-full` runs after `events-incremental` it blows away all the agendas.\r\n\r\nA [slack conversation](https://opencivicdata.slack.com/archives/pupa/p1463506105000003) with @paultag lead me to believe that this shouldn't be happening if no agenda items are added or touched.\r\n\r\nHowever, I've just built a simple scraper a reproduced the wiping behaviour:\r\nhttps://github.com/patcon/scrapers-us-municipal/tree/agenda-wipe-bug-demo\r\n\r\nIf I run the below code, the agenda items appear, and then disappear after running the second scrape:\r\n\r\n```\r\npupa update test events_has_agenda\r\npupa update test events_no_agenda\r\n```\r\n\r\nCan someone confirm that this is unexpected behaviour, and perhaps suggest any ideas on where the regression may have happened? Thanks! :)"}}
{"actor":{"display_login":"patcon"}}