{"action":"created","issue":{"url":"https://api.github.com/repos/alphagov/publishing-api/issues/1242","repository_url":"https://api.github.com/repos/alphagov/publishing-api","labels_url":"https://api.github.com/repos/alphagov/publishing-api/issues/1242/labels{/name}","comments_url":"https://api.github.com/repos/alphagov/publishing-api/issues/1242/comments","events_url":"https://api.github.com/repos/alphagov/publishing-api/issues/1242/events","html_url":"https://github.com/alphagov/publishing-api/pull/1242","id":326559480,"node_id":"MDExOlB1bGxSZXF1ZXN0MTkwNjE1Nzcy","number":1242,"title":"Task to queue messages for all content","user":{"login":"MatMoore","id":87579,"node_id":"MDQ6VXNlcjg3NTc5","avatar_url":"https://avatars1.githubusercontent.com/u/87579?v=4","gravatar_id":"","url":"https://api.github.com/users/MatMoore","html_url":"https://github.com/MatMoore","followers_url":"https://api.github.com/users/MatMoore/followers","following_url":"https://api.github.com/users/MatMoore/following{/other_user}","gists_url":"https://api.github.com/users/MatMoore/gists{/gist_id}","starred_url":"https://api.github.com/users/MatMoore/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/MatMoore/subscriptions","organizations_url":"https://api.github.com/users/MatMoore/orgs","repos_url":"https://api.github.com/users/MatMoore/repos","events_url":"https://api.github.com/users/MatMoore/events{/privacy}","received_events_url":"https://api.github.com/users/MatMoore/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":6,"created_at":"2018-05-25T15:01:51Z","updated_at":"2018-06-04T15:05:02Z","closed_at":null,"author_association":"CONTRIBUTOR","pull_request":{"url":"https://api.github.com/repos/alphagov/publishing-api/pulls/1242","html_url":"https://github.com/alphagov/publishing-api/pull/1242","diff_url":"https://github.com/alphagov/publishing-api/pull/1242.diff","patch_url":"https://github.com/alphagov/publishing-api/pull/1242.patch"},"body":"Paired with @chao-xian \r\n\r\nExample usage: `rake queue:requeue_all_the_things[bulk.data-warehouse]`\r\n\r\nCurrently in content performance manager, the way we initially\r\npopulate our content data is very different to how we incrementally\r\nupdate it as content changes. This is because the API returns us\r\ndata in a different format to the message queue.\r\n\r\nIn particular, it doesn't send us links or the details hash,\r\nso we have to make additional calls to the content store to\r\nfully populate the content. These calls are architecturally\r\nundesirable because the content store is supposed to be used\r\nfor serving the frontend of the site.\r\n\r\nWe are thinking that it would be simpler\r\nif we could drive everything from the message queue (this\r\nis the solution previously adopted by search). To do this\r\nwe need some way of sending all the live content items through\r\nthe system on demand. This is expected to be run only as a developer\r\ntask, so we would pause the normal consumer in content performance\r\nmanager, run this rake task, and wait for everything to be\r\nprocessed.\r\n\r\n# Next steps\r\n- Update the new CPM consumer to process messages instead of discarding them\r\n- We need to measure how long this takes end to end\r\n- We should write documentation for it\r\n\r\n# Trello\r\n- https://trello.com/c/bIKQuMU3/75-content-performance-manager-is-talking-to-content-store\r\n- https://trello.com/c/m3vzLnR5/372-use-only-publishing-api-to-preload-items"},"comment":{"url":"https://api.github.com/repos/alphagov/publishing-api/issues/comments/394387866","html_url":"https://github.com/alphagov/publishing-api/pull/1242#issuecomment-394387866","issue_url":"https://api.github.com/repos/alphagov/publishing-api/issues/1242","id":394387866,"node_id":"MDEyOklzc3VlQ29tbWVudDM5NDM4Nzg2Ng==","user":{"login":"MatMoore","id":87579,"node_id":"MDQ6VXNlcjg3NTc5","avatar_url":"https://avatars1.githubusercontent.com/u/87579?v=4","gravatar_id":"","url":"https://api.github.com/users/MatMoore","html_url":"https://github.com/MatMoore","followers_url":"https://api.github.com/users/MatMoore/followers","following_url":"https://api.github.com/users/MatMoore/following{/other_user}","gists_url":"https://api.github.com/users/MatMoore/gists{/gist_id}","starred_url":"https://api.github.com/users/MatMoore/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/MatMoore/subscriptions","organizations_url":"https://api.github.com/users/MatMoore/orgs","repos_url":"https://api.github.com/users/MatMoore/repos","events_url":"https://api.github.com/users/MatMoore/events{/privacy}","received_events_url":"https://api.github.com/users/MatMoore/received_events","type":"User","site_admin":false},"created_at":"2018-06-04T15:05:02Z","updated_at":"2018-06-04T15:05:02Z","author_association":"CONTRIBUTOR","body":"Hi all, \r\n\r\nAny objections to me merging this as is? I'm going to flesh out the consumer process separately."}}
{"actor":{"display_login":"MatMoore"}}