{"action":"created","issue":{"url":"https://api.github.com/repos/goodeggs/goodeggs-mongoose-timestamps/issues/1","repository_url":"https://api.github.com/repos/goodeggs/goodeggs-mongoose-timestamps","labels_url":"https://api.github.com/repos/goodeggs/goodeggs-mongoose-timestamps/issues/1/labels{/name}","comments_url":"https://api.github.com/repos/goodeggs/goodeggs-mongoose-timestamps/issues/1/comments","events_url":"https://api.github.com/repos/goodeggs/goodeggs-mongoose-timestamps/issues/1/events","html_url":"https://github.com/goodeggs/goodeggs-mongoose-timestamps/pull/1","id":162229992,"number":1,"title":"Add indexing to createdAt and updatedAt by default","user":{"login":"asalant","id":110776,"avatar_url":"https://avatars.githubusercontent.com/u/110776?v=3","gravatar_id":"","url":"https://api.github.com/users/asalant","html_url":"https://github.com/asalant","followers_url":"https://api.github.com/users/asalant/followers","following_url":"https://api.github.com/users/asalant/following{/other_user}","gists_url":"https://api.github.com/users/asalant/gists{/gist_id}","starred_url":"https://api.github.com/users/asalant/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/asalant/subscriptions","organizations_url":"https://api.github.com/users/asalant/orgs","repos_url":"https://api.github.com/users/asalant/repos","events_url":"https://api.github.com/users/asalant/events{/privacy}","received_events_url":"https://api.github.com/users/asalant/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2016-06-24T20:59:30Z","updated_at":"2016-06-27T18:31:18Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/goodeggs/goodeggs-mongoose-timestamps/pulls/1","html_url":"https://github.com/goodeggs/goodeggs-mongoose-timestamps/pull/1","diff_url":"https://github.com/goodeggs/goodeggs-mongoose-timestamps/pull/1.diff","patch_url":"https://github.com/goodeggs/goodeggs-mongoose-timestamps/pull/1.patch"},"body":"Used in ETL processes to find incremental updates.\r\n\r\nFor example, doing an incremental update for a days worth of data on `order_items` without an index on `updated_at` takes 1:30sec. With the index it takes 6sec.\r\n\r\n**Question: should we make this opt-in?**\r\nThis PR includes a significant change of behavior - it creates indices that were not being created before.  For Good Eggs, we generally want it turned on since our data warehouse ETL scripts use `createdAt` and `updatedAt`. The alternative is to require `createIndexes: true` to enable this behavior.\r\n\r\nFYI @sziolko"},"comment":{"url":"https://api.github.com/repos/goodeggs/goodeggs-mongoose-timestamps/issues/comments/228833720","html_url":"https://github.com/goodeggs/goodeggs-mongoose-timestamps/pull/1#issuecomment-228833720","issue_url":"https://api.github.com/repos/goodeggs/goodeggs-mongoose-timestamps/issues/1","id":228833720,"user":{"login":"sziolko","id":4226304,"avatar_url":"https://avatars.githubusercontent.com/u/4226304?v=3","gravatar_id":"","url":"https://api.github.com/users/sziolko","html_url":"https://github.com/sziolko","followers_url":"https://api.github.com/users/sziolko/followers","following_url":"https://api.github.com/users/sziolko/following{/other_user}","gists_url":"https://api.github.com/users/sziolko/gists{/gist_id}","starred_url":"https://api.github.com/users/sziolko/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sziolko/subscriptions","organizations_url":"https://api.github.com/users/sziolko/orgs","repos_url":"https://api.github.com/users/sziolko/repos","events_url":"https://api.github.com/users/sziolko/events{/privacy}","received_events_url":"https://api.github.com/users/sziolko/received_events","type":"User","site_admin":false},"created_at":"2016-06-27T18:31:18Z","updated_at":"2016-06-27T18:31:18Z","body":"@randypuro regarding the oplog, I also agree that those logs are the best way to get to actual real-time feeds. That is a direction stripe has gone with mosql, but will require a fair amount more work to get there feeding into redshift from our projects. There are paid services that will do this with some (unclear without getting product demos etc) translation of document collection -> table(s). \r\n\r\nIf you think there are quick ways to work from the oplog to get a subset of documents for the ETL process to translate & load I would be happy to discuss them, that part of Mongo is not something I have worked with."}}
{"actor":{"display_login":"sziolko"}}