{"action":"created","issue":{"url":"https://api.github.com/repos/RADAR-base/MongoDb-Sink-Connector/issues/34","repository_url":"https://api.github.com/repos/RADAR-base/MongoDb-Sink-Connector","labels_url":"https://api.github.com/repos/RADAR-base/MongoDb-Sink-Connector/issues/34/labels{/name}","comments_url":"https://api.github.com/repos/RADAR-base/MongoDb-Sink-Connector/issues/34/comments","events_url":"https://api.github.com/repos/RADAR-base/MongoDb-Sink-Connector/issues/34/events","html_url":"https://github.com/RADAR-base/MongoDb-Sink-Connector/issues/34","id":319357715,"number":34,"title":"Have a configurable option to optimize the mongodb writer","user":{"login":"yatharthranjan","id":11093544,"avatar_url":"https://avatars2.githubusercontent.com/u/11093544?v=4","gravatar_id":"","url":"https://api.github.com/users/yatharthranjan","html_url":"https://github.com/yatharthranjan","followers_url":"https://api.github.com/users/yatharthranjan/followers","following_url":"https://api.github.com/users/yatharthranjan/following{/other_user}","gists_url":"https://api.github.com/users/yatharthranjan/gists{/gist_id}","starred_url":"https://api.github.com/users/yatharthranjan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/yatharthranjan/subscriptions","organizations_url":"https://api.github.com/users/yatharthranjan/orgs","repos_url":"https://api.github.com/users/yatharthranjan/repos","events_url":"https://api.github.com/users/yatharthranjan/events{/privacy}","received_events_url":"https://api.github.com/users/yatharthranjan/received_events","type":"User","site_admin":false},"labels":[{"id":490097125,"url":"https://api.github.com/repos/RADAR-base/MongoDb-Sink-Connector/labels/wontfix","name":"wontfix","color":"ffffff","default":true}],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-05-01T23:08:49Z","updated_at":"2018-05-02T06:58:18Z","closed_at":"2018-05-02T06:58:18Z","author_association":"OWNER","body":"Right now the mongoDb writer just writes the latest values for each id in each topic. See here - https://github.com/RADAR-base/MongoDb-Sink-Connector/blob/46ea3af8652e8ca6cd6c9de9880495c9204aac1d/src/main/java/org/radarcns/connect/mongodb/MongoDbWriter.java#L146 \r\nThis is important for performance when dealing with large amounts of data from the streams apps.\r\nBut this is not ideal for someone who wants to use the mongoDb connector standalone and wants to write all the data from topics to the mongoDb. \r\nCreate a config option to handle this case which can be specified in the sink-mongodb.properties file\r\nThis may also help solve #33 "},"comment":{"url":"https://api.github.com/repos/RADAR-base/MongoDb-Sink-Connector/issues/comments/385882379","html_url":"https://github.com/RADAR-base/MongoDb-Sink-Connector/issues/34#issuecomment-385882379","issue_url":"https://api.github.com/repos/RADAR-base/MongoDb-Sink-Connector/issues/34","id":385882379,"user":{"login":"blootsvoets","id":313450,"avatar_url":"https://avatars0.githubusercontent.com/u/313450?v=4","gravatar_id":"","url":"https://api.github.com/users/blootsvoets","html_url":"https://github.com/blootsvoets","followers_url":"https://api.github.com/users/blootsvoets/followers","following_url":"https://api.github.com/users/blootsvoets/following{/other_user}","gists_url":"https://api.github.com/users/blootsvoets/gists{/gist_id}","starred_url":"https://api.github.com/users/blootsvoets/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/blootsvoets/subscriptions","organizations_url":"https://api.github.com/users/blootsvoets/orgs","repos_url":"https://api.github.com/users/blootsvoets/repos","events_url":"https://api.github.com/users/blootsvoets/events{/privacy}","received_events_url":"https://api.github.com/users/blootsvoets/received_events","type":"User","site_admin":false},"created_at":"2018-05-02T06:58:18Z","updated_at":"2018-05-02T06:58:18Z","author_association":"OWNER","body":"The behaviour of MongoDB is that if two records with the same ID are written, the first one is overwritten. This is consistent with what the connector does, only the connector does it before writing to MongoDB. Users can specify a custom converter to generate those IDs, so if each converted record gets a unique ID, or does not get an ID at all, no substitution takes place, again, consistent with how MongoDB behaves."}}
{"actor":{"display_login":"blootsvoets"}}