{"action":"created","issue":{"url":"https://api.github.com/repos/mongodb-labs/mongo-connector/issues/551","repository_url":"https://api.github.com/repos/mongodb-labs/mongo-connector","labels_url":"https://api.github.com/repos/mongodb-labs/mongo-connector/issues/551/labels{/name}","comments_url":"https://api.github.com/repos/mongodb-labs/mongo-connector/issues/551/comments","events_url":"https://api.github.com/repos/mongodb-labs/mongo-connector/issues/551/events","html_url":"https://github.com/mongodb-labs/mongo-connector/issues/551","id":182685230,"number":551,"title":"why oplog.timestamp is null?","user":{"login":"lifuchao","id":15504114,"avatar_url":"https://avatars.githubusercontent.com/u/15504114?v=3","gravatar_id":"","url":"https://api.github.com/users/lifuchao","html_url":"https://github.com/lifuchao","followers_url":"https://api.github.com/users/lifuchao/followers","following_url":"https://api.github.com/users/lifuchao/following{/other_user}","gists_url":"https://api.github.com/users/lifuchao/gists{/gist_id}","starred_url":"https://api.github.com/users/lifuchao/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lifuchao/subscriptions","organizations_url":"https://api.github.com/users/lifuchao/orgs","repos_url":"https://api.github.com/users/lifuchao/repos","events_url":"https://api.github.com/users/lifuchao/events{/privacy}","received_events_url":"https://api.github.com/users/lifuchao/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/mongodb-labs/mongo-connector/labels/question","name":"question","color":"cc317c"}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":6,"created_at":"2016-10-13T03:14:20Z","updated_at":"2016-10-17T20:50:57Z","closed_at":null,"body":"when I execute mongo-connector 2.4 sync to elasticsearch2.3.4 data sync correctly ,no errors,but oplog.timestamp file has nothing. does not it update timestamp like [\"rs0\", 6339713900350538292] ? \r\nhow and when mongo-connector will update oplog.timestamp?\r\nwhen I shutdown mongo-connector,and want to continue syn,I will wait too long ,data do not sync into elasticsearch .\r\nthanks,urgent!\r\n\r\nI run mongo-connector like \"mongo-connector -c config.json\"\r\nand my config.json like here:\r\n```json\r\n{\r\n  \"mainAddress\": \"*.*.*.*:27017\",\r\n  \"oplogFile\": \"/data/opt/mongo-connector/oplog.timestamp\",\r\n  \"verbosity\": 1,\r\n  \"logging\": {\r\n    \"type\": \"file\",\r\n    \"filename\": \"/data/opt/mongo-connector/mongo-connector.log\",\r\n    \"__rotationWhen\": \"D\",\r\n    \"__rotationInterval\": 1,\r\n    \"__rotationBackups\": 10\r\n  },\r\n  \"fields\": [\"_id\",,\"label\",\"pinyin\",\"begin_time\",\"end_time\"],\r\n  \"namespaces\": {\r\n    \"include\": [\"aa.a\", \"bb.b\"],\r\n    \"mapping\": {\r\n      \"aa.a\": \"aa.a\",\r\n      \"bb.b\": \"bb.b\"\r\n    }\r\n  },\r\n  \"docManagers\": [\r\n    {\r\n      \"docManager\": \"elastic2_doc_manager\",\r\n      \"targetURL\": \"*.*.*.*:9200\",\r\n\t  \"bulkSize\": 4000,\r\n      \"autoCommitInterval\": null,\r\n      \"args\": {\r\n        \"clientOptions\": {\"timeout\": 300}\r\n      }\r\n    }\r\n  ]\r\n}\r\n```\r\n\r\nEdit: formatted json"},"comment":{"url":"https://api.github.com/repos/mongodb-labs/mongo-connector/issues/comments/254330019","html_url":"https://github.com/mongodb-labs/mongo-connector/issues/551#issuecomment-254330019","issue_url":"https://api.github.com/repos/mongodb-labs/mongo-connector/issues/551","id":254330019,"user":{"login":"ShaneHarvey","id":5015933,"avatar_url":"https://avatars.githubusercontent.com/u/5015933?v=3","gravatar_id":"","url":"https://api.github.com/users/ShaneHarvey","html_url":"https://github.com/ShaneHarvey","followers_url":"https://api.github.com/users/ShaneHarvey/followers","following_url":"https://api.github.com/users/ShaneHarvey/following{/other_user}","gists_url":"https://api.github.com/users/ShaneHarvey/gists{/gist_id}","starred_url":"https://api.github.com/users/ShaneHarvey/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ShaneHarvey/subscriptions","organizations_url":"https://api.github.com/users/ShaneHarvey/orgs","repos_url":"https://api.github.com/users/ShaneHarvey/repos","events_url":"https://api.github.com/users/ShaneHarvey/events{/privacy}","received_events_url":"https://api.github.com/users/ShaneHarvey/received_events","type":"User","site_admin":false},"created_at":"2016-10-17T20:50:57Z","updated_at":"2016-10-17T20:50:57Z","body":"Perhaps the initial 2000 docs/s is because MongoConnector does a collection dump on the first startup using bulk operations. After that, updates are sent individually which could be causing the slow down you're seeing. There's a pull request in the works to make the Elastic DocManagers faster which you can check out: https://github.com/mongodb-labs/elastic2-doc-manager/pull/15"}}
{"actor":{"display_login":"ShaneHarvey"}}