{"action":"opened","issue":{"url":"https://api.github.com/repos/marklogic/marklogic-contentpump/issues/37","repository_url":"https://api.github.com/repos/marklogic/marklogic-contentpump","labels_url":"https://api.github.com/repos/marklogic/marklogic-contentpump/issues/37/labels{/name}","comments_url":"https://api.github.com/repos/marklogic/marklogic-contentpump/issues/37/comments","events_url":"https://api.github.com/repos/marklogic/marklogic-contentpump/issues/37/events","html_url":"https://github.com/marklogic/marklogic-contentpump/issues/37","id":179916541,"number":37,"title":"REGR: mlcp direct access tests are missing a document while extracting from old data","user":{"login":"sravanr","id":7087293,"avatar_url":"https://avatars.githubusercontent.com/u/7087293?v=3","gravatar_id":"","url":"https://api.github.com/users/sravanr","html_url":"https://github.com/sravanr","followers_url":"https://api.github.com/users/sravanr/followers","following_url":"https://api.github.com/users/sravanr/following{/other_user}","gists_url":"https://api.github.com/users/sravanr/gists{/gist_id}","starred_url":"https://api.github.com/users/sravanr/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sravanr/subscriptions","organizations_url":"https://api.github.com/users/sravanr/orgs","repos_url":"https://api.github.com/users/sravanr/repos","events_url":"https://api.github.com/users/sravanr/events{/privacy}","received_events_url":"https://api.github.com/users/sravanr/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/marklogic/marklogic-contentpump/labels/bug","name":"bug","color":"1d76db"},{"url":"https://api.github.com/repos/marklogic/marklogic-contentpump/labels/major","name":"major","color":"d93f0b"},{"url":"https://api.github.com/repos/marklogic/marklogic-contentpump/labels/mlcp","name":"mlcp","color":"84b6eb"},{"url":"https://api.github.com/repos/marklogic/marklogic-contentpump/labels/new","name":"new","color":"0e8a16"}],"state":"open","locked":false,"assignee":{"login":"jxchen-us","id":13925591,"avatar_url":"https://avatars.githubusercontent.com/u/13925591?v=3","gravatar_id":"","url":"https://api.github.com/users/jxchen-us","html_url":"https://github.com/jxchen-us","followers_url":"https://api.github.com/users/jxchen-us/followers","following_url":"https://api.github.com/users/jxchen-us/following{/other_user}","gists_url":"https://api.github.com/users/jxchen-us/gists{/gist_id}","starred_url":"https://api.github.com/users/jxchen-us/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jxchen-us/subscriptions","organizations_url":"https://api.github.com/users/jxchen-us/orgs","repos_url":"https://api.github.com/users/jxchen-us/repos","events_url":"https://api.github.com/users/jxchen-us/events{/privacy}","received_events_url":"https://api.github.com/users/jxchen-us/received_events","type":"User","site_admin":false},"assignees":[{"login":"jxchen-us","id":13925591,"avatar_url":"https://avatars.githubusercontent.com/u/13925591?v=3","gravatar_id":"","url":"https://api.github.com/users/jxchen-us","html_url":"https://github.com/jxchen-us","followers_url":"https://api.github.com/users/jxchen-us/followers","following_url":"https://api.github.com/users/jxchen-us/following{/other_user}","gists_url":"https://api.github.com/users/jxchen-us/gists{/gist_id}","starred_url":"https://api.github.com/users/jxchen-us/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jxchen-us/subscriptions","organizations_url":"https://api.github.com/users/jxchen-us/orgs","repos_url":"https://api.github.com/users/jxchen-us/repos","events_url":"https://api.github.com/users/jxchen-us/events{/privacy}","received_events_url":"https://api.github.com/users/jxchen-us/received_events","type":"User","site_admin":false}],"milestone":{"url":"https://api.github.com/repos/marklogic/marklogic-contentpump/milestones/2","html_url":"https://github.com/marklogic/marklogic-contentpump/milestones/8.0-6","labels_url":"https://api.github.com/repos/marklogic/marklogic-contentpump/milestones/2/labels","id":1851398,"number":2,"title":"8.0-6","description":"","creator":{"login":"mattsunsjf","id":7323156,"avatar_url":"https://avatars.githubusercontent.com/u/7323156?v=3","gravatar_id":"","url":"https://api.github.com/users/mattsunsjf","html_url":"https://github.com/mattsunsjf","followers_url":"https://api.github.com/users/mattsunsjf/followers","following_url":"https://api.github.com/users/mattsunsjf/following{/other_user}","gists_url":"https://api.github.com/users/mattsunsjf/gists{/gist_id}","starred_url":"https://api.github.com/users/mattsunsjf/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mattsunsjf/subscriptions","organizations_url":"https://api.github.com/users/mattsunsjf/orgs","repos_url":"https://api.github.com/users/mattsunsjf/repos","events_url":"https://api.github.com/users/mattsunsjf/events{/privacy}","received_events_url":"https://api.github.com/users/mattsunsjf/received_events","type":"User","site_admin":false},"open_issues":2,"closed_issues":8,"state":"open","created_at":"2016-06-27T20:26:54Z","updated_at":"2016-09-28T23:25:50Z","due_on":null,"closed_at":null},"comments":0,"created_at":"2016-09-28T23:25:50Z","updated_at":"2016-09-28T23:25:50Z","closed_at":null,"body":"Following regression tests are failing from 27th sept, as 26th is no mlcp day. I see last 25 sept being last pass day.\r\n\r\nmlcp-da-test-json.xml\r\nmlcp-da-test2.xml\r\nmlcp-da-test3.xml\r\nmlcp-da-test4.xml\r\nmlcp-da-test5.xml\r\n\r\nAfter my investigation on the test mlcp-da-test-json.xml, i found the following command is not extracting all the documents [ missing document json_xml_basic_test28.xml )\r\n```\r\n/space/b8_0/qa/mlcp/runmlcp.sh /space/b8_0/qa EXTRACT -input_file_path /space/b8_0/qa/mlcp/data/extract/forests/mlcp-ext-src-f11,/space/b8_0/qa/mlcp/data/extract/forests/mlcp-ext-src-f12 -output_file_path /space/b8_0/qa/mlcp/data/output/mlcp-ext-src-jsonmix -mode local\r\n\r\n--->\r\nstderr/out from shell cmd: 2016-09-28\r\ndrwxrwxr-x 5 skottam qa 4096 2016-09-28 11:32:38.939173861 -0700 marklogic-contentpump\r\ndirectory exists\r\nhowever, it was created today\r\ndata/xml/bigdata directory exists.\r\n-rwxrwxrwx 1 skottam qa 754 Sep 28 15:26 /space/b8_0/qa/mlcp/marklogic-contentpump/conf/log4j.properties\r\nEXTRACT -input_file_path /space/b8_0/qa/mlcp/data/extract/forests/mlcp-ext-src-f11,/space/b8_0/qa/mlcp/data/extract/forests/mlcp-ext-src-f12 -output_file_path /space/b8_0/qa/mlcp/data/output/mlcp-ext-src-jsonmix -mode local\r\n\r\nstderr/out from shell cmd: 16/09/28 15:26:22 INFO input.FileInputFormat: Total input paths to process : 10\r\n16/09/28 15:26:22 INFO contentpump.LocalJobRunner:  completed 100%\r\n16/09/28 15:26:22 INFO contentpump.LocalJobRunner: com.marklogic.mapreduce.MarkLogicCounter: \r\n16/09/28 15:26:22 INFO contentpump.LocalJobRunner: INPUT_RECORDS: 32\r\n16/09/28 15:26:22 INFO contentpump.LocalJobRunner: OUTPUT_RECORDS: 32\r\n16/09/28 15:26:22 INFO contentpump.LocalJobRunner: Total execution time: 0 sec\r\n\r\n\r\n```\r\n\r\nThe same command on Sunday regression \r\n\r\n```\r\nrunning following shell command: \r\n   \t /space/builder/builds/linux64/b8_0/qa/mlcp/runmlcp.sh /space/builder/builds/linux64/b8_0/qa EXTRACT -input_file_path /space/builder/builds/linux64/b8_0/qa/mlcp/data/extract/forests/mlcp-ext-src-f11,/space/builder/builds/linux64/b8_0/qa/mlcp/data/extract/forests/mlcp-ext-src-f12 -output_file_path /space/builder/builds/linux64/b8_0/qa/mlcp/data/output/mlcp-ext-src-jsonmix -mode local \r\n\t\r\nstderr/out from shell cmd: 16/09/25 11:07:48 INFO input.FileInputFormat: Total input paths to process : 10\r\n16/09/25 11:07:48 INFO contentpump.LocalJobRunner:  completed 100%\r\n16/09/25 11:07:48 INFO contentpump.LocalJobRunner: com.marklogic.mapreduce.MarkLogicCounter: \r\n16/09/25 11:07:48 INFO contentpump.LocalJobRunner: INPUT_RECORDS: 33\r\n16/09/25 11:07:48 INFO contentpump.LocalJobRunner: OUTPUT_RECORDS: 33\r\n16/09/25 11:07:48 INFO contentpump.LocalJobRunner: Total execution time: 0 sec\r\n\r\n```\r\n\r\n\r\n\r\n\r\n\r\n"}}
{"actor":{"display_login":"sravanr"}}