{"action":"opened","issue":{"url":"https://api.github.com/repos/inspirehep/magpie/issues/171","repository_url":"https://api.github.com/repos/inspirehep/magpie","labels_url":"https://api.github.com/repos/inspirehep/magpie/issues/171/labels{/name}","comments_url":"https://api.github.com/repos/inspirehep/magpie/issues/171/comments","events_url":"https://api.github.com/repos/inspirehep/magpie/issues/171/events","html_url":"https://github.com/inspirehep/magpie/issues/171","id":387226682,"node_id":"MDU6SXNzdWUzODcyMjY2ODI=","number":171,"title":"Getting Issues in Batch Training  ~ IndexError","user":{"login":"rajeshkumargp","id":10574181,"node_id":"MDQ6VXNlcjEwNTc0MTgx","avatar_url":"https://avatars1.githubusercontent.com/u/10574181?v=4","gravatar_id":"","url":"https://api.github.com/users/rajeshkumargp","html_url":"https://github.com/rajeshkumargp","followers_url":"https://api.github.com/users/rajeshkumargp/followers","following_url":"https://api.github.com/users/rajeshkumargp/following{/other_user}","gists_url":"https://api.github.com/users/rajeshkumargp/gists{/gist_id}","starred_url":"https://api.github.com/users/rajeshkumargp/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rajeshkumargp/subscriptions","organizations_url":"https://api.github.com/users/rajeshkumargp/orgs","repos_url":"https://api.github.com/users/rajeshkumargp/repos","events_url":"https://api.github.com/users/rajeshkumargp/events{/privacy}","received_events_url":"https://api.github.com/users/rajeshkumargp/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-12-04T10:50:22Z","updated_at":"2018-12-04T10:50:22Z","closed_at":null,"author_association":"NONE","body":"I have tried to batch train a data with a corpus. \r\nWhile batch training I got error as below: \r\n\r\n`Fitted to 8691 vectors`\r\n`Epoch 1/10`\r\n`Traceback (most recent call last):`\r\n`  File \"TrainWithCorpus.py\", line 98, in <module>`\r\n`    magpie.batch_train(train_dir, vocabulary=labels,epochs=EPOCH_CUR,callbacks=[csv_logger,checkpoint,b])`\r\n`  File \"/home/Abc/TrialBatch/Version3.0/Scripts/magpieCNN/magpie/main.py\", line 176, in batch_train`\r\n`    verbose=verbose,`\r\n`  File \"/home/Abc/TrialBatch/TrailVirtualEnvironment/lib/python3.5/site-packages/keras/legacy/interfaces.py\", line 91, in wrapper`\r\n`    return func(*args, **kwargs)`\r\n`  File \"/home/Abc/TrialBatch/TrailVirtualEnvironment/lib/python3.5/site-packages/keras/engine/training.py\", line 1418, in fit_generator`\r\n`    initial_epoch=initial_epoch)`\r\n`  File \"/home/Abc/TrialBatch/TrailVirtualEnvironment/lib/python3.5/site-packages/keras/engine/training_generator.py\", line 181, in fit_generator`\r\n`    generator_output = next(output_generator)`\r\n`  File \"/home/Abc/TrialBatch/TrailVirtualEnvironment/lib/python3.5/site-packages/keras/utils/data_utils.py\", line 709, in get`\r\n`    six.reraise(*sys.exc_info())`\r\n`  File \"/home/Abc/TrialBatch/TrailVirtualEnvironment/lib/python3.5/site-packages/six.py\", line 693, in reraise`\r\n`    raise value`\r\n`  File \"/home/Abc/TrialBatch/TrailVirtualEnvironment/lib/python3.5/site-packages/keras/utils/data_utils.py\", line 685, in get`\r\n`    inputs = self.queue.get(block=True).get()`\r\n`  File \"/usr/lib/python3.5/multiprocessing/pool.py\", line 608, in get`\r\n`    raise self._value`\r\n`  File \"/usr/lib/python3.5/multiprocessing/pool.py\", line 119, in worker`\r\n`    result = (True, func(*args, **kwds))`\r\n`  File \"/home/Abc/TrialBatch/TrailVirtualEnvironment/lib/python3.5/site-packages/keras/utils/data_utils.py\", line 626, in next_sample`\r\n`    return six.next(_SHARED_SEQUENCES[uid])`\r\n`  File \"/home/Abc/TrialBatch/Version3.0/Scripts/magpieCNN/magpie/nn/input_data.py\", line 105, in iterate_over_batches`\r\n`    yield build_x_and_y(files, filename_it.dirname, **kwargs)`\r\n`  File \"/home/Abc/TrialBatch/Version3.0/Scripts/magpieCNN/magpie/nn/input_data.py\", line 88, in build_x_and_y`\r\n`    y_matrix[doc_id][index] = True`\r\n`IndexError: index 1135 is out of bounds for axis 0 with size 1102`\r\n\r\nCan you please guide to  proceed further.  \r\n\r\n"}}
{"actor":{"display_login":"rajeshkumargp"}}