{"action":"created","issue":{"url":"https://api.github.com/repos/tensorflow/models/issues/3213","repository_url":"https://api.github.com/repos/tensorflow/models","labels_url":"https://api.github.com/repos/tensorflow/models/issues/3213/labels{/name}","comments_url":"https://api.github.com/repos/tensorflow/models/issues/3213/comments","events_url":"https://api.github.com/repos/tensorflow/models/issues/3213/events","html_url":"https://github.com/tensorflow/models/issues/3213","id":290404815,"node_id":"MDU6SXNzdWUyOTA0MDQ4MTU=","number":3213,"title":"attention ocr could not converge on custom data","user":{"login":"chengmengli06","id":31561586,"node_id":"MDQ6VXNlcjMxNTYxNTg2","avatar_url":"https://avatars2.githubusercontent.com/u/31561586?v=4","gravatar_id":"","url":"https://api.github.com/users/chengmengli06","html_url":"https://github.com/chengmengli06","followers_url":"https://api.github.com/users/chengmengli06/followers","following_url":"https://api.github.com/users/chengmengli06/following{/other_user}","gists_url":"https://api.github.com/users/chengmengli06/gists{/gist_id}","starred_url":"https://api.github.com/users/chengmengli06/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/chengmengli06/subscriptions","organizations_url":"https://api.github.com/users/chengmengli06/orgs","repos_url":"https://api.github.com/users/chengmengli06/repos","events_url":"https://api.github.com/users/chengmengli06/events{/privacy}","received_events_url":"https://api.github.com/users/chengmengli06/received_events","type":"User","site_admin":false},"labels":[{"id":387356495,"node_id":"MDU6TGFiZWwzODczNTY0OTU=","url":"https://api.github.com/repos/tensorflow/models/labels/stat:awaiting%20response","name":"stat:awaiting response","color":"5319e7","default":false},{"id":473246506,"node_id":"MDU6TGFiZWw0NzMyNDY1MDY=","url":"https://api.github.com/repos/tensorflow/models/labels/type:support","name":"type:support","color":"f9d0c4","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":9,"created_at":"2018-01-22T09:49:42Z","updated_at":"2018-10-09T08:58:06Z","closed_at":null,"author_association":"NONE","body":"### Describe the problem\r\nattention ocr could not converge, it is a bad project, the loss gradually increases. The dataset \r\nis double checked, with 8202 classes. \r\n\r\n### Source code / logs\r\n2018-01-22 17:41:30.359779: I tensorflow/core/kernels/logging_ops.cc:79] lbls[5021][2178][2010][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][*][127][657][6862][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][*]\r\n2018-01-22 17:41:30.460314: I tensorflow/core/kernels/logging_ops.cc:79] lbls[209][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][*][7355][3947][4114][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][*]\r\n2018-01-22 17:41:31.147930: I tensorflow/core/kernels/logging_ops.cc:79] Mixed_5d shape[8][5][72][288]\r\n2018-01-22 17:41:31.148958: I tensorflow/core/kernels/logging_ops.cc:79] Mixed_5d shape[8][5][72][288]\r\n2018-01-22 17:41:31.149403: I tensorflow/core/kernels/logging_ops.cc:79] pool views fn concat shape[8 5 72...][8 5 72...]\r\n2018-01-22 17:41:31.149848: I tensorflow/core/kernels/logging_ops.cc:79] pool views fn concat shape[8 5 72...][8 5 72...]\r\n2018-01-22 17:41:31.150309: I tensorflow/core/kernels/logging_ops.cc:79] pool views fn out shape[8 72 1440]\r\n2018-01-22 17:41:31.150345: I tensorflow/core/kernels/logging_ops.cc:79] pooled view shape[8 72 1440][8 5 72...]\r\n2018-01-22 17:41:31.150855: I tensorflow/core/kernels/logging_ops.cc:79] pool views fn out shape[8 72 1440]\r\n2018-01-22 17:41:31.150888: I tensorflow/core/kernels/logging_ops.cc:79] pooled view shape[8 72 1440][8 5 72...]\r\n2018-01-22 17:41:31.219392: I tensorflow/core/kernels/logging_ops.cc:79] logits shape[8 16 7917]\r\n2018-01-22 17:41:31.219826: I tensorflow/core/kernels/logging_ops.cc:79] logits shape[8 16 7917]\r\n2018-01-22 17:41:31.221575: I tensorflow/core/kernels/logging_ops.cc:79] chars_logit[5554][5554][5554][5554][5554][5554][5554][5554][5554][5554][5554][5554][5554][5554][5554][5554][*][5554][5554][5554][5554][5554][5554][5554][5554][5554][5554][5554][5554][5554][5554][5554][5554][*][5554 5554 5554...][16][16][8 16]\r\n2018-01-22 17:41:31.222405: I tensorflow/core/kernels/logging_ops.cc:79] chars_logit[7382][7382][5554][5554][5554][1736][1736][1736][1736][1736][1736][1736][1736][1736][1736][1736][*][5554][5554][5554][5554][5554][5554][5554][5554][5554][5554][5554][5554][5554][5554][5554][5554][*][5554 5554 5554...][16][16][8 16]\r\n2018-01-22 17:41:31.231981: I tensorflow/core/kernels/logging_ops.cc:79] sequence loss[31.543655]\r\n2018-01-22 17:41:31.232015: I tensorflow/core/kernels/logging_ops.cc:79] sequence loss[34.622742]\r\nINFO:tensorflow:global step 1: loss = 34.7808 (4.958 sec/step)\r\nINFO 2018-01-22 17:41:31.000788: tf_logging.py: 82 global step 1: loss = 34.7808 (4.958 sec/step)\r\n2018-01-22 17:41:31.844581: I tensorflow/core/kernels/logging_ops.cc:79] lbls[5][2038][4389][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][*][6802][2178][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][*]\r\n2018-01-22 17:41:31.858722: I tensorflow/core/kernels/logging_ops.cc:79] Mixed_5d shape[8][5][72][288]\r\n2018-01-22 17:41:31.860548: I tensorflow/core/kernels/logging_ops.cc:79] pool views fn concat shape[8 5 72...][8 5 72...]\r\n2018-01-22 17:41:31.861751: I tensorflow/core/kernels/logging_ops.cc:79] pool views fn out shape[8 72 1440]\r\n2018-01-22 17:41:31.861780: I tensorflow/core/kernels/logging_ops.cc:79] pooled view shape[8 72 1440][8 5 72...]\r\n2018-01-22 17:41:31.896185: I tensorflow/core/kernels/logging_ops.cc:79] logits shape[8 16 7917]\r\n2018-01-22 17:41:31.897872: I tensorflow/core/kernels/logging_ops.cc:79] chars_logit[4200][4200][4200][4200][4200][4200][4200][4200][4200][4200][4200][4200][4200][4200][4200][4200][*][5554][1736][1736][1736][1736][1736][1736][1736][1736][1736][1736][1736][1736][1736][1736][1736][*][5554 1736 1736...][16][16][8 16]\r\n2018-01-22 17:41:31.902992: I tensorflow/core/kernels/logging_ops.cc:79] sequence loss[29.514463]\r\nINFO:tensorflow:global step 2: loss = 29.6725 (0.226 sec/step)\r\nINFO 2018-01-22 17:41:32.000061: tf_logging.py: 82 global step 2: loss = 29.6725 (0.226 sec/step)\r\n2018-01-22 17:41:32.077037: I tensorflow/core/kernels/logging_ops.cc:79] lbls[2864][2648][5646][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][*][6376][2121][1203][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][*]\r\n2018-01-22 17:41:32.089354: I tensorflow/core/kernels/logging_ops.cc:79] Mixed_5d shape[8][5][72][288]\r\n2018-01-22 17:41:32.090356: I tensorflow/core/kernels/logging_ops.cc:79] pool views fn concat shape[8 5 72...][8 5 72...]\r\n2018-01-22 17:41:32.091563: I tensorflow/core/kernels/logging_ops.cc:79] pool views fn out shape[8 72 1440]\r\n2018-01-22 17:41:32.091597: I tensorflow/core/kernels/logging_ops.cc:79] pooled view shape[8 72 1440][8 5 72...]\r\n2018-01-22 17:41:32.127391: I tensorflow/core/kernels/logging_ops.cc:79] logits shape[8 16 7917]\r\n2018-01-22 17:41:32.129693: I tensorflow/core/kernels/logging_ops.cc:79] chars_logit[5238][5238][5238][5238][5238][5238][5238][5238][5238][5238][5238][5238][5238][5238][5238][5238][*][1736][5238][5238][5238][5238][5238][5238][5238][5238][5238][5238][5238][5238][5238][5238][5238][*][1736 5238 5238...][16][16][8 16]\r\n2018-01-22 17:41:32.135553: I tensorflow/core/kernels/logging_ops.cc:79] sequence loss[36.587006]\r\nINFO:tensorflow:global step 3: loss = 36.7450 (0.164 sec/step)\r\nINFO 2018-01-22 17:41:32.000228: tf_logging.py: 82 global step 3: loss = 36.7450 (0.164 sec/step)\r\n2018-01-22 17:41:32.244753: I tensorflow/core/kernels/logging_ops.cc:79] lbls[2430][2331][2602][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][*][3750][6375][7678][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][*]\r\n2018-01-22 17:41:32.256183: I tensorflow/core/kernels/logging_ops.cc:79] Mixed_5d shape[8][5][72][288]\r\n2018-01-22 17:41:32.257116: I tensorflow/core/kernels/logging_ops.cc:79] pool views fn concat shape[8 5 72...][8 5 72...]\r\n2018-01-22 17:41:32.258149: I tensorflow/core/kernels/logging_ops.cc:79] pool views fn out shape[8 72 1440]\r\n2018-01-22 17:41:32.258288: I tensorflow/core/kernels/logging_ops.cc:79] pooled view shape[8 72 1440][8 5 72...]\r\n2018-01-22 17:41:32.294241: I tensorflow/core/kernels/logging_ops.cc:79] logits shape[8 16 7917]\r\n2018-01-22 17:41:32.296386: I tensorflow/core/kernels/logging_ops.cc:79] chars_logit[4200][2443][2443][2443][2443][2443][2443][2443][2443][2443][2443][2443][2443][2443][2443][2443][*][7287][4200][4200][4200][4200][2443][2443][2443][2443][2443][2443][2443][2443][2443][2443][2443][*][7287 4200 4200...][16][16][8 16]\r\n2018-01-22 17:41:32.301545: I tensorflow/core/kernels/logging_ops.cc:79] sequence loss[32.544807]\r\nINFO:tensorflow:global step 4: loss = 32.7028 (0.171 sec/step)\r\nINFO 2018-01-22 17:41:32.000402: tf_logging.py: 82 global step 4: loss = 32.7028 (0.171 sec/step)\r\n2018-01-22 17:41:32.415413: I tensorflow/core/kernels/logging_ops.cc:79] lbls[5608][6993][5888][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][*][2509][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][*]\r\n2018-01-22 17:41:32.427194: I tensorflow/core/kernels/logging_ops.cc:79] Mixed_5d shape[8][5][72][288]\r\n2018-01-22 17:41:32.428143: I tensorflow/core/kernels/logging_ops.cc:79] pool views fn concat shape[8 5 72...][8 5 72...]\r\n2018-01-22 17:41:32.429181: I tensorflow/core/kernels/logging_ops.cc:79] pool views fn out shape[8 72 1440]\r\n2018-01-22 17:41:32.429210: I tensorflow/core/kernels/logging_ops.cc:79] pooled view shape[8 72 1440][8 5 72...]\r\n2018-01-22 17:41:32.465629: I tensorflow/core/kernels/logging_ops.cc:79] logits shape[8 16 7917]\r\n2018-01-22 17:41:32.468201: I tensorflow/core/kernels/logging_ops.cc:79] chars_logit[5238][2443][2443][2443][2443][2443][2443][2443][2443][2443][2443][2443][2443][2443][2443][2443][*][5238][2443][2443][2443][2443][2443][2443][2443][2443][2443][2443][2443][2443][2443][2443][2443][*][5238 2443 2443...][16][16][8 16]\r\n2018-01-22 17:41:32.473847: I tensorflow/core/kernels/logging_ops.cc:79] sequence loss[33.510151]\r\nINFO:tensorflow:global step 5: loss = 33.6682 (0.165 sec/step)\r\nINFO 2018-01-22 17:41:32.000570: tf_logging.py: 82 global step 5: loss = 33.6682 (0.165 sec/step)\r\n....\r\nINFO 2018-01-22 17:45:08.000270: tf_logging.py: 82 global step 1292: loss = 181.0154 (0.156 sec/step)\r\n2018-01-22 17:45:08.281153: I tensorflow/core/kernels/logging_ops.cc:79] lbls[1928][2675][6477][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][*][4963][269][6482][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][*]\r\n2018-01-22 17:45:08.293001: I tensorflow/core/kernels/logging_ops.cc:79] Mixed_5d shape[8][5][72][288]\r\n2018-01-22 17:45:08.294005: I tensorflow/core/kernels/logging_ops.cc:79] pool views fn concat shape[8 5 72...][8 5 72...]\r\n2018-01-22 17:45:08.295178: I tensorflow/core/kernels/logging_ops.cc:79] pool views fn out shape[8 72 1440]\r\n2018-01-22 17:45:08.295209: I tensorflow/core/kernels/logging_ops.cc:79] pooled view shape[8 72 1440][8 5 72...]\r\n2018-01-22 17:45:08.331004: I tensorflow/core/kernels/logging_ops.cc:79] logits shape[8 16 7917]\r\n2018-01-22 17:45:08.332727: I tensorflow/core/kernels/logging_ops.cc:79] chars_logit[2633][2633][2633][2633][2633][2633][2633][2633][2633][2633][2633][2633][2633][2633][2633][2633][*][2633][2633][2633][2633][2633][2633][2633][2633][2633][2633][2633][2633][2633][2633][2633][2633][*][2633 2633 2633...][16][16][8 16]\r\n2018-01-22 17:45:08.337821: I tensorflow/core/kernels/logging_ops.cc:79] sequence loss[255.01726]\r\nINFO:tensorflow:global step 1293: loss = 255.2530 (0.158 sec/step)\r\nINFO 2018-01-22 17:45:08.000429: tf_logging.py: 82 global step 1293: loss = 255.2530 (0.158 sec/step)\r\n2018-01-22 17:45:08.441829: I tensorflow/core/kernels/logging_ops.cc:79] lbls[2921][540][6477][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][*][1923][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][8202][*]\r\n2018-01-22 17:45:08.451025: I tensorflow/core/kernels/logging_ops.cc:79] Mixed_5d shape[8][5][72][288]\r\n2018-01-22 17:45:08.451860: I tensorflow/core/kernels/logging_ops.cc:79] pool views fn concat shape[8 5 72...][8 5 72...]\r\n2018-01-22 17:45:08.452752: I tensorflow/core/kernels/logging_ops.cc:79] pool views fn out shape[8 72 1440]\r\n2018-01-22 17:45:08.452780: I tensorflow/core/kernels/logging_ops.cc:79] pooled view shape[8 72 1440][8 5 72...]\r\n2018-01-22 17:45:08.489094: I tensorflow/core/kernels/logging_ops.cc:79] logits shape[8 16 7917]\r\n2018-01-22 17:45:08.490680: I tensorflow/core/kernels/logging_ops.cc:79] chars_logit[2105][2105][2105][2105][2105][2105][2105][2105][2105][2105][2105][2105][2105][2105][2105][2105][*][2105][5888][5888][5888][5888][5888][5888][5888][5888][5888][5888][5888][5888][5888][5888][5888][*][2105 5888 5888...][16][16][8 16]\r\n2018-01-22 17:45:08.495944: I tensorflow/core/kernels/logging_ops.cc:79] sequence loss[210.91998]\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/tensorflow/models/issues/comments/428115236","html_url":"https://github.com/tensorflow/models/issues/3213#issuecomment-428115236","issue_url":"https://api.github.com/repos/tensorflow/models/issues/3213","id":428115236,"node_id":"MDEyOklzc3VlQ29tbWVudDQyODExNTIzNg==","user":{"login":"gagan144","id":20434254,"node_id":"MDQ6VXNlcjIwNDM0MjU0","avatar_url":"https://avatars0.githubusercontent.com/u/20434254?v=4","gravatar_id":"","url":"https://api.github.com/users/gagan144","html_url":"https://github.com/gagan144","followers_url":"https://api.github.com/users/gagan144/followers","following_url":"https://api.github.com/users/gagan144/following{/other_user}","gists_url":"https://api.github.com/users/gagan144/gists{/gist_id}","starred_url":"https://api.github.com/users/gagan144/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/gagan144/subscriptions","organizations_url":"https://api.github.com/users/gagan144/orgs","repos_url":"https://api.github.com/users/gagan144/repos","events_url":"https://api.github.com/users/gagan144/events{/privacy}","received_events_url":"https://api.github.com/users/gagan144/received_events","type":"User","site_admin":false},"created_at":"2018-10-09T08:58:06Z","updated_at":"2018-10-09T08:58:06Z","author_association":"NONE","body":"@morningdip Thanks for a wonderful solution. Can you please tell what are the considerations for creating charset file? I used ASCII codes to map letter. Is this correct? What is the correct way to assign id to <nul>? I used 9999 and cant get it working.\r\nAlso, can you share how to create charset file using python? I am using following code but it seems there is something wrong with the encoding; unable to create UTF-8 without BOM:\r\n\r\nwith open(\"charset.txt\", 'w', encoding=\"utf-8\") as f:\r\n    f.write(\"\\n\".join(content_lines))\r\n\r\n"}}
{"actor":{"display_login":"gagan144"}}