{"action":"created","issue":{"url":"https://api.github.com/repos/noplay/python-mysql-replication/issues/277","repository_url":"https://api.github.com/repos/noplay/python-mysql-replication","labels_url":"https://api.github.com/repos/noplay/python-mysql-replication/issues/277/labels{/name}","comments_url":"https://api.github.com/repos/noplay/python-mysql-replication/issues/277/comments","events_url":"https://api.github.com/repos/noplay/python-mysql-replication/issues/277/events","html_url":"https://github.com/noplay/python-mysql-replication/issues/277","id":357197573,"node_id":"MDU6SXNzdWUzNTcxOTc1NzM=","number":277,"title":"Json length is larger than packet length","user":{"login":"rahilsh","id":22071745,"node_id":"MDQ6VXNlcjIyMDcxNzQ1","avatar_url":"https://avatars1.githubusercontent.com/u/22071745?v=4","gravatar_id":"","url":"https://api.github.com/users/rahilsh","html_url":"https://github.com/rahilsh","followers_url":"https://api.github.com/users/rahilsh/followers","following_url":"https://api.github.com/users/rahilsh/following{/other_user}","gists_url":"https://api.github.com/users/rahilsh/gists{/gist_id}","starred_url":"https://api.github.com/users/rahilsh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rahilsh/subscriptions","organizations_url":"https://api.github.com/users/rahilsh/orgs","repos_url":"https://api.github.com/users/rahilsh/repos","events_url":"https://api.github.com/users/rahilsh/events{/privacy}","received_events_url":"https://api.github.com/users/rahilsh/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2018-09-05T12:05:26Z","updated_at":"2018-09-06T20:13:31Z","closed_at":null,"author_association":"NONE","body":"We are using pg_chameleon for replicating data from MySQL to PostgreSQL and pg_chameleon is using python-MySQL-replication internally. We are getting below error during replication. Is there any way to resolve it \r\n\r\n```\r\n2018-09-04 13:13:49 MainProcess INFO: Starting the replica daemons for source mysql \r\n2018-09-04 18:32:21 MainProcess ERROR: Read process alive: False - Replay process alive: True\r\n2018-09-04 18:32:21 MainProcess ERROR: Stack trace: Traceback (most recent call last):\r\n  File \"/var/log/bucardo/venv/lib64/python3.6/site-packages/pg_chameleon/lib/global_lib.py\", line 487, in read_replica\r\n    self.mysql_source.read_replica()\r\n  File \"/var/log/bucardo/venv/lib64/python3.6/site-packages/pg_chameleon/lib/mysql_lib.py\", line 1336, in read_replica\r\n    replica_data=self.__read_replica_stream(batch_data)\r\n  File \"/var/log/bucardo/venv/lib64/python3.6/site-packages/pg_chameleon/lib/mysql_lib.py\", line 1199, in __read_replica_stream\r\n    for row in binlogevent.rows:\r\n  File \"/var/log/bucardo/venv/lib64/python3.6/site-packages/pymysqlreplication/row_event.py\", line 429, in rows\r\n    self._fetch_rows()\r\n  File \"/var/log/bucardo/venv/lib64/python3.6/site-packages/pymysqlreplication/row_event.py\", line 424, in _fetch_rows\r\n    self.__rows.append(self._fetch_one_row())\r\n  File \"/var/log/bucardo/venv/lib64/python3.6/site-packages/pymysqlreplication/row_event.py\", line 513, in _fetch_one_row\r\n    row[\"before_values\"] = self._read_column_data(self.columns_present_bitmap)\r\n  File \"/var/log/bucardo/venv/lib64/python3.6/site-packages/pymysqlreplication/row_event.py\", line 181, in _read_column_data\r\n    values[name] = self.packet.read_binary_json(column.length_size)\r\n  File \"/var/log/bucardo/venv/lib64/python3.6/site-packages/pymysqlreplication/packet.py\", line 352, in read_binary_json\r\n    return self.read_binary_json_type(t, length)\r\n  File \"/var/log/bucardo/venv/lib64/python3.6/site-packages/pymysqlreplication/packet.py\", line 357, in read_binary_json_type\r\n    return self.read_binary_json_object(length - 1, large)\r\n  File \"/var/log/bucardo/venv/lib64/python3.6/site-packages/pymysqlreplication/packet.py\", line 416, in read_binary_json_object\r\n    raise ValueError('Json length is larger than packet length')\r\nValueError: Json length is larger than packet length\r\n\r\n2018-09-04 18:32:21 MainProcess ERROR: Read daemon crashed. Terminating the replay daemon.\r\n2018-09-04 18:32:21 MainProcess INFO: Replica process for source MySQL ended\r\n```"},"comment":{"url":"https://api.github.com/repos/noplay/python-mysql-replication/issues/comments/419225873","html_url":"https://github.com/noplay/python-mysql-replication/issues/277#issuecomment-419225873","issue_url":"https://api.github.com/repos/noplay/python-mysql-replication/issues/277","id":419225873,"node_id":"MDEyOklzc3VlQ29tbWVudDQxOTIyNTg3Mw==","user":{"login":"the4thdoctor","id":3079622,"node_id":"MDQ6VXNlcjMwNzk2MjI=","avatar_url":"https://avatars1.githubusercontent.com/u/3079622?v=4","gravatar_id":"","url":"https://api.github.com/users/the4thdoctor","html_url":"https://github.com/the4thdoctor","followers_url":"https://api.github.com/users/the4thdoctor/followers","following_url":"https://api.github.com/users/the4thdoctor/following{/other_user}","gists_url":"https://api.github.com/users/the4thdoctor/gists{/gist_id}","starred_url":"https://api.github.com/users/the4thdoctor/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/the4thdoctor/subscriptions","organizations_url":"https://api.github.com/users/the4thdoctor/orgs","repos_url":"https://api.github.com/users/the4thdoctor/repos","events_url":"https://api.github.com/users/the4thdoctor/events{/privacy}","received_events_url":"https://api.github.com/users/the4thdoctor/received_events","type":"User","site_admin":false},"created_at":"2018-09-06T20:13:31Z","updated_at":"2018-09-06T20:13:31Z","author_association":"NONE","body":"I'm trying to reproduce the issue on pg_chameleon, however the replica works fine when I run \r\n` insert into test_json (field_json) values (cast('null' AS JSON));`\r\n\r\nmy configuration is mysql 5.7.23 on freebsd 11.2, python 3.6.\r\n\r\ncould it be a not conventional packet coming out from RDS?"}}
{"actor":{"display_login":"the4thdoctor"}}