{"action":"created","issue":{"url":"https://api.github.com/repos/laurenz/oracle_fdw/issues/235","repository_url":"https://api.github.com/repos/laurenz/oracle_fdw","labels_url":"https://api.github.com/repos/laurenz/oracle_fdw/issues/235/labels{/name}","comments_url":"https://api.github.com/repos/laurenz/oracle_fdw/issues/235/comments","events_url":"https://api.github.com/repos/laurenz/oracle_fdw/issues/235/events","html_url":"https://github.com/laurenz/oracle_fdw/issues/235","id":294921228,"number":235,"title":"oracle_fdw \"Dropping\" Rows","user":{"login":"bsislow","id":30243584,"avatar_url":"https://avatars0.githubusercontent.com/u/30243584?v=4","gravatar_id":"","url":"https://api.github.com/users/bsislow","html_url":"https://github.com/bsislow","followers_url":"https://api.github.com/users/bsislow/followers","following_url":"https://api.github.com/users/bsislow/following{/other_user}","gists_url":"https://api.github.com/users/bsislow/gists{/gist_id}","starred_url":"https://api.github.com/users/bsislow/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bsislow/subscriptions","organizations_url":"https://api.github.com/users/bsislow/orgs","repos_url":"https://api.github.com/users/bsislow/repos","events_url":"https://api.github.com/users/bsislow/events{/privacy}","received_events_url":"https://api.github.com/users/bsislow/received_events","type":"User","site_admin":false},"labels":[{"id":189750464,"url":"https://api.github.com/repos/laurenz/oracle_fdw/labels/problem","name":"problem","color":"fbca04","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":8,"created_at":"2018-02-06T21:36:36Z","updated_at":"2018-02-10T16:24:03Z","closed_at":null,"author_association":"NONE","body":"All of a sudden - a few days ago - oracle_fdw started \"dropping\" rows - meaning rows being INSERTed into Oracle were missing from the Oracle side.\r\n\r\nThis process we've been using has been working for several months.\r\n\r\nNo application changes or data changes have occurred as far as we know.\r\n\r\nWe are executing an INSERT over FT every minute such as:\r\n\r\nINSERT INTO FT WHERE ID > X and ID <= Y\r\n\r\nIf 100 rows exist on the source PG database, sometimes a few get dropped on the Oracle side and we might end up with 97 for the same ID range in Oracle - for example.\r\n\r\nThere are no jobs on the Oracle side that remove rows - unless they are over a day old. This would not affect any current runs where the rows are missing.\r\n\r\nCan we turn some kind of debugging on with oracle_fdw to see what is going on?\r\n\r\nWhat else do you need to know from us?"},"comment":{"url":"https://api.github.com/repos/laurenz/oracle_fdw/issues/comments/364667779","html_url":"https://github.com/laurenz/oracle_fdw/issues/235#issuecomment-364667779","issue_url":"https://api.github.com/repos/laurenz/oracle_fdw/issues/235","id":364667779,"user":{"login":"laurenz","id":220612,"avatar_url":"https://avatars3.githubusercontent.com/u/220612?v=4","gravatar_id":"","url":"https://api.github.com/users/laurenz","html_url":"https://github.com/laurenz","followers_url":"https://api.github.com/users/laurenz/followers","following_url":"https://api.github.com/users/laurenz/following{/other_user}","gists_url":"https://api.github.com/users/laurenz/gists{/gist_id}","starred_url":"https://api.github.com/users/laurenz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/laurenz/subscriptions","organizations_url":"https://api.github.com/users/laurenz/orgs","repos_url":"https://api.github.com/users/laurenz/repos","events_url":"https://api.github.com/users/laurenz/events{/privacy}","received_events_url":"https://api.github.com/users/laurenz/received_events","type":"User","site_admin":false},"created_at":"2018-02-10T16:24:03Z","updated_at":"2018-02-10T16:24:03Z","author_association":"OWNER","body":"Thanks for the explanation, it is much clearer now. I was asking for details, because a mistake in the procedure might be the cause of the problem.\r\n\r\nCan you tell me how transactions are handled? Do you call `BEGIN` and `COMMIT` explicitly (when?), or does the `INSERT ... SELECT ...` run in its own transaction?\r\n\r\nYou should be looking for rollbacks and errors in your log.\r\n\r\nAnother idea I have it to add a trigger `AFTER INSERT` on the foreign table that logs which rows were inserted in Oracle. Then you can compare the values in the logging table and the values in Oracle; that might give you a clue."}}
{"actor":{"display_login":"laurenz"}}