{"action":"created","issue":{"url":"https://api.github.com/repos/inspirehep/inspire-next/issues/987","repository_url":"https://api.github.com/repos/inspirehep/inspire-next","labels_url":"https://api.github.com/repos/inspirehep/inspire-next/issues/987/labels{/name}","comments_url":"https://api.github.com/repos/inspirehep/inspire-next/issues/987/comments","events_url":"https://api.github.com/repos/inspirehep/inspire-next/issues/987/events","html_url":"https://github.com/inspirehep/inspire-next/issues/987","id":139880129,"number":987,"title":"Conversion errors in Record migration","user":{"login":"jalavik","id":633680,"avatar_url":"https://avatars.githubusercontent.com/u/633680?v=3","gravatar_id":"","url":"https://api.github.com/users/jalavik","html_url":"https://github.com/jalavik","followers_url":"https://api.github.com/users/jalavik/followers","following_url":"https://api.github.com/users/jalavik/following{/other_user}","gists_url":"https://api.github.com/users/jalavik/gists{/gist_id}","starred_url":"https://api.github.com/users/jalavik/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jalavik/subscriptions","organizations_url":"https://api.github.com/users/jalavik/orgs","repos_url":"https://api.github.com/users/jalavik/repos","events_url":"https://api.github.com/users/jalavik/events{/privacy}","received_events_url":"https://api.github.com/users/jalavik/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":{"login":"tomaszgy","id":10139760,"avatar_url":"https://avatars.githubusercontent.com/u/10139760?v=3","gravatar_id":"","url":"https://api.github.com/users/tomaszgy","html_url":"https://github.com/tomaszgy","followers_url":"https://api.github.com/users/tomaszgy/followers","following_url":"https://api.github.com/users/tomaszgy/following{/other_user}","gists_url":"https://api.github.com/users/tomaszgy/gists{/gist_id}","starred_url":"https://api.github.com/users/tomaszgy/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tomaszgy/subscriptions","organizations_url":"https://api.github.com/users/tomaszgy/orgs","repos_url":"https://api.github.com/users/tomaszgy/repos","events_url":"https://api.github.com/users/tomaszgy/events{/privacy}","received_events_url":"https://api.github.com/users/tomaszgy/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/inspirehep/inspire-next/milestones/14","html_url":"https://github.com/inspirehep/inspire-next/milestones/Information%20architecture%20-%20third%20iteration","labels_url":"https://api.github.com/repos/inspirehep/inspire-next/milestones/14/labels","id":1455754,"number":14,"title":"Information architecture - third iteration","description":"","creator":{"login":"jmartinm","id":580727,"avatar_url":"https://avatars.githubusercontent.com/u/580727?v=3","gravatar_id":"","url":"https://api.github.com/users/jmartinm","html_url":"https://github.com/jmartinm","followers_url":"https://api.github.com/users/jmartinm/followers","following_url":"https://api.github.com/users/jmartinm/following{/other_user}","gists_url":"https://api.github.com/users/jmartinm/gists{/gist_id}","starred_url":"https://api.github.com/users/jmartinm/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jmartinm/subscriptions","organizations_url":"https://api.github.com/users/jmartinm/orgs","repos_url":"https://api.github.com/users/jmartinm/repos","events_url":"https://api.github.com/users/jmartinm/events{/privacy}","received_events_url":"https://api.github.com/users/jmartinm/received_events","type":"User","site_admin":false},"open_issues":25,"closed_issues":26,"state":"open","created_at":"2015-12-11T10:33:17Z","updated_at":"2016-06-15T16:07:53Z","due_on":"2016-05-30T22:00:00Z","closed_at":null},"comments":1,"created_at":"2016-03-10T13:05:12Z","updated_at":"2016-06-15T16:07:53Z","closed_at":"2016-06-15T16:07:53Z","body":"**NOTE that some codepaths will be different on Invenio 3 version of INSPIRE.**\r\n\r\nDoing a full load of INSPIRE into QA revealed still a few record errors:\r\n\r\n```\r\nTraceback (most recent call last):\r\n File \"/opt/inspire/src/inspire/inspirehep/modules/migrator/tasks.py\", line 245, in migrate_chunk\r\n dry_run=dry_run, validation=True\r\n File \"/opt/inspire/src/inspire/inspirehep/modules/migrator/tasks.py\", line 398, in create_record\r\n json = strip_empty_values(hep.do(record))\r\n File \"/opt/inspire/src/inspire/inspirehep/dojson/hep/model.py\", line 51, in do\r\n add_book_info(output, blob)\r\n File \"/opt/inspire/src/inspire/inspirehep/dojson/hep/model.py\", line 37, in add_book_info\r\n collections.append(c.get('primary').lower())\r\nAttributeError: 'tuple' object has no attribute 'lower'\r\n\r\nERROR with record 775757 and json None\r\n```\r\n\r\n```\r\n[2016-03-10 02:33:54,869: ERROR/Worker-11] inspirehep.modules.migrator.tasks.migrate_chunk[e9d44d89-67fe-4760-afc9-ac2a8b91b929]: ERROR with record 887476 and json {'oai_pmh': [{'set': (u'INSPIRE:HEP', u'CDS'), 'id': u'oai:inspirehep.net:887476'}], 'date_and_time_of_latest_transaction': u'20140307211849.0', 'report_numbers': [{'value': u'BONN-IB-96-34'}], '_collections': [u'HEP'], 'control_number': u'887476', 'subject_terms': [{'term': u'Instrumentation', 'scheme': u'INSPIRE'}], 'external_system_numbers': [{'institute': u'INSPIRETeX', 'obsolete': False, 'value': u'Voss:1975sva'}, {'institute': u'CDS', 'obsolete': False, 'value': u'553209'}], 'title_translation': [{'title': u'Proof of electrons in a magnetic spectrometer'}], 'languages': [u'German'], 'authors': [{'profile': {'__url__': u'http://inspirehep.net/record/984423'}, 'uuid': '76d4f827-8181-4858-99d8-7d31b440c1f1', 'curated_relation': False, 'affiliations': [{'value': u'Munich U.'}], 'recid': 984423, 'full_name': u'Voss, R\\xfcdiger', 'signature_block': u'Vr'}], 'titles': [{'title': u'Nachweis von Elektronen in einem Magnetspektrometer'}], 'collections': [{'primary': u'Thesis'}, {'primary': u'CORE'}, {'primary': u'HEP'}], 'creation_modification_date': [{'modification_date': u'2011-02-08', 'creation_date': u'2014-03-07'}], 'thesis': [{'date': u'1975', 'curated_relation': False, 'university': u'Munich U.', 'degree_type': u'Master'}], 'accelerator_experiments': [{'curated_relation': False, 'experiment': (u'AMS', u'PAMELA', u'ISOMAX')}], 'breadcrumb_title': u'Nachweis von Elektronen in einem Magnetspektrometer', 'dois': [], 'facet_inspire_subjects': [u'Instrumentation'], 'earliest_date': '1975'}\r\n\r\n\r\n[2016-03-10 02:33:55,027: ERROR/Worker-11] inspirehep.modules.migrator.tasks.migrate_chunk[e9d44d89-67fe-4760-afc9-ac2a8b91b929]: 'tuple' object has no attribute 'lower'\r\nTraceback (most recent call last):\r\n File \"/opt/inspire/src/inspire/inspirehep/modules/migrator/tasks.py\", line 253, in migrate_chunk\r\n before_record_index.send(recid, json=json, index=index)\r\n File \"/opt/inspire/lib/python2.7/site-packages/blinker/base.py\", line 267, in send\r\n for receiver in self.receivers_for(sender)]\r\n File \"/opt/inspire/src/inspire/inspirehep/modules/records/receivers.py\", line 136, in match_valid_experiments\r\n experiment = experiment.lower()\r\nAttributeError: 'tuple' object has no attribute 'lower'\r\n```\r\n\r\n```\r\n[2016-03-10 02:48:52,239: ERROR/Worker-10] inspirehep.modules.migrator.tasks.migrate_chunk[c6b11eee-1f07-4758-83da-018f12aa2a34]: 'NoneType' object is not iterable\r\nTraceback (most recent call last):\r\n File \"/opt/inspire/src/inspire/inspirehep/modules/migrator/tasks.py\", line 245, in migrate_chunk\r\n dry_run=dry_run, validation=True\r\n File \"/opt/inspire/src/inspire/inspirehep/modules/migrator/tasks.py\", line 385, in create_record\r\n json = strip_empty_values(institutions.do(record))\r\n File \"/opt/inspire/src/inspire/inspirehep/dojson/schema.py\", line 32, in do\r\n output = super(SchemaOverdo, self).do(blob, **kwargs)\r\n File \"/opt/inspire/lib/python2.7/site-packages/dojson/overdo.py\", line 125, in do\r\n data = creator(output, key, value)\r\n File \"/opt/inspire/lib/python2.7/site-packages/dojson/utils.py\", line 55, in wrapper\r\n return [f(self, key, values, **kwargs)]\r\n File \"/opt/inspire/src/inspire/inspirehep/dojson/institutions/fields/bd1xx.py\", line 77, in name\r\n names = list(utils.force_list(value.get('a'))) or []\r\nTypeError: 'NoneType' object is not iterable\r\n\r\nERROR with record 902715 and json None\r\n```\r\n\r\nMore incoming.."},"comment":{"url":"https://api.github.com/repos/inspirehep/inspire-next/issues/comments/226236710","html_url":"https://github.com/inspirehep/inspire-next/issues/987#issuecomment-226236710","issue_url":"https://api.github.com/repos/inspirehep/inspire-next/issues/987","id":226236710,"user":{"login":"jalavik","id":633680,"avatar_url":"https://avatars.githubusercontent.com/u/633680?v=3","gravatar_id":"","url":"https://api.github.com/users/jalavik","html_url":"https://github.com/jalavik","followers_url":"https://api.github.com/users/jalavik/followers","following_url":"https://api.github.com/users/jalavik/following{/other_user}","gists_url":"https://api.github.com/users/jalavik/gists{/gist_id}","starred_url":"https://api.github.com/users/jalavik/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jalavik/subscriptions","organizations_url":"https://api.github.com/users/jalavik/orgs","repos_url":"https://api.github.com/users/jalavik/repos","events_url":"https://api.github.com/users/jalavik/events{/privacy}","received_events_url":"https://api.github.com/users/jalavik/received_events","type":"User","site_admin":false},"created_at":"2016-06-15T16:07:53Z","updated_at":"2016-06-15T16:07:53Z","body":"Outdated"}}
{"actor":{"display_login":"jalavik"}}