{"action":"created","issue":{"url":"https://api.github.com/repos/EC-Earth/ece2cmor3/issues/174","repository_url":"https://api.github.com/repos/EC-Earth/ece2cmor3","labels_url":"https://api.github.com/repos/EC-Earth/ece2cmor3/issues/174/labels{/name}","comments_url":"https://api.github.com/repos/EC-Earth/ece2cmor3/issues/174/comments","events_url":"https://api.github.com/repos/EC-Earth/ece2cmor3/issues/174/events","html_url":"https://github.com/EC-Earth/ece2cmor3/issues/174","id":324388466,"number":174,"title":"Processing NEMO output fails","user":{"login":"klauswyser","id":26412703,"avatar_url":"https://avatars2.githubusercontent.com/u/26412703?v=4","gravatar_id":"","url":"https://api.github.com/users/klauswyser","html_url":"https://github.com/klauswyser","followers_url":"https://api.github.com/users/klauswyser/followers","following_url":"https://api.github.com/users/klauswyser/following{/other_user}","gists_url":"https://api.github.com/users/klauswyser/gists{/gist_id}","starred_url":"https://api.github.com/users/klauswyser/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/klauswyser/subscriptions","organizations_url":"https://api.github.com/users/klauswyser/orgs","repos_url":"https://api.github.com/users/klauswyser/repos","events_url":"https://api.github.com/users/klauswyser/events{/privacy}","received_events_url":"https://api.github.com/users/klauswyser/received_events","type":"User","site_admin":false},"labels":[{"id":530717418,"url":"https://api.github.com/repos/EC-Earth/ece2cmor3/labels/question","name":"question","color":"cc317c","default":true}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":5,"created_at":"2018-05-18T12:18:52Z","updated_at":"2018-05-22T13:54:16Z","closed_at":null,"author_association":"COLLABORATOR","body":"I try processing NEMO output (daily and monthly) output from a historical experiment but get stuck right at the beginning:\r\n````\r\nINFO:ece2cmor3.ece2cmorlib:Selected 54 NEMO tasks from 54 input tasks\r\nINFO:ece2cmor3.nemo2cmor:Creating NEMO grids in CMOR...\r\nTraceback (most recent call last):\r\n  File \"/var/lib/slurm/slurmd/job18784129/slurm_script\", line 97, in <module>\r\n    main()\r\n  File \"/var/lib/slurm/slurmd/job18784129/slurm_script\", line 91, in main\r\n    ece2cmorlib.perform_nemo_tasks(args.datadir, args.exp, startdate, length)\r\n  File \"/home/sm_wyser/.conda/envs/ece2cmor3-3-2/lib/python2.7/site-packages/ece2cmor3-1.0.0-py2.7.egg/ece2cmor3/ece2cmorlib.py\", line 175, in perform_nemo_tasks\r\n    if not nemo2cmor.initialize(datadir, expname, tableroot, startdate, interval):\r\n  File \"/home/sm_wyser/.conda/envs/ece2cmor3-3-2/lib/python2.7/site-packages/ece2cmor3-1.0.0-py2.7.egg/ece2cmor3/nemo2cmor.py\", line 53, in initialize\r\n    create_grids()\r\n  File \"/home/sm_wyser/.conda/envs/ece2cmor3-3-2/lib/python2.7/site-packages/ece2cmor3-1.0.0-py2.7.egg/ece2cmor3/nemo2cmor.py\", line 291, in create_grids\r\n    grid = read_grid(gridfiles[0])\r\n  File \"/home/sm_wyser/.conda/envs/ece2cmor3-3-2/lib/python2.7/site-packages/ece2cmor3-1.0.0-py2.7.egg/ece2cmor3/nemo2cmor.py\", line 299, in read_grid\r\n    lons = ds.variables['nav_lon'][:,:]\r\nKeyError: 'nav_lon'\r\n````\r\nI used a fairly recent version of the EC-Earth model (r5498) which includes all the recent updates of NEMO, in partcular a lot of stuff from XIOS and SHACONEMO. Is it possible that some important variable or dimension names have changed in the NEMO output and these changes are not reflected yet in nemopar.json?\r\n\r\nBTW: how do we ensure backward compatibility in ece2cmor3 with respect to changes in the NEMO output? Some people will still have to process Primavera (=old NEMO) output, while others already start processing CMIP6 (=new NEMO output) output."},"comment":{"url":"https://api.github.com/repos/EC-Earth/ece2cmor3/issues/comments/390998852","html_url":"https://github.com/EC-Earth/ece2cmor3/issues/174#issuecomment-390998852","issue_url":"https://api.github.com/repos/EC-Earth/ece2cmor3/issues/174","id":390998852,"user":{"login":"etiennesky","id":1018556,"avatar_url":"https://avatars1.githubusercontent.com/u/1018556?v=4","gravatar_id":"","url":"https://api.github.com/users/etiennesky","html_url":"https://github.com/etiennesky","followers_url":"https://api.github.com/users/etiennesky/followers","following_url":"https://api.github.com/users/etiennesky/following{/other_user}","gists_url":"https://api.github.com/users/etiennesky/gists{/gist_id}","starred_url":"https://api.github.com/users/etiennesky/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/etiennesky/subscriptions","organizations_url":"https://api.github.com/users/etiennesky/orgs","repos_url":"https://api.github.com/users/etiennesky/repos","events_url":"https://api.github.com/users/etiennesky/events{/privacy}","received_events_url":"https://api.github.com/users/etiennesky/received_events","type":"User","site_admin":false},"created_at":"2018-05-22T13:54:16Z","updated_at":"2018-05-22T13:54:16Z","author_association":"NONE","body":"maybe we should open a bug report on the portal? I think this should be fixed ASAP, because many post-processing tools are broken now (ece3post, ece2cmor3)"}}
{"actor":{"display_login":"etiennesky"}}