{"action":"created","issue":{"url":"https://api.github.com/repos/tjcrone/flowmow/issues/6","repository_url":"https://api.github.com/repos/tjcrone/flowmow","labels_url":"https://api.github.com/repos/tjcrone/flowmow/issues/6/labels{/name}","comments_url":"https://api.github.com/repos/tjcrone/flowmow/issues/6/comments","events_url":"https://api.github.com/repos/tjcrone/flowmow/issues/6/events","html_url":"https://github.com/tjcrone/flowmow/issues/6","id":349200424,"node_id":"MDU6SXNzdWUzNDkyMDA0MjQ=","number":6,"title":"Processing steps","user":{"login":"tjcrone","id":5667194,"node_id":"MDQ6VXNlcjU2NjcxOTQ=","avatar_url":"https://avatars1.githubusercontent.com/u/5667194?v=4","gravatar_id":"","url":"https://api.github.com/users/tjcrone","html_url":"https://github.com/tjcrone","followers_url":"https://api.github.com/users/tjcrone/followers","following_url":"https://api.github.com/users/tjcrone/following{/other_user}","gists_url":"https://api.github.com/users/tjcrone/gists{/gist_id}","starred_url":"https://api.github.com/users/tjcrone/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tjcrone/subscriptions","organizations_url":"https://api.github.com/users/tjcrone/orgs","repos_url":"https://api.github.com/users/tjcrone/repos","events_url":"https://api.github.com/users/tjcrone/events{/privacy}","received_events_url":"https://api.github.com/users/tjcrone/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2018-08-09T16:26:34Z","updated_at":"2018-08-09T17:01:01Z","closed_at":null,"author_association":"OWNER","body":"Here are what I understand to be the FlowMow2 processing steps:\r\n\r\n- [x] Move all Sentry data into Google Drive and share publicly.\r\n- [x] Read all raw data into Pandas dataframes.\r\n- [x] Project nav into UTM-9 meters for subsequent processing.\r\n- [x] Convert Paros tau and eta values to pressure.\r\n- [x] Convert SBE3 \"counts\" values to temperature.\r\n- [ ] Confirm that we have a single logging system and have no need to fit to a common clock.\r\n- [ ] Apply origami transform and timestamp interpolation to obtain first-pass real-world position vector (x, y, z) for the Nortek ADV.\r\n- [ ] Sanity check origami transform. How?\r\n- [ ] Filter Paros data into real-world Nortek position. I do not understand how this is supposed to work. It also may not be necessary.\r\n- [ ] Determine/confirm the Nortek velocity coordinate system and units.\r\n- [ ] Calculate Nortek vertical acceleration vector field.\r\n- [ ] Project SBE3 onto Nortek data (or vice versa?). Use smoothing or averaging if the sample rates are very different?\r\n- [ ] Build an arbitrary rotated coordinate system to simplify slicing in space.\r\n- [ ] Integrate over the study area. We did this once last year. Should discuss best ways to do this.\r\n- [ ] Visualize using Holoviews perhaps?\r\n- [ ] Explore temporal slicing/variability."},"comment":{"url":"https://api.github.com/repos/tjcrone/flowmow/issues/comments/411827308","html_url":"https://github.com/tjcrone/flowmow/issues/6#issuecomment-411827308","issue_url":"https://api.github.com/repos/tjcrone/flowmow/issues/6","id":411827308,"node_id":"MDEyOklzc3VlQ29tbWVudDQxMTgyNzMwOA==","user":{"login":"tjcrone","id":5667194,"node_id":"MDQ6VXNlcjU2NjcxOTQ=","avatar_url":"https://avatars1.githubusercontent.com/u/5667194?v=4","gravatar_id":"","url":"https://api.github.com/users/tjcrone","html_url":"https://github.com/tjcrone","followers_url":"https://api.github.com/users/tjcrone/followers","following_url":"https://api.github.com/users/tjcrone/following{/other_user}","gists_url":"https://api.github.com/users/tjcrone/gists{/gist_id}","starred_url":"https://api.github.com/users/tjcrone/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tjcrone/subscriptions","organizations_url":"https://api.github.com/users/tjcrone/orgs","repos_url":"https://api.github.com/users/tjcrone/repos","events_url":"https://api.github.com/users/tjcrone/events{/privacy}","received_events_url":"https://api.github.com/users/tjcrone/received_events","type":"User","site_admin":false},"created_at":"2018-08-09T17:01:01Z","updated_at":"2018-08-09T17:01:01Z","author_association":"OWNER","body":"Here is a suggested organization for the processing pipeline:\r\n\r\n1. \"read_raw\" notebook outputs six \"_raw\" hdf5 files placed in the data/interim directory.\r\n2. \"convert_raw\" notebook converts the nav to UTM, Paros and SBE3 to real values, and outputs three \"_converted\" hdf5 files.\r\n3. \"origami_transform\" notebook applies the origami transform to the Nortek ADV data and results in the \"nortek_origami\" hdf5 file.\r\n4. \"paros_transform\" notebook applies the Paros filter to the nortek_origami data and results in the \"nortek_paros\" hdf5 file.\r\n5. \"gx3_transform\" notebook applies the GX3-25 filter to the nortek_origami data and results in the \"nortek_gx3\" hdf5 file.\r\n6. \"slam\" notebook implements full SLAM resulting in the \"nortek_slam\" hdf5 file.\r\n\r\nI'll stop there for now and adjust as we move forward and assess the goodness of this idea.\r\n"}}
{"actor":{"display_login":"tjcrone"}}