{"action":"created","issue":{"url":"https://api.github.com/repos/onaio/gisida/issues/235","repository_url":"https://api.github.com/repos/onaio/gisida","labels_url":"https://api.github.com/repos/onaio/gisida/issues/235/labels{/name}","comments_url":"https://api.github.com/repos/onaio/gisida/issues/235/comments","events_url":"https://api.github.com/repos/onaio/gisida/issues/235/events","html_url":"https://github.com/onaio/gisida/issues/235","id":376516677,"node_id":"MDU6SXNzdWUzNzY1MTY2Nzc=","number":235,"title":"Canopy Superset Connector Module","user":{"login":"cKellyDesign","id":4141527,"node_id":"MDQ6VXNlcjQxNDE1Mjc=","avatar_url":"https://avatars1.githubusercontent.com/u/4141527?v=4","gravatar_id":"","url":"https://api.github.com/users/cKellyDesign","html_url":"https://github.com/cKellyDesign","followers_url":"https://api.github.com/users/cKellyDesign/followers","following_url":"https://api.github.com/users/cKellyDesign/following{/other_user}","gists_url":"https://api.github.com/users/cKellyDesign/gists{/gist_id}","starred_url":"https://api.github.com/users/cKellyDesign/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cKellyDesign/subscriptions","organizations_url":"https://api.github.com/users/cKellyDesign/orgs","repos_url":"https://api.github.com/users/cKellyDesign/repos","events_url":"https://api.github.com/users/cKellyDesign/events{/privacy}","received_events_url":"https://api.github.com/users/cKellyDesign/received_events","type":"User","site_admin":false},"labels":[{"id":929174384,"node_id":"MDU6TGFiZWw5MjkxNzQzODQ=","url":"https://api.github.com/repos/onaio/gisida/labels/gisida-core","name":"gisida-core","color":"c6ba09","default":false}],"state":"open","locked":false,"assignee":{"login":"cKellyDesign","id":4141527,"node_id":"MDQ6VXNlcjQxNDE1Mjc=","avatar_url":"https://avatars1.githubusercontent.com/u/4141527?v=4","gravatar_id":"","url":"https://api.github.com/users/cKellyDesign","html_url":"https://github.com/cKellyDesign","followers_url":"https://api.github.com/users/cKellyDesign/followers","following_url":"https://api.github.com/users/cKellyDesign/following{/other_user}","gists_url":"https://api.github.com/users/cKellyDesign/gists{/gist_id}","starred_url":"https://api.github.com/users/cKellyDesign/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cKellyDesign/subscriptions","organizations_url":"https://api.github.com/users/cKellyDesign/orgs","repos_url":"https://api.github.com/users/cKellyDesign/repos","events_url":"https://api.github.com/users/cKellyDesign/events{/privacy}","received_events_url":"https://api.github.com/users/cKellyDesign/received_events","type":"User","site_admin":false},"assignees":[{"login":"cKellyDesign","id":4141527,"node_id":"MDQ6VXNlcjQxNDE1Mjc=","avatar_url":"https://avatars1.githubusercontent.com/u/4141527?v=4","gravatar_id":"","url":"https://api.github.com/users/cKellyDesign","html_url":"https://github.com/cKellyDesign","followers_url":"https://api.github.com/users/cKellyDesign/followers","following_url":"https://api.github.com/users/cKellyDesign/following{/other_user}","gists_url":"https://api.github.com/users/cKellyDesign/gists{/gist_id}","starred_url":"https://api.github.com/users/cKellyDesign/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cKellyDesign/subscriptions","organizations_url":"https://api.github.com/users/cKellyDesign/orgs","repos_url":"https://api.github.com/users/cKellyDesign/repos","events_url":"https://api.github.com/users/cKellyDesign/events{/privacy}","received_events_url":"https://api.github.com/users/cKellyDesign/received_events","type":"User","site_admin":false}],"milestone":null,"comments":7,"created_at":"2018-11-01T18:36:33Z","updated_at":"2018-11-06T19:55:23Z","closed_at":null,"author_association":"COLLABORATOR","body":"This module will ingest data directly from Superset Postgres DBs via SQL queries routed through a simple Node REST API."},"comment":{"url":"https://api.github.com/repos/onaio/gisida/issues/comments/436387046","html_url":"https://github.com/onaio/gisida/issues/235#issuecomment-436387046","issue_url":"https://api.github.com/repos/onaio/gisida/issues/235","id":436387046,"node_id":"MDEyOklzc3VlQ29tbWVudDQzNjM4NzA0Ng==","user":{"login":"cKellyDesign","id":4141527,"node_id":"MDQ6VXNlcjQxNDE1Mjc=","avatar_url":"https://avatars1.githubusercontent.com/u/4141527?v=4","gravatar_id":"","url":"https://api.github.com/users/cKellyDesign","html_url":"https://github.com/cKellyDesign","followers_url":"https://api.github.com/users/cKellyDesign/followers","following_url":"https://api.github.com/users/cKellyDesign/following{/other_user}","gists_url":"https://api.github.com/users/cKellyDesign/gists{/gist_id}","starred_url":"https://api.github.com/users/cKellyDesign/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cKellyDesign/subscriptions","organizations_url":"https://api.github.com/users/cKellyDesign/orgs","repos_url":"https://api.github.com/users/cKellyDesign/repos","events_url":"https://api.github.com/users/cKellyDesign/events{/privacy}","received_events_url":"https://api.github.com/users/cKellyDesign/received_events","type":"User","site_admin":false},"created_at":"2018-11-06T19:55:23Z","updated_at":"2018-11-06T19:55:23Z","author_association":"COLLABORATOR","body":"We can get some data out of the CSV export but are running into limitations in terms of what we can do with it for Gisida. Any data exposed this way is limited to what we can build out as a chart, building a [Table View Chart](https://superset.ona.io/superset/explore/?form_data=%7B%22datasource%22%3A%22151__table%22%2C%22viz_type%22%3A%22table%22%2C%22slice_id%22%3A1674%2C%22granularity_sqla%22%3Anull%2C%22time_grain_sqla%22%3Anull%2C%22since%22%3A%22100+years+ago%22%2C%22until%22%3A%22now%22%2C%22groupby%22%3A%5B%22period_date%22%2C%22loc%22%5D%2C%22metrics%22%3A%5B%7B%22hasCustomLabel%22%3Afalse%2C%22expressionType%22%3A%22SQL%22%2C%22fromFormData%22%3Atrue%2C%22label%22%3A%22SUM%28total_risk_case_sum%29%22%2C%22column%22%3Anull%2C%22sqlExpression%22%3A%22SUM%28total_risk_case_sum%29%22%2C%22aggregate%22%3Anull%2C%22optionName%22%3A%22metric_vjltuutiu7l_yomy5ortem%22%7D%2C%7B%22hasCustomLabel%22%3Afalse%2C%22expressionType%22%3A%22SQL%22%2C%22fromFormData%22%3Atrue%2C%22label%22%3A%22SUM%28total_people_gbv_sum%29%22%2C%22column%22%3Anull%2C%22sqlExpression%22%3A%22SUM%28total_people_gbv_sum%29%22%2C%22aggregate%22%3Anull%2C%22optionName%22%3A%22metric_6q8z933aowg_mn7x44r0voe%22%7D%2C%7B%22hasCustomLabel%22%3Afalse%2C%22expressionType%22%3A%22SQL%22%2C%22fromFormData%22%3Atrue%2C%22label%22%3A%22SUM%28total_cf_sum%29%22%2C%22column%22%3Anull%2C%22sqlExpression%22%3A%22SUM%28total_cf_sum%29%22%2C%22aggregate%22%3Anull%2C%22optionName%22%3A%22metric_ri19nbmg49b_j5qdx5m7t9i%22%7D%2C%7B%22hasCustomLabel%22%3Afalse%2C%22expressionType%22%3A%22SIMPLE%22%2C%22fromFormData%22%3Atrue%2C%22label%22%3A%22SUM%28total_psych_benefit_sum%29%22%2C%22column%22%3A%7B%22optionName%22%3A%22_col_total_psych_benefit_sum%22%2C%22description%22%3Anull%2C%22filterable%22%3Atrue%2C%22type%22%3A%22OBJECT%22%2C%22is_dttm%22%3Afalse%2C%22verbose_name%22%3Anull%2C%22expression%22%3A%22%22%2C%22groupby%22%3Atrue%2C%22column_name%22%3A%22total_psych_benefit_sum%22%7D%2C%22sqlExpression%22%3Anull%2C%22aggregate%22%3A%22SUM%22%2C%22optionName%22%3A%22metric_7bscabt06tw_e14g91xg6yi%22%7D%5D%2C%22percent_metrics%22%3A%5B%5D%2C%22timeseries_limit_metric%22%3A%7B%22hasCustomLabel%22%3Afalse%2C%22expressionType%22%3A%22SQL%22%2C%22fromFormData%22%3Atrue%2C%22label%22%3A%22DATE%28period_date%29%22%2C%22column%22%3Anull%2C%22sqlExpression%22%3A%22DATE%28period_date%29%22%2C%22aggregate%22%3Anull%2C%22optionName%22%3A%22metric_pkwbteu7pce_3ta7fqjjll7%22%7D%2C%22row_limit%22%3A10000%2C%22include_time%22%3Afalse%2C%22order_desc%22%3Afalse%2C%22all_columns%22%3A%5B%5D%2C%22order_by_cols%22%3A%5B%5D%2C%22adhoc_filters%22%3Anull%2C%22table_timestamp_format%22%3A%22%25Y-%25m-%25d+%25H%3A%25M%3A%25S%22%2C%22page_length%22%3A0%2C%22include_search%22%3Afalse%2C%22table_filter%22%3Afalse%2C%22align_pn%22%3Afalse%2C%22color_pn%22%3Atrue%2C%22url_params%22%3A%7B%7D%2C%22limit%22%3A%220%22%7D) gets us part way but I'm having trouble understanding how to generate a table with cumulative sum totals over time (a common Gisida layer data requirement). \r\n\r\nWe have also put together a simple [Node/Express API](https://github.com/cKellyDesign/tembo) layer to handle the actual [Slice Data requests](https://ona-tembo.herokuapp.com/slice/json/1674). This currently only works because we have altered the PUBLIC role to have access to explore certain assets, moving forward we will probably want to remove this PUBLIC role access and instead have the API passing Auth tokens into Superset to get private data.\r\n\r\nAnother thing unclear to me is how we will apply filters to layers with Canopy Superset sources without creating, saving, and referencing new slices for every filter. Obviously this does not scale so we'll have to come up with something.\r\n\r\ncc - @mberg @pld @KipSigei @csc5k "}}
{"actor":{"display_login":"cKellyDesign"}}