{"action":"created","issue":{"url":"https://api.github.com/repos/StrikeNP/trac_test/issues/793","repository_url":"https://api.github.com/repos/StrikeNP/trac_test","labels_url":"https://api.github.com/repos/StrikeNP/trac_test/issues/793/labels{/name}","comments_url":"https://api.github.com/repos/StrikeNP/trac_test/issues/793/comments","events_url":"https://api.github.com/repos/StrikeNP/trac_test/issues/793/events","html_url":"https://github.com/StrikeNP/trac_test/issues/793","id":330469454,"node_id":"MDU6SXNzdWUzMzA0Njk0NTQ=","number":793,"title":"Design what-if sampling code for CLUBB standalone (Trac #793)","user":{"login":"StrikeNP","id":2577059,"node_id":"MDQ6VXNlcjI1NzcwNTk=","avatar_url":"https://avatars0.githubusercontent.com/u/2577059?v=4","gravatar_id":"","url":"https://api.github.com/users/StrikeNP","html_url":"https://github.com/StrikeNP","followers_url":"https://api.github.com/users/StrikeNP/followers","following_url":"https://api.github.com/users/StrikeNP/following{/other_user}","gists_url":"https://api.github.com/users/StrikeNP/gists{/gist_id}","starred_url":"https://api.github.com/users/StrikeNP/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/StrikeNP/subscriptions","organizations_url":"https://api.github.com/users/StrikeNP/orgs","repos_url":"https://api.github.com/users/StrikeNP/repos","events_url":"https://api.github.com/users/StrikeNP/events{/privacy}","received_events_url":"https://api.github.com/users/StrikeNP/received_events","type":"User","site_admin":false},"labels":[{"id":958019852,"node_id":"MDU6TGFiZWw5NTgwMTk4NTI=","url":"https://api.github.com/repos/StrikeNP/trac_test/labels/Migrated%20from%20Trac","name":"Migrated from Trac","color":"FFFFFF","default":false},{"id":958042830,"node_id":"MDU6TGFiZWw5NTgwNDI4MzA=","url":"https://api.github.com/repos/StrikeNP/trac_test/labels/clubb_src","name":"clubb_src","color":"FFFFFF","default":false},{"id":958179350,"node_id":"MDU6TGFiZWw5NTgxNzkzNTA=","url":"https://api.github.com/repos/StrikeNP/trac_test/labels/roessle9@uwm.edu","name":"roessle9@uwm.edu","color":"FFFFFF","default":false},{"id":958042692,"node_id":"MDU6TGFiZWw5NTgwNDI2OTI=","url":"https://api.github.com/repos/StrikeNP/trac_test/labels/task","name":"task","color":"FFFFFF","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":{"url":"https://api.github.com/repos/StrikeNP/trac_test/milestones/8","html_url":"https://github.com/StrikeNP/trac_test/milestone/8","labels_url":"https://api.github.com/repos/StrikeNP/trac_test/milestones/8/labels","id":3408876,"node_id":"MDk6TWlsZXN0b25lMzQwODg3Ng==","number":8,"title":"Improve SILHS","description":null,"creator":{"login":"StrikeNP","id":2577059,"node_id":"MDQ6VXNlcjI1NzcwNTk=","avatar_url":"https://avatars0.githubusercontent.com/u/2577059?v=4","gravatar_id":"","url":"https://api.github.com/users/StrikeNP","html_url":"https://github.com/StrikeNP","followers_url":"https://api.github.com/users/StrikeNP/followers","following_url":"https://api.github.com/users/StrikeNP/following{/other_user}","gists_url":"https://api.github.com/users/StrikeNP/gists{/gist_id}","starred_url":"https://api.github.com/users/StrikeNP/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/StrikeNP/subscriptions","organizations_url":"https://api.github.com/users/StrikeNP/orgs","repos_url":"https://api.github.com/users/StrikeNP/repos","events_url":"https://api.github.com/users/StrikeNP/events{/privacy}","received_events_url":"https://api.github.com/users/StrikeNP/received_events","type":"User","site_admin":false},"open_issues":16,"closed_issues":65,"state":"open","created_at":"2018-06-07T19:59:06Z","updated_at":"2018-06-10T14:17:52Z","due_on":null,"closed_at":null},"comments":86,"created_at":"2018-06-07T23:25:05Z","updated_at":"2018-06-10T15:38:56Z","closed_at":null,"author_association":"OWNER","body":"\n'''Introduction'''\n\nIn order to reduce the cost of sampling microphysics, we want to implement what-if sampling in CLUBB standalone.  First, let's think about the design and potential problems.\n\n'''Technical spec'''\n\n * Let's re-read Art Owen's description of what-if sampling.\n\n * Let's look for other references on what-if sampling.\n\n * Let's design the code.  Here's a start:\n   * Call CLUBB, Generate means and covariances, theta_1a.\n   * Call SILHS, Generate sample points, x_i.\n   * Call Microphys for each sample point, Generate tendencies, f(x_i).\n   * Update means and covariances using Microphys, theta_1b\n   * Loop over timestep\n       * Call CLUBB, Generate theta_2a, P_2a\n       * Update means and covariances using microphys integral, Int{ f * P2a/P1a }\n\nOne challenge: computing P2a/P1a.  We should look for an inexpensive way to do this.  \n\n    \n\nAttachments:\n\nhttp://carson.math.uwm.edu/trac/clubb/attachment/ticket/793/Ch-var-is.pdf\nhttp://carson.math.uwm.edu/trac/clubb/attachment/ticket/793/TaylorFrancis_MonteCarloEstimationUnderDifferentistributionsUsingTheSameSimulation_1987.pdf\nhttp://carson.math.uwm.edu/trac/clubb/attachment/ticket/793/clubb_mean_evolution.png\nhttp://carson.math.uwm.edu/trac/clubb/attachment/ticket/793/pdf_rain_starts.2.jpg\nhttp://carson.math.uwm.edu/trac/clubb/attachment/ticket/793/pdf_rain_stops.jpg\nhttp://carson.math.uwm.edu/trac/clubb/attachment/ticket/793/pdf_rain_starts.jpg\nhttp://carson.math.uwm.edu/trac/clubb/attachment/ticket/793/dycoms2_rf02_ds_rwp.png\nhttp://carson.math.uwm.edu/trac/clubb/attachment/ticket/793/pdfratiotest.py\nhttp://carson.math.uwm.edu/trac/clubb/attachment/ticket/793/dycoms2_rf02_ds_turbulent_advection.png\nhttp://carson.math.uwm.edu/trac/clubb/attachment/ticket/793/rico_setup.txt\nhttp://carson.math.uwm.edu/trac/clubb/attachment/ticket/793/rico_no_silhs.png\nhttp://carson.math.uwm.edu/trac/clubb/attachment/ticket/793/rico_silhs_setup.txt\nhttp://carson.math.uwm.edu/trac/clubb/attachment/ticket/793/rico_silhs_noisy.png\nhttp://carson.math.uwm.edu/trac/clubb/attachment/ticket/793/reuse_behavior_twp_ice.png\nhttp://carson.math.uwm.edu/trac/clubb/attachment/ticket/793/redraws_caused.png\nhttp://carson.math.uwm.edu/trac/clubb/attachment/ticket/793/k_lh_start_over_time.png\nhttp://carson.math.uwm.edu/trac/clubb/attachment/ticket/793/ranking.pdf\nhttp://carson.math.uwm.edu/trac/clubb/attachment/ticket/793/ranking_plots.pdf\nhttp://carson.math.uwm.edu/trac/clubb/attachment/ticket/793/convergence_rrm_mc.png\n\nMigrated from http://carson.math.uwm.edu/trac/clubb/ticket/793\n```json\n{\n    \"status\": \"new\", \n    \"changetime\": \"2017-05-08T18:06:50\", \n    \"description\": \"\\n'''Introduction'''\\n\\nIn order to reduce the cost of sampling microphysics, we want to implement what-if sampling in CLUBB standalone.  First, let's think about the design and potential problems.\\n\\n'''Technical spec'''\\n\\n * Let's re-read Art Owen's description of what-if sampling.\\n\\n * Let's look for other references on what-if sampling.\\n\\n * Let's design the code.  Here's a start:\\n   * Call CLUBB, Generate means and covariances, theta_1a.\\n   * Call SILHS, Generate sample points, x_i.\\n   * Call Microphys for each sample point, Generate tendencies, f(x_i).\\n   * Update means and covariances using Microphys, theta_1b\\n   * Loop over timestep\\n       * Call CLUBB, Generate theta_2a, P_2a\\n       * Update means and covariances using microphys integral, Int{ f * P2a/P1a }\\n\\nOne challenge: computing P2a/P1a.  We should look for an inexpensive way to do this.  \\n\\n    \", \n    \"reporter\": \"vlarson@uwm.edu\", \n    \"cc\": \"vlarson@uwm.edu\", \n    \"resolution\": \"\", \n    \"_ts\": \"1494266810609326\", \n    \"component\": \"clubb_src\", \n    \"summary\": \"Design what-if sampling code for CLUBB standalone\", \n    \"priority\": \"major\", \n    \"keywords\": \"\", \n    \"time\": \"2016-09-02T18:00:25\", \n    \"milestone\": \"Improve SILHS\", \n    \"owner\": \"roessle9@uwm.edu\", \n    \"type\": \"task\"\n}\n```\n"},"comment":{"url":"https://api.github.com/repos/StrikeNP/trac_test/issues/comments/396058580","html_url":"https://github.com/StrikeNP/trac_test/issues/793#issuecomment-396058580","issue_url":"https://api.github.com/repos/StrikeNP/trac_test/issues/793","id":396058580,"node_id":"MDEyOklzc3VlQ29tbWVudDM5NjA1ODU4MA==","user":{"login":"StrikeNP","id":2577059,"node_id":"MDQ6VXNlcjI1NzcwNTk=","avatar_url":"https://avatars0.githubusercontent.com/u/2577059?v=4","gravatar_id":"","url":"https://api.github.com/users/StrikeNP","html_url":"https://github.com/StrikeNP","followers_url":"https://api.github.com/users/StrikeNP/followers","following_url":"https://api.github.com/users/StrikeNP/following{/other_user}","gists_url":"https://api.github.com/users/StrikeNP/gists{/gist_id}","starred_url":"https://api.github.com/users/StrikeNP/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/StrikeNP/subscriptions","organizations_url":"https://api.github.com/users/StrikeNP/orgs","repos_url":"https://api.github.com/users/StrikeNP/repos","events_url":"https://api.github.com/users/StrikeNP/events{/privacy}","received_events_url":"https://api.github.com/users/StrikeNP/received_events","type":"User","site_admin":false},"created_at":"2018-06-10T15:38:56Z","updated_at":"2018-06-10T15:38:56Z","author_association":"OWNER","body":"Trac update at 2017/02/14 at 21:25\n\nvlarson@uwm.edu commented:\n\nThomas and I talked.\n\n * Perhaps the most interesting use case for what-if sampling is the small-sample limit.  If we have 60 samples available, we might as well distribute them among all the time steps.  But if we can afford only 6 samples, and we need to compute microphysical covariance terms (e.g., lh_thlp2_mc), then it might be advantageous to choose 6 sample points and re-use twice, rather than try to compute covariances each time step with only 2 sample points.  So testing cases with l_var_covar = .true., using only 6 or 4 samples, might be interesting.  It might also be interesting to see if what-if sampling is more advantageous for l_var_covar = .true. vs. .false.\n\n * The design of the tests is important.  As \"truth\", we might want to run the cases with many sample points (32 or even 100).  Then we could evaluate which is closer to the \"truth\" simulations: regular sampling with 6 sample points, or what-if sampling with 6 sample points.  We'd want to compare both accuracy and speed.\n\n * Based on some of Thomas' scatterplots, it seems that the mu_diff criterion is more influential than ensuring that the weights are between 0.1 and 10.  But attachment:ranking.pdf​ suggests that restricting the weights improves the accuracy.  This seems contradictory.\n\n"}}
{"actor":{"display_login":"StrikeNP"}}