{"action":"created","issue":{"url":"https://api.github.com/repos/LSSTDESC/DC2_Repo/issues/140","repository_url":"https://api.github.com/repos/LSSTDESC/DC2_Repo","labels_url":"https://api.github.com/repos/LSSTDESC/DC2_Repo/issues/140/labels{/name}","comments_url":"https://api.github.com/repos/LSSTDESC/DC2_Repo/issues/140/comments","events_url":"https://api.github.com/repos/LSSTDESC/DC2_Repo/issues/140/events","html_url":"https://github.com/LSSTDESC/DC2_Repo/issues/140","id":302360189,"number":140,"title":"phoSim sky background tests","user":{"login":"TomGlanzman","id":9436484,"avatar_url":"https://avatars0.githubusercontent.com/u/9436484?v=4","gravatar_id":"","url":"https://api.github.com/users/TomGlanzman","html_url":"https://github.com/TomGlanzman","followers_url":"https://api.github.com/users/TomGlanzman/followers","following_url":"https://api.github.com/users/TomGlanzman/following{/other_user}","gists_url":"https://api.github.com/users/TomGlanzman/gists{/gist_id}","starred_url":"https://api.github.com/users/TomGlanzman/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/TomGlanzman/subscriptions","organizations_url":"https://api.github.com/users/TomGlanzman/orgs","repos_url":"https://api.github.com/users/TomGlanzman/repos","events_url":"https://api.github.com/users/TomGlanzman/events{/privacy}","received_events_url":"https://api.github.com/users/TomGlanzman/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"rmandelb","id":1454906,"avatar_url":"https://avatars3.githubusercontent.com/u/1454906?v=4","gravatar_id":"","url":"https://api.github.com/users/rmandelb","html_url":"https://github.com/rmandelb","followers_url":"https://api.github.com/users/rmandelb/followers","following_url":"https://api.github.com/users/rmandelb/following{/other_user}","gists_url":"https://api.github.com/users/rmandelb/gists{/gist_id}","starred_url":"https://api.github.com/users/rmandelb/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rmandelb/subscriptions","organizations_url":"https://api.github.com/users/rmandelb/orgs","repos_url":"https://api.github.com/users/rmandelb/repos","events_url":"https://api.github.com/users/rmandelb/events{/privacy}","received_events_url":"https://api.github.com/users/rmandelb/received_events","type":"User","site_admin":false},"assignees":[{"login":"rmandelb","id":1454906,"avatar_url":"https://avatars3.githubusercontent.com/u/1454906?v=4","gravatar_id":"","url":"https://api.github.com/users/rmandelb","html_url":"https://github.com/rmandelb","followers_url":"https://api.github.com/users/rmandelb/followers","following_url":"https://api.github.com/users/rmandelb/following{/other_user}","gists_url":"https://api.github.com/users/rmandelb/gists{/gist_id}","starred_url":"https://api.github.com/users/rmandelb/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rmandelb/subscriptions","organizations_url":"https://api.github.com/users/rmandelb/orgs","repos_url":"https://api.github.com/users/rmandelb/repos","events_url":"https://api.github.com/users/rmandelb/events{/privacy}","received_events_url":"https://api.github.com/users/rmandelb/received_events","type":"User","site_admin":false},{"login":"cwwalter","id":5562740,"avatar_url":"https://avatars2.githubusercontent.com/u/5562740?v=4","gravatar_id":"","url":"https://api.github.com/users/cwwalter","html_url":"https://github.com/cwwalter","followers_url":"https://api.github.com/users/cwwalter/followers","following_url":"https://api.github.com/users/cwwalter/following{/other_user}","gists_url":"https://api.github.com/users/cwwalter/gists{/gist_id}","starred_url":"https://api.github.com/users/cwwalter/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cwwalter/subscriptions","organizations_url":"https://api.github.com/users/cwwalter/orgs","repos_url":"https://api.github.com/users/cwwalter/repos","events_url":"https://api.github.com/users/cwwalter/events{/privacy}","received_events_url":"https://api.github.com/users/cwwalter/received_events","type":"User","site_admin":false},{"login":"salmanhabib","id":9030901,"avatar_url":"https://avatars0.githubusercontent.com/u/9030901?v=4","gravatar_id":"","url":"https://api.github.com/users/salmanhabib","html_url":"https://github.com/salmanhabib","followers_url":"https://api.github.com/users/salmanhabib/followers","following_url":"https://api.github.com/users/salmanhabib/following{/other_user}","gists_url":"https://api.github.com/users/salmanhabib/gists{/gist_id}","starred_url":"https://api.github.com/users/salmanhabib/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/salmanhabib/subscriptions","organizations_url":"https://api.github.com/users/salmanhabib/orgs","repos_url":"https://api.github.com/users/salmanhabib/repos","events_url":"https://api.github.com/users/salmanhabib/events{/privacy}","received_events_url":"https://api.github.com/users/salmanhabib/received_events","type":"User","site_admin":false},{"login":"TomGlanzman","id":9436484,"avatar_url":"https://avatars0.githubusercontent.com/u/9436484?v=4","gravatar_id":"","url":"https://api.github.com/users/TomGlanzman","html_url":"https://github.com/TomGlanzman","followers_url":"https://api.github.com/users/TomGlanzman/followers","following_url":"https://api.github.com/users/TomGlanzman/following{/other_user}","gists_url":"https://api.github.com/users/TomGlanzman/gists{/gist_id}","starred_url":"https://api.github.com/users/TomGlanzman/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/TomGlanzman/subscriptions","organizations_url":"https://api.github.com/users/TomGlanzman/orgs","repos_url":"https://api.github.com/users/TomGlanzman/repos","events_url":"https://api.github.com/users/TomGlanzman/events{/privacy}","received_events_url":"https://api.github.com/users/TomGlanzman/received_events","type":"User","site_admin":false},{"login":"johnrpeterson","id":9884658,"avatar_url":"https://avatars0.githubusercontent.com/u/9884658?v=4","gravatar_id":"","url":"https://api.github.com/users/johnrpeterson","html_url":"https://github.com/johnrpeterson","followers_url":"https://api.github.com/users/johnrpeterson/followers","following_url":"https://api.github.com/users/johnrpeterson/following{/other_user}","gists_url":"https://api.github.com/users/johnrpeterson/gists{/gist_id}","starred_url":"https://api.github.com/users/johnrpeterson/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/johnrpeterson/subscriptions","organizations_url":"https://api.github.com/users/johnrpeterson/orgs","repos_url":"https://api.github.com/users/johnrpeterson/repos","events_url":"https://api.github.com/users/johnrpeterson/events{/privacy}","received_events_url":"https://api.github.com/users/johnrpeterson/received_events","type":"User","site_admin":false},{"login":"katrinheitmann","id":12860812,"avatar_url":"https://avatars2.githubusercontent.com/u/12860812?v=4","gravatar_id":"","url":"https://api.github.com/users/katrinheitmann","html_url":"https://github.com/katrinheitmann","followers_url":"https://api.github.com/users/katrinheitmann/followers","following_url":"https://api.github.com/users/katrinheitmann/following{/other_user}","gists_url":"https://api.github.com/users/katrinheitmann/gists{/gist_id}","starred_url":"https://api.github.com/users/katrinheitmann/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/katrinheitmann/subscriptions","organizations_url":"https://api.github.com/users/katrinheitmann/orgs","repos_url":"https://api.github.com/users/katrinheitmann/repos","events_url":"https://api.github.com/users/katrinheitmann/events{/privacy}","received_events_url":"https://api.github.com/users/katrinheitmann/received_events","type":"User","site_admin":false}],"milestone":null,"comments":119,"created_at":"2018-03-05T16:09:53Z","updated_at":"2018-03-09T14:34:51Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"The ongoing Run 1.1 has revealed a background issue with phoSim.  A summary from Rachael Mandelbaum in the slack desc-dc2 channel (2 Mar 2018, 09:21am Pacific):\r\n\r\n```\r\nFor those who did not see all this traffic, a comparison between HSC data and the PhoSim run 1.1\r\nimages showed quite different levels of structure in the sky background.  In particular, PhoSim images\r\nseem to have an excess of small-scale structure.  The reason this is a problem is that if you have to\r\nratchet up the complexity of the background model in DM, then it can complicate measurements related\r\nto individual objects (e.g., galaxy photometry).  In other words: if the sky does not have strong\r\nfluctuations on small scales, the combined background + object modeling problem is quite different from\r\nthe case where it does have strong fluctuations on small scales.  So -- there is a concern that the\r\nPhoSim sky background may be turning this into an unrealistically complex problem.  This then leads to\r\nthe question of what to do about the rest of run 1.1, and what to do about actual DC2.\r\n```\r\n\r\nThis issue will define the phoSim tests to be done (scope and configuration) and their results.  These tests will aim to change phoSim configuration settings in a controlled way to observe the differences in resultant images.\r\n\r\n-------\r\n\r\n**Table of tests** (all WFD, r-band, obsHistID=417009, central raft (R22), otherwise identical with Run1.1 ) indicating relevant phoSim physics override changes.  \r\n\r\n**Note:  \"n/s\" = not set in the command file, hence a default value is used.** (see below)\r\n\r\nTest(stream)|backalpha|backbeta|backgamma|backdelta|activebuffer|airglowvariation|clearclouds|note\r\n-----|-----|-----|-----|-----|-----|-----|-----|-----\r\nRun1.1| 0.1 |4.0 |1000|1.0 |600 |n/s| no |\r\n000000|0.1| 4.0 |1000|1.0 |600 |0.0| no |\r\n000001|0.05| 4.0|1000| 1.0 |600|n/s| no |\r\n000002   | 0.01|4.0|1000|1.0 |600 |0.0| no |\r\n000003   | 0.1 | 4.0|1000|1.0 |600  |0.2| no |\r\n000004   | 0.05 |4.0 |1000| 1.0 |600 |0.2| no |\r\n000005   | 0.01|4.0 |1000|1.0 |600 |0.2| no |\r\n000006  | 0.05|4.0 |1000|1.0 |600 |0.0| no |\r\n000007  | 0.01|4.0 |1000|1.0 |600 |0.0| yes |\r\n000008  | 0.01|4.0 |10|1.0 |600 |0.0| yes |\r\n000009 |n/s| n/s|n/s|n/s | n/s|0.0|yes|full backgrounds\r\n000010  | 0.01| 5.0|1000| 1.0 |600|0.0| yes |oops!\r\n000011  | 0.01|6.0 |1000| 1.0 |600|0.0| yes |oops!\r\n000012  | 0.1| 5.0|1000| 1.0 |600|0.0| yes |\r\n000013  | 0.1|6.0 |1000| 1.0 |600|0.0| yes |\r\n\r\nNote: for reference, all phoSim command files used in these tests are stored in /global/projecta/projectdirs/lsst/production/DC2/DC2-phoSim-test_WFD-r with names like commands-000001.txt (for Test 000001), etc.\r\n\r\n-----\r\n\r\n**Location of images (at NERSC):**\r\n```\r\n/global/projecta/projectdirs/lsst/production/DC2/DC2-phoSim-test_WFD-r/output/<stream>\r\n```\r\n-----\r\n\r\n**Brief description of the *background* parameters** in phoSim taken from https://bitbucket.org/phosim/phosim_release/wiki/Physics%20Commands\r\n\r\n```\r\nOptimization Commands (use with caution):\r\n\r\n- backalpha X (X is the signal to noise of a groups of background\r\nphotons above the background itself, default = 0.1, set to 0 for\r\nsingle photon background (very slow))\r\n\r\n- backbeta X (X is the size factor (times 10\") of the background groups\r\nabove the detector, default = 4.0 which means 40\" gaussian radius)\r\n\r\n- backgamma X (X is the number of photons to simulate at a time (and\r\ntherefore smooth over detector physics) when a photon hits the sensor,\r\ndefault = 2.0, for quickbackground use 1000.0)\r\n\r\n- backdelta X (X is the size factor to divide by to get the size of the\r\ngrouping in the sensor, default = 80.0 which means a 0.5\" gaussian\r\nradius, for quick background use 1.0)\r\n```\r\n\r\nThe default value for 'activebuffer' is 10 (for quickbackground use 600).  The default of 'backBuffer' is 100."},"comment":{"url":"https://api.github.com/repos/LSSTDESC/DC2_Repo/issues/comments/371828889","html_url":"https://github.com/LSSTDESC/DC2_Repo/issues/140#issuecomment-371828889","issue_url":"https://api.github.com/repos/LSSTDESC/DC2_Repo/issues/140","id":371828889,"user":{"login":"katrinheitmann","id":12860812,"avatar_url":"https://avatars2.githubusercontent.com/u/12860812?v=4","gravatar_id":"","url":"https://api.github.com/users/katrinheitmann","html_url":"https://github.com/katrinheitmann","followers_url":"https://api.github.com/users/katrinheitmann/followers","following_url":"https://api.github.com/users/katrinheitmann/following{/other_user}","gists_url":"https://api.github.com/users/katrinheitmann/gists{/gist_id}","starred_url":"https://api.github.com/users/katrinheitmann/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/katrinheitmann/subscriptions","organizations_url":"https://api.github.com/users/katrinheitmann/orgs","repos_url":"https://api.github.com/users/katrinheitmann/repos","events_url":"https://api.github.com/users/katrinheitmann/events{/privacy}","received_events_url":"https://api.github.com/users/katrinheitmann/received_events","type":"User","site_admin":false},"created_at":"2018-03-09T14:34:51Z","updated_at":"2018-03-09T14:34:51Z","author_association":"CONTRIBUTOR","body":"[summary_new_2.pdf](https://github.com/LSSTDESC/DC2_Repo/files/1797180/summary_new_2.pdf)\r\nAn important test finished over night -- Test000009, full background. The result has been added to the others. The run with low backgamma is still not done -- so that is doesn't seem an option then? I have put the new outputs from Simon's code to the rest here: /global/cscratch1/sd/heitmann/output\r\n\r\n@TomGlanzman How much slower was 000009 compared to e.g. 000002? Thanks!"}}
{"actor":{"display_login":"katrinheitmann"}}