{"action":"created","issue":{"url":"https://api.github.com/repos/ligovirgo/gwdetchar/issues/45","repository_url":"https://api.github.com/repos/ligovirgo/gwdetchar","labels_url":"https://api.github.com/repos/ligovirgo/gwdetchar/issues/45/labels{/name}","comments_url":"https://api.github.com/repos/ligovirgo/gwdetchar/issues/45/comments","events_url":"https://api.github.com/repos/ligovirgo/gwdetchar/issues/45/events","html_url":"https://github.com/ligovirgo/gwdetchar/issues/45","id":194414257,"number":45,"title":"gwdetchar-slow-correlation should remove outliers in the range and BLRMs","user":{"login":"jrsmith02","id":7536082,"avatar_url":"https://avatars.githubusercontent.com/u/7536082?v=3","gravatar_id":"","url":"https://api.github.com/users/jrsmith02","html_url":"https://github.com/jrsmith02","followers_url":"https://api.github.com/users/jrsmith02/followers","following_url":"https://api.github.com/users/jrsmith02/following{/other_user}","gists_url":"https://api.github.com/users/jrsmith02/gists{/gist_id}","starred_url":"https://api.github.com/users/jrsmith02/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jrsmith02/subscriptions","organizations_url":"https://api.github.com/users/jrsmith02/orgs","repos_url":"https://api.github.com/users/jrsmith02/repos","events_url":"https://api.github.com/users/jrsmith02/events{/privacy}","received_events_url":"https://api.github.com/users/jrsmith02/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2016-12-08T18:51:30Z","updated_at":"2016-12-09T00:16:21Z","closed_at":null,"body":"Currently the ~80Mpc range often contains 1-3 spikes that reach down to nearly zero range due to ETM saturations in a given 24 hour period. This stretches the y-axis scaling and makes it hard to see whether things are really correlated. I think we should remove outlying points and replace them by the mean of neighboring points or something. Stackoverflow suggests: \r\n`def reject_outliers(data, m=2):\r\n    return data[abs(data - np.mean(data)) < m * np.std(data)]`\r\nThat will just remove the points but we want to keep a point there just replace it by the mean of the nearest two points (I'd say point before and after but that would have rare edge effects). @duncanmmacleod do you have any implementation suggestions? "},"comment":{"url":"https://api.github.com/repos/ligovirgo/gwdetchar/issues/comments/265895731","html_url":"https://github.com/ligovirgo/gwdetchar/issues/45#issuecomment-265895731","issue_url":"https://api.github.com/repos/ligovirgo/gwdetchar/issues/45","id":265895731,"user":{"login":"tjma12","id":12533353,"avatar_url":"https://avatars.githubusercontent.com/u/12533353?v=3","gravatar_id":"","url":"https://api.github.com/users/tjma12","html_url":"https://github.com/tjma12","followers_url":"https://api.github.com/users/tjma12/followers","following_url":"https://api.github.com/users/tjma12/following{/other_user}","gists_url":"https://api.github.com/users/tjma12/gists{/gist_id}","starred_url":"https://api.github.com/users/tjma12/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tjma12/subscriptions","organizations_url":"https://api.github.com/users/tjma12/orgs","repos_url":"https://api.github.com/users/tjma12/repos","events_url":"https://api.github.com/users/tjma12/events{/privacy}","received_events_url":"https://api.github.com/users/tjma12/received_events","type":"User","site_admin":false},"created_at":"2016-12-09T00:16:21Z","updated_at":"2016-12-09T00:16:21Z","body":"I mocked up an outlier removal function, I'm going to drop it into my gwdetchar installation and test it. Dotted lines in this example are the mean, and +/- 2 sigma lines.\r\nhttps://ldas-jobs.ligo.caltech.edu/~thomas.massinger/detchar/smooth_range/RMS.png"}}
{"actor":{"display_login":"tjma12"}}