{"action":"created","issue":{"url":"https://api.github.com/repos/scikit-learn-contrib/hdbscan/issues/186","repository_url":"https://api.github.com/repos/scikit-learn-contrib/hdbscan","labels_url":"https://api.github.com/repos/scikit-learn-contrib/hdbscan/issues/186/labels{/name}","comments_url":"https://api.github.com/repos/scikit-learn-contrib/hdbscan/issues/186/comments","events_url":"https://api.github.com/repos/scikit-learn-contrib/hdbscan/issues/186/events","html_url":"https://github.com/scikit-learn-contrib/hdbscan/issues/186","id":304571545,"number":186,"title":"Clustering & prediction on data with uncertainties","user":{"login":"leenderthayen","id":11664090,"avatar_url":"https://avatars0.githubusercontent.com/u/11664090?v=4","gravatar_id":"","url":"https://api.github.com/users/leenderthayen","html_url":"https://github.com/leenderthayen","followers_url":"https://api.github.com/users/leenderthayen/followers","following_url":"https://api.github.com/users/leenderthayen/following{/other_user}","gists_url":"https://api.github.com/users/leenderthayen/gists{/gist_id}","starred_url":"https://api.github.com/users/leenderthayen/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/leenderthayen/subscriptions","organizations_url":"https://api.github.com/users/leenderthayen/orgs","repos_url":"https://api.github.com/users/leenderthayen/repos","events_url":"https://api.github.com/users/leenderthayen/events{/privacy}","received_events_url":"https://api.github.com/users/leenderthayen/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-03-12T23:03:11Z","updated_at":"2018-03-13T01:48:54Z","closed_at":null,"author_association":"NONE","body":"Hello all,\r\n\r\nI'm a theoretical physicist, and have been using hdbscan for a while now. Needless to say, I've been very thankful to the makers for this great piece of software. I have question/request, however.\r\n\r\nThe data I've been clustering carry uncertainties in some dimensions. For the sake of simplicity, we can assume the uncertainties are gaussian. While clustering with the central values, neglecting any uncertainties, results in physically meaningful clusters, my ultimate interest lies in the prediction of new data. The question is now if it is possible to use the uncertainties with the prediction algorithm. There seems to be (almost) no literature on this, or I have been searching in the wrong directions.\r\n\r\nI can imagine defining a custom metric as the euclidian distance normalized to the uncertainty of the individual data points added in quadrature, but I don't see how this works to predict new points. A very brute-force method of performing the clustering and prediction on all data points sampled within their uncertainties will be prohibitively expensive. I can imagine some fiddling with the final posterior could do the trick, but I'm not sure yet if this is the correct way to proceed.\r\n\r\nDoes anyone have an idea on how to do this, or pointers to some literature?\r\n\r\nThanks!"},"comment":{"url":"https://api.github.com/repos/scikit-learn-contrib/hdbscan/issues/comments/372519133","html_url":"https://github.com/scikit-learn-contrib/hdbscan/issues/186#issuecomment-372519133","issue_url":"https://api.github.com/repos/scikit-learn-contrib/hdbscan/issues/186","id":372519133,"user":{"login":"lmcinnes","id":11962885,"avatar_url":"https://avatars0.githubusercontent.com/u/11962885?v=4","gravatar_id":"","url":"https://api.github.com/users/lmcinnes","html_url":"https://github.com/lmcinnes","followers_url":"https://api.github.com/users/lmcinnes/followers","following_url":"https://api.github.com/users/lmcinnes/following{/other_user}","gists_url":"https://api.github.com/users/lmcinnes/gists{/gist_id}","starred_url":"https://api.github.com/users/lmcinnes/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lmcinnes/subscriptions","organizations_url":"https://api.github.com/users/lmcinnes/orgs","repos_url":"https://api.github.com/users/lmcinnes/repos","events_url":"https://api.github.com/users/lmcinnes/events{/privacy}","received_events_url":"https://api.github.com/users/lmcinnes/received_events","type":"User","site_admin":false},"created_at":"2018-03-13T01:48:54Z","updated_at":"2018-03-13T01:48:54Z","author_association":"COLLABORATOR","body":"I admit that this is rather tricky. I believe I understand your problem, but I will definitely have to think for a bit about the right way to go about trying to find some solution. It certainly isn't obvious. I'll try to get back to you soon with at least some ideas, or references to potential approaches."}}
{"actor":{"display_login":"lmcinnes"}}