{"action":"created","issue":{"url":"https://api.github.com/repos/BitFunnel/BitFunnel/issues/401","repository_url":"https://api.github.com/repos/BitFunnel/BitFunnel","labels_url":"https://api.github.com/repos/BitFunnel/BitFunnel/issues/401/labels{/name}","comments_url":"https://api.github.com/repos/BitFunnel/BitFunnel/issues/401/comments","events_url":"https://api.github.com/repos/BitFunnel/BitFunnel/issues/401/events","html_url":"https://github.com/BitFunnel/BitFunnel/issues/401","id":313891747,"number":401,"title":"Establish termtable defaults for density and treatment","user":{"login":"jondgoodwin","id":5818466,"avatar_url":"https://avatars1.githubusercontent.com/u/5818466?v=4","gravatar_id":"","url":"https://api.github.com/users/jondgoodwin","html_url":"https://github.com/jondgoodwin","followers_url":"https://api.github.com/users/jondgoodwin/followers","following_url":"https://api.github.com/users/jondgoodwin/following{/other_user}","gists_url":"https://api.github.com/users/jondgoodwin/gists{/gist_id}","starred_url":"https://api.github.com/users/jondgoodwin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jondgoodwin/subscriptions","organizations_url":"https://api.github.com/users/jondgoodwin/orgs","repos_url":"https://api.github.com/users/jondgoodwin/repos","events_url":"https://api.github.com/users/jondgoodwin/events{/privacy}","received_events_url":"https://api.github.com/users/jondgoodwin/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-04-12T21:20:25Z","updated_at":"2018-04-13T08:36:57Z","closed_at":null,"author_association":"COLLABORATOR","body":"The BitFunnel tool's termtable command requires that density and treatment be specified, but provides insufficient advice for choosing good values.\r\n\r\n* For density, 0.10, 0.15, and 0.20 are all appropriate. We tend to use 0.10 in tutorials to make the math easier, but the most common density is closer to 0.15. I think the SIGIR 2017 paper lists the densities we used for each shard. It’s not clear what the default should be because it depends on who is using the system. I’d hate to use 0.10 to simplify things and then have someone reject the system because it used too much memory.\r\n* We should default to Optimal and down the road, we might even remove the others. They were mainly useful for research (e.g. comparing naïve with optimal)."},"comment":{"url":"https://api.github.com/repos/BitFunnel/BitFunnel/issues/comments/381065951","html_url":"https://github.com/BitFunnel/BitFunnel/issues/401#issuecomment-381065951","issue_url":"https://api.github.com/repos/BitFunnel/BitFunnel/issues/401","id":381065951,"user":{"login":"jondgoodwin","id":5818466,"avatar_url":"https://avatars1.githubusercontent.com/u/5818466?v=4","gravatar_id":"","url":"https://api.github.com/users/jondgoodwin","html_url":"https://github.com/jondgoodwin","followers_url":"https://api.github.com/users/jondgoodwin/followers","following_url":"https://api.github.com/users/jondgoodwin/following{/other_user}","gists_url":"https://api.github.com/users/jondgoodwin/gists{/gist_id}","starred_url":"https://api.github.com/users/jondgoodwin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jondgoodwin/subscriptions","organizations_url":"https://api.github.com/users/jondgoodwin/orgs","repos_url":"https://api.github.com/users/jondgoodwin/repos","events_url":"https://api.github.com/users/jondgoodwin/events{/privacy}","received_events_url":"https://api.github.com/users/jondgoodwin/received_events","type":"User","site_admin":false},"created_at":"2018-04-13T08:36:57Z","updated_at":"2018-04-13T08:36:57Z","author_association":"COLLABORATOR","body":"When choosing a target density number, what is the trade-off the user making? I want to write help text that briefly summarizes what a lower density gives you vs. what a higher density gives you. I can also put more detailed explanation in the \"how to\" page on the website that describes document ingestion."}}
{"actor":{"display_login":"jondgoodwin"}}