{"action":"created","issue":{"url":"https://api.github.com/repos/facebookresearch/fastText/issues/103","repository_url":"https://api.github.com/repos/facebookresearch/fastText","labels_url":"https://api.github.com/repos/facebookresearch/fastText/issues/103/labels{/name}","comments_url":"https://api.github.com/repos/facebookresearch/fastText/issues/103/comments","events_url":"https://api.github.com/repos/facebookresearch/fastText/issues/103/events","html_url":"https://github.com/facebookresearch/fastText/issues/103","id":183987625,"number":103,"title":"FastText for semi supervised text classification","user":{"login":"nguyenhoan1988","id":2057220,"avatar_url":"https://avatars.githubusercontent.com/u/2057220?v=3","gravatar_id":"","url":"https://api.github.com/users/nguyenhoan1988","html_url":"https://github.com/nguyenhoan1988","followers_url":"https://api.github.com/users/nguyenhoan1988/followers","following_url":"https://api.github.com/users/nguyenhoan1988/following{/other_user}","gists_url":"https://api.github.com/users/nguyenhoan1988/gists{/gist_id}","starred_url":"https://api.github.com/users/nguyenhoan1988/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nguyenhoan1988/subscriptions","organizations_url":"https://api.github.com/users/nguyenhoan1988/orgs","repos_url":"https://api.github.com/users/nguyenhoan1988/repos","events_url":"https://api.github.com/users/nguyenhoan1988/events{/privacy}","received_events_url":"https://api.github.com/users/nguyenhoan1988/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2016-10-19T15:01:55Z","updated_at":"2016-11-16T16:24:25Z","closed_at":"2016-11-16T16:24:25Z","body":"I have a big dataset of Tweets (>100M) and only a small portion of those are labelled (~10K).\nI would like to use fasttext to train a model to detect the topic of a tweet.\nDo you have any methods to get use of all the data?\nOne way I could think of is train the word embedding model on the unlabelled tweets, then train the classifier on the labelled one.\n"},"comment":{"url":"https://api.github.com/repos/facebookresearch/fastText/issues/comments/260992890","html_url":"https://github.com/facebookresearch/fastText/issues/103#issuecomment-260992890","issue_url":"https://api.github.com/repos/facebookresearch/fastText/issues/103","id":260992890,"user":{"login":"EdouardGrave","id":10478219,"avatar_url":"https://avatars.githubusercontent.com/u/10478219?v=3","gravatar_id":"","url":"https://api.github.com/users/EdouardGrave","html_url":"https://github.com/EdouardGrave","followers_url":"https://api.github.com/users/EdouardGrave/followers","following_url":"https://api.github.com/users/EdouardGrave/following{/other_user}","gists_url":"https://api.github.com/users/EdouardGrave/gists{/gist_id}","starred_url":"https://api.github.com/users/EdouardGrave/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/EdouardGrave/subscriptions","organizations_url":"https://api.github.com/users/EdouardGrave/orgs","repos_url":"https://api.github.com/users/EdouardGrave/repos","events_url":"https://api.github.com/users/EdouardGrave/events{/privacy}","received_events_url":"https://api.github.com/users/EdouardGrave/received_events","type":"User","site_admin":false},"created_at":"2016-11-16T16:24:25Z","updated_at":"2016-11-16T16:24:25Z","body":"Hi @nguyenhoan1988,\r\nAs of now, a potential solution is to learn unsupervised word vectors on the unlabeled tweets (e.g. using `./fasttext skipgram`) and then use these vectors to initialize the classifier, using the `-pretrainedVectors` command line option. This option is used to specify a text file containing pre-trained word vectors (e.g. the `.vec` file outputed by `./fasttext skipgram`).\r\n\r\n```\r\n./fasttext skipgram -input UNLABELED_DATA -output UNSUP_VECTORS\r\n./fasttext supervised -input LABELED_DATA -output MODEL -pretrainedVectors UNSUP_VECTORS.vec\r\n```"}}
{"actor":{"display_login":"EdouardGrave"}}