{"action":"created","issue":{"url":"https://api.github.com/repos/zalandoresearch/flair/issues/67","repository_url":"https://api.github.com/repos/zalandoresearch/flair","labels_url":"https://api.github.com/repos/zalandoresearch/flair/issues/67/labels{/name}","comments_url":"https://api.github.com/repos/zalandoresearch/flair/issues/67/comments","events_url":"https://api.github.com/repos/zalandoresearch/flair/issues/67/events","html_url":"https://github.com/zalandoresearch/flair/issues/67","id":350342121,"node_id":"MDU6SXNzdWUzNTAzNDIxMjE=","number":67,"title":"'UnicodeDecodeError' when using functions defined in data_fetcher.py ","user":{"login":"iamyihwa","id":12494156,"node_id":"MDQ6VXNlcjEyNDk0MTU2","avatar_url":"https://avatars2.githubusercontent.com/u/12494156?v=4","gravatar_id":"","url":"https://api.github.com/users/iamyihwa","html_url":"https://github.com/iamyihwa","followers_url":"https://api.github.com/users/iamyihwa/followers","following_url":"https://api.github.com/users/iamyihwa/following{/other_user}","gists_url":"https://api.github.com/users/iamyihwa/gists{/gist_id}","starred_url":"https://api.github.com/users/iamyihwa/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/iamyihwa/subscriptions","organizations_url":"https://api.github.com/users/iamyihwa/orgs","repos_url":"https://api.github.com/users/iamyihwa/repos","events_url":"https://api.github.com/users/iamyihwa/events{/privacy}","received_events_url":"https://api.github.com/users/iamyihwa/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2018-08-14T09:08:07Z","updated_at":"2018-08-14T11:12:01Z","closed_at":null,"author_association":"NONE","body":"Hello \r\n\r\nI was following steps given in the documentations in [here](https://github.com/zalandoresearch/flair/blob/master/resources/docs/TUTORIAL_BASICS.md).\r\n\r\n\r\n**Situation:** \r\nI am trying to train a Spanish NER. The data I am using to train is similar is a CONLL format. \r\nThe error happened when I was testing a few options to load the input files. \r\nI have installed flair through git clone and installed from master branch. \r\nI first wanted to install via pip install however I wanted to train my own embedding and according to [this ](https://github.com/zalandoresearch/flair/blob/master/resources/docs/TUTORIAL_TRAINING_LM_EMBEDDINGS.md) it seems a feature available only through the git clone not from pip install. \r\n\r\n**When the error occurred:** \r\nWhen I ran the function to load the file \r\n```data = NLPTaskDataFetcher.read_conll_sequence_labeling_data('./data/esp2.train')```\r\nI got an error that said:  \r\n```UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 291: ordinal not in range(128)```\r\n\r\n**Screenshot of the error** \r\n![image](https://user-images.githubusercontent.com/12494156/44082776-7dcb6060-9fb2-11e8-8c4d-59183d402b5e.png)\r\n\r\n\r\n\r\n**What  I tried:** \r\nI have tried (1) different functions implemented in the file data_fetcher. (2) also gave option of encoding to 'utf-8' in  ```open(path_to_conll_file, encoding='utf-8')``` , but didn't solve the issue. \r\n\r\nI have also tried a couple of options to change system encoding but not so successful. \r\n\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/zalandoresearch/flair/issues/comments/412836966","html_url":"https://github.com/zalandoresearch/flair/issues/67#issuecomment-412836966","issue_url":"https://api.github.com/repos/zalandoresearch/flair/issues/67","id":412836966,"node_id":"MDEyOklzc3VlQ29tbWVudDQxMjgzNjk2Ng==","user":{"login":"stefan-it","id":20651387,"node_id":"MDQ6VXNlcjIwNjUxMzg3","avatar_url":"https://avatars1.githubusercontent.com/u/20651387?v=4","gravatar_id":"","url":"https://api.github.com/users/stefan-it","html_url":"https://github.com/stefan-it","followers_url":"https://api.github.com/users/stefan-it/followers","following_url":"https://api.github.com/users/stefan-it/following{/other_user}","gists_url":"https://api.github.com/users/stefan-it/gists{/gist_id}","starred_url":"https://api.github.com/users/stefan-it/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/stefan-it/subscriptions","organizations_url":"https://api.github.com/users/stefan-it/orgs","repos_url":"https://api.github.com/users/stefan-it/repos","events_url":"https://api.github.com/users/stefan-it/events{/privacy}","received_events_url":"https://api.github.com/users/stefan-it/received_events","type":"User","site_admin":false},"created_at":"2018-08-14T11:12:01Z","updated_at":"2018-08-14T11:12:01Z","author_association":"CONTRIBUTOR","body":"What is the output of `locale` on your commandline?"}}
{"actor":{"display_login":"stefan-it"}}