{"action":"opened","issue":{"url":"https://api.github.com/repos/ruippeixotog/scala-scraper/issues/22","repository_url":"https://api.github.com/repos/ruippeixotog/scala-scraper","labels_url":"https://api.github.com/repos/ruippeixotog/scala-scraper/issues/22/labels{/name}","comments_url":"https://api.github.com/repos/ruippeixotog/scala-scraper/issues/22/comments","events_url":"https://api.github.com/repos/ruippeixotog/scala-scraper/issues/22/events","html_url":"https://github.com/ruippeixotog/scala-scraper/issues/22","id":145801366,"number":22,"title":"browser.get() not working for some URLs","user":{"login":"piercelamb","id":9285584,"avatar_url":"https://avatars.githubusercontent.com/u/9285584?v=3","gravatar_id":"","url":"https://api.github.com/users/piercelamb","html_url":"https://github.com/piercelamb","followers_url":"https://api.github.com/users/piercelamb/followers","following_url":"https://api.github.com/users/piercelamb/following{/other_user}","gists_url":"https://api.github.com/users/piercelamb/gists{/gist_id}","starred_url":"https://api.github.com/users/piercelamb/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/piercelamb/subscriptions","organizations_url":"https://api.github.com/users/piercelamb/orgs","repos_url":"https://api.github.com/users/piercelamb/repos","events_url":"https://api.github.com/users/piercelamb/events{/privacy}","received_events_url":"https://api.github.com/users/piercelamb/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":0,"created_at":"2016-04-04T20:52:17Z","updated_at":"2016-04-04T20:52:17Z","closed_at":null,"body":"Hi,\r\n\r\nI'm trying to scrape some public linkedin urls (ill use mine as an example) using:\r\n\r\nval browser = new Browser\r\nbrowser.get(\"https://www.linkedin.com/in/piercelamb\"). \r\n\r\nThis code is returning: \r\n\r\n\"org.jsoup.HttpStatusException: HTTP error fetching URL\"\r\n\r\nAnd in some cases, returning a \"status=999\" which doesn't make sense. I *can* parse that link using pure Jsoup code, i.e.\r\n\r\nJsoup.connect(\"https://www.linkedin.com/in/piercelamb\").get() just fine.\r\n\r\nI tried updating from the 0.1.1 version of your artifact to 0.1.2. Also dug into the code somewhat and saw that you seemed to separate out a trait for Browser and 2 classes, though this doesn't appear to be reflected in the artifact. The only difference from base Jsoup code appears to be your executePipeline(...) function which im trying to understand since it is likely causing the problem. Perhaps its the default cookies you pass in defaultRequestSettings?"}}