{"action":"created","issue":{"url":"https://api.github.com/repos/r-public/room_utils/issues/6","repository_url":"https://api.github.com/repos/r-public/room_utils","labels_url":"https://api.github.com/repos/r-public/room_utils/issues/6/labels{/name}","comments_url":"https://api.github.com/repos/r-public/room_utils/issues/6/comments","events_url":"https://api.github.com/repos/r-public/room_utils/issues/6/events","html_url":"https://github.com/r-public/room_utils/issues/6","id":144784538,"number":6,"title":"Scrape the \"all rooms\" page","user":{"login":"mrdwab","id":802388,"avatar_url":"https://avatars.githubusercontent.com/u/802388?v=3","gravatar_id":"","url":"https://api.github.com/users/mrdwab","html_url":"https://github.com/mrdwab","followers_url":"https://api.github.com/users/mrdwab/followers","following_url":"https://api.github.com/users/mrdwab/following{/other_user}","gists_url":"https://api.github.com/users/mrdwab/gists{/gist_id}","starred_url":"https://api.github.com/users/mrdwab/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mrdwab/subscriptions","organizations_url":"https://api.github.com/users/mrdwab/orgs","repos_url":"https://api.github.com/users/mrdwab/repos","events_url":"https://api.github.com/users/mrdwab/events{/privacy}","received_events_url":"https://api.github.com/users/mrdwab/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2016-03-31T04:17:10Z","updated_at":"2016-03-31T07:41:40Z","closed_at":null,"body":"There should be a function to scrape the \"all rooms\" page (with the relevant options of at least \"active\" and \"people\") (http://chat.stackoverflow.com/?tab=all&sort=active and http://chat.stackoverflow.com/?tab=all&sort=people) and return a `data.frame` of the relevant URLs. This would make the package more generally relevant. \r\n\r\n@alistaire47, you seem to know what's up when it comes to scraping ;-) \r\n\r\nI'm guessing it's something along the lines of starting with:\r\n\r\n```r\r\nthe_url_i_want %>% \r\n  read_html() %>% \r\n  html_node('#roomlist') %>% \r\n  html_nodes(\"h3\") %>% \r\n  html_nodes(\"a\")\r\n```"},"comment":{"url":"https://api.github.com/repos/r-public/room_utils/issues/comments/203801502","html_url":"https://github.com/r-public/room_utils/issues/6#issuecomment-203801502","issue_url":"https://api.github.com/repos/r-public/room_utils/issues/6","id":203801502,"user":{"login":"romunov","id":544571,"avatar_url":"https://avatars.githubusercontent.com/u/544571?v=3","gravatar_id":"","url":"https://api.github.com/users/romunov","html_url":"https://github.com/romunov","followers_url":"https://api.github.com/users/romunov/followers","following_url":"https://api.github.com/users/romunov/following{/other_user}","gists_url":"https://api.github.com/users/romunov/gists{/gist_id}","starred_url":"https://api.github.com/users/romunov/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/romunov/subscriptions","organizations_url":"https://api.github.com/users/romunov/orgs","repos_url":"https://api.github.com/users/romunov/repos","events_url":"https://api.github.com/users/romunov/events{/privacy}","received_events_url":"https://api.github.com/users/romunov/received_events","type":"User","site_admin":false},"created_at":"2016-03-31T07:41:40Z","updated_at":"2016-03-31T07:41:40Z","body":"Of course you can. You need to specify exports in your roxygen part of the\nscript. See my examples here:\nhttps://github.com/romunov/zvau/blob/7135636db9d5a7436a35121dbbd26fd5c1396660/R/writeINEST.R\n\nOn Thu, Mar 31, 2016 at 9:24 AM, Edward Visel <notifications@github.com>\nwrote:\n\n> Check it out:\n> https://github.com/alistaire47/room_utils/blob/master/rooms.R\n>\n> I tried to get the roxygen comments roughly right, but please double-check\n> them before we integrate it; I'm still pretty new to package development.\n>\n> Also, I realized that despite prefixing all the non-base functions with ::,\n> the scraping scripts still won't run without importing a package with pipes\n> (unless we do something like magrittr::%>%, but that seems absurd), so I\n> just put library(magrittr) at the top. I'm not sure if there's a standard\n> way to deal with that issue, but I'm sure somebody has encountered it\n> before.\n>\n> —\n> You are receiving this because you are subscribed to this thread.\n> Reply to this email directly or view it on GitHub\n> <https://github.com/r-public/room_utils/issues/6#issuecomment-203794415>\n>\n\n\n\n-- \nIn God we trust, all others bring data.\n"}}