{"action":"closed","issue":{"url":"https://api.github.com/repos/joshbuchea/HEAD/issues/79","repository_url":"https://api.github.com/repos/joshbuchea/HEAD","labels_url":"https://api.github.com/repos/joshbuchea/HEAD/issues/79/labels{/name}","comments_url":"https://api.github.com/repos/joshbuchea/HEAD/issues/79/comments","events_url":"https://api.github.com/repos/joshbuchea/HEAD/issues/79/events","html_url":"https://github.com/joshbuchea/HEAD/issues/79","id":156280674,"number":79,"title":"meta name=robots is not deprecated","user":{"login":"4thana","id":8932386,"avatar_url":"https://avatars.githubusercontent.com/u/8932386?v=3","gravatar_id":"","url":"https://api.github.com/users/4thana","html_url":"https://github.com/4thana","followers_url":"https://api.github.com/users/4thana/followers","following_url":"https://api.github.com/users/4thana/following{/other_user}","gists_url":"https://api.github.com/users/4thana/gists{/gist_id}","starred_url":"https://api.github.com/users/4thana/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/4thana/subscriptions","organizations_url":"https://api.github.com/users/4thana/orgs","repos_url":"https://api.github.com/users/4thana/repos","events_url":"https://api.github.com/users/4thana/events{/privacy}","received_events_url":"https://api.github.com/users/4thana/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2016-05-23T13:28:35Z","updated_at":"2016-05-23T19:53:38Z","closed_at":"2016-05-23T19:53:38Z","body":"AFAIK meta name=robots is still the preferred way to tell Google and other search engines to crawl and/or include a page in their index or not. It is also neither deprecated nor is it ignored by the crawlers. \r\n\r\nYour mentioned alternatives do something completely different. If you want to remove pages from the Google index for example it doesn't help to prevent the bot from accessing the pages (either via robots.txt or .htaccess), you will only prevent the pages from getting updated in this way, but they will still remain in the Google index forever. The only way to do this is via this meta tag (also recommended by Google: https://support.google.com/webmasters/answer/93710?hl=en).\r\n\r\nWhere exactly did you get the idea that it is deprecated and ignored by bots? "}}
{"actor":{"display_login":"joshbuchea"}}