{"action":"created","issue":{"url":"https://api.github.com/repos/Azure/azure-storage-net/issues/231","repository_url":"https://api.github.com/repos/Azure/azure-storage-net","labels_url":"https://api.github.com/repos/Azure/azure-storage-net/issues/231/labels{/name}","comments_url":"https://api.github.com/repos/Azure/azure-storage-net/issues/231/comments","events_url":"https://api.github.com/repos/Azure/azure-storage-net/issues/231/events","html_url":"https://github.com/Azure/azure-storage-net/issues/231","id":133624053,"number":231,"title":"Why can't I add this HTTP header to my blobs?","user":{"login":"GuardRex","id":1622880,"avatar_url":"https://avatars.githubusercontent.com/u/1622880?v=3","gravatar_id":"","url":"https://api.github.com/users/GuardRex","html_url":"https://github.com/GuardRex","followers_url":"https://api.github.com/users/GuardRex/followers","following_url":"https://api.github.com/users/GuardRex/following{/other_user}","gists_url":"https://api.github.com/users/GuardRex/gists{/gist_id}","starred_url":"https://api.github.com/users/GuardRex/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/GuardRex/subscriptions","organizations_url":"https://api.github.com/users/GuardRex/orgs","repos_url":"https://api.github.com/users/GuardRex/repos","events_url":"https://api.github.com/users/GuardRex/events{/privacy}","received_events_url":"https://api.github.com/users/GuardRex/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":8,"created_at":"2016-02-15T05:06:54Z","updated_at":"2016-02-16T20:06:29Z","closed_at":null,"body":"I just learned that Googlebot-Image has been indexing images at my site, presumably because a `robots.txt` entry is only honored for LOCAL images ... those served from the site's domain. Images that are in Azure Storage (served by the Azure CDN) are on a different domain, thus Google indexes the images.\r\n\r\nTo stop this, Googlebot-Image needs to see this header on the blobs:\r\n```\r\nX-Robots-Tag: noindex\r\n```\r\nHowever, when I try to add this header (as a user-defined header) in CloudBerry Explorer for Azure Blob Storage, the header cannot be added.\r\n\r\nSo, what's up with this? Are you preventing me from adding the header? If so, why? If there is no good reason to stop me from adding the header, can you change your policy and allow its use? ... or do you have any other ideas?"},"comment":{"url":"https://api.github.com/repos/Azure/azure-storage-net/issues/comments/184857037","html_url":"https://github.com/Azure/azure-storage-net/issues/231#issuecomment-184857037","issue_url":"https://api.github.com/repos/Azure/azure-storage-net/issues/231","id":184857037,"user":{"login":"benaadams","id":1142958,"avatar_url":"https://avatars.githubusercontent.com/u/1142958?v=3","gravatar_id":"","url":"https://api.github.com/users/benaadams","html_url":"https://github.com/benaadams","followers_url":"https://api.github.com/users/benaadams/followers","following_url":"https://api.github.com/users/benaadams/following{/other_user}","gists_url":"https://api.github.com/users/benaadams/gists{/gist_id}","starred_url":"https://api.github.com/users/benaadams/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/benaadams/subscriptions","organizations_url":"https://api.github.com/users/benaadams/orgs","repos_url":"https://api.github.com/users/benaadams/repos","events_url":"https://api.github.com/users/benaadams/events{/privacy}","received_events_url":"https://api.github.com/users/benaadams/received_events","type":"User","site_admin":false},"created_at":"2016-02-16T20:06:29Z","updated_at":"2016-02-16T20:06:29Z","body":"> What I don't know is if they even look for it under these circumstances\r\n\r\nThey do as its the premise for all links as they are linked from somewhere else; though they cache the `robots.txt` for 24 hours at least so make sure you get it right :)"}}