Servers may choose to outline rules on the behaviour of internet bots by implementing a robots.txt file: this file is simply text stating the rules governing a bot's behaviour on that server. Any bot interacting with (or 'spidering') any server that does not follow these rules should, in theory, be denied access to, or removed from, the affected website.
For other uses, see Ignorance (disambiguation). Ignorance is a state of being uninformed or lack of knowledge. The word ignorant is an adjective describing a person in the state of being unaware and is often (incorrectly) used to describe individuals who deliberately ignore or disregard important information or facts.
So in short, the only time ignorance does not mean bliss is when you're the right person in the right place at the right time to gain something from this knowledge you have.