On May 16th I set up a /robots.txt file which instructs search engines not to index the Gallery (as well as some miscellaneous other pages). This has effectively dropped the Gallery out of search results as far as I can tell.
My motivation was to save bandwidth. I had mixed feelings about all the Gallery photos being so easily locatable. Now I have mixed feelings about them being so hard to find!
If you prefer to have your Gallery pages indexed by search engines, let me know and we’ll work something out.
If you have other nerdylorrin.net content you’d like to not let be indexed, I can add it to the list. But be aware that while search engines do honor /robots.txt, this should not be seen as a way of making anything private. In fact, one way to look for interesting things on a website is to open up the robots.txt file for a list of things not to look at!
