not all of which get mentioned on every page. (Wikipedia and Facebook are two platforms with particularly thorough robot accounting.) Underneath, the robots.txt page lists sections or pages of the ...

Gina Trapani, Lifehacker's founding editor, is still married to her todo.txt file even after a sordid affair with Remember the Milk. Her weekly feature, Smarterware, appears every Wednesday on ...