Yahoo! Slurp Now Supports Wildcards in robots.txtYou can now use '*' in robots directives for Yahoo! Slurp to wildcard match a sequence of characters in your URL. You can use this symbol in any part of the URL string you provide in the robots directive.

Proposal for robots.txt To Have Greater Flexibility"The desire for greater control over how search engines index and display Web sites is driving an effort by leading news organizations and other publishers to revise a 13-year-old technology for restricting access."