A
arn
Guest
Member
What are people doing with robots.txt and no index on media gallery pages? Having just synced my entire attachment database, I don't think abruptly tossing up 800k thin content pages seems like a good idea.
robots.txt is not a great option since it also blocks link previews from Twitter, Facebook etc...
So that leaves "no index". But probably actually "no index, no follow" -- since i don't really want Google spending time crawling 800k no index pages. Anyone doing anything specific or...
Read more
robots.txt is not a great option since it also blocks link previews from Twitter, Facebook etc...
So that leaves "no index". But probably actually "no index, no follow" -- since i don't really want Google spending time crawling 800k no index pages. Anyone doing anything specific or...
Read more
Check out: