Few days back, I was getting HTTP 404 error in my RSS Reader for some feeds. Some of them are very popular feeds and when I checked the feed XML content, I couldn't find any problem. After doing some step by step debugging I found an interesting thing - the path provided for the DTD in <!DCOTYPE... is no longer valid. When the XmlTextReader was trying to download the DTD from "http://my.netscape.com/pub... it got the exception "HTTP 404 error" and bubbled up to the top level....

Recently, I faced a problem where I need to ensure that someone really clicked on a link from a browser. One possible option could be using javascript instead of a direct link. But as many of the referrer sites have already set the link in their pages, I can't ask all of them to fix in their sites. And although this can solve bot or crawler but can't block if someone programmatically hits this page. The page link was like following: One option is the check on server side to prevent Crawler. But this...