<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/css" href="/stylesheets/rss.css"?>
<rss version="2.0" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:trackback="http://madskills.com/public/xml/rss/module/trackback/">
  <channel>
    <title>No Content, No Fuss: Google Webmaster tools</title>
    <link>http://anil.recoil.org/blog/articles/2006/12/28/google-webmaster-tools</link>
    <language>en-us</language>
    <ttl>40</ttl>
    <description>Anil Madhavapeddy</description>
    <item>
      <title>Google Webmaster tools</title>
      <description>&lt;p&gt;The conversion of the Recoil web services to external FastCGI pinned our &lt;a href="http://trac.edgewall.org/"&gt;Trac&lt;/a&gt; installation at &lt;a href="http://melange.recoil.org/"&gt;Melange&lt;/a&gt; as the source of the CPU hogging.  It turned out the Google crawler was indexing the entire source tree via Trac, causing it to go ballistic.&lt;/p&gt;

&lt;p&gt;I then stumbled on the latest cool Googlism: the &lt;a href="https://www.google.com/webmasters/tools/"&gt;Google Webmaster Tool&lt;/a&gt;, which lets you register your sites and displays options, diagnostics and statistics about how the Google crawler views your website.
I turned down the frequency at which Google hits the Trac installation (as well as installing a suitable &lt;a href="http://melange.recoil.org/robots.txt"&gt;robots.txt&lt;/a&gt; file).  This solved the immediate problem, but some of the search statistics were fun to check out as well.&lt;/p&gt;

&lt;p&gt;It turns out the &lt;a href="http://anil.recoil.org/gallery/"&gt;gallery&lt;/a&gt; is pretty highly ranked for &lt;a href="http://images.google.com/"&gt;image searches&lt;/a&gt;.  My trips to Japan seems to have made it big, with popular searches including "&lt;a href="http://images.google.com/images?q=shibuya&amp;amp;hl=en&amp;amp;ie=UTF-8&amp;amp;oe=UTF-8&amp;amp;sa=N&amp;amp;tab=wi"&gt;Shibuya&lt;/a&gt;", "&lt;a href="http://images.google.com/images?q=tokyo%20at%20night&amp;amp;hl=en&amp;amp;ie=UTF-8&amp;amp;oe=UTF-8&amp;amp;sa=N&amp;amp;tab=wi"&gt;tokyo at night&lt;/a&gt;", and "&lt;a href="http://images.google.com/images?q=japanese%20roof&amp;amp;hl=en&amp;amp;ie=UTF-8&amp;amp;oe=UTF-8&amp;amp;sa=N&amp;amp;tab=wi"&gt;japanese roof&lt;/a&gt;".  My random pictures of &lt;a href="http://images.google.com/images?q=buffalo%20india&amp;amp;hl=en&amp;amp;ie=UTF-8&amp;amp;oe=UTF-8&amp;amp;sa=N&amp;amp;tab=wi"&gt;indian buffaloes&lt;/a&gt;, &lt;a href="http://images.google.com/images?svnum=10&amp;amp;hl=en&amp;amp;lr=&amp;amp;q=smoggy+skyline&amp;amp;btnG=Search"&gt;smoggy skylines&lt;/a&gt; and &lt;a href="http://images.google.com/images?q=fried%20ice%20cream&amp;amp;hl=en&amp;amp;ie=UTF-8&amp;amp;oe=UTF-8&amp;amp;sa=N&amp;amp;tab=wi"&gt;fried ice-cream&lt;/a&gt; seem especially popular as well.  It's a wierd old Internet eh?&lt;/p&gt;

&lt;p&gt;The gallery has fallen a bit by the wayside in recent months.  I'll update it when I get back to Cambridge!&lt;/p&gt;</description>
      <pubDate>Thu, 28 Dec 2006 15:04:00 +0000</pubDate>
      <guid isPermaLink="false">urn:uuid:ae998dee-78ec-4f05-b751-1ff800d3f880</guid>
      <author>anil@recoil.org (Anil Madhavapeddy)</author>
      <link>http://anil.recoil.org/blog/articles/2006/12/28/google-webmaster-tools</link>
      <category>travel</category>
      <category>recoil</category>
      <category>net</category>
    </item>
    <item>
      <title>"Google Webmaster tools" by Anil</title>
      <description>&lt;p&gt;Quality, not quantity I guess.  Not something I believe in, from all the cameraphone shots in my gallery :)&lt;/p&gt;</description>
      <pubDate>Sat, 30 Dec 2006 01:46:00 +0000</pubDate>
      <guid isPermaLink="false">urn:uuid:210ee5ea-cb44-4151-96bc-dc602ffb0dcc</guid>
      <link>http://anil.recoil.org/blog/articles/2006/12/28/google-webmaster-tools#comment-585</link>
    </item>
    <item>
      <title>"Google Webmaster tools" by Alastair Tse</title>
      <description>&lt;p&gt;At least your keywords are relevent, instead I get lots of hits for nintendo screenshots from google images. And I have only a grand total of 2. Go figure.&lt;/p&gt;</description>
      <pubDate>Fri, 29 Dec 2006 10:16:54 +0000</pubDate>
      <guid isPermaLink="false">urn:uuid:7d77d2a1-b481-47f6-96a9-87819643d060</guid>
      <link>http://anil.recoil.org/blog/articles/2006/12/28/google-webmaster-tools#comment-582</link>
    </item>
  </channel>
</rss>
