Aparently Alexa’s Web Search Platform was released on the 13th — just a few days ago. I just happened to run into it by accident while doing some research. Its not free, but it is powerful. Apparently its the same platform that they use to power Archive.org’s Wayback Machine.

I’m not a programmer. Sometimes I wish I was. Here is what “rca66″ on Slashdot had to say about this –

1. You have access to more than just the index - you have access to the crawled data, which is about 300 Terabyte(s). So, if you want to do something with the pages, you don’t have to download them, you don’t have to rely, that they are there - you can use the crawled data to do whatever you want.

This is good stuff.