The (soon) open source search engine on object storage with sub-second latency

 https://quickwit.io/

Interesting project to build a low-cost web search. 

We build and maintain an open repository of web crawl data that can be accessed and analyzed by anyone.

 https://commoncrawl.org/

Interesting open data set of web crawl data sitting out on S3