The quality of search engines has gone down so much for technical questions.
I’m looking for a way to index sites like stack exchanges, reddit, quora, and research papers. Would this be possible to do this locally with metadata?
The quality of search engines has gone down so much for technical questions.
I’m looking for a way to index sites like stack exchanges, reddit, quora, and research papers. Would this be possible to do this locally with metadata?
Solr is a great search engine. It won’t help you with the crawling, but if you manage to get the data into Solr you have a come far.