Comparing quality of search results: Google vs. Bing(startpage.com) |
Comparing quality of search results: Google vs. Bing(startpage.com) |
What I'd like to see the author do is this:
1) write a script to conduct the searches on Google and Bing, combine and save the top 20 results of each search to a spreadsheet, in random or alphabetical order.
2) using the spreadsheet alone, follow each link and rank the order the author thinks is most relevant.
3) compare the author's rankings with Google's and Bing's actual results
The fact that the author is judging search results while knowing which engine produced them... it makes something that is subjective to start with even more subjective.
It's why I chose terms in which I knew what results I wanted to begin with, and came up with the criteria before searching for them.
To run your study, I would have chosen to search terms I knew nothing about, and looked for results that better educated me. Through my method, I knew by searching for "Rust" I was looking for the programming language.
My method was not meant to be scientific, but I used as much of the scientific method as possible without the ability to a blind or double blind study.