Large Scale Experimentation at Bing

Experimenting at large scale is fundamental for improving Bing. Last June, we published a blog in this Search Quality Insights series titled Experimentation and Continuous Improvement at Bing, which covered a specific type of experiments known as interleaving. In this blog, Dr. Ronny Kohavi describes our broader online experimentation efforts at large scale and includes compelling examples that illustrate the power of these efforts, e.g., he shows...
Read More

Safer Web Exploration with Bing

The internet’s massive reach and ever growing accessibility makes it an attractive place for cyber-criminals, who use it to distribute malware to unsuspecting users. To deliver malicious software to the user at large scale, savvy hackers increasingly try to game search engines to amplify the effect of their exploits by targeting frequently visited sites. At Bing our job is to not only deliver relevant results, but also provide a safe...
Read More

Experimentation and Continuous Improvement at Bing

One technical problem in Web search is how best to measure the quality of search results. Our powerful machine learning systems correct the spelling of your query, interpret your search intent, differentiate quality pages from junk, rank documents from our index of tens of billions of documents, and optimize whole-page layout. These systems, and many more, must all be optimized towards user satisfaction. The problem is that there is no perfect...
Read More

Ten Blue Links No More: Dynamic Page Sizing

Most search engines still provide a fixed number of web links on the search results page, typically 10 blue links in addition to instant answers. But are 10 blue links the right number of links for all queries and scenarios? Intuitively it doesn’t seem so. For example, showing fewer search results in navigational queries may enable users get to their desired URL faster. Also, users may benefit from seeing more blue links when they return to...
Read More

A Deeper Look at Autosuggest

Autosuggest enables people to select a query from a pull-down menu of suggestions when they start typing a query. You often find the query you want in the menu and select it, saving you extra keystrokes while reducing a chance of misspelling. It is a feature that people may take for granted but upon examination it involves a tremendous amount of technical sophistication and computational horsepower. In this blog Antonio Gulli who is our...
Read More

Building a State-of-the-Art Speller

Is it Swarzinegar, Swarneger, Scwarznagger or Schwartiznegar? These are just a few of more than 2,000 different ways users on Bing have typed their queries in hope of searching for “Schwarzenegger.” The aim of the Bing Speller is to correct these queries so users receive relevant web results that match their intent even when their query is misspelt. A great speller makes a search engine feel like magic to the users. In this blog my...
Read More

Behind the Bing It On Challenge

As I mentioned in my original post there has never been a more exciting or challenging time to be in the search space. The core to a great search engine has been and will always remain the same: delivering relevant, comprehensive and unbiased results that people can trust. We use thousands of signals from queries to documents and user feedback to determine the best search results and in turn make hundreds of improvements to our features every year...
Read More

Minimizing Answer Defects

Back in March, Jan Pedersen explored the topic of Whole Page Relevance. In the post, he outlined how Bing ranks media objects to deliver a rich set of results that go beyond just web pages using machine learning techniques. These objects include videos, images, maps, news items and assorted media objects or what we call answers. Today, Kieran McDonald will detail how we ensure that the answers are not defective and the results match the intent of...
Read More

Friends and Experts

  The foundation of web search has been built on keywords, links and clicks pointing to pages. This approach is great for finding web sites but search is more than about simply finding pages. With the help of social networks, people are able to share nearly everything they do in digital form and offer their opinions on almost every conceivable topic. From real-time streams to social conversations, connections are created that present the...
Read More

Scientific Research Contributions (I)

Researchers and engineers in Microsoft Research (MSR) and Bing R&D have been working closely together and have made significant contributions to the science of search. These contributions often start as basic research ideas published as scientific articles in international conferences and journals. These articles are reviewed by search experts from industry and academic institutions around the world, and only those that significantly advance...
Read More