How to scrape Bing search results

The impact of AI on Bing search will probably make scraping search results even more useful than before. In this step-by-step guide, we show you how to scrape Bing data.


“AI will fundamentally change every software category, starting with the largest category of all – search.”

- Satya Nadella, Chairman and CEO, Microsoft.

On February 7, 2023, Microsoft launched an all-new, AI-powered Bing search engine and Edge browser, currently available in preview at The goal, according to Microsoft, is “to deliver better search, more complete answers, a new chat experience, and the ability to generate content.”

New Bing and Google Bard announcement

At the same time, Google is preparing its own interactive chatbot, Bard (currently available only to a select group of beta testers). With these two leaders of the SERPs realm taking search engine results into a brave new world, it’s likely that Google and Bing SERPs will continue to be of immense importance in the future. AI-generated answers will continue to display online sources with web content relevant to the questions being asked. If citations and page suggestions in chat results drive traffic, then the quality and comprehensiveness of a web page’s content will become more, rather than less, vital.

Applications of ChatGPT and other large language models in web scraping
A few use cases for large language models used for web scraping.

All of this means that scraping Bing search results and extracting data from Google SERPs will remain efficient methods of collecting information for monitoring website performance, academic research, data analysis, and more.

The new Bing

Why scrape Bing search results?

Whatever the future holds, there’s no time like the present to scrape Bing. While Google remains the number one search engine in the world, on average, 1.114 billion people use Bing as their main tool for searching the web. Last year, the number of daily Bing searches reached 900 million. So we’re going to show you how to scrape Bing with a tool explicitly designed for the task. If you want to know how to do the same thing for Google, you can try Google Search Results Scraper. Go to this tutorial to learn how to use it, or follow the video guide below.

How to scrape Google search results video tutorial

How to scrape Bing search results

Step-by-step guide

Go to Bing Search Result Scraper

Step 1. Go to Bing Search Result Scraper in Apify Store

If you have an account, you’ll be taken directly to the scraper page. If you don’t, you’ll be prompted to sign up for free. You don’t need a credit card and there's no time limit on your free subscription. When you click the Try for free button, you’ll be able to configure the scraper to your liking.

How to scrape Bing search results. Step 1. Go to Bing Search Result Scraper in Apify Store

Step 2. Specify search queries or URLs

Choose the queries or URLs you wish to scrape, as in the default example below. You can add as many queries or URLs as you wish with the Add button.

How to scrape Bing search results. Step 2. Specify search queries or URLs

Step 3. Choose optional settings

You can configure the optimal settings to your needs. For example, you can change the maximum results per page or pages per query.

How to scrape Bing search results. Step 3. Choose optional settings

Step 4. Choose proxies

We recommend the default proxy setting, Automatic proxy, but you can also use selected or custom proxies and choose a proxy country.

How to scrape Bing search results. Step 4. Choose proxies

Step 5. Choose advanced settings

If you’re a developer, you can specify further parameters of the scrape in the advanced options.

How to scrape Bing search results. Step 5. Choose advanced settings

Step 6. Run the scraper and export the results

Once you’re happy with your settings, click the Start button at the bottom of the page, and the Bing scraper will start collecting your data. When the status changes from running to succeeded, you can preview and download your dataset in any of the formats provided.

How to scrape Bing search results. Step 6. Run the scraper and export the results

Below is a sample dataset from this run in JSON.

How to scrape Bing search results. Sample dataset in JSON

If you haven’t done it already, try Bing Search Result Scraper for yourself while following along with this tutorial.

Frequently asked questions

Does Bing allow scraping?

You can scrape Bing provided you follow its terms of use. However, keep in mind that some kinds of data are protected by international regulations, so be careful scraping personal data, intellectual property, or confidential data.

Since web scraping Bing and other search engines does not require a login, it is legal to scrape Bing search results as the data is publicly available. However, you may still be bound by the Bing terms of use. If you are unsure of the legal implications of your scraping, you can learn more in Is web scraping legal?

Can I use AI to scrape Bing?

AI is currently unable to scrape websites directly, but it can help generate code for scraping Bing if you prompt it with the target elements you want to scrape. Note that the code may not be functional, and website structure and design changes may impact the targeted elements and attributes.

What data can be scraped from Bing?

Scraping Bing can provide you with data such as:

  • Organic results
  • Related queries
  • See results for
  • Recommended searches
  • People Also Ask
  • Wiki results
  • News, Image, Video results

Does Bing search have APIs?

There are multiple Bing Search plans available in Bing Search API v7. The free tier provides three transactions per second and 1,000 transactions per month for all markets except Japan. You can find more information about the paid plans on the Bing Search API pricing page.

Natasha Lekh
Natasha Lekh
Crafting content that charms both readers and Google’s algorithms: readmes, blogs, and SEO secrets.
Theo Vasilis
Theo Vasilis
Writer, Python dabbler, and crafter of web scraping tutorials. Loves to inform, inspire, and illuminate. Interested in human and machine learning alike.

Get started now

Step up your web scraping and automation