Python

Discover how Apify can help with Python, the dominant language in ML and data science. Explore web scraping with Scrapy, Beautiful Soup, and more.

16 Posts

Python

Web scraping with Python Requests

Python has become a language widely used by developers because it's easy, efficient, and flexible. Here we're going to learn how to scrape websites with Python. We will learn a few basic concepts, but our main focus will be web scraping in Python with the Requests library.

Usama Jamil

May 24, 2023

Python

What are the best Python web scraping libraries?

Python developers have access to some of the best web scraping libraries and frameworks available. See how they work in practice and how to choose.

Percival Villalva

May 22, 2023

Python

How to parse JSON with Python

Understand JSON structure and syntax, and learn how to parse JSON strings and files using Python's built-in json module and convert JSON files using Pandas.

Percival Villalva

May 18, 2023

Web Scraping

What is web scraping?

Learn about the value of web scraping, the challenges of automated data extraction, and a range of tools for collecting information from websites.

Theo Vasilis

May 15, 2023

Scrapy

Web Scraping with Scrapy

Learn how to use Scrapy in real projects, taking advantage of its features and overcoming its limitations by using tools like Playwright.

Percival Villalva

Apr 17, 2023

Python

Web scraping with Beautiful Soup and Requests

Learn web scraping with Python's Beautiful Soup & Requests libraries. Extract data at scale for machine learning, data analysis, research, and more.

Percival Villalva

Mar 30, 2023

Web Scraping

Web scraping with Selenium and Python

In this step-by-step tutorial, we show you how to scrape data from a website using Python with Selenium. Learn how to locate and wait for elements, take screenshots, and execute JavaScript code with examples.

Theo Vasilis

Mar 29, 2023

Comparison

Beautiful Soup vs. Scrapy for web scraping

Many people who are just starting out with web scraping wonder what the differences are between Beautiful Soup and Scrapy. This post should shed some light on their different features and purposes and help you decide which one is better for your project.

Theo Vasilis

Mar 20, 2023

Python

Apify ❤️ Python: Releasing a Python SDK for Actors

Whether you are scraping with BeautifulSoup, Scrapy, Selenium, or Playwright, the Apify Python SDK helps you run your project in the cloud at any scale.

František Nesveda

Mar 14, 2023