Find elements in Selenium by XPath
A guide to using XPath in Selenium, from basics to real-world examples.
Category
Python
Discover how Apify can help with Python, the dominant language in ML and data science. Explore web scraping with Scrapy, Beautiful Soup, and more.
77 Posts
Selenium wait for page to load
3 Selenium wait strategies. Learn their differences, use cases, and how to utilize them.
Scrapy vs. Beautiful Soup: which one to choose for web scraping
Beautiful Soup or Scrapy? We shed light on their differences so you can choose the best one for your web scraping project.
How to handle forms and authentication in Scrapy
Learn how to use Scrapy to deal with complex login forms and token authentication
How to handle timeouts in Python Requests
Learn to set connect and read timeouts, handle exceptions, and use timeouts with sessions and in a multithreaded environment.
MechanicalSoup: a good Python tool for web scraping?
Learn how MechanicalSoup compares with other Python tools like BeautifulSoup and Selenium
Python dictionaries: a comprehensive guide for devs
Learn how to modify and remove dictionaries and use built-in Python dictionary methods.
Web scraping HTML tables with Python
I scraped HTML tables from Yahoo Finance with Pandas, and I didn't even need to open DevTools!
How to use a proxy with Python Requests
A step-by-step guide to using proxies with the Python Requests library.
Python Playwright: a complete guide
A comprehensive Python guide for browser automation and web scraping with Playwright.
Web scraping with Python Requests
Learn how to send HTTP requests and handle responses with the Requests library.
Python CSS selectors and how to use them
A short guide to using CSS selectors with Selenium and Beautiful Soup.
How to post JSON data with Python Requests
Everything about sending a POST request with JSON data, including handling responses and potential errors.
Top 5 Python HTML parsers: which one should you use?
Explore the top Python HTML parsers and choose the one that suits your project requirements.
Scrapy vs. Selenium: how to choose between them for web scraping
What are Scrapy and Selenium good for? When should you opt for one over the other?
Pagination in Python: how to scrape a paginated website
Learn to build a scraper with Beautiful Soup to scrape paginated sites and deploy it to the cloud.
How to save an image with Python
Methods for downloading and saving images from URLs using Python libraries like shutil, OpenCV, matplotlib, and PIL.
Web scraping with JavaScript vs. Python in 2024
Two of the most popular programming languages. But which to use for web scraping in 2024?
