How to scrape Transfermarkt

Natasha Lekh
Natasha Lekh

Anyone would like to have a money-printing machine - even we here at Apify wouldn’t mind owning one. This dream is what gets some people excited about speculating on sports betting and arbitrage algorithms. Sorry to disappoint you, but we can’t offer you some kind of a betting calculator able to collect and analyze data from different bookmakers and point at the winning team or player. After all, intuitive betting requires quite a lot of expertise in the field, deep analysis of the sports events and a dash of pure luck. Besides, we wouldn’t do it anyway, as we do not endorse gambling of any kind 🤨

However, what we can offer is an API for one of the best websites for following football events, accomplishments, team changes and the fastest capturing of livescores. And sometimes this is all you need: to get the necessary sports data quickly and from various sources, compare the odds with the expertise, and then try your luck. The first thing is something we can help with. So let’s see how a Transfermarkt API should work and how you can use it.

Why scrape Transfermarkt?

Fighting out arbitrage chances can be considered an art of its own. You can get plenty of useful insights from there, as Transfermarkt includes data on most major and minor leagues, individual players, teams content, as well as award winners of the past. You can also collect data on coach stats, special events, lineups, standings, pre-match odds, all kinds of statistics really, and of course, livescores. Transfermarkt’s stats are very adaptable and customizable, hence providing a comprehensive overview on historical data from all previous seasons to assist viewers in analyzing and forecasting upcoming match results. And the Transfers&Rumours and Forum pages deserve a highlight of their own as they have been considered quite reliable and accurate sources in the sports forecasting world.

Besides, when you explore Transfermarkt, you can also regard it as an educational resource, sort of a valuable encyclopedia of soccer statistics. You can see whether the opposing teams already have a history of facing each other, how they did before and use these insights for your arbitrage analysis. You can also scrape transfer news, fixtures, and player values on the market.

All these records of odds of football matches can be captured from a single URL page and quickly downloaded onto your computer to be used for further analysis to support and increase your forecast accuracy. Our Transfermarkt Scraper will ensure you get your records of odds of matches as soon as they appear on the website. You can also scrape data from any country-dependent subdomain of this website, be it German transfermarkt.de or American transfermarkt.us.

To summarize, this is how you can use the data extracted from Transfermarkt:

  • Consolidate web scraping efforts by monitoring this and other soccer-related websites simultaneously and combining extracted data.
  • Accumulating the knowledge of past games needed for analysis and sports results forecasts.
  • Creating data-based rules for a betting strategy.
  • Live monitoring and analysis of what motivates the evolution and changes in betting rates as well as what information influences betting decisions.

You can set up Transfermarkt Scraper to run automatically and regularly during matches. It will collect the records into your preferred format (e.g. as an Exel table). If a scraper does all the hard data collection work for you, it can make sports betting a bit more predictable and increase the chances of finding new arbitrage opportunities.

Step-by-step guide to scraping Transfermarkt

  1. Go over to apify.com website. Find the Solutions tab on the top and choose Apify Store button.

1-2

  1. Type in Transfermarkt into the Search bar and click on the dropdown list line once it appears. This will redirect you onto this actor’s own page.

2

  1. Once you’re on the Transfermarkt actor page (which will look like this) click the green Try for free button.
    3

  2. Log in or sign up for free using your email, gmail or Github.
    4

  3. Once you do that, you’ll be redirected to your Apify Console. You can consider it the workspace for your Transfermarkt scraper and other actors.

  4. A new Task for the Transfermarkt Scraper will be created automatically. To run this task, we need to fill in some input parameters first.
    6

  5. Leave the Apify Console for a moment and go over to the transfermarkt.com and pick the web page you want to scrape. Let’s say we want to scrape the data on a specific player, Robert Lewandowski. Find him at the Competitions page. The most important thing here now is simply to copy the URL that your search produced.
    7

  6. Now head back to the Apify task and click “+ Add URL”. Then simply paste your Transfermarkt URL into the appearing field. You can also tweak the crawlDepth and pageDepth parameters here. Mind that higher numbers will take longer to scrape and more CU off your plan. So if you want to stick with the most recent results, don’t set those parameters too high.
    8

  7. Once you’re all set with the optional parameters, click on the Save&Run button and wait for the actor’s run to finish.

  8. Notice that your task has changed its status to Running. Once the status moves to Succeeded, you can click on the Dataset tab to see the results of your transfermarkt scraping.
    10

  9. Explore the Dataset tab containing your scraped data in lots of formats, including HTML table, JSON, CSV, Excel, XML, and RSS feed. You can choose to upload it onto your computer for further use in spreadsheets, other programs or apps, or your own projects. You can also preview the data before downloading it by clicking the preview button.
    11

  10. The scraper has other customizable input parameters and we will be adding more of those in the future. Email us at support@apify.com if you have any questions at all.

One last little reminder: the job of our Transfermarkt scraper is to extract only the relevant information in a well-structured manner. So can it help you out with placing bets? Rather no than yes, but it will get all the info you need to make the right betting decisions.


You can also set up our Content Checker with enabled Slack integration to notify you every time there’s a new entry on a specific part of this website, although it’s not designed for scraping it. You can also check out our other sport-specific scraper, Soccerstats Scraper, and see how that one works for you, since it’s a bit more complex. Happy scraping and best of luck!



Great! Next, complete checkout for full access to Apify
Welcome back! You've successfully signed in
You've successfully subscribed to Apify
Success! Your account is fully activated, you now have access to all content
Success! Your billing info has been updated
Your billing was not updated