Content
Dun & Bradstreet creates "AI-driven ESG intelligence built from deep coverage of private and public company data" and provides commercial data, analytics, and insights for businesses. If you need to scrape a lot of data from the Dun & Bradstreet commercial database, you probably already know that they don’t provide a very flexible or cost-effective API.
Dun & Bradstreet Scraper data scraper is essentially a tool for web scraping. It can crawl and extract company information, insights, financial projections, industry snapshots, and much more. It can scrape the huge D&B Data Cloud, Business Directory, articles, companies, and industries by search term.
Features
- Scrape companies: You can scrape companies from DnB by search term.
- Scrape articles: You can scrape articles by search term.
- Scrape industries: Retrieve industry insights by search term
- Scrape individual URLs: You can extract all data from any specific individual URLs.
Start URLs
Dun & Bradstreet Scraper tutorial with Start URLs
You can check the output of this video here.
Search
Dun & Bradstreet Scraper tutorial with Search mode
You can check the output of this video here.
Setup and usage
Go to Apify Store, just search for “dun” and click the very first result.
A detailed readme will welcome you with loads of ways you can use this Actor. You can check inputs, example outputs, learn how the Actor works, and see how much time and CU (compute units) it will consume.
There are two main ways to use Dun & Bradstreet Scraper. One is to provide “Start URLs” and the other one is to use “Mode” and “Search”. They can both be used at the same time.
A “Start URL” can be any company, article, or industry detail URL. The Actor will scrape all the URLs that you define here.
You can select a mode between “Companies”, “Articles” or “Industries” and use “Search” as your search keyword.
Example outputs
Scraped DnB Company
The structure of each company in DnB looks like this:
{
"Company Name":"NEXT BYTE PTY LTD",
"Company Summary":"NEXT BYTE PTY LTD is located in Albion, QUEENSLAND, Australia and is part of the Retail Sector Industry. NEXT BYTE PTY LTD has 1,440 total employees across all of its locations and generates $505.96 million in sales (USD). There are 54 companies in the NEXT BYTE PTY LTD corporate family.\n\nD&B Hoovers provides sales leads and sales intelligence data on over 120 million companies like NEXT BYTE PTY LTD around the world, including contacts, financials, and competitor information. To witness the full depth and breadth of our data and for industry leading sales intelligence tools, take D&B Hoovers for a test drive. Try D&B Hoovers FreeNEXT BYTE PTY LTD is located in Albion, QUEENSLAND, Australia and is part of the Retail Sector Industry. NEXT BYTE PTY LTD has 1,440 total employees across all of its locations and generates $505.96 million in sales (USD). There are 54 companies in the NEXT BYTE PTY LTD corporate family.",
"Company Type":"Proprietorship",
"Company Role":"Subsidiary",
"Website":"http://www.vitagroup.com.au",
"Location":{
"Street Address":"Vita Place 77 Hudson Rd",
"City":"Albion",
"Region":"QUEENSLAND",
"Postal Code":"4010",
"Country":"Australia"
},
"Phone":"+61-736246666\n \n Call Us\n \n (866) 258-3217",
"Description":"NEXT BYTE PTY LTD is located in Albion, QUEENSLAND, Australia and is part of the Retail Sector Industry. NEXT BYTE PTY LTD has 1,440 total employees across all of its locations and generates $505.96 million in sales (USD). There are 54 companies in the NEXT BYTE PTY LTD corporate family.",
"Key Principal":"MAXINE JOAN HORNE",
"Industry":[
"Retail Sector",
"Miscellaneous retail stores, nec",
"Computer and software stores",
"Computer related services, nec",
"Services, nec"
],
"Company Snapshot":{
"Employees (This Site)":"",
"Employees (All Sites)":"1,440",
"Revenue":"505.96",
"Year Started":"1997",
"Incorporated":"1997",
"Fiscal Year End":"JUN",
"Assets":"",
"Ticker Symbol":"",
"Net Income Growth":"",
"Sales Growth":""
},
"Financial Statements":{
"Cost Of Revenue":"",
"Gross Profit":"",
"Operating Income":"",
"Income Before Tax":"",
"Net income":"",
"Diluted EPS":""
},
"Competitors":[
],
"Principals":[
{
"Name":"MAXINE JOAN HORNE",
"Position":"Director"
},
{
"Name":"GEORGE EDWARD JAMES SOUTHGATE",
"Position":"Director"
}
],
"Breadcrumbs":[
"HOME",
"BUSINESS DIRECTORY",
"RETAIL",
"AUSTRALIA",
"QUEENSLAND",
"ALBION"
]
}
Scraped DnB Article
The structure of each article in DnB looks like this:
{
"Url":"https://www.dnb.com/perspectives/corporate-compliance/achieve-greater-fatca-and-crs-compliance.html",
"Title":"Achieve Greater FATCA and CRS Compliance More Efficiently",
"Breadcrumbs":[
"Home",
"Perspectives",
"Corporate Compliance"
],
"Author":"David Bolner",
"Date":"May 30, 2017",
"Related Articles":[
{
"Name":"Six Degrees of Separation: Why You Need to Be Smarter with Data",
"Link":"/perspectives/corporate-compliance/data-connectivity-relationships.html"
},
{
"Name":"A Record Year for FCPA Fines",
"Link":"/perspectives/corporate-compliance/2020-record-year-fcpa-settlement-amounts.html"
},
{
"Name":"Beneficial Ownership",
"Link":"/products/corporate-compliance/beneficial-ownership.html"
},
{
"Name":"Direct for Compliance",
"Link":"/products/corporate-compliance/direct-for-compliance.html"
},
{
"Name":"D&B Compass",
"Link":"/products/corporate-compliance/dnb-compass.html"
},
{
"Name":"D&B Onboard",
"Link":"/products/corporate-compliance/dnb-onboard.html"
},
{
"Name":"",
"Link":"/products.html"
}
],
"Cover Image":"https://www.dnb.com/content/dam/english/image-library/Modernization/workspaces/FACTA-and-crs-compliance.jpg",
"Body":"\n\n <p>Foreign Account Tax Compliance Act (FATCA) 2016 deadlines may have passed, but financial institutions (FIs) can achieve Common Reporting Standards (CRS) and FATCA compliance more easily in 2017 using data and technology, as well as lessons learned from 2016.<b></b></p>\n<h2>Pre-existing Account Review Process Is People-Intensive</h2>\n<p>FIs were expected to review their pre-existing accounts (a financial account opened prior to July 1, 2014) to document their account holders’ FATCA status during 2016. Once the accounts’ FATCA statuses are established, FIs would monitor the accounts for any change in circumstances. Many organizations went to great expense and effort to meet this goal with varying results. </p>\n<p></p>"
}
Scraped DnB Industry
The structure of each industry in DnB looks like this:
{
"SIC Codes":"7359",
"NAICS Codes":"532420",
"Related Industries":[
"Computer Networking Equipment Manufacturing",
"Commercial & Industrial Equipment Rental & Leasing",
"Computer & Office Equipment Wholesalers",
"Computer Manufacturing",
"Rental & Leasing"
],
"Description":"Companies in this industry lease technology and office equipment for use in business operations. Major companies include CSI Leasing, Electro Rent, Marlin Business Services, and SmartSource Rentals (all based in the US), along with Fuyo General Lease (Japan) and Syscap (the UK). Major manufacturers such as Hewlett Packard, Canon, and Xerox also offer technology leasing services.",
"Competitive Landscape":"Demand is driven by business activity, especially in industries that rely heavily on technology. The profitability of individual companies depends on the merchandising mix and the cost of financing rental inventory. Large companies have economies of scale in buying equipment and having multiple outlets to lease the equipment. Smaller companies can compete by providing specialty products for local markets and superior customer service. The US industry is concentrated: the top 50 companies account for about 85% of revenue.",
"Products, Operations & Technology":"Leasing of computers and peripheral equipment accounts for about 50% of industry revenue; leasing of office machinery, furniture, and fixtures accounts for about 30%."
}
Final words
Dun & Bradstreet Scraper is still under active development, and there are lots of powerful new features on the way. Please don’t hesitate to look me up if you have any feedback or feature requests.
P.S. You should always use a proxy to get the best results.
