Back to blog

LLMs

Discover how LLMs, such as GPT-4, can revolutionize your web scraping and automation workflow. Explore the power of natural language understanding, text generation, and context-aware responses to enhance data extraction, content analysis, and AI-driven applications. Unleash the potential of Apify's LLM integration to generate high-quality text, improve language processing tasks, and unlock new possibilities in automated data handling and communication.

23 Posts

LLM web scraping: illustration showing code snippets from using website content crawler

LLMs

Web crawling

LLM web scraping: using large language models to talk to websites

Discover a new way to interact with websites using large language models. Website Content Crawler makes it easy to ingest and process web content, turning any website into a conversational partner for your AI chatbot or LLM.

David Barton

Apr 17, 2024

LLMs

8 open-source LangChain alternatives

LangChain is a powerful framework for developing LLM apps, but it's not without its disadvantages. So what are the alternatives?

Theo Vasilis

Apr 3, 2024

Machine learning

LLMs

Text generation with Hugging Face

An exploration of the Hugging Face text-to-text generation pipeline.

Talha Irfan

Jan 30, 2024

Custom GPTs: how to upload a knowledge base to your GPT

LLMs

Web crawling

Custom GPTs: how to add a knowledge base

Collect and upload web data to your GPT's knowledge base in 5 easy steps.

Theo Vasilis

Jan 5, 2024

Data

Integration

LlamaIndex vs. LangChain

A guide to the functionalities of LlamaIndex and LangChain so you know when to use them.

Theo Vasilis

Dec 11, 2023

LLMs

Machine learning

What is data ingestion for large language models?

Learn about the process of collecting and preparing data for your own LLMs. Tools and tips included.

Theo Vasilis

Nov 23, 2023

Add custom actions to your GPTs with Apify Actors

ChatGPT

LLMs

Add custom actions to your GPTs with Apify Actors

Apify Actors now export the OpenAPI specs for their API, which makes it easy to call them from your GPTs and give them web scraping capability.

Jan Čurn

Nov 15, 2023

Pinecone vector database for large language models

LLMs

Machine learning

What is Pinecone and why use it with your LLMs?

The rise of generative AI resulted in a massive interest in vector databases, making Pinecone an industry leader.

Theo Vasilis

Nov 7, 2023

How to integrate Google Search into your AI apps

LLMs

Web scraping

How to integrate Google Search into your AI apps

A quick guide to creating an internet-access-enabled AI application.

Theo Vasilis

Nov 6, 2023

What is retrieval-augmented generation (RAG) and why use it for chatbots?

LLMs

Data

What is retrieval-augmented generation, and why use it for chatbots?

RAG is revolutionizing search and information retrieval. We explain how it works.

Theo Vasilis

Oct 16, 2023

What is multimodal AI and what can it do?

LLMs

Machine learning

Multimodal AI: what can it do, and why is it a game-changer?

Current uses of multimodal AI and implications for the future.

Theo Vasilis

Oct 4, 2023

LLMs

Of centaurs and cyborgs: how AI is reshaping work

Reflections on Navigating the Jagged Technological Frontier.

Theo Vasilis

Sep 25, 2023

Web scraping

Data

How to improve AI models with web scraping and data augmentation

The problems of AI degradation and model collapse and how to solve them.

Theo Vasilis

Sep 12, 2023

LLMs

Python

How to create a custom AI chatbot with Python

By the end of this short tutorial, you'll know how to use Python to develop a retrieval-augmented chatbot!

Jiří Moravčík

Aug 28, 2023

Illustration showing how Intercom's new AI chatbot uses Apify to ingest web data for customer support

Case studies

LLMs

How Intercom uses Apify to feed web data to its AI chatbot for customer support

Find out how Fin, Intercom’s new customer support AI chatbot, uses Apify's web crawling technology to leverage data from customer websites and documentation.

David Barton

Aug 15, 2023

Web scraping

LLMs

Web scraping for AI: how to collect data for LLMs

A tutorial that shows you how to crawl, extract, and process web data to feed, fine-tune, or train large language models.

Theo Vasilis

Aug 10, 2023

NLP vs. LLM: Natural language processing with large language models

LLMs

Machine learning

Traditional NLP techniques and the rise of LLMs

The field of NLP has changed with the rise of LLMs, but NLP still has a role to play. Apply NLP techniques to scraped data and learn about tokenization, stemming, lemmatization, removing stop words, and more NLP techniques.