Category

Machine Learning

Apify can help you generate large-scale datasets from the web for the training of your artificial intelligence and machine learning models.
5 Posts
Vector databases for LLMs
AI

What is a vector database?

Vector databases are all the rage these days. The reason is simple: they’ve rapidly become a popular way to add long-term memory to LLMs such as GPT-4, LLaMDA, and LLaMA. Learn how vector databases can store ML embeddings to integrate with tools like ChatGPT.
Theo Vasilis
Theo Vasilis
AI and motherboard - Data ingestion for large language models
AI

What is data ingestion for large language models?

Data ingestion for LLMs is super easy… said no one ever! The fact is, it’s a complex process that involves collecting, preprocessing, and preparing data. Find out how to go about gathering and processing the data for your own large language models.
Theo Vasilis
Theo Vasilis
Web scraping is used to collect data for machine translation to bridge language barriers
Education

How web scraping is bridging language barriers

When a research team set out to build a machine translation module for Syrian and Moroccan migrants and refugees, it faced a significant challenge: how do you get enough data for dialects used only in casual conversation? This is how web scraping became the solution.
Theo Vasilis
Theo Vasilis