Multimodal Data Analysis with LLMs and Python – Tutorial

Показать описание

Learn how to analyze multimodal data with LLMs and Python. This tutorial covers:
- Classifying text with LLMs
- Answering questions about images
- Transcribing audio data (speech) to text
- Building a natural language query interface over an SQL database

✏️ Course developed by Immanuel Trummer, PhD

⭐️ Contents ⭐️
00:00 Introduction
01:29 Setup
05:44 Analyzing Text
32:25 Analyzing Images
52:10 Analyzing Audio Data
01:00:17 Analyzing Tables
01:42:05 Conclusion

freeCodeCamp.org

Рекомендации по теме

Комментарии

More on the topic in my book "Analyzing Multimodal Data with LLMs", available here:

immanueltrummer

OpenAI tokens are not exactly cheap for someone who is just getting started as a student. It is a shame that these LLMs cannot run properly in a locally hosted environment. However, if tutorials can be extended to other LLM models which are freely available, that might be really helpful.

strayedaway

Maybe this will work for simple queries. Queries on large dbs needs to be optimized and running blind will take down the db itself

rubberducky

Great content.. please can you make a playlist on A+ comptia

im_victor

awsome content, can i ask for the same but with gemini ?? that would be great

diegoc

@immanueltrummer4111, I wonder if it can handle two or more joining of tables. Have you tried that?

dadoll

I want a code to integrate code interpreter with llm how can I do it

thunder

Multimodal Data Analysis with LLMs and Python – Tutorial

Multimodal Data Analysis with LLMs and Python – Tutorial

How do Multimodal AI models work? Simple explanation

How Large Language Models Work

LLM Explained | What is LLM

LLM Chronicles #6.3: Multi-Modal LLMs for Image, Sound and Video

Integrating Multi-Modal Data with LLM and RAG for Clinical Decision Support.

Transformers (how LLMs work) explained visually | DL5

Building Multimodal AI RAG with LlamaIndex, NVIDIA NIM, and Milvus | LLM App Development

[2025 Spring] Using AI Verde - Multimodal/ Visual QA/OCR: Intro to LLM Compute for UA Campus

Llama-OCR + Multimodal RAG + Local LLM Python Project: Easy AI/Chat for your Docs

LLMs (Large Language Models) in Finance: Multimodal, Multi-model, and Open Vs. Closed Systems

[1hr Talk] Intro to Large Language Models

How to Fine-Tune and Train LLMs With Your Own Data EASILY and FAST - Encord!

EASIEST Way to Fine-Tune a LLM and Use It With Ollama

How Does Rag Work? - Vector Database and LLMs #datascience #naturallanguageprocessing #llm #gpt

Multimodality and Data Fusion Techniques in Deep Learning

Running Chunks through Embedding Models

MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning

Manning Introduces: AI-Assisted Data Science

Multimodal AI from First Principles - Neural Nets that can see, hear, AND write.

🤵 Discover unparalleled data-driven strategic analysis with our SHIFU plan!

LLMs and Multimodal AI with Stefania Druga of Google | Episode 1

NExT-GPT: The first Any-to-Any Multimodal LLM

📊Harness data power with Jeda.ai Interactive Charts and Filters