EfficientML.ai Lecture 12 - Transformer and LLM (Part I) (MIT 6.5940, Fall 2023)
1:17:49
EfficientML.ai Lecture 12 - Transformer and LLM (Part I) (MIT …
11.1K viewsOct 20, 2023
YouTubeMIT HAN Lab
LLM in a flash: Efficient Large Language Model Inference with Limited Memory
6:28
LLM in a flash: Efficient Large Language Model Inference with Li…
4.8K viewsDec 23, 2023
YouTubeAI Papers Academy
Deep Dive: Optimizing LLM inference
36:12
Deep Dive: Optimizing LLM inference
44.6K viewsMar 11, 2024
YouTubeJulien Simon
Lianmin Zheng on Efficient LLM Inference with SGLang
22:57
Lianmin Zheng on Efficient LLM Inference with SGLang
1.7K views7 months ago
YouTubeAMD Developer Central
Mastering LLM Inference Optimization From Theory to Cost Effective Deployment: Mark Moyou
33:39
Mastering LLM Inference Optimization From Theory to Cost …
31.7K viewsJan 1, 2025
YouTubeAI Engineer
Efficient Streaming Language Models with Attention Sinks (Paper Explained)
Efficient Streaming Language Models with Attention Sinks (Pape…
37.5K viewsOct 14, 2023
YouTubeYannic Kilcher
Efficient LLM Inference (vLLM KV Cache, Flash Decoding & Lookahead Decoding)
45:44
Efficient LLM Inference (vLLM KV Cache, Flash Decoding & Lookahe…
9.2K viewsMar 1, 2024
YouTubeNoble Saji Mathews
34:14
Understanding the LLM Inference Workload - Mark Moyou, NVIDIA
22K viewsOct 1, 2024
YouTubePyTorch
3:34
Making inferences in literary texts | Reading | Khan Academy
416.9K viewsMar 27, 2020
YouTubeKhan Academy
GaLore EXPLAINED: Memory-Efficient LLM Training by Gradien…
10.6K viewsMay 27, 2024
YouTubeAI Coffee Break with Letitia
6:14
Rules of Inference - Basic Terminology
259.4K viewsMay 30, 2018
YouTubeNeso Academy
52:54
LLMs | Efficient LLM Decoding-II | Lec15.2
1.8K viewsOct 9, 2024
YouTubeLCS2
54:05
LLMs | Efficient LLM Decoding-I | Lec15.1
2.3K viewsOct 4, 2024
YouTubeLCS2
5:30
Efficient LLM FINE TUNING - LORA | Visualized and Explained LORA
3K viewsApr 3, 2024
YouTubeBiasVsVariance
1:20
Demo: Efficient FPGA-based LLM Inference Servers
1.8K viewsNov 7, 2024
YouTubeAltera
45:11
LLM inference optimization: Model Quantization and Distillation
1.2K viewsSep 22, 2024
YouTubeYanAITalk
45:32
A Survey of Techniques for Maximizing LLM Performance
220.4K viewsNov 13, 2023
YouTubeOpenAI
50:38
vLLM Office Hours - Model Quantization for Efficient vLLM Inf…
1.8K viewsJul 29, 2024
YouTubeNeural Magic
1:17
Efficient LLM inference solution on Intel GPU
722 viewsJan 18, 2024
bilibiliPaperWeekly
50:37
Practical LLM Inference in Modern Java by Alfonso² Peterssen, Alina …
2.7K viewsOct 11, 2024
YouTubeDevoxx
10:54
Boost Your AI Predictions: Maximize Speed with vLLM Library for Larg…
9.4K viewsNov 27, 2023
YouTubeVenelin Valkov
1:14
What Happens During Inference When You Ask an LLM a Question?
4.5K views6 months ago
YouTubeNVIDIA Developer
44:06
LLM inference optimization: Architecture, KV cache and Flash …
13.1K viewsSep 7, 2024
YouTubeYanAITalk
1:27:40
Probabilistic ML - Lecture 24 - Variational Inference
3.6K viewsAug 4, 2023
YouTubeTübingen Machine Learning
44:36
32. Rules of inference
31.5K viewsMar 1, 2021
YouTubeGATE CSE LECTURES BY AMIT KHURANA
55:39
Understanding LLM Inference | NVIDIA Experts Deconstruct How …
21.2K viewsApr 23, 2024
YouTubeDataCamp
30:25
Exploring the Latency/Throughput & Cost Space for LLM Inference // Ti…
26.6K viewsOct 25, 2023
YouTubeMLOps.community
Lecture 15 | Efficient Methods and Hardware for Deep Learning
186.7K viewsAug 11, 2017
YouTubeStanford University School of Engineering
18:32
Faster LLM Inference: Speeding up Falcon 7b (with QLoRA adapter) P…
10.2K viewsJun 11, 2023
YouTubeVenelin Valkov
17:05
WebLLM: A high-performance in-browser LLM Inference engine
20.6K viewsNov 21, 2024
YouTubeChrome for Developers
See more videos
Static thumbnail place holder