Скачать с ютуб LLM in a flash: Efficient Large Language Model Inference with Limited Memory в хорошем качестве

LLM in a flash: Efficient Large Language Model Inference with Limited Memory

In this video we review a recent important paper from Apple, titled: "LLM in a flash: Efficient Large Language Model Inference with Limited Memory". This paper presents a method to run large language models (LLMs) on devices that does not have enough memory to store the entire model's weights. This is an exciting progress in LLMs democratization as it brings closer to using top large language models on our personal computers or our phones. Watch the video to learn more about how this method works. Paper page - https://arxiv.org/abs/2312.11514 Blog post - https://aipapersacademy.com/llm-in-a-... ----------------------------------------------------------------------------------------------- ✉️ Join the newsletter - https://aipapersacademy.com/newsletter/ 👍 Please like & subscribe if you enjoy this content We use VideoScribe to edit our videos - https://tidd.ly/44TZEiX (affiliate) ----------------------------------------------------------------------------------------------- Chapters: 0:00 Introduction 1:25 Flash Memory & LLM Inference 3:42 Reduce Data Transfer 5:16 Increase Chunk Size