Скачать с ютуб PaliGemma by Google: Train Model on Custom Detection Dataset в хорошем качестве

PaliGemma by Google: Train Model on Custom Detection Dataset

Learn how to fine-tune PaliGemma, Google's open-source Vision-Language Model, for custom object detection tasks. This step-by-step tutorial walks you through modifying Google's notebook to train PaliGemma on your dataset. We'll use the handwritten digits and math operations dataset from RF100, explore the JSONL format, and demonstrate how to deploy your fine-tuned model for real-world inference. Discover the power of PaliGemma for image captioning, VQA, and object detection, and overcome its limitations. Chapters: - 00:00 PaliGemma Capabilities - 02:03 Environment Setup - 05:25 Dataset Format - 09:07 Downloading Pre-trained Model - 11:27 Loading Dataset - 13:45 Training and Evaluating the Model - 15:19 Deploying the Model - 17:37 Important Considerations - 20:02 Outro Resources: - Roboflow: https://roboflow.com - 🔴 Community Session June 6th, 2024 at 08:00 AM PST / 11:00 AM EST / 05:00 PM CET: https://roboflow.stream - ⭐ Notebooks GitHub: https://github.com/roboflow/notebooks - ⭐ Supervision GitHub: https://github.com/roboflow/supervision - 📓 PaliGemma notebook: https://colab.research.google.com/git... - 🗞 Gemma arXiv paper: https://arxiv.org/pdf/2403.08295 - 🗞 SigLIP arXiv paper: https://arxiv.org/pdf/2303.15343 - 🗞 PaliGemma blog post: https://blog.roboflow.com/how-to-fine... - 🔗 RF100: https://www.rf100.org - 🔗 PaliGemma model card: https://www.kaggle.com/models/google/... - 🔗 PaliGemma fine-tuned checkpoints: https://huggingface.co/collections/go... - 🔗 PaliGemma HF Space: https://huggingface.co/spaces/big-vis... Stay updated with the projects I'm working on at https://github.com/roboflow and https://github.com/SkalskiP! ⭐