Tag: LLMOps

Advanced LLMOps Deploying and Managing LLMs in Production


Free Download Advanced LLMOps Deploying and Managing LLMs in Production
Released 7/2024
MP4 | Video: h264, 1280×720 | Audio: AAC, 44.1 KHz, 2 Ch
Skill Level: Advanced | Genre: eLearning | Language: English + srt | Duration: 1h 45m | Size: 197 MB
Cutting-edge artificial intelligence technologies are changing the world. But without proper deployment and management, your applications may never reach their full potential. Worse, they could simply fail or even cause critical errors in your systems. As more organizations are incorporating large language models into their workflows, there’s an increasing need for professionals skilled in deploying and monitoring these models effectively, responsibly, and securely in production environments. In this course, learn the advanced techniques and best practices for deploying and monitoring LLMs in production environments. Explore LLM deployment options, handling API limitations, performance monitoring techniques, prompt management, addressing hallucinations, and more. Plus, learn about security and cost considerations, and test your learning with challenges and solutions.

(more…)

Rust LLMOps


Free Download Rust LLMOps
Released: 07/2024
Duration: 3h 53m | .MP4 1280×720, 30 fps(r) | AAC, 48000 Hz, 2ch | 540 MB
Level: Intermediate | Genre: eLearning | Language: English
In this course, MLOps expert Noah Gift covers the Rust language through live coding. Discover an iterative approach to understand and master the language, particularly focusing on its applications in MLOps. After going over the tools and methodologies that you will use in this course, dive into infrastructure as code, monitoring and logging, and auditing networks. Explore several key topics around security, permissions, and privacy. Find out how software like Candle, Codespaces, and Starcoder can enhance your experience with Rust. Learn about serverless inference, as well as Rust CLI inference and Rust chat inference. Explore Rust-BERT, Rust-PyTorch, ONNX, and more. Explore several AI services and how you can leverage them with Rust. Plus, explore several live coding sessions with Rust Cargo Lambda.

(more…)