{"product_id":"9781633434233","title":"GPU Programming with Triton: Accelerate AI training and inference","description":"\u003ctable\u003e\u003ctbody\u003e\n\u003ctr\u003e\n\u003ctd style=\"\"\u003e\u003cstrong\u003eAuthor\/Contributor(s):\u003c\/strong\u003e\u003c\/td\u003e\n\u003ctd style=\"\"\u003eFartale, Harshwardhan \u003cbr\u003e\n\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd style=\"\"\u003e\u003cstrong\u003ePublisher:\u003c\/strong\u003e\u003c\/td\u003e\n\u003ctd\u003eManning\u003cbr\u003e\n\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd style=\"\"\u003e\u003cstrong\u003eDate:\u003c\/strong\u003e\u003c\/td\u003e\n\u003ctd\u003e3\/30\/2027\u003cbr\u003e\n\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd style=\"\"\u003e\u003cstrong\u003eBinding:\u003c\/strong\u003e\u003c\/td\u003e\n\u003ctd style=\"\"\u003ePaperback\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd style=\"\"\u003e\u003cstrong\u003eCondition:\u003c\/strong\u003e\u003c\/td\u003e\n\u003ctd style=\"\"\u003eNEW\u003cbr\u003e\n\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003c\/tbody\u003e\u003c\/table\u003e\u003cb\u003eGet the eBook free when you register your print book at Manning.\u003c\/b\u003e\u003cbr\u003e\u003cbr\u003eUntil recently, writing GPU kernels for LLM training and inference meant learning low-level programming tools like CUDA and C++. Triton, an open source, Python-based DSL created by OpenAI, bridges the gap between high-level machine learning frameworks and low-level GPU programming. Triton is built into PyTorch 2 and backed by NVIDIA, Intel, AMD, and Red Hat.\u003cbr\u003e \u003cbr\u003eIn this book, you'll learn how to work within the Triton ecosystem, from writing your first kernel to implementing advanced LLM features like FlashAttention and Native Sparse Attention. You'll use Triton to deliver the kernel-level control, fusion power, and acceleration that frameworks like PyTorch need under the hood without dropping down to CUDA and C++.\u003cbr\u003e \u003cbr\u003eIn this practical book written for readers with no previous GPU programming experience, author \u003cb\u003eHarshwardhan Fartale\u003c\/b\u003e introduces Triton’s innovative block-level programming model that replaces the tedious manipulation of low-level threads required by CUDA. Written for the latest hardware and LLMs, this book teaches GPU programming and Triton together, in Python, by profiling real workloads, identifying bottlenecks, and understanding why each optimization (coalescing, tiling, shared memory, reductions, and fusion) actually works.\u003cbr\u003e \u003cbr\u003eAs you go, you'll build the kernels that power modern AI systems, including FlashAttention, Native Sparse Attention, sparse matrix multiplication, and on-chip fused operations. You'll learn to profile real workloads, find the bottlenecks, wrap your kernel for production, and integrate it end to end into PyTorch. Each chapter includes handpicked practice problems designed to build the fluency that makes working in Triton feel like second nature.\u003cbr\u003e \u003cbr\u003e \u003cb\u003eWhat's inside\u003c\/b\u003e\u003cbr\u003e \u003cbr\u003e • Writing production-grade Triton kernels\u003cbr\u003e • Core optimization techniques\u003cbr\u003e • Building FlashAttention, Native Sparse Attention, and sparse matrix multiplication from scratch\u003cbr\u003e • Profiling real workloads and integrating custom Triton kernels into PyTorch\u003cbr\u003e • Reasoning about how GPUs actually execute your code\u003cbr\u003e \u003cbr\u003e\u003cb\u003eAbout the reader\u003c\/b\u003e\u003cbr\u003e \u003cbr\u003e For ML engineers and researchers comfortable with Python and PyTorch.\u003cbr\u003e \u003cbr\u003e \u003cb\u003eAbout the author\u003c\/b\u003e\u003cbr\u003e \u003cbr\u003e \u003cb\u003eHarshwardhan Fartale\u003c\/b\u003e is a researcher and engineer based in Bangalore, where he builds machine learning systems for scientific and defense applications. He has delivered courses in generative AI, machine learning, and MLOps to audiences ranging from university students to national research bodies.","brand":"Manning","offers":[{"title":"Default Title","offer_id":49089025704191,"sku":"9781633434233","price":69.99,"currency_code":"USD","in_stock":true}],"url":"https:\/\/massivebookshop.com\/de\/products\/9781633434233","provider":"MASSIVE BOOKSHOP","version":"1.0","type":"link"}