With AlphaTensor, DeepMind Technologies has presented an AI system that is supposed to independently find novel, efficient and provably correct algorithms for complex mathematical tasks. AlphaTensor ...

Abstract: Sparse Matrix-Multivector (SpMM) multiplication is a key kernel for deep learning models and scientific computing applications. However, achieving high performance for SpMM on GPUs is ...

Abstract: Half-precision matrix multiply has played a key role in the training of deep learning models. The newly designed Nvidia Tensor Cores offer the native instructions for half-precision small ...

Hi, thanks for your great work on Transformer Engine! I am working on a project that requires high-performance batched matrix multiplication (i.e., 3D tensor multiplication) where all inputs are ...

AlphaTensor, builds upon AlphaZero, an agent that has shown superhuman performance on board games, like chess, Go and shogi, and this work shows the journey of AlphaZero from playing games to tackling ...

Researchers have created a new system that automatically produces code optimized for sparse data. We live in the age of big data, but most of that data is "sparse." Imagine, for instance, a massive ...

NVIDIA is today the most valuable company in the world, but things might not have turned out the same way had it ...

You can create a release to package software, along with release notes and links to binary files, for other people to use. Learn more about releases in our docs.

AMD software programmers have begun to distribute new fixes for the forthcoming GFX11 architecture, also known as RDNA3. According to a recent patch, AMD is working on their own instructions that can ...