Loading…
AITemplate is a Python framework that renders neural networks into high-performance CUDA/HIP C++ code for efficient inference. It specializes in FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) acceleration to maximize throughput. The project is open-source under the Apache-2.0 license and hosted by the facebookincubator organization on GitHub.
We haven’t found AITemplate in the AI answers we’ve checked.