TensorRT-LLM

tensorrt-llm · Machine learning, LLMs and agents · tool

Also known as: tensorrt-llm, tensorrt.

Part of: Model serving

The lesson for this

• Low-latency inference: TensorRT-LLM, quantization and edge deployment

Practice paths with this tool

• Practice: Low-latency inference: TensorRT-LLM, quantization and edge deployment

Pathways that reach it

• MLOps / ML platform engineer