LLM inference · quantization · KV caching · Mixture of Experts · tensor parallellism · dynamic neural networks · torch compile · CUDA kernels