This repo contains TensorRT-LLM engine files for Mistral-7B-instruct-v0.2 compiled on Windows 11 in single-GPU mode on a RTX 3080Ti GPU.
