Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
gstaff
/
TensorRT-LLM-engine-Mistral-7B-instruct-v0.2
like
0
Transformers
Inference Endpoints
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
TensorRT-LLM-engine-Mistral-7B-instruct-v0.2
1 contributor
History:
3 commits
gstaff
Create README.md
185d660
verified
3 months ago
.gitattributes
1.59 kB
Add TensorRT-LLM engine files for Mistral-7B-instruct-v0.2 compiled on Windows 11 NVIDIA GeForce RTX 3080Ti for single GPU mode.
3 months ago
README.md
193 Bytes
Create README.md
3 months ago
config.json
1.54 kB
Add TensorRT-LLM engine files for Mistral-7B-instruct-v0.2 compiled on Windows 11 NVIDIA GeForce RTX 3080Ti for single GPU mode.
3 months ago
llama_float16_tp1_rank0.engine
4.2 GB
LFS
Add TensorRT-LLM engine files for Mistral-7B-instruct-v0.2 compiled on Windows 11 NVIDIA GeForce RTX 3080Ti for single GPU mode.
3 months ago
model.cache
227 kB
Add TensorRT-LLM engine files for Mistral-7B-instruct-v0.2 compiled on Windows 11 NVIDIA GeForce RTX 3080Ti for single GPU mode.
3 months ago