Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Trelis
/
mpt-7b-instruct-hosted-inference-8bit
like
0
Text Generation
Transformers
PyTorch
mosaicml/dolly_hhrlhf
mpt
Composer
MosaicML
llm-foundry
hosted inference
8 bit
8bit
8-bit precision
custom_code
text-generation-inference
arxiv:
2205.14135
arxiv:
2108.12409
arxiv:
2010.04245
License:
cc-by-sa-3.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
mpt-7b-instruct-hosted-inference-8bit
1 contributor
History:
6 commits
RonanMcGovern
add inference guide
043bfe2
10 months ago
.gitattributes
1.52 kB
initial commit
10 months ago
README.md
10 kB
add inference guide
10 months ago
config.json
1.68 kB
Upload MPTForCausalLM
10 months ago
generation_config.json
112 Bytes
Upload MPTForCausalLM
10 months ago
pytorch_model.bin
pickle
Detected Pickle imports (5)
"torch._utils._rebuild_tensor_v2"
,
"torch.HalfStorage"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch.CharStorage"
What is a pickle import?
6.86 GB
LFS
Upload MPTForCausalLM
10 months ago
special_tokens_map.json
99 Bytes
Upload tokenizer
10 months ago
tokenizer.json
2.11 MB
Upload tokenizer
10 months ago
tokenizer_config.json
237 Bytes
Upload tokenizer
10 months ago