GGUF quants for https://huggingface.co/Salesforce/SFR-Embedding-Mistral
NOTE: This is a text embedding model used for feature extraction.
As of Feb. 9, 2024 this model is no. 1 on the MTEB leaderboard.
https://huggingface.co/spaces/mteb/leaderboard
I have an example of how to use llama.cpp to generate embeddings for sentence similarity on my repo:
https://github.com/dranger003/llama.cpp-dotnet
| Layers | Context | Template |
|---|---|---|
32 |
32768 |
Instruct: {task_description} |
- Downloads last month
- 2,513