aghorbani/h2o-danube2-1.8b-chat-gguf

h2o-danube2-1.8b-chat - GGUF

• Model creator: H2O.ai
• Original model: h2o-danube2-1.8b-chat

Description

This repo contains GGUF format model files for h2o-danube2-1.8b-chat.

Provided files

• h2o-danube2-1.8b-chat-Q2_K.gguf
• h2o-danube2-1.8b-chat-Q3_K_M.gguf
• h2o-danube2-1.8b-chat-Q4_K_M.gguf
• h2o-danube2-1.8b-chat-Q5_K_M.gguf
• h2o-danube2-1.8b-chat-Q6_K.gguf