Edit Models filters

Inference status

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

4,620

Full-text search

Active filters: 8-bit

HF1BitLLM/Llama3-8B-1.58-Linear-10B-tokens

Text Generation • Updated 21 days ago • 148 • 8

CyberNative/CyberBase-13b

Text Generation • Updated May 16 • 53 • 25

faisalahmedsifat/bloom-3b-convo-bangla-english-instruction-existing

Text Generation • Updated Nov 15, 2023 • 5 • 1

01-ai/Yi-6B-Chat-8bits

Text Generation • Updated Jul 29 • 167 • 9

Flurin17/whisper-large-v3-peft-swiss-german

Updated Feb 26 • 124 • 2

MaziyarPanahi/dolphin-2.5-mixtral-8x7b-GGUF

Text Generation • Updated Feb 4 • 370 • 4

MaziyarPanahi/Sensei-7B-V1-GGUF

Text Generation • Updated Feb 4 • 452 • 5

devlocalhost/blip2-opt-2.7b-xray-captions

Visual Question Answering • Updated Feb 11 • 3 • 1

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19 • 962 • 45

Vision-CAIR/MiniGPT4-Video

Updated Jul 24 • 32 • 28

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 1.33k • 117

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14 • 4.34k • 163

Entreprenerdly/blip2-opt-2.7b-fp16-sharded

Visual Question Answering • Updated Apr 26 • 1

RichardErkhov/mukayese_-_transformer-turkish-summarization-8bits

Text Generation • Updated May 9 • 14 • 1

PRATIKDE/gemma-7b_model_pratikndwaipayan

Text Generation • Updated Jun 22 • 5 • 2

lakkeo/stable-cypher-instruct-3b

Text Generation • Updated 6 days ago • 1.2k • 18

meta-llama/Llama-Guard-3-8B-INT8

Text Generation • Updated Aug 7 • 33.3k • 28

Qwen/Qwen2-VL-2B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated 19 days ago • 2.5k • 7

ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-GPTQ_Q8

Updated 13 days ago • 211 • 3

MaziyarPanahi/DeepSeek-V2.5-GGUF

Text Generation • Updated 28 days ago • 486 • 3

HF1BitLLM/Llama3-8B-1.58-100B-tokens

Text Generation • Updated 21 days ago • 2.27k • 48

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • Updated 26 days ago • 9.88k • 16

Qwen/Qwen2-VL-72B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated 16 days ago • 8.46k • 2

LoneStriker/Mistral-Small-Instruct-2409-8.0bpw-h8-exl2

Updated 22 days ago • 163 • 4

niruemon/llm-swp

Updated 16 days ago • 75 • 1

MikeRoz/TheDrummer_Cydonia-22B-v1-8.0bpw-h8-exl2

Updated 21 days ago • 54 • 3

DewEfresh/pixtral-12b-8bit

Updated 21 days ago • 3.27k • 9

LoneStriker/Qwen2.5-14B-Instruct-8.0bpw-h8-exl2

Text Generation • Updated 21 days ago • 14 • 1

LoneStriker/Qwen2.5-32B-Instruct-8.0bpw-h8-exl2

Text Generation • Updated 21 days ago • 27 • 1

brunopio/Llama3-8B-1.58-100B-tokens-GGUF

Text Generation • Updated 20 days ago • 326 • 4