Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
40.9
TFLOPS
10
11
3
Mohamed Mekkouri
medmekk
Follow
edbeeching's profile picture
eliebak's profile picture
anilkask's profile picture
15 followers
·
6 following
Mekkcyber
AI & ML interests
None yet
Articles
Fine-tuning LLMs to 1.58bit: extreme quantization made easy
22 days ago
•
147
Organizations
models
12
Sort: Recently updated
medmekk/Meta-Llama-3-8B-torchao-int8_weight_only
Updated
about 9 hours ago
•
2
medmekk/Llama-3.1-70B-torchao-int8_weight_only
Updated
1 day ago
•
32
medmekk/gpt2-torchao-int8_weight_only
Updated
1 day ago
•
2
medmekk/Meta-Llama-3-8B-torchao-int8_dynamic_activation_int8_weight
Updated
1 day ago
•
2
medmekk/Meta-Llama-3-8B-torchao-int4_weight_only-gs_256
Updated
1 day ago
•
2
medmekk/Meta-Llama-3-8B-torchao-int4_weight_only-gs-32
Updated
1 day ago
•
2
medmekk/Meta-Llama-3-8B-torchao-int4_weight_only-gs-64
Updated
1 day ago
•
2
medmekk/Meta-Llama-3-8B-quantized-int4_weight_only-2
Updated
1 day ago
•
2
medmekk/Meta-Llama-3-8B-quantized-int8_weight_only-2
Updated
1 day ago
•
2
medmekk/Meta-Llama-3-8B-quantized-int4_weight_only
Updated
1 day ago
•
2
Expand 12 models
datasets
None public yet