Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
13.5
TFLOPS
37
35
64
Marc Sun
marcsun13
Follow
scaraliu's profile picture
klebster's profile picture
atabeyunlu's profile picture
90 followers
·
129 following
_marcsun
SunMarc
AI & ML interests
LLM, Quantization, Training, Inference
Articles
Fine-tuning LLMs to 1.58bit: extreme quantization made easy
22 days ago
•
147
Accelerate 1.0.0
27 days ago
•
43
Llama 3.1 - 405B, 70B & 8B with multilinguality and long context
Jul 23
•
200
quanto: a pytorch quantization toolkit
Mar 18
•
28
Overview of natively supported quantization schemes in 🤗 Transformers
Sep 12, 2023
•
10
Making LLMs lighter with AutoGPTQ and transformers
Aug 23, 2023
•
29
Organizations
models
13
Sort:Â Recently updated
marcsun13/sft_openassistant-guanaco
Text Generation
•
Updated
Jul 5
•
7
marcsun13/gemma-2-27b-it-bnb-colab
Text Generation
•
Updated
Jul 4
•
25
marcsun13/gemma-2-9b-it-GPTQ
Text Generation
•
Updated
Jul 3
•
341
•
2
marcsun13/test_push_checkpoint
Fill-Mask
•
Updated
Jun 28
•
7
marcsun13/Mixtral-8x7B-v0.1-GPTQ
Text Generation
•
Updated
Dec 11, 2023
•
13
marcsun13/Mixtral-tiny-GPTQ
Text Generation
•
Updated
Dec 11, 2023
•
8
marcsun13/Llama-2-13B-AWQ
Text Generation
•
Updated
Nov 6, 2023
•
11
marcsun13/opt-125m-awq
Text Generation
•
Updated
Oct 30, 2023
•
19
marcsun13/opt-350m-gptq-4bit
Text Generation
•
Updated
Jul 31, 2023
•
468
marcsun13/gpt2-xl-linear-sharded
Updated
Jun 30, 2023
Expand 13 models
datasets
None public yet