Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
RedHatAI
/
Llama-3.3-70B-Instruct-quantized.w4a16
like
4
Follow
Red Hat AI
2.87k
Text Generation
Safetensors
8 languages
llama
facebook
meta
llama-3
int4
vllm
chat
neuralmagic
llmcompressor
conversational
4-bit precision
compressed-tensors
arxiv:
2210.17323
License:
llama3.3
Model card
Files
Files and versions
xet
Community
2
Copy to bucket
new
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (1)
Sort: Recently created
Remove sparsity_config section
1
#2 opened about 2 months ago by
shivkaul
shivkaul