File size: 534 Bytes
84b730e b0ed94f 84b730e b0ed94f c221703 84b730e |
1 2 3 4 5 6 7 8 9 10 11 12 |
---
license: other
license_name: nvidia-open-model-license
license_link: >-
https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-open-model-license/
---
EXL3 quants of [Llama-3_1-Nemotron-Ultra-253B-v1](https://huggingface.co/nvidia/Llama-3_1-Nemotron-Ultra-253B-v1)
[2.00 bits per weight](https://huggingface.co/turboderp/Llama-3.1-Nemotron-Ultra-253B-v1-exl3/tree/2.0bpw)
[5.00 bits per weight](https://huggingface.co/turboderp/Llama-3.1-Nemotron-Ultra-253B-v1-exl3/tree/5.0bpw)
(more bitrates will follow) |