Hugging Face's logo

mlx-community
/
Jinx-gpt-oss-20b-mxfp4-mlx

Text Generation
MLX
Safetensors
gpt_oss
vllm
conversational
4-bit precision
Model card Files
xet
Community
Jinx-gpt-oss-20b-mxfp4-mlx
File size: 4,260 Bytes 
b247bcb
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
 
---
library_name: mlx
license: apache-2.0
pipeline_tag: text-generation
base_model: Jinx-org/Jinx-gpt-oss-20b-mxfp4
tags:
- vllm
- mlx
extra_gated_heading: You need to read and agree to the Disclaimer and User Agreementa
  to access this model.
extra_gated_description: '

  ## Disclaimer and User Agreement


  1. Introduction

  Thank you for your interest in accessing this model (“the Model”).

  Before you access, download, or use the Model or any derivative works, please read
  and understand this Disclaimer and User Agreement (“Agreement”).


  By checking “I have read and agree” and accessing the Model, you acknowledge that
  you have read, understood, and agreed to all terms of this Agreement.

  If you do not agree with any part of this Agreement, do not request or use the Model.


  2. Nature of the Model & Risk Notice

  The Model is trained using large-scale machine learning techniques and may generate
  inaccurate, false, offensive, violent, sexual, discriminatory, politically sensitive,
  or otherwise uncontrolled content.


  The Model does not guarantee the accuracy, completeness, or legality of any generated
  content. You must independently evaluate and verify the outputs, and you assume
  all risks arising from their use.


  The Model may reflect biases or errors present in its training data, potentially
  producing inappropriate or controversial outputs.


  3. License and Permitted Use

  You may use the Model solely for lawful, compliant, and non-malicious purposes in
  research, learning, experimentation, and development, in accordance with applicable
  laws and regulations.


  You must not use the Model for activities including, but not limited to:


  Creating, distributing, or promoting unlawful, violent, pornographic, terrorist,
  discriminatory, defamatory, or privacy-invasive content;


  Any activity that could cause significant negative impact on individuals, groups,
  organizations, or society;


  High-risk applications such as automated decision-making, medical diagnosis, financial
  transactions, or legal advice without proper validation and human oversight.


  You must not remove, alter, or circumvent any safety mechanisms implemented in the
  Model.


  4. Data and Privacy

  You are solely responsible for any data processed or generated when using the Model,
  including compliance with data protection and privacy regulations.


  The Model’s authors and contributors make no guarantees or warranties regarding
  data security or privacy.


  5. Limitation of Liability

  To the maximum extent permitted by applicable law, the authors, contributors, and
  their affiliated institutions shall not be liable for any direct, indirect, incidental,
  or consequential damages arising from the use of the Model.


  You agree to bear full legal responsibility for any disputes, claims, or litigation
  arising from your use of the Model, and you release the authors and contributors
  from any related liability.


  6. Updates and Termination

  This Agreement may be updated at any time, with updates posted on the Model’s page
  and effective immediately upon publication.


  If you violate this Agreement, the authors reserve the right to revoke your access
  to the Model at any time.


  I have read and fully understand this Disclaimer and User Agreement, and I accept
  full responsibility for any consequences arising from my use of the Model.'
extra_gated_button_content: I've read and agree
---

# mlx-community/Jinx-gpt-oss-20b-mxfp4-mlx

This model [mlx-community/Jinx-gpt-oss-20b-mxfp4-mlx](https://huggingface.co/mlx-community/Jinx-gpt-oss-20b-mxfp4-mlx) was
converted to MLX format from [Jinx-org/Jinx-gpt-oss-20b-mxfp4](https://huggingface.co/Jinx-org/Jinx-gpt-oss-20b-mxfp4)
using mlx-lm version **0.27.1**.

## Use with mlx

```bash
pip install mlx-lm
```

```python
from mlx_lm import load, generate

model, tokenizer = load("mlx-community/Jinx-gpt-oss-20b-mxfp4-mlx")

prompt = "hello"

if tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, add_generation_prompt=True
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)
```