metadata
language:
- en
license: llama3.3
library_name: transformers
tags:
- Llama-3.3
- Instruct
- loyal AI
- fingerprint
- finetune
- chat
- gpt4
- synthetic data
- roleplaying
- unhinged
- funny
- opinionated
- assistant
- companion
- friend
- mlx
- mlx-my-repo
base_model: SentientAGI/Dobby-Unhinged-Llama-3.3-70B
mlx-community/Dobby-Unhinged-Llama-3.3-70B-mlx-4Bit
The Model mlx-community/Dobby-Unhinged-Llama-3.3-70B-mlx-4Bit was converted to MLX format from SentientAGI/Dobby-Unhinged-Llama-3.3-70B using mlx-lm version 0.26.4.
Use with mlx
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("mlx-community/Dobby-Unhinged-Llama-3.3-70B-mlx-4Bit")
prompt="hello"
if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, tokenize=False, add_generation_prompt=True
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)