Update README.md
Browse files
README.md
CHANGED
@@ -83,3 +83,5 @@ You can also use `llama-embedding` for one-shot embedding:
|
|
83 |
```bash
|
84 |
llama-embedding -hf jinaai/jina-embeddings-v4-text-matching-GGUF:F16 --pooling mean -p "jina is awesome" 2>/dev/null
|
85 |
```
|
|
|
|
|
|
83 |
```bash
|
84 |
llama-embedding -hf jinaai/jina-embeddings-v4-text-matching-GGUF:F16 --pooling mean -p "jina is awesome" 2>/dev/null
|
85 |
```
|
86 |
+
|
87 |
+
Note, v4 is trained with Matryoshka embeddings, and converting to GGUF doesn't break the Matryoshka feature. Let's say you get embeddings with shape `NxD` - you can simply use `embeddings[:, :truncate_dim]` to get smaller truncated embeddings. Note that not every dimension is trained though. For v4, you can set `truncate_dim` to any of these values: `[128, 256, 512, 1024, 2048]`.
|