hanxiao commited on
Commit
5e52881
·
verified ·
1 Parent(s): 5307f8f

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +4 -2
README.md CHANGED
@@ -78,7 +78,9 @@ curl -X POST "http://127.0.0.1:8080/v1/embeddings" \
78
  }'
79
  ```
80
 
81
- To get fully consistent results as if you were using `AutoModel.from_pretrained("jinaai/jina-embeddings-v4")...`, you need to be very careful about the prefixes and manually add them to your GGUF model inputs. Here's a reference table:
 
 
82
 
83
  | Input Type | Task | `prompt_name` (Role) | Actual Input Processed by Model |
84
  |------------|------|-------------|-------------------------------|
@@ -91,7 +93,7 @@ To get fully consistent results as if you were using `AutoModel.from_pretrained(
91
  | **Image** | Any task | N/A | `<\|im_start\|>user\n<\|vision_start\|>\<\|image_pad\|>\<\|vision_end\|>Describe the image.\<\|im_end\|>` |
92
 
93
 
94
- To some users, ⚠️ indicates a somewhat surprising behavior where prompt_name='passage' gets overridden to "Query: " when using text-matching in the original AutoModel.from_pretrained("jinaai/jina-embeddings-v4").... However, this is reasonable since text-matching is a sentence similarity task with no left/right roles—the inputs are symmetric.
95
 
96
  You can also use `llama-embedding` for one-shot embedding:
97
 
 
78
  }'
79
  ```
80
 
81
+ ### Consistent Result vs `AutoModel.from_pretrained`
82
+
83
+ To get fully consistent results as if you were [using `AutoModel.from_pretrained("jinaai/jina-embeddings-v4")...`](https://huggingface.co/jinaai/jina-embeddings-v4#usage), you need to be **very careful** about the prefixes and manually add them to your GGUF model inputs. Here's a reference table:
84
 
85
  | Input Type | Task | `prompt_name` (Role) | Actual Input Processed by Model |
86
  |------------|------|-------------|-------------------------------|
 
93
  | **Image** | Any task | N/A | `<\|im_start\|>user\n<\|vision_start\|>\<\|image_pad\|>\<\|vision_end\|>Describe the image.\<\|im_end\|>` |
94
 
95
 
96
+ To some users, ⚠️ indicates a somewhat surprising behavior where `prompt_name='passage'` gets overridden to `"Query: "` when using `text-matching` in the original `AutoModel.from_pretrained("jinaai/jina-embeddings-v4")....` However, this is reasonable since `text-matching` is a sentence similarity task with no left/right roles—the inputs are symmetric.
97
 
98
  You can also use `llama-embedding` for one-shot embedding:
99