\+ TransCLIP-ZS | $\text{69.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{73.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.2}}}}$ | $\text{34.8}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.8}}}}$ | $\text{73.9}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{1.0}}}}$ | $\text{80.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.2}}}}$ | $\text{82.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.7}}}}$ | $\text{90.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$ | $\text{95.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.6}}}}$ | $\text{94.5}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.1}}}}$ | $\text{68.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.2}}}}$ | $\text{82.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.3}}}}$ | $\text{77.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.7}}}}$

Table 11: TransCLIP atop inductive vision-language zero-shot and popular few-
shot methods for ViT-B/32 vision encoder.

| Method |  ImageNet |  SUN397 |  Aircraft |  EuroSAT |  StanfordCars |  Food101 |  Pets |  Flower102 |  Caltech101 |  DTD |  UCF101 |  Average
---|---|---|---|---|---|---|---|---|---|---|---|---|---
0-shot | CLIP-ViT-B/32 | 61.9 | 62.1 | 19.1 | 45.2 | 60.2 | 80.4 | 87.4 | 66.5 | 91.5 | 42.7 | 63.6 | 61.9
\+ TransCLIP-ZS | $\text{64.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.0}}}}$ | $\text{67.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.5}}}}$ | $\text{20.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.3}}}}$ | $\text{59.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{13.8}}}}$ | $\text{63.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.2}}}}$ | $\text{81.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{89.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{74.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{7.9}}}}$ | $\text{91.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.3}}}}$ | $\text{50.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{7.7}}}}$ | $\text{68.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.1}}}}$ | $\text{66.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.6}}}}$
1-shot | CoOp | 60.8 | 63.3 | 15.6 | 51.9 | 59.5 | 75.7 | 87.7 | 71.5 | 91.8 | 47.1 | 66.0 | 62.8
\+ TransCLIP-ZS | $\text{63.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.1}}}}$ | $\text{68.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.0}}}}$ | $\text{17.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.0}}}}$ | $\text{64.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{13.0}}}}$ | $\text{63.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.9}}}}$ | $\text{78.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.0}}}}$ | $\text{89.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.5}}}}$ | $\text{84.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{12.8}}}}$ | $\text{92.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.4}}}}$ | $\text{53.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.9}}}}$ | $\text{71.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.9}}}}$ | $\text{68.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.1}}}}$
TIP-Adapter-F | 64.3 | 65.4 | 22.2 | 59.7 | 61.1 | 80.4 | 87.5 | 81.1 | 92.4 | 50.9 | 66.5 | 66.5
\+ TransCLIP-ZS | $\text{66.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.1}}}}$ | $\text{69.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.5}}}}$ | $\text{23.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{71.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{12.1}}}}$ | $\text{64.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.7}}}}$ | $\text{81.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.0}}}}$ | $\text{89.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.9}}}}$ | $\text{89.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{8.5}}}}$ | $\text{92.3}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.2}}}}$ | $\text{55.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.0}}}}$ | $\text{72.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.9}}}}$ | $\text{70.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.1}}}}$
TaskRes | 64.6 | 65.3 | 23.8 | 60.8 | 62.4 | 79.0 | 84.6 | 77.7 | 91.2 | 52.7 | 67.5 | 66.3
\+ TransCLIP-ZS | $\text{66.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.1}}}}$ | $\text{69.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.5}}}}$ | $\text{23.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.1}}}}$ | $\text{73.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{12.6}}}}$ | $\text{64.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.8}}}}$ | $\text{80.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{88.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.5}}}}$ | $\text{86.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{8.9}}}}$ | $\text{91.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.5}}}}$ | $\text{57.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.3}}}}$ | $\text{72.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.3}}}}$ | $\text{70.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.1}}}}$
ProGrad | 62.0 | 64.8 | 21.1 | 53.5 | 60.5 | 78.2 | 87.9 | 74.4 | 91.5 | 51.1 | 66.6 | 64.7
\+ TransCLIP-ZS | $\text{64.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.9}}}}$ | $\text{69.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.4}}}}$ | $\text{22.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{63.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{9.8}}}}$ | $\text{63.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.1}}}}$ | $\text{80.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.0}}}}$ | $\text{89.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{86.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{12.0}}}}$ | $\text{92.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.6}}}}$ | $\text{55.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.7}}}}$ | $\text{72.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.4}}}}$ | $\text{69.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.3}}}}$
4-shot | CoOp | 63.2 | 67.1 | 24.1 | 67.8 | 66.4 | 75.5 | 88.8 | 87.6 | 92.9 | 55.1 | 74.9 | 69.4
\+ TransCLIP-ZS | $\text{65.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.6}}}}$ | $\text{70.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.7}}}}$ | $\text{25.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.3}}}}$ | $\text{77.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{9.4}}}}$ | $\text{69.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.0}}}}$ | $\text{78.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.3}}}}$ | $\text{90.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{92.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.4}}}}$ | $\text{93.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.5}}}}$ | $\text{59.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.2}}}}$ | $\text{79.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.4}}}}$ | $\text{72.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.5}}}}$
TIP-Adapter-F | 65.8 | 68.3 | 28.8 | 71.5 | 67.6 | 80.9 | 88.6 | 88.9 | 94.6 | 58.0 | 75.1 | 71.6
\+ TransCLIP-ZS | $\text{67.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{72.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.7}}}}$ | $\text{28.5}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.3}}}}$ | $\text{76.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.3}}}}$ | $\text{68.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.9}}}}$ | $\text{81.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.8}}}}$ | $\text{90.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.6}}}}$ | $\text{92.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.5}}}}$ | $\text{93.8}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.8}}}}$ | $\text{62.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.1}}}}$ | $\text{78.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.5}}}}$ | $\text{73.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.2}}}}$
TaskRes | 66.1 | 70.1 | 25.3 | 68.8 | 69.5 | 80.4 | 87.3 | 81.8 | 93.9 | 57.9 | 71.7 | 70.2
\+ TransCLIP-ZS | $\text{67.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{72.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.6}}}}$ | $\text{25.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.4}}}}$ | $\text{77.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{8.3}}}}$ | $\text{70.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.8}}}}$ | $\text{81.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{90.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.7}}}}$ | $\text{88.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.5}}}}$ | $\text{94.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.3}}}}$ | $\text{61.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.0}}}}$ | $\text{76.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.4}}}}$ | $\text{73.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.0}}}}$
ProGrad | 65.2 | 69.6 | 24.8 | 63.0 | 66.5 | 79.2 | 89.4 | 87.7 | 93.4 | 56.1 | 73.7 | 69.9
\+ TransCLIP-ZS | $\text{67.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.9}}}}$ | $\text{72.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.0}}}}$ | $\text{25.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.8}}}}$ | $\text{74.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{11.0}}}}$ | $\text{69.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.9}}}}$ | $\text{80.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{91.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{92.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.0}}}}$ | $\text{92.8}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.5}}}}$ | $\text{61.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.1}}}}$ | $\text{78.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.3}}}}$ | $\text{73.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.4}}}}$
16-shot | CoOp | 66.8 | 72.3 | 32.8 | 82.4 | 76.1 | 78.6 | 88.8 | 95.5 | 94.9 | 64.9 | 78.5 | 75.6
\+ TransCLIP-ZS | $\text{68.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.6}}}}$ | $\text{74.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.9}}}}$ | $\text{32.7}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.1}}}}$ | $\text{84.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.6}}}}$ | $\text{77.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.0}}}}$ | $\text{80.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.2}}}}$ | $\text{90.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$ | $\text{95.5}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.0}}}}$ | $\text{95.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.5}}}}$ | $\text{67.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.4}}}}$ | $\text{81.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.7}}}}$ | $\text{77.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$
TIP-Adapter-F | 68.4 | 74.1 | 34.8 | 83.4 | 77.0 | 81.7 | 90.4 | 94.3 | 95.1 | 68.0 | 80.5 | 77.1
\+ TransCLIP-ZS | $\text{69.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.5}}}}$ | $\text{74.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.7}}}}$ | $\text{35.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.2}}}}$ | $\text{84.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.7}}}}$ | $\text{77.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.3}}}}$ | $\text{82.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.3}}}}$ | $\text{91.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.6}}}}$ | $\text{95.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.0}}}}$ | $\text{95.1}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.1}}}}$ | $\text{67.4}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.6}}}}$ | $\text{82.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.0}}}}$ | $\text{77.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.5}}}}$
TaskRes | 68.2 | 73.5 | 37.0 | 76.9 | 78.1 | 81.4 | 89.4 | 95.5 | 95.6 | 68.1 | 80.3 | 76.7
\+ TransCLIP-ZS | $\text{69.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{74.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.0}}}}$ | $\text{35.3}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{1.7}}}}$ | $\text{80.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.4}}}}$ | $\text{77.2}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.8}}}}$ | $\text{82.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.6}}}}$ | $\text{90.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.3}}}}$ | $\text{95.1}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.4}}}}$ | $\text{94.8}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.9}}}}$ | $\text{67.8}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.4}}}}$ | $\text{82.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.0}}}}$ | $\text{77.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.5}}}}$
ProGrad | 66.9 | 73.2 | 33.2 | 80.6 | 76.2 | 80.2 | 89.4 | 95.1 | 95.0 | 65.3 | 80.0 | 75.9
\+ TransCLIP-ZS | $\text{68.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.5}}}}$ | $\text{74.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.5}}}}$ | $\text{33.2}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.0}}}}$ | $\text{82.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.2}}}}$ | $\text{77.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.9}}}}$ | $\text{81.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$ | $\text{90.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.0}}}}$ | $\text{95.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.3}}}}$ | $\text{94.3}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.8}}}}$ | $\text{67.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.5}}}}$ | $\text{82.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.8}}}}$ | $\text{77.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.2}}}}$

Table 12: TransCLIP atop inductive vision-language zero-shot and popular few-
shot methods for ViT-B/16 vision encoder.

| Method |  ImageNet |  SUN397 |  Aircraft |  EuroSAT |  StanfordCars |  Food101 |  Pets |  Flower102 |  Caltech101 |  DTD |  UCF101 |  Average
---|---|---|---|---|---|---|---|---|---|---|---|---|---
0-shot | CLIP-ViT-B/16 | 66.6 | 62.5 | 24.7 | 48.3 | 65.6 | 85.9 | 89.1 | 70.7 | 93.2 | 43.5 | 67.5 | 65.3
\+ TransCLIP-ZS | $\text{70.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.7}}}}$ | $\text{68.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.3}}}}$ | $\text{26.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.2}}}}$ | $\text{65.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{16.8}}}}$ | $\text{69.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.8}}}}$ | $\text{87.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.2}}}}$ | $\text{92.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.5}}}}$ | $\text{76.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.9}}}}$ | $\text{92.7}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.5}}}}$ | $\text{49.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.0}}}}$ | $\text{74.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.9}}}}$ | $\text{70.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.1}}}}$
1-shot | CoOp | 65.7 | 66.9 | 20.7 | 56.4 | 67.6 | 84.3 | 90.2 | 78.2 | 92.5 | 50.1 | 71.2 | 67.6
\+ TransCLIP-ZS | $\text{69.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.6}}}}$ | $\text{71.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.6}}}}$ | $\text{23.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.1}}}}$ | $\text{65.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{8.9}}}}$ | $\text{71.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.3}}}}$ | $\text{86.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.0}}}}$ | $\text{91.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.8}}}}$ | $\text{89.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{11.5}}}}$ | $\text{93.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.3}}}}$ | $\text{55.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.4}}}}$ | $\text{77.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.5}}}}$ | $\text{72.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.8}}}}$
TIP-Adapter-F | 69.5 | 67.2 | 28.8 | 67.8 | 67.1 | 85.8 | 90.6 | 83.7 | 94.0 | 51.6 | 73.4 | 70.9
\+ TransCLIP-ZS | $\text{72.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.5}}}}$ | $\text{71.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.6}}}}$ | $\text{30.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.9}}}}$ | $\text{76.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{9.1}}}}$ | $\text{71.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.9}}}}$ | $\text{86.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{93.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.4}}}}$ | $\text{92.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{9.1}}}}$ | $\text{93.5}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.5}}}}$ | $\text{57.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.1}}}}$ | $\text{80.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.7}}}}$ | $\text{75.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.3}}}}$
PLOT | 66.9 | 67.0 | 28.9 | 72.8 | 68.5 | 84.9 | 91.9 | 81.8 | 94.0 | 52.8 | 74.7 | 71.3
\+ TransCLIP-ZS | $\text{75.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{8.9}}}}$ | $\text{70.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.3}}}}$ | $\text{28.1}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.8}}}}$ | $\text{78.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.0}}}}$ | $\text{70.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.6}}}}$ | $\text{85.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.4}}}}$ | $\text{91.1}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.8}}}}$ | $\text{93.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{11.4}}}}$ | $\text{94.0}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.0}}}}$ | $\text{56.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.9}}}}$ | $\text{81.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.7}}}}$ | $\text{75.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.7}}}}$
TaskRes | 69.6 | 68.1 | 31.2 | 65.6 | 69.1 | 84.5 | 90.2 | 81.6 | 93.6 | 53.4 | 71.8 | 70.8
\+ TransCLIP-ZS | $\text{72.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.5}}}}$ | $\text{72.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.4}}}}$ | $\text{31.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.2}}}}$ | $\text{73.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{8.1}}}}$ | $\text{71.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.4}}}}$ | $\text{86.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.0}}}}$ | $\text{91.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.5}}}}$ | $\text{90.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{9.1}}}}$ | $\text{94.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.4}}}}$ | $\text{59.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.0}}}}$ | $\text{76.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.6}}}}$ | $\text{74.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.7}}}}$
ProGrad | 67.0 | 67.0 | 28.7 | 57.0 | 68.2 | 84.9 | 91.4 | 80.8 | 93.5 | 52.8 | 73.3 | 69.5
\+ TransCLIP-ZS | $\text{70.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.1}}}}$ | $\text{71.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.6}}}}$ | $\text{30.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.8}}}}$ | $\text{70.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{13.9}}}}$ | $\text{72.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.1}}}}$ | $\text{86.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.6}}}}$ | $\text{92.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$ | $\text{91.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{10.7}}}}$ | $\text{94.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.7}}}}$ | $\text{57.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.1}}}}$ | $\text{79.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.1}}}}$ | $\text{74.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.8}}}}$
4-shot | CoOp | 68.8 | 69.7 | 30.8 | 69.6 | 74.4 | 84.5 | 92.5 | 92.2 | 94.5 | 59.4 | 77.5 | 74.0
\+ TransCLIP-ZS | $\text{71.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.6}}}}$ | $\text{73.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.5}}}}$ | $\text{33.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.3}}}}$ | $\text{77.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{7.5}}}}$ | $\text{77.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.2}}}}$ | $\text{86.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.9}}}}$ | $\text{93.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{95.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.1}}}}$ | $\text{95.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.6}}}}$ | $\text{63.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.6}}}}$ | $\text{81.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.3}}}}$ | $\text{77.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.1}}}}$
TIP-Adapter-F | 70.7 | 70.8 | 35.7 | 76.8 | 74.1 | 86.5 | 91.9 | 92.1 | 94.8 | 59.8 | 78.1 | 75.6
\+ TransCLIP-ZS | $\text{72.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.9}}}}$ | $\text{74.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.5}}}}$ | $\text{36.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.5}}}}$ | $\text{79.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.9}}}}$ | $\text{75.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.8}}}}$ | $\text{87.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.9}}}}$ | $\text{93.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.3}}}}$ | $\text{95.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.3}}}}$ | $\text{95.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.3}}}}$ | $\text{64.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.2}}}}$ | $\text{83.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.2}}}}$ | $\text{77.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.3}}}}$
PLOT | 70.0 | 71.8 | 34.8 | 84.7 | 76.6 | 83.5 | 92.8 | 93.2 | 94.9 | 61.0 | 79.7 | 76.6
\+ TransCLIP-ZS | $\text{77.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{7.2}}}}$ | $\text{73.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{33.9}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.9}}}}$ | $\text{81.8}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{2.9}}}}$ | $\text{75.8}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.8}}}}$ | $\text{85.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.2}}}}$ | $\text{92.5}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.3}}}}$ | $\text{95.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.6}}}}$ | $\text{94.8}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.1}}}}$ | $\text{63.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.6}}}}$ | $\text{83.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.6}}}}$ | $\text{78.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$
TaskRes | 71.0 | 72.8 | 33.3 | 73.8 | 76.1 | 86.1 | 91.9 | 85.0 | 94.9 | 59.7 | 75.5 | 74.6
\+ TransCLIP-ZS | $\text{73.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.0}}}}$ | $\text{75.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.5}}}}$ | $\text{34.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{78.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.4}}}}$ | $\text{77.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{87.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.2}}}}$ | $\text{93.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{92.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{7.4}}}}$ | $\text{95.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.2}}}}$ | $\text{64.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.6}}}}$ | $\text{79.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.7}}}}$ | $\text{77.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.7}}}}$
ProGrad | 70.2 | 71.7 | 34.0 | 69.5 | 75.0 | 85.4 | 92.0 | 91.1 | 94.4 | 59.8 | 77.9 | 74.6
\+ TransCLIP-ZS | $\text{72.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.1}}}}$ | $\text{75.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.3}}}}$ | $\text{35.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.6}}}}$ | $\text{74.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.3}}}}$ | $\text{77.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.9}}}}$ | $\text{87.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.5}}}}$ | $\text{93.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{95.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.2}}}}$ | $\text{95.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.8}}}}$ | $\text{64.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.1}}}}$ | $\text{83.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.4}}}}$ | $\text{77.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.1}}}}$
16-shot | CoOp | 71.9 | 74.9 | 43.3 | 85.0 | 82.8 | 84.2 | 91.9 | 96.8 | 95.8 | 69.7 | 83.1 | 79.9
\+ TransCLIP-ZS | $\text{73.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$ | $\text{76.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.8}}}}$ | $\text{42.9}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.4}}}}$ | $\text{86.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.0}}}}$ | $\text{83.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.2}}}}$ | $\text{86.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.1}}}}$ | $\text{93.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.2}}}}$ | $\text{97.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.8}}}}$ | $\text{95.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.1}}}}$ | $\text{71.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{85.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.3}}}}$ | $\text{81.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$
TIP-Adapter-F | 73.3 | 76.0 | 44.6 | 85.9 | 82.3 | 86.8 | 92.6 | 96.2 | 95.7 | 70.8 | 83.9 | 80.7
\+ TransCLIP-ZS | $\text{74.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.9}}}}$ | $\text{76.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.8}}}}$ | $\text{44.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.3}}}}$ | $\text{85.2}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.7}}}}$ | $\text{82.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.4}}}}$ | $\text{87.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.6}}}}$ | $\text{93.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.9}}}}$ | $\text{96.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.7}}}}$ | $\text{95.7}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.1}}}}$ | $\text{69.2}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{1.5}}}}$ | $\text{85.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{81.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.4}}}}$
PLOT | 72.5 | 76.0 | 46.8 | 92.1 | 84.6 | 85.6 | 92.5 | 97.1 | 96.0 | 71.1 | 84.8 | 81.7
\+ TransCLIP-ZS | $\text{77.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.3}}}}$ | $\text{75.0}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{1.0}}}}$ | $\text{41.8}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{4.9}}}}$ | $\text{84.6}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{7.5}}}}$ | $\text{79.6}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{4.9}}}}$ | $\text{85.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.2}}}}$ | $\text{92.2}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.4}}}}$ | $\text{97.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.1}}}}$ | $\text{95.0}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{1.0}}}}$ | $\text{68.7}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{2.4}}}}$ | $\text{85.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.9}}}}$ | $\text{80.3}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{1.4}}}}$
TaskRes | 73.0 | 76.0 | 44.8 | 80.7 | 83.5 | 86.9 | 92.5 | 97.3 | 95.9 | 70.9 | 83.4 | 80.5
\+ TransCLIP-ZS | $\text{74.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.0}}}}$ | $\text{76.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.8}}}}$ | $\text{43.6}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{1.2}}}}$ | $\text{80.5}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.3}}}}$ | $\text{82.8}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.7}}}}$ | $\text{87.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.6}}}}$ | $\text{92.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.4}}}}$ | $\text{97.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.3}}}}$ | $\text{96.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.1}}}}$ | $\text{70.2}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.7}}}}$ | $\text{86.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.8}}}}$ | $\text{80.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.3}}}}$
ProGrad | 72.1 | 75.1 | 42.8 | 83.6 | 82.9 | 85.8 | 92.9 | 96.6 | 95.9 | 68.9 | 82.6 | 79.9
\+ TransCLIP-ZS | $\text{73.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$ | $\text{76.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{42.8}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.0}}}}$ | $\text{83.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.2}}}}$ | $\text{83.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.2}}}}$ | $\text{87.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.3}}}}$ | $\text{93.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.8}}}}$ | $\text{97.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.8}}}}$ | $\text{96.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.1}}}}$ | $\text{71.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.5}}}}$ | $\text{86.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.4}}}}$ | $\text{81.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$

Table 13: TransCLIP atop inductive vision-language zero-shot and popular few-
shot methods for ViT-L/14 vision encoder.

| Method |  ImageNet |  SUN397 |  Aircraft |  EuroSAT |  StanfordCars |  Food101 |  Pets |  Flower102 |  Caltech101 |  DTD |  UCF101 |  Average
---|---|---|---|---|---|---|---|---|---|---|---|---|---
0-shot | CLIP-ViT-L/14 | 72.9 | 67.7 | 32.6 | 60.3 | 76.9 | 90.9 | 93.5 | 79.5 | 95.2 | 53.5 | 74.9 | 72.5
\+ TransCLIP-ZS | $\text{77.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.3}}}}$ | $\text{73.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.9}}}}$ | $\text{35.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.7}}}}$ | $\text{75.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{15.6}}}}$ | $\text{79.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.1}}}}$ | $\text{91.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.0}}}}$ | $\text{94.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.2}}}}$ | $\text{85.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.8}}}}$ | $\text{97.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.3}}}}$ | $\text{60.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.5}}}}$ | $\text{81.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.7}}}}$ | $\text{77.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.9}}}}$
1-shot | CoOp | 71.5 | 68.9 | 36.9 | 68.4 | 78.8 | 89.0 | 94.0 | 87.2 | 95.0 | 58.6 | 78.7 | 75.2
\+ TransCLIP-ZS | $\text{75.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.5}}}}$ | $\text{74.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.4}}}}$ | $\text{38.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.0}}}}$ | $\text{80.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{11.9}}}}$ | $\text{81.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.8}}}}$ | $\text{91.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.1}}}}$ | $\text{95.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$ | $\text{95.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{7.8}}}}$ | $\text{96.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.3}}}}$ | $\text{64.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.5}}}}$ | $\text{83.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.8}}}}$ | $\text{79.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.4}}}}$
TIP-Adapter-F | 76.4 | 71.0 | 38.5 | 67.8 | 79.2 | 91.0 | 93.2 | 90.9 | 95.3 | 59.3 | 77.9 | 76.4
\+ TransCLIP-ZS | $\text{78.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.4}}}}$ | $\text{75.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.5}}}}$ | $\text{40.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.4}}}}$ | $\text{75.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{7.7}}}}$ | $\text{80.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.3}}}}$ | $\text{91.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.9}}}}$ | $\text{94.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.9}}}}$ | $\text{97.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.5}}}}$ | $\text{96.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.6}}}}$ | $\text{64.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.6}}}}$ | $\text{83.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.9}}}}$ | $\text{80.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.6}}}}$
TaskRes | 76.2 | 71.4 | 39.6 | 71.8 | 79.9 | 89.8 | 93.5 | 87.4 | 95.0 | 60.1 | 77.7 | 76.6
\+ TransCLIP-ZS | $\text{78.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.5}}}}$ | $\text{75.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.5}}}}$ | $\text{41.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.6}}}}$ | $\text{82.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{10.2}}}}$ | $\text{81.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.2}}}}$ | $\text{91.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.6}}}}$ | $\text{94.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$ | $\text{94.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{7.2}}}}$ | $\text{96.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.2}}}}$ | $\text{65.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.6}}}}$ | $\text{83.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.1}}}}$ | $\text{80.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.9}}}}$
ProGrad | 73.6 | 71.1 | 38.4 | 71.4 | 80.0 | 90.5 | 94.4 | 89.0 | 95.7 | 58.8 | 80.2 | 76.6
\+ TransCLIP-ZS | $\text{76.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.3}}}}$ | $\text{75.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.7}}}}$ | $\text{41.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.8}}}}$ | $\text{78.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{7.3}}}}$ | $\text{81.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{91.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.2}}}}$ | $\text{95.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.2}}}}$ | $\text{97.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{8.5}}}}$ | $\text{96.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.7}}}}$ | $\text{65.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{7.0}}}}$ | $\text{84.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.8}}}}$ | $\text{80.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.8}}}}$
4-shot | CoOp | 74.9 | 73.1 | 43.6 | 76.2 | 83.3 | 88.8 | 94.6 | 95.9 | 96.7 | 64.1 | 83.0 | 79.5
\+ TransCLIP-ZS | $\text{77.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.0}}}}$ | $\text{76.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.8}}}}$ | $\text{44.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.5}}}}$ | $\text{81.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.5}}}}$ | $\text{84.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.7}}}}$ | $\text{91.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.4}}}}$ | $\text{95.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.2}}}}$ | $\text{97.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$ | $\text{97.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.7}}}}$ | $\text{67.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.6}}}}$ | $\text{85.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.0}}}}$ | $\text{81.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.3}}}}$
TIP-Adapter-F | 77.0 | 74.1 | 47.4 | 81.4 | 82.3 | 91.2 | 94.0 | 95.5 | 96.5 | 64.4 | 83.9 | 80.7
\+ TransCLIP-ZS | $\text{79.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.0}}}}$ | $\text{77.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.1}}}}$ | $\text{47.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.2}}}}$ | $\text{83.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.6}}}}$ | $\text{82.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.6}}}}$ | $\text{91.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.7}}}}$ | $\text{94.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.8}}}}$ | $\text{98.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.0}}}}$ | $\text{97.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{69.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.6}}}}$ | $\text{87.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.7}}}}$ | $\text{82.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.9}}}}$
TaskRes | 77.1 | 74.9 | 42.5 | 77.3 | 83.6 | 90.6 | 94.4 | 90.1 | 96.6 | 65.1 | 80.0 | 79.3
\+ TransCLIP-ZS | $\text{79.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.2}}}}$ | $\text{78.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.6}}}}$ | $\text{44.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.4}}}}$ | $\text{81.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.1}}}}$ | $\text{83.2}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.3}}}}$ | $\text{91.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{95.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.3}}}}$ | $\text{96.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.4}}}}$ | $\text{97.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{68.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.9}}}}$ | $\text{86.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.1}}}}$ | $\text{82.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.8}}}}$
ProGrad | 76.5 | 74.9 | 44.5 | 79.3 | 83.9 | 90.6 | 94.8 | 95.6 | 96.7 | 66.1 | 83.9 | 80.6
\+ TransCLIP-ZS | $\text{78.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.3}}}}$ | $\text{78.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.2}}}}$ | $\text{46.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.3}}}}$ | $\text{82.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.3}}}}$ | $\text{84.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.1}}}}$ | $\text{91.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.2}}}}$ | $\text{95.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{97.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.3}}}}$ | $\text{97.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.6}}}}$ | $\text{70.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.2}}}}$ | $\text{87.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.8}}}}$ | $\text{82.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.2}}}}$
16-shot | CoOp | 78.2 | 77.5 | 55.4 | 87.2 | 89.1 | 89.8 | 94.6 | 99.1 | 97.2 | 74.1 | 87.2 | 84.5
\+ TransCLIP-ZS | $\text{79.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.3}}}}$ | $\text{79.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.3}}}}$ | $\text{54.6}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.7}}}}$ | $\text{90.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.4}}}}$ | $\text{88.0}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{1.1}}}}$ | $\text{91.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{95.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.8}}}}$ | $\text{99.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.4}}}}$ | $\text{98.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.9}}}}$ | $\text{75.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.2}}}}$ | $\text{89.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.8}}}}$ | $\text{85.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$
TIP-Adapter-F | 79.3 | 79.6 | 55.8 | 86.1 | 88.1 | 91.6 | 94.6 | 98.3 | 97.5 | 74.0 | 87.4 | 84.7
\+ TransCLIP-ZS | $\text{80.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.9}}}}$ | $\text{80.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.4}}}}$ | $\text{56.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.2}}}}$ | $\text{88.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.7}}}}$ | $\text{87.4}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.7}}}}$ | $\text{91.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.4}}}}$ | $\text{95.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{99.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.9}}}}$ | $\text{97.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.4}}}}$ | $\text{73.9}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.1}}}}$ | $\text{88.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$ | $\text{85.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.7}}}}$
TaskRes | 78.1 | 76.7 | 55.0 | 83.7 | 87.6 | 91.5 | 94.6 | 97.7 | 97.2 | 74.2 | 86.2 | 83.9
\+ TransCLIP-ZS | $\text{79.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{79.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.7}}}}$ | $\text{52.9}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{2.2}}}}$ | $\text{85.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.6}}}}$ | $\text{85.4}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{2.2}}}}$ | $\text{92.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.5}}}}$ | $\text{95.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.7}}}}$ | $\text{99.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{97.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.6}}}}$ | $\text{72.6}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{1.5}}}}$ | $\text{88.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.6}}}}$ | $\text{84.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.6}}}}$
ProGrad | 78.4 | 78.3 | 55.6 | 88.5 | 88.7 | 90.8 | 94.8 | 98.8 | 97.3 | 73.7 | 87.9 | 84.8
\+ TransCLIP-ZS | $\text{79.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.2}}}}$ | $\text{80.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.8}}}}$ | $\text{54.2}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{1.4}}}}$ | $\text{90.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.2}}}}$ | $\text{87.3}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{1.4}}}}$ | $\text{91.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{95.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.0}}}}$ | $\text{99.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.6}}}}$ | $\text{97.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.5}}}}$ | $\text{75.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.3}}}}$ | $\text{90.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.1}}}}$ | $\text{85.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.8}}}}$

Table 14: Cross-Dataset transferability evaluation for five encoders. Few-shot
learning methods are trained on 16-shot ImageNet and evaluate on the ten other
fine-grained datasets. Average excludes ImageNet.

|  | Source | Target |
---|---|---|---|---
| Method |  ImageNet |  SUN397 |  Aircraft |  EuroSAT |  StanfordCars |  Food101 |  Pets |  Flower102 |  Caltech101 |  DTD |  UCF101 |  Average
ResNet-50 | CoOp | 63.0 | 56.5 | 13.8 | 22.7 | 53.1 | 73.6 | 84.2 | 56.7 | 85.7 | 34.5 | 56.9 | 53.8
\+ TransCLIP-ZS | $\text{63.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.5}}}}$ | $\text{62.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.9}}}}$ | $\text{14.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.4}}}}$ | $\text{38.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{16.0}}}}$ | $\text{56.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.0}}}}$ | $\text{76.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.6}}}}$ | $\text{84.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.5}}}}$ | $\text{66.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{9.5}}}}$ | $\text{87.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{38.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.7}}}}$ | $\text{62.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.6}}}}$ | $\text{58.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.9}}}}$
CoCoOp | 63.2 | 61.5 | 16.5 | 27.1 | 55.9 | 78.1 | 88.2 | 65.5 | 88.6 | 39.6 | 61.1 | 58.2
\+ TransCLIP-ZS | $\text{66.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.2}}}}$ | $\text{63.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{16.5}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.1}}}}$ | $\text{36.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{8.9}}}}$ | $\text{57.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.3}}}}$ | $\text{74.7}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{3.5}}}}$ | $\text{86.1}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{2.1}}}}$ | $\text{70.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.3}}}}$ | $\text{88.5}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.1}}}}$ | $\text{43.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.7}}}}$ | $\text{65.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.9}}}}$ | $\text{60.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.9}}}}$
ProGrad | 63.4 | 58.4 | 13.5 | 24.2 | 52.6 | 75.9 | 85.9 | 61.8 | 85.9 | 36.1 | 57.6 | 55.2
\+ TransCLIP-ZS | $\text{63.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.2}}}}$ | $\text{63.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.9}}}}$ | $\text{14.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.6}}}}$ | $\text{37.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{13.0}}}}$ | $\text{55.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.0}}}}$ | $\text{77.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.3}}}}$ | $\text{87.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.6}}}}$ | $\text{70.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{8.2}}}}$ | $\text{88.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.6}}}}$ | $\text{42.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.0}}}}$ | $\text{62.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.9}}}}$ | $\text{59.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.6}}}}$
ResNet-101 | CoOp | 66.5 | 58.4 | 14.2 | 25.3 | 59.5 | 79.1 | 86.0 | 60.4 | 88.3 | 34.2 | 56.4 | 56.2
\+ TransCLIP-ZS | $\text{68.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.0}}}}$ | $\text{63.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.3}}}}$ | $\text{15.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.0}}}}$ | $\text{30.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.6}}}}$ | $\text{65.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.7}}}}$ | $\text{81.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.9}}}}$ | $\text{86.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.9}}}}$ | $\text{69.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{9.4}}}}$ | $\text{90.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.9}}}}$ | $\text{37.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.7}}}}$ | $\text{63.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{7.3}}}}$ | $\text{60.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.3}}}}$
CoCoOp | 65.2 | 62.9 | 17.8 | 25.8 | 62.8 | 81.4 | 87.2 | 64.0 | 91.3 | 39.8 | 61.1 | 59.4
\+ TransCLIP-ZS | $\text{73.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{8.1}}}}$ | $\text{65.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.7}}}}$ | $\text{17.8}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.1}}}}$ | $\text{45.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{19.3}}}}$ | $\text{67.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.4}}}}$ | $\text{79.9}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{1.5}}}}$ | $\text{87.1}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.1}}}}$ | $\text{71.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{7.6}}}}$ | $\text{90.9}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.4}}}}$ | $\text{40.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.3}}}}$ | $\text{67.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.3}}}}$ | $\text{63.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.9}}}}$
ViT-B/32 | CoOp | 66.8 | 60.6 | 14.2 | 31.8 | 56.9 | 78.8 | 85.6 | 58.9 | 90.3 | 35.9 | 61.8 | 57.5
\+ TransCLIP-ZS | $\text{68.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.6}}}}$ | $\text{65.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.0}}}}$ | $\text{14.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.7}}}}$ | $\text{49.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{17.7}}}}$ | $\text{60.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.5}}}}$ | $\text{80.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.5}}}}$ | $\text{86.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.9}}}}$ | $\text{68.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{9.0}}}}$ | $\text{92.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.6}}}}$ | $\text{40.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.5}}}}$ | $\text{67.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.8}}}}$ | $\text{62.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.1}}}}$
CoCoOp | 66.0 | 64.6 | 17.8 | 40.5 | 59.6 | 80.8 | 88.2 | 65.4 | 92.1 | 42.7 | 64.9 | 61.7
\+ TransCLIP-ZS | $\text{71.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.9}}}}$ | $\text{67.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.8}}}}$ | $\text{17.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.0}}}}$ | $\text{54.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{13.9}}}}$ | $\text{61.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.5}}}}$ | $\text{79.0}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{1.9}}}}$ | $\text{85.7}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{2.5}}}}$ | $\text{73.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{8.5}}}}$ | $\text{92.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.3}}}}$ | $\text{47.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.1}}}}$ | $\text{71.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.0}}}}$ | $\text{65.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.4}}}}$
ProGrad | 66.9 | 61.9 | 13.5 | 33.4 | 56.3 | 79.6 | 86.3 | 60.8 | 91.4 | 38.0 | 62.5 | 58.4
\+ TransCLIP-ZS | $\text{68.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.5}}}}$ | $\text{66.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.5}}}}$ | $\text{14.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.7}}}}$ | $\text{51.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{18.4}}}}$ | $\text{59.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.5}}}}$ | $\text{80.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.3}}}}$ | $\text{86.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.6}}}}$ | $\text{70.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{10.1}}}}$ | $\text{92.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.0}}}}$ | $\text{42.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.5}}}}$ | $\text{67.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.3}}}}$ | $\text{63.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.0}}}}$
MaPLE | 65.7 | 65.0 | 18.1 | 41.0 | 60.6 | 80.8 | 88.4 | 65.5 | 91.6 | 42.3 | 63.6 | 61.7
\+ TransCLIP-ZS | $\text{71.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.8}}}}$ | $\text{67.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.7}}}}$ | $\text{18.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.4}}}}$ | $\text{54.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{13.6}}}}$ | $\text{60.4}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.2}}}}$ | $\text{78.7}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{2.2}}}}$ | $\text{85.4}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{3.0}}}}$ | $\text{72.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{7.0}}}}$ | $\text{92.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.6}}}}$ | $\text{46.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.5}}}}$ | $\text{68.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.3}}}}$ | $\text{64.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.9}}}}$
MaPLE w/ PromptAlign | / | 66.1 | 18.8 | 39.7 | 63.5 | 82.1 | 88.4 | 66.1 | 92.1 | 42.5 | 65.6 | 62.5
ViT-B/16 | CoOp | 71.9 | 62.0 | 15.7 | 44.6 | 62.1 | 84.3 | 88.3 | 67.1 | 92.7 | 39.5 | 64.1 | 62.0
\+ TransCLIP-ZS | $\text{73.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$ | $\text{67.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.4}}}}$ | $\text{17.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$ | $\text{54.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{9.9}}}}$ | $\text{66.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.8}}}}$ | $\text{86.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.0}}}}$ | $\text{89.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{74.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{7.2}}}}$ | $\text{93.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.7}}}}$ | $\text{42.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.6}}}}$ | $\text{69.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.7}}}}$ | $\text{66.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.1}}}}$
CoCoOp | 71.1 | 67.0 | 22.7 | 44.6 | 64.9 | 86.2 | 90.7 | 71.6 | 93.9 | 45.2 | 68.8 | 65.6
\+ TransCLIP-ZS | $\text{76.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.7}}}}$ | $\text{69.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.7}}}}$ | $\text{22.6}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.1}}}}$ | $\text{59.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{14.6}}}}$ | $\text{67.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.1}}}}$ | $\text{85.4}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.8}}}}$ | $\text{89.8}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.9}}}}$ | $\text{79.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{7.4}}}}$ | $\text{94.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.3}}}}$ | $\text{50.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.4}}}}$ | $\text{74.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.7}}}}$ | $\text{69.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.6}}}}$
ProGrad | 72.1 | 63.9 | 21.6 | 38.9 | 64.0 | 85.9 | 90.2 | 67.8 | 92.9 | 43.2 | 65.9 | 63.4
\+ TransCLIP-ZS | $\text{73.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$ | $\text{68.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.7}}}}$ | $\text{22.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{55.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{16.4}}}}$ | $\text{67.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.8}}}}$ | $\text{87.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.2}}}}$ | $\text{91.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{73.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.1}}}}$ | $\text{94.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{46.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.4}}}}$ | $\text{73.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{7.6}}}}$ | $\text{68.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.6}}}}$
PromptSRC | 71.4 | 67.3 | 24.1 | 45.0 | 65.6 | 86.5 | 90.1 | 70.5 | 93.8 | 46.2 | 68.9 | 65.8
\+ TransCLIP-ZS | $\text{76.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.5}}}}$ | $\text{69.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.6}}}}$ | $\text{24.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.8}}}}$ | $\text{59.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{14.4}}}}$ | $\text{67.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.0}}}}$ | $\text{85.3}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{1.2}}}}$ | $\text{89.4}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.7}}}}$ | $\text{76.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.2}}}}$ | $\text{94.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.4}}}}$ | $\text{51.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.0}}}}$ | $\text{76.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{7.0}}}}$ | $\text{69.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.7}}}}$
MaPLE | 70.5 | 67.3 | 24.4 | 45.8 | 65.7 | 86.4 | 90.4 | 72.0 | 93.7 | 46.3 | 68.7 | 66.1
\+ TransCLIP-ZS | $\text{76.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.1}}}}$ | $\text{69.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.5}}}}$ | $\text{24.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.2}}}}$ | $\text{59.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{13.7}}}}$ | $\text{66.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.2}}}}$ | $\text{85.4}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{1.0}}}}$ | $\text{89.7}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.7}}}}$ | $\text{78.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.0}}}}$ | $\text{94.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.6}}}}$ | $\text{49.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.1}}}}$ | $\text{74.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.6}}}}$ | $\text{69.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.1}}}}$
Maple w/ PromptAlign | / | 67.5 | 24.8 | 47.9 | 68.5 | 86.7 | 90.8 | 72.4 | 94.0 | 47.2 | 69.5 | 66.9
ViT-L/14 | CoOp | 78.2 | 64.9 | 21.6 | 51.4 | 75.5 | 89.3 | 91.0 | 68.9 | 93.6 | 43.6 | 68.8 | 66.9
\+ TransCLIP-ZS | $\text{79.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$ | $\text{70.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.7}}}}$ | $\text{24.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.8}}}}$ | $\text{72.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{21.3}}}}$ | $\text{79.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.4}}}}$ | $\text{91.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.8}}}}$ | $\text{93.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.6}}}}$ | $\text{78.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{9.2}}}}$ | $\text{96.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.5}}}}$ | $\text{48.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.6}}}}$ | $\text{75.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.5}}}}$ | $\text{72.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.0}}}}$
CoCoOp | 77.8 | 70.8 | 31.0 | 47.4 | 77.9 | 91.4 | 94.1 | 76.2 | 97.1 | 50.7 | 74.1 | 71.1
\+ TransCLIP-ZS | $\text{81.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.1}}}}$ | $\text{73.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.0}}}}$ | $\text{33.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.1}}}}$ | $\text{76.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{28.9}}}}$ | $\text{78.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.8}}}}$ | $\text{90.6}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.8}}}}$ | $\text{94.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.3}}}}$ | $\text{81.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.1}}}}$ | $\text{97.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.1}}}}$ | $\text{55.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.7}}}}$ | $\text{79.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.1}}}}$ | $\text{76.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.9}}}}$
ProGrad | 78.4 | 66.9 | 24.8 | 45.4 | 75.9 | 90.4 | 93.1 | 73.4 | 95.3 | 45.8 | 71.8 | 68.3
\+ TransCLIP-ZS | $\text{79.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.2}}}}$ | $\text{72.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.5}}}}$ | $\text{26.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.0}}}}$ | $\text{67.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{21.7}}}}$ | $\text{78.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.8}}}}$ | $\text{91.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.2}}}}$ | $\text{95.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.5}}}}$ | $\text{79.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.0}}}}$ | $\text{96.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.3}}}}$ | $\text{51.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.0}}}}$ | $\text{78.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.6}}}}$ | $\text{73.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{5.6}}}}$
MaPLE | 77.2 | 71.6 | 30.2 | 55.7 | 77.3 | 91.3 | 93.1 | 76.7 | 96.2 | 53.8 | 74.9 | 72.1
\+ TransCLIP-ZS | $\text{81.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.4}}}}$ | $\text{74.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.5}}}}$ | $\text{32.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.6}}}}$ | $\text{75.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{19.6}}}}$ | $\text{78.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.0}}}}$ | $\text{90.5}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.8}}}}$ | $\text{94.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{83.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.3}}}}$ | $\text{97.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.2}}}}$ | $\text{56.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.4}}}}$ | $\text{81.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{6.1}}}}$ | $\text{76.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.2}}}}$

Table 15: Domain Generalization evaluation for five encoders with manual
prompting strategies.

|  | Source | Target |  |
---|---|---|---|---|---
| Method |  ImageNet |  Adversarial |  ImageNetV2 |  Rendition |  Sketch | Average | Average OOD
ResNet-50 |  w/ a photo of a | 58.0 | 22.0 | 51.2 | 56.1 | 33.3 | 44.1 | 40.7
\+ TransCLIP-ZS | $\text{60.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.8}}}}$ | $\text{21.5}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.4}}}}$ | $\text{51.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.1}}}}$ | $\text{52.8}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{3.3}}}}$ | $\text{35.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.8}}}}$ | $\text{44.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.2}}}}$ | $\text{40.2}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.5}}}}$
w/ custom templates | 60.3 | 23.8 | 53.4 | 60.5 | 35.5 | 46.7 | 43.3
\+ TransCLIP-ZS | $\text{61.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$ | $\text{23.4}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.5}}}}$ | $\text{52.6}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.8}}}}$ | $\text{56.4}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{4.2}}}}$ | $\text{36.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{46.1}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.6}}}}$ | $\text{42.2}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{1.1}}}}$
ResNet-101 |  w/ a photo of a | 60.6 | 28.2 | 54.3 | 64.2 | 38.0 | 49.1 | 46.2
\+ TransCLIP-ZS | $\text{64.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.2}}}}$ | $\text{29.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.0}}}}$ | $\text{56.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.9}}}}$ | $\text{65.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.0}}}}$ | $\text{42.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.3}}}}$ | $\text{51.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.5}}}}$ | $\text{48.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.0}}}}$
w/ custom templates | 62.5 | 29.8 | 56.1 | 67.7 | 40.6 | 51.4 | 48.6
\+ TransCLIP-ZS | $\text{65.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.0}}}}$ | $\text{30.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.8}}}}$ | $\text{57.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.9}}}}$ | $\text{68.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.5}}}}$ | $\text{44.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.4}}}}$ | $\text{53.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{49.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$
ViT-B/32 |  w/ a photo of a | 61.9 | 29.9 | 54.7 | 66.8 | 40.8 | 50.8 | 48.1
\+ TransCLIP-ZS | $\text{64.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.0}}}}$ | $\text{30.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.6}}}}$ | $\text{55.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{67.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.2}}}}$ | $\text{43.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.8}}}}$ | $\text{52.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.5}}}}$ | $\text{49.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.2}}}}$
w/ custom templates | 63.8 | 32.1 | 56.3 | 69.5 | 42.1 | 52.8 | 50.0
\+ TransCLIP-ZS | $\text{66.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.5}}}}$ | $\text{32.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.3}}}}$ | $\text{56.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.2}}}}$ | $\text{69.2}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.3}}}}$ | $\text{44.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.1}}}}$ | $\text{53.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.0}}}}$ | $\text{50.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.6}}}}$
ViT-B/16 |  w/ a photo of a | 66.6 | 47.9 | 60.6 | 73.8 | 46.0 | 59.0 | 57.1
\+ TransCLIP-ZS | $\text{70.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.7}}}}$ | $\text{49.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{62.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{75.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.3}}}}$ | $\text{49.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.7}}}}$ | $\text{61.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.4}}}}$ | $\text{59.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.1}}}}$
w/ custom templates | 68.8 | 50.6 | 62.3 | 77.8 | 48.4 | 61.6 | 59.8
\+ TransCLIP-ZS | $\text{71.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.7}}}}$ | $\text{52.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$ | $\text{63.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{78.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.2}}}}$ | $\text{51.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.7}}}}$ | $\text{63.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.6}}}}$ | $\text{61.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$
ViT-L/14 |  w/ a photo of a | 72.9 | 68.4 | 67.2 | 85.3 | 57.4 | 70.2 | 69.6
\+ TransCLIP-ZS | $\text{77.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{4.3}}}}$ | $\text{71.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.0}}}}$ | $\text{69.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.8}}}}$ | $\text{87.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.8}}}}$ | $\text{60.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.6}}}}$ | $\text{72.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.7}}}}$ | $\text{71.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.3}}}}$
w/ custom templates | 75.9 | 70.9 | 70.2 | 87.8 | 59.7 | 72.9 | 72.2
\+ TransCLIP-ZS | $\text{78.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.7}}}}$ | $\text{73.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.7}}}}$ | $\text{70.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.5}}}}$ | $\text{89.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{61.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.2}}}}$ | $\text{74.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.8}}}}$ | $\text{73.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.6}}}}$

Table 16: Domain Generalization evaluation for five encoders. Few-shot
learning methods are trained on 16-shot ImageNet and evaluated on the 4 other
variants.

|  | Source | Target |  |
---|---|---|---|---|---
| Method |  ImageNet |  Adversarial |  ImageNetV2 |  Rendition |  Sketch | Average | Average OOD
ResNet-50 | CoOp | 63.0 | 22.0 | 55.0 | 55.0 | 32.8 | 45.5 | 41.2
\+ TransCLIP-ZS | $\text{63.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.5}}}}$ | $\text{21.0}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{1.0}}}}$ | $\text{53.6}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{1.4}}}}$ | $\text{52.3}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{2.7}}}}$ | $\text{34.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.0}}}}$ | $\text{45.0}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.5}}}}$ | $\text{40.4}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.8}}}}$
TaskRes | 64.6 | 22.9 | 56.4 | 60.8 | 35.9 | 48.1 | 44.0
\+ TransCLIP-ZS | $\text{64.4}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.2}}}}$ | $\text{21.7}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{1.2}}}}$ | $\text{54.8}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{1.6}}}}$ | $\text{56.2}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{4.6}}}}$ | $\text{36.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.0}}}}$ | $\text{46.8}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{1.3}}}}$ | $\text{42.4}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{1.6}}}}$
ResNet-101 | CoOp | 66.5 | 29.5 | 58.3 | 63.6 | 39.0 | 51.4 | 47.6
\+ TransCLIP-ZS | $\text{68.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.0}}}}$ | $\text{29.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.5}}}}$ | $\text{58.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.2}}}}$ | $\text{64.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.2}}}}$ | $\text{42.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.3}}}}$ | $\text{52.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$ | $\text{48.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.3}}}}$
TaskRes | 67.6 | 30.0 | 59.6 | 68.4 | 41.8 | 53.5 | 49.9
\+ TransCLIP-ZS | $\text{69.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{30.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.2}}}}$ | $\text{59.3}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.4}}}}$ | $\text{68.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.4}}}}$ | $\text{44.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.9}}}}$ | $\text{54.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.0}}}}$ | $\text{50.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.8}}}}$
ViT-B/32 | CoOp | 66.8 | 31.2 | 58.5 | 65.2 | 40.1 | 52.3 | 48.7
\+ TransCLIP-ZS | $\text{68.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.6}}}}$ | $\text{31.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.1}}}}$ | $\text{58.3}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.2}}}}$ | $\text{65.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.3}}}}$ | $\text{42.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.6}}}}$ | $\text{53.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.9}}}}$ | $\text{49.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.7}}}}$
TaskRes | 68.2 | 31.3 | 59.3 | 69.5 | 42.5 | 54.2 | 50.6
\+ TransCLIP-ZS | $\text{69.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{31.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.1}}}}$ | $\text{59.1}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.2}}}}$ | $\text{69.3}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.3}}}}$ | $\text{44.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.4}}}}$ | $\text{54.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.6}}}}$ | $\text{51.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.5}}}}$
ViT-B/16 | CoOp | 71.9 | 49.4 | 64.1 | 75.1 | 47.1 | 61.5 | 58.9
\+ TransCLIP-ZS | $\text{73.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$ | $\text{50.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.3}}}}$ | $\text{64.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.4}}}}$ | $\text{75.7}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.7}}}}$ | $\text{50.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.2}}}}$ | $\text{62.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$ | $\text{60.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.4}}}}$
TaskRes | 73.0 | 50.3 | 65.6 | 77.8 | 49.2 | 63.2 | 60.7
\+ TransCLIP-ZS | $\text{74.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.0}}}}$ | $\text{51.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.6}}}}$ | $\text{65.4}_{{\color[rgb]{.25,.25,.25}\raisebox{2.0pt}{\normalsize-{0.2}}}}$ | $\text{78.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.6}}}}$ | $\text{51.6}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.4}}}}$ | $\text{64.3}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{61.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$
ViT-L/14 | CoOp | 78.2 | 69.4 | 70.8 | 85.4 | 57.5 | 72.3 | 70.8
\+ TransCLIP-ZS | $\text{79.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.3}}}}$ | $\text{71.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.6}}}}$ | $\text{71.1}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.3}}}}$ | $\text{86.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.5}}}}$ | $\text{60.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{2.5}}}}$ | $\text{73.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.6}}}}$ | $\text{72.5}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$
TaskRes | 78.1 | 71.3 | 71.6 | 87.9 | 60.1 | 73.8 | 72.7
\+ TransCLIP-ZS | $\text{79.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.7}}}}$ | $\text{74.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{3.0}}}}$ | $\text{71.8}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{0.2}}}}$ | $\text{88.9}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.1}}}}$ | $\text{62.0}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.9}}}}$ | $\text{75.4}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.6}}}}$ | $\text{74.2}_{{\color[rgb]{0,0.5,0}\raisebox{2.0pt}{\normalsize+{1.5}}}}$

Table 17: Detailed results of transductive methods in the few-shot setting for
the 11 datasets with ResNet-50 as visual backbone.

Shots | Method | ImageNet | SUN | Aircraft | EuroSAT | Cars | Food | Pets | Flowers | Caltech | DTD | UCF | Average
---|---|---|---|---|---|---|---|---|---|---|---|---|---
1 | TF | 20.6 | 31.2 | 13.1 | 39.0 | 21.8 | 28.3 | 27.2 | 53.6 | 66.1 | 27.7 | 38.1 | 33.3
BD-CSPN | 24.7 | 36.9 | 13.9 | 40.3 | 27.2 | 34.1 | 34.1 | 66.7 | 74.3 | 32.8 | 43.4 | 38.9
LaplacianShot | 23.8 | 35.5 | 14.0 | 42.3 | 27.0 | 34.7 | 37.3 | 66.6 | 72.4 | 32.8 | 43.2 | 39.1
PT-MAP | 29.4 | 42.9 | 15.7 | 48.0 | 33.8 | 44.8 | 56.5 | 61.4 | 46.9 | 38.6 | 52.2 | 42.7
TIM | 26.1 | 40.0 | 13.4 | 42.5 | 27.3 | 41.4 | 35.0 | 69.1 | 62.3 | 31.7 | 46.9 | 39.6
CoOp + UPL | 59.6 | 63.4 | 17.5 | 54.7 | 56.4 | 75.3 | 82.8 | 73.5 | 87.4 | 48.3 | 66.1 | 62.3
TransCLIP-FS | 55.7 | 63.5 | 20.6 | 70.3 | 56.2 | 77.2 | 86.9 | 83.7 | 87.4 | 51.3 | 70.7 | 65.8
2 | TF | 29.6 | 43.1 | 16.6 | 57.2 | 32.3 | 41.4 | 40.1 | 68.4 | 77.5 | 41.4 | 51.3 | 45.4
BD-CSPN | 33.2 | 48.1 | 17.8 | 58.6 | 36.2 | 47.4 | 50.0 | 77.0 | 80.7 | 43.2 | 54.1 | 49.7
LaplacianShot | 33.1 | 47.8 | 17.7 | 60.0 | 36.1 | 48.7 | 50.4 | 77.5 | 81.0 | 43.3 | 55.2 | 50.1
PT-MAP | 39.3 | 54.6 | 19.3 | 61.4 | 43.5 | 60.1 | 67.0 | 68.9 | 51.5 | 50.4 | 61.9 | 52.5
TIM | 35.5 | 52.2 | 18.2 | 60.2 | 38.1 | 57.2 | 51.7 | 79.7 | 76.1 | 44.2 | 59.6 | 52.1
CoOp + UPL | 59.8 | 64.0 | 19.3 | 62.9 | 59.2 | 74.8 | 81.2 | 80.5 | 88.1 | 49.5 | 68.0 | 64.3
TransCLIP-FS | 59.3 | 66.2 | 20.3 | 71.5 | 58.7 | 77.2 | 86.0 | 87.1 | 87.8 | 55.2 | 72.8 | 67.5
4 | TF | 38.5 | 53.1 | 20.4 | 64.9 | 42.8 | 52.5 | 49.3 | 80.7 | 83.6 | 48.4 | 59.3 | 54.0
BD-CSPN | 40.7 | 54.9 | 20.2 | 65.4 | 43.4 | 56.6 | 54.3 | 83.7 | 84.0 | 48.1 | 59.8 | 55.6
LaplacianShot | 40.5 | 54.9 | 19.7 | 68.0 | 43.3 | 58.0 | 55.5 | 84.2 | 83.9 | 47.9 | 60.1 | 56.0
PT-MAP | 46.8 | 61.4 | 22.8 | 69.5 | 50.7 | 66.6 | 70.0 | 71.0 | 54.6 | 56.3 | 68.0 | 58.0
TIM | 43.3 | 59.1 | 22.9 | 71.0 | 49.6 | 64.0 | 58.8 | 87.6 | 79.1 | 53.2 | 65.8 | 59.5
CoOp + UPL | 60.3 | 65.7 | 23.3 | 71.0 | 63.0 | 75.8 | 83.6 | 87.3 | 88.0 | 55.2 | 69.1 | 67.5
TransCLIP-FS | 59.3 | 66.5 | 25.0 | 73.8 | 61.4 | 76.6 | 81.6 | 88.4 | 88.2 | 57.6 | 73.3 | 68.4
8 | TF | 45.1 | 59.7 | 24.1 | 66.8 | 51.2 | 61.1 | 61.7 | 86.4 | 86.3 | 55.9 | 65.1 | 60.3
BD-CSPN | 45.6 | 59.6 | 22.9 | 66.2 | 50.4 | 62.4 | 65.7 | 87.5 | 85.5 | 54.6 | 65.1 | 60.5
LaplacianShot | 45.2 | 59.1 | 22.4 | 69.1 | 49.6 | 63.4 | 65.7 | 87.6 | 85.8 | 53.9 | 65.9 | 60.7
PT-MAP | 50.6 | 64.2 | 23.4 | 66.7 | 55.9 | 69.6 | 76.9 | 72.9 | 54.8 | 60.4 | 70.6 | 60.5
TIM | 49.9 | 63.4 | 25.0 | 69.5 | 59.7 | 70.0 | 71.8 | 89.9 | 82.9 | 59.1 | 70.8 | 64.7
CoOp + UPL | 60.9 | 67.0 | 26.0 | 71.7 | 66.5 | 75.5 | 82.7 | 91.2 | 88.3 | 59.0 | 71.4 | 69.1
TransCLIP-FS | 59.9 | 68.3 | 28.0 | 74.5 | 67.6 | 76.9 | 86.6 | 90.4 | 88.7 | 62.1 | 76.1 | 70.8
16 | TF | 50.0 | 63.2 | 26.6 | 71.8 | 57.7 | 66.1 | 66.4 | 90.3 | 87.3 | 58.8 | 67.7 | 64.2
BD-CSPN | 49.7 | 62.4 | 25.5 | 71.3 | 56.6 | 66.0 | 66.2 | 89.6 | 86.7 | 57.8 | 67.2 | 63.5
LaplacianShot | 48.9 | 61.5 | 24.6 | 71.5 | 54.8 | 66.7 | 67.5 | 89.5 | 86.4 | 56.2 | 67.5 | 63.2
PT-MAP | 54.1 | 66.1 | 25.6 | 68.1 | 61.1 | 70.6 | 79.0 | 75.2 | 57.0 | 62.4 | 71.0 | 62.7
TIM | 55.5 | 66.8 | 30.8 | 81.6 | 68.0 | 72.4 | 75.0 | 88.9 | 85.7 | 63.1 | 74.4 | 69.3
CoOp + UPL | 60.9 | 69.4 | 31.6 | 78.0 | 71.4 | 76.2 | 83.5 | 93.6 | 89.1 | 62.8 | 73.5 | 71.8
TransCLIP-FS | 62.6 | 70.4 | 30.3 | 77.6 | 71.5 | 77.1 | 87.3 | 92.5 | 88.7 | 64.4 | 77.7 | 72.7

Table 18: Detailed results of transductive methods in the few-shot setting for
the 11 datasets with ResNet-101 as visual backbone.

Shots | Method | ImageNet | SUN | Aircraft | EuroSAT | Cars | Food | Pets | Flowers | Caltech | DTD | UCF | Average
---|---|---|---|---|---|---|---|---|---|---|---|---|---
1 | TF | 24.9 | 33.3 | 16.0 | 38.5 | 29.4 | 34.3 | 37.1 | 57.0 | 71.6 | 29.7 | 43.5 | 37.8
BD-CSPN | 29.9 | 40.2 | 16.8 | 39.5 | 35.1 | 42.6 | 51.0 | 70.0 | 79.6 | 32.1 | 51.8 | 44.4
LaplacianShot | 30.0 | 40.0 | 17.1 | 40.6 | 37.2 | 43.8 | 51.8 | 71.7 | 79.4 | 34.9 | 52.1 | 45.3
PT-MAP | 34.3 | 46.2 | 18.1 | 49.3 | 44.0 | 53.0 | 69.5 | 65.0 | 51.6 | 39.1 | 58.9 | 48.1
TIM | 31.5 | 44.2 | 16.6 | 42.9 | 39.0 | 54.9 | 51.8 | 77.6 | 66.5 | 36.1 | 56.2 | 47.0
CoOp + UPL | 62.7 | 64.5 | 20.8 | 63.6 | 61.7 | 77.8 | 83.8 | 72.8 | 89.6 | 47.0 | 69.1 | 64.9
TransCLIP-FS | 64.3 | 66.6 | 19.6 | 67.2 | 70.0 | 82.9 | 91.5 | 80.4 | 91.2 | 47.0 | 70.1 | 68.3
2 | TF | 34.8 | 46.6 | 19.6 | 53.7 | 41.2 | 49.1 | 51.1 | 73.8 | 83.1 | 42.3 | 56.3 | 50.1
BD-CSPN | 39.9 | 51.7 | 20.3 | 54.2 | 46.7 | 57.7 | 60.4 | 80.8 | 85.5 | 45.5 | 59.4 | 54.7
LaplacianShot | 39.9 | 51.8 | 20.9 | 59.3 | 46.9 | 59.0 | 63.2 | 81.9 | 85.9 | 45.5 | 59.8 | 55.8
PT-MAP | 44.3 | 57.4 | 21.8 | 62.0 | 52.9 | 65.7 | 76.6 | 71.0 | 56.2 | 52.5 | 65.8 | 56.9
TIM | 42.4 | 55.6 | 19.9 | 63.5 | 50.2 | 69.2 | 67.3 | 85.5 | 81.5 | 49.0 | 62.6 | 58.8
CoOp + UPL | 63.0 | 65.4 | 23.6 | 66.4 | 66.6 | 77.8 | 85.2 | 81.2 | 89.4 | 51.4 | 70.9 | 67.4
TransCLIP-FS | 64.6 | 67.2 | 22.7 | 68.3 | 70.7 | 80.8 | 89.1 | 85.2 | 91.5 | 49.8 | 72.8 | 69.3
4 | TF | 44.9 | 56.9 | 23.7 | 62.8 | 53.4 | 61.6 | 61.1 | 83.7 | 87.5 | 51.5 | 65.4 | 59.3
BD-CSPN | 47.8 | 58.8 | 23.7 | 62.1 | 54.4 | 66.0 | 70.1 | 86.1 | 87.7 | 51.2 | 65.4 | 61.2
LaplacianShot | 47.7 | 58.9 | 23.4 | 71.9 | 54.3 | 67.3 | 70.9 | 86.8 | 87.7 | 51.1 | 65.8 | 62.3
PT-MAP | 51.7 | 63.8 | 25.5 | 68.0 | 60.3 | 71.6 | 79.9 | 74.6 | 56.4 | 57.4 | 71.0 | 61.8
TIM | 51.2 | 63.2 | 25.1 | 73.6 | 61.4 | 75.8 | 76.8 | 87.0 | 87.8 | 55.3 | 71.7 | 66.3
CoOp + UPL | 63.9 | 67.4 | 25.4 | 70.8 | 69.3 | 79.5 | 85.5 | 87.4 | 90.3 | 55.6 | 73.2 | 69.2
TransCLIP-FS | 65.1 | 68.7 | 26.2 | 73.7 | 71.6 | 81.3 | 90.1 | 88.6 | 91.7 | 56.4 | 73.2 | 71.5
8 | TF | 51.5 | 62.9 | 27.1 | 63.3 | 61.5 | 69.0 | 72.3 | 89.1 | 89.7 | 58.2 | 70.2 | 65.0
BD-CSPN | 52.7 | 63.1 | 27.3 | 62.7 | 61.0 | 70.9 | 76.8 | 89.5 | 89.4 | 57.0 | 70.3 | 65.5
LaplacianShot | 52.3 | 62.8 | 26.8 | 68.4 | 60.7 | 71.7 | 77.3 | 89.6 | 89.2 | 56.0 | 70.3 | 65.9
PT-MAP | 55.5 | 66.5 | 28.1 | 67.0 | 64.6 | 73.7 | 84.6 | 76.6 | 59.4 | 61.1 | 72.2 | 64.5
TIM | 56.6 | 67.3 | 28.1 | 74.3 | 70.0 | 77.0 | 85.3 | 91.5 | 88.6 | 60.5 | 71.7 | 70.1
CoOp + UPL | 64.6 | 69.0 | 28.3 | 77.9 | 73.5 | 79.5 | 85.8 | 92.1 | 90.7 | 61.2 | 75.8 | 72.6
TransCLIP-FS | 65.0 | 69.6 | 27.9 | 71.2 | 74.4 | 81.5 | 90.3 | 89.0 | 91.7 | 61.7 | 76.1 | 72.6
16 | TF | 56.3 | 66.8 | 30.7 | 68.0 | 68.0 | 73.6 | 76.3 | 92.0 | 90.9 | 61.9 | 72.6 | 68.8
BD-CSPN | 56.4 | 66.1 | 30.8 | 66.0 | 67.2 | 73.4 | 76.4 | 91.8 | 90.8 | 60.5 | 72.4 | 68.3
LaplacianShot | 56.0 | 65.5 | 29.4 | 71.2 | 65.8 | 74.4 | 78.6 | 91.7 | 90.2 | 58.8 | 72.3 | 68.5
PT-MAP | 58.6 | 68.3 | 30.9 | 69.5 | 69.2 | 75.3 | 85.3 | 78.2 | 61.5 | 62.9 | 73.4 | 66.6
TIM | 61.4 | 70.6 | 34.6 | 79.2 | 75.8 | 78.8 | 84.4 | 91.8 | 88.9 | 67.2 | 76.4 | 73.6
CoOp + UPL | 64.6 | 71.1 | 34.9 | 82.1 | 77.6 | 79.5 | 85.7 | 94.0 | 92.1 | 65.2 | 77.1 | 74.9
TransCLIP-FS | 66.4 | 71.1 | 28.4 | 73.8 | 77.1 | 81.6 | 90.6 | 90.8 | 92.3 | 61.5 | 76.8 | 73.7

Table 19: Detailed results of transductive methods in the few-shot setting for
the 11 datasets with ViT-B/32 as visual backbone.

Shots | Method | ImageNet | SUN | Aircraft | EuroSAT | Cars | Food | Pets | Flowers | Caltech | DTD | UCF | Average
---|---|---|---|---|---|---|---|---|---|---|---|---|---
1 | TF | 25.1 | 36.1 | 14.6 | 44.4 | 26.7 | 34.4 | 33.3 | 60.0 | 74.4 | 29.0 | 46.4 | 38.6
BD-CSPN | 30.1 | 42.9 | 16.2 | 45.7 | 33.8 | 41.2 | 43.9 | 73.1 | 80.2 | 30.8 | 52.6 | 44.6
LaplacianShot | 29.2 | 41.7 | 16.1 | 48.6 | 33.2 | 43.1 | 43.8 | 73.3 | 80.6 | 32.7 | 52.9 | 45.0
PT-MAP | 33.1 | 48.8 | 17.0 | 54.8 | 38.6 | 49.8 | 50.9 | 62.4 | 52.5 | 37.9 | 57.0 | 45.7
TIM | 31.5 | 47.6 | 16.6 | 55.2 | 36.4 | 51.4 | 48.4 | 76.8 | 71.5 | 35.6 | 57.6 | 48.1
CoOp + UPL | 63.0 | 66.2 | 21.0 | 64.0 | 58.1 | 78.8 | 84.0 | 74.4 | 89.7 | 52.0 | 68.3 | 65.4
TransCLIP-FS | 64.3 | 68.9 | 22.7 | 63.5 | 63.7 | 82.2 | 90.1 | 83.2 | 92.2 | 52.3 | 69.5 | 68.4
2 | TF | 34.7 | 49.5 | 19.3 | 56.5 | 37.4 | 48.7 | 47.4 | 75.1 | 83.9 | 44.5 | 57.7 | 50.4
BD-CSPN | 39.2 | 53.1 | 20.7 | 57.2 | 42.1 | 55.5 | 55.2 | 82.4 | 86.8 | 45.6 | 61.6 | 54.5
LaplacianShot | 39.1 | 53.9 | 20.4 | 58.3 | 42.4 | 57.7 | 57.3 | 82.5 | 86.7 | 45.9 | 62.6 | 55.2
PT-MAP | 42.6 | 60.1 | 22.3 | 63.7 | 46.0 | 63.9 | 64.0 | 69.5 | 55.6 | 50.4 | 66.8 | 55.0
TIM | 41.1 | 59.0 | 21.1 | 68.9 | 44.1 | 66.2 | 60.1 | 86.5 | 81.5 | 48.6 | 68.1 | 58.7
CoOp + UPL | 63.4 | 66.6 | 22.8 | 71.9 | 60.8 | 78.5 | 85.0 | 81.0 | 90.1 | 53.5 | 70.2 | 67.6
TransCLIP-FS | 64.8 | 69.5 | 22.9 | 76.9 | 63.8 | 81.2 | 89.9 | 85.4 | 92.1 | 52.9 | 71.0 | 70.0
4 | TF | 44.5 | 59.4 | 23.2 | 62.1 | 48.6 | 60.8 | 57.9 | 85.2 | 89.1 | 52.6 | 65.2 | 59.0
BD-CSPN | 47.0 | 61.1 | 23.4 | 64.2 | 49.1 | 65.3 | 64.8 | 87.2 | 89.4 | 52.0 | 67.0 | 61.0
LaplacianShot | 46.8 | 61.1 | 23.6 | 68.4 | 49.2 | 65.6 | 66.6 | 87.6 | 89.3 | 51.4 | 67.5 | 61.6
PT-MAP | 50.1 | 65.5 | 24.1 | 68.9 | 52.3 | 70.3 | 69.0 | 73.3 | 57.3 | 56.1 | 70.1 | 59.7
TIM | 50.4 | 65.0 | 24.7 | 70.0 | 56.1 | 73.0 | 74.4 | 90.5 | 88.7 | 55.9 | 71.8 | 65.5
CoOp + UPL | 63.9 | 68.8 | 26.6 | 72.6 | 63.7 | 78.2 | 85.2 | 88.8 | 90.1 | 55.4 | 73.1 | 69.7
TransCLIP-FS | 64.7 | 70.1 | 26.4 | 78.0 | 66.5 | 80.3 | 87.2 | 88.7 | 92.2 | 58.0 | 74.3 | 71.5
8 | TF | 50.9 | 64.7 | 27.1 | 67.6 | 57.1 | 68.5 | 68.0 | 89.4 | 90.5 | 58.2 | 70.7 | 64.8
BD-CSPN | 51.2 | 64.8 | 27.4 | 66.5 | 56.9 | 69.6 | 71.7 | 90.0 | 89.6 | 56.3 | 71.0 | 65.0
LaplacianShot | 51.0 | 64.3 | 26.4 | 70.0 | 55.9 | 70.4 | 73.7 | 90.2 | 90.1 | 55.4 | 70.8 | 65.3
PT-MAP | 53.7 | 68.3 | 27.4 | 70.9 | 58.5 | 72.8 | 75.4 | 75.2 | 59.7 | 59.4 | 71.5 | 63.0
TIM | 56.2 | 69.0 | 28.4 | 75.8 | 65.1 | 76.1 | 79.6 | 92.3 | 87.4 | 63.3 | 75.4 | 69.9
CoOp + UPL | 64.8 | 69.7 | 30.0 | 79.6 | 68.9 | 79.3 | 85.5 | 91.6 | 91.8 | 62.1 | 73.9 | 72.5
TransCLIP-FS | 65.5 | 71.3 | 28.0 | 78.2 | 70.8 | 81.0 | 89.4 | 90.0 | 92.3 | 61.1 | 77.0 | 73.2
16 | TF | 55.6 | 68.0 | 29.7 | 69.7 | 62.9 | 72.6 | 73.7 | 92.0 | 91.6 | 61.6 | 73.1 | 68.2
BD-CSPN | 55.3 | 67.5 | 29.8 | 69.5 | 62.3 | 72.9 | 74.2 | 91.9 | 91.7 | 59.6 | 73.3 | 68.0
LaplacianShot | 54.8 | 66.7 | 28.4 | 71.2 | 60.9 | 73.2 | 75.3 | 91.3 | 91.3 | 58.3 | 72.9 | 67.7
PT-MAP | 56.9 | 69.9 | 29.2 | 71.3 | 63.1 | 74.1 | 78.7 | 77.1 | 60.7 | 61.9 | 72.9 | 65.1
TIM | 60.5 | 71.8 | 33.0 | 79.4 | 72.2 | 78.1 | 85.0 | 92.8 | 88.4 | 66.6 | 78.1 | 73.3
CoOp + UPL | 64.8 | 71.9 | 34.1 | 84.3 | 73.6 | 79.0 | 85.8 | 94.2 | 92.4 | 64.8 | 78.3 | 74.8
TransCLIP-FS | 66.6 | 72.6 | 30.1 | 78.9 | 73.2 | 81.1 | 89.5 | 90.9 | 94.4 | 62.7 | 77.2 | 74.3

Table 20: Detailed results of transductive methods in the few-shot setting for
the 11 datasets with ViT-B/16 as visual backbone.

Shots | Method | ImageNet | SUN | Aircraft | EuroSAT | Cars | Food | Pets | Flowers | Caltech | DTD | UCF | Average
---|---|---|---|---|---|---|---|---|---|---|---|---|---
1 | TF | 29.7 | 38.1 | 19.2 | 46.0 | 32.5 | 43.5 | 38.2 | 67.8 | 75.5 | 31.6 | 48.8 | 42.8
BD-CSPN | 35.4 | 45.7 | 22.0 | 45.7 | 42.0 | 54.2 | 52.9 | 82.9 | 83.5 | 34.7 | 58.0 | 50.6
LaplacianShot | 34.9 | 44.5 | 22.1 | 52.1 | 41.1 | 53.0 | 52.2 | 83.1 | 83.4 | 35.8 | 57.3 | 50.9
PT-MAP | 40.1 | 52.6 | 23.8 | 59.7 | 48.4 | 64.4 | 61.8 | 69.4 | 54.1 | 41.8 | 63.5 | 52.7
TIM | 37.5 | 48.3 | 22.8 | 48.2 | 44.8 | 65.7 | 53.9 | 86.4 | 75.1 | 35.8 | 62.7 | 52.8
CoOp + UPL | 68.8 | 68.5 | 27.2 | 70.0 | 68.9 | 83.6 | 90.6 | 81.7 | 92.7 | 51.3 | 73.1 | 70.6
TransCLIP-FS | 69.8 | 70.6 | 29.9 | 72.5 | 70.9 | 87.9 | 93.8 | 84.8 | 93.1 | 53.3 | 78.4 | 73.2
2 | TF | 40.5 | 51.6 | 25.3 | 63.1 | 45.1 | 58.8 | 54.8 | 83.2 | 87.0 | 47.3 | 59.4 | 56.0
BD-CSPN | 46.1 | 56.1 | 26.7 | 64.7 | 50.7 | 67.5 | 64.6 | 89.6 | 89.6 | 48.9 | 64.0 | 60.8
LaplacianShot | 45.8 | 55.9 | 27.1 | 68.2 | 51.1 | 68.2 | 66.0 | 89.7 | 89.6 | 48.9 | 65.1 | 61.4
PT-MAP | 50.7 | 63.1 | 28.6 | 71.7 | 57.5 | 77.5 | 75.7 | 73.9 | 59.1 | 53.8 | 68.7 | 61.9
TIM | 47.9 | 60.7 | 28.1 | 75.8 | 55.7 | 78.7 | 70.6 | 91.4 | 86.6 | 52.3 | 66.4 | 64.9
CoOp + UPL | 69.2 | 69.2 | 30.1 | 73.4 | 71.0 | 83.8 | 88.4 | 87.9 | 93.3 | 53.9 | 75.8 | 72.4
TransCLIP-FS | 70.3 | 70.9 | 30.0 | 77.1 | 71.7 | 87.0 | 91.7 | 90.6 | 93.5 | 55.1 | 78.5 | 74.2
4 | TF | 51.1 | 61.0 | 30.3 | 64.9 | 56.8 | 71.0 | 65.9 | 90.9 | 91.5 | 53.7 | 67.9 | 64.1
BD-CSPN | 53.8 | 62.5 | 30.5 | 64.8 | 58.5 | 75.3 | 72.0 | 92.5 | 92.0 | 52.1 | 70.9 | 65.9
LaplacianShot | 53.5 | 62.5 | 29.6 | 74.3 | 58.5 | 75.7 | 73.4 | 92.8 | 92.0 | 52.7 | 71.7 | 67.0
PT-MAP | 57.6 | 68.1 | 31.2 | 74.9 | 63.1 | 81.1 | 79.5 | 76.2 | 60.2 | 58.4 | 73.9 | 65.8
TIM | 57.4 | 67.0 | 32.8 | 79.3 | 65.8 | 83.5 | 82.3 | 93.4 | 88.5 | 58.1 | 76.5 | 71.3
CoOp + UPL | 69.7 | 71.4 | 32.6 | 74.0 | 74.6 | 83.8 | 91.3 | 92.1 | 93.2 | 58.9 | 76.9 | 74.4
TransCLIP-FS | 70.3 | 71.9 | 34.0 | 79.4 | 74.0 | 86.4 | 91.6 | 93.6 | 94.0 | 61.1 | 79.1 | 75.9
8 | TF | 57.2 | 66.8 | 34.7 | 68.5 | 65.4 | 77.4 | 74.3 | 93.8 | 92.4 | 60.3 | 73.8 | 69.5
BD-CSPN | 57.9 | 66.5 | 34.1 | 68.3 | 64.6 | 78.0 | 77.2 | 93.2 | 92.4 | 59.0 | 74.2 | 69.6
LaplacianShot | 57.6 | 65.9 | 33.4 | 73.2 | 64.7 | 79.3 | 79.3 | 93.3 | 92.3 | 56.5 | 74.6 | 70.0
PT-MAP | 61.0 | 70.6 | 34.1 | 75.0 | 68.5 | 82.0 | 84.5 | 77.2 | 62.1 | 62.4 | 75.6 | 68.5
TIM | 62.6 | 71.3 | 35.9 | 79.8 | 74.4 | 84.3 | 87.4 | 94.0 | 90.7 | 63.6 | 80.2 | 74.9
CoOp + UPL | 70.5 | 72.8 | 38.6 | 79.1 | 78.3 | 84.5 | 90.4 | 94.4 | 93.3 | 60.6 | 79.6 | 76.6
TransCLIP-FS | 70.5 | 73.2 | 36.4 | 79.7 | 76.9 | 86.7 | 91.9 | 93.9 | 94.2 | 65.7 | 81.5 | 77.3
16 | TF | 61.8 | 70.1 | 38.3 | 74.3 | 71.2 | 80.7 | 79.5 | 95.4 | 93.6 | 62.9 | 76.0 | 73.1
BD-CSPN | 61.7 | 69.4 | 37.7 | 73.4 | 70.7 | 80.2 | 81.2 | 94.8 | 93.3 | 61.3 | 76.0 | 72.7
LaplacianShot | 60.9 | 68.3 | 36.1 | 78.1 | 69.2 | 81.2 | 81.7 | 94.8 | 93.1 | 58.6 | 76.3 | 72.6
PT-MAP | 64.0 | 72.0 | 37.4 | 75.6 | 72.0 | 82.7 | 86.1 | 78.5 | 63.7 | 63.7 | 76.3 | 70.2
TIM | 67.8 | 73.6 | 40.6 | 83.6 | 79.5 | 84.9 | 88.7 | 95.4 | 92.4 | 67.5 | 82.1 | 77.8
CoOp + UPL | 71.6 | 75.1 | 43.2 | 83.0 | 82.3 | 85.0 | 90.4 | 95.8 | 94.3 | 68.7 | 80.4 | 79.1
TransCLIP-FS | 71.8 | 74.7 | 38.6 | 83.0 | 79.8 | 86.9 | 92.4 | 94.4 | 94.0 | 65.1 | 82.1 | 78.4

Table 21: Detailed results of transductive methods in the few-shot setting for
the 11 datasets with ViT-L/14 as visual backbone.

Shots | Method | ImageNet | SUN | Aircraft | EuroSAT | Cars | Food | Pets | Flowers | Caltech | DTD | UCF | Average
---|---|---|---|---|---|---|---|---|---|---|---|---|---
1 | TF | 36.6 | 41.2 | 26.3 | 49.8 | 45.2 | 53.9 | 45.8 | 81.8 | 79.7 | 35.8 | 58.3 | 50.4
BD-CSPN | 45.3 | 50.5 | 28.9 | 53.3 | 57.5 | 67.3 | 66.7 | 93.4 | 88.4 | 39.6 | 67.2 | 59.8
LaplacianShot | 43.5 | 48.4 | 30.9 | 56.6 | 56.1 | 69.3 | 65.8 | 93.3 | 87.9 | 40.1 | 66.2 | 59.8
PT-MAP | 49.8 | 58.1 | 33.1 | 65.6 | 60.6 | 80.1 | 78.1 | 75.2 | 58.5 | 45.7 | 69.7 | 61.3
TIM | 47.7 | 56.0 | 31.1 | 62.8 | 61.1 | 79.7 | 74.2 | 95.4 | 80.1 | 41.7 | 71.5 | 63.8
CoOp + UPL | 76.0 | 72.6 | 35.8 | 72.7 | 79.2 | 89.5 | 93.2 | 86.8 | 94.9 | 60.3 | 81.1 | 76.6
TransCLIP-FS | 75.9 | 74.5 | 37.9 | 77.4 | 78.8 | 92.2 | 95.4 | 95.9 | 95.6 | 61.3 | 83.3 | 78.9
2 | TF | 50.1 | 56.6 | 33.5 | 71.7 | 58.3 | 71.6 | 65.7 | 93.0 | 90.5 | 49.8 | 69.4 | 64.6
BD-CSPN | 57.0 | 61.2 | 35.6 | 72.6 | 65.1 | 79.9 | 77.2 | 95.7 | 92.8 | 52.3 | 74.7 | 69.5
LaplacianShot | 56.5 | 61.3 | 35.9 | 76.8 | 65.4 | 80.3 | 77.4 | 96.2 | 93.3 | 52.4 | 74.8 | 70.0
PT-MAP | 61.3 | 68.0 | 37.0 | 78.4 | 68.4 | 87.3 | 86.7 | 77.9 | 61.1 | 56.5 | 75.2 | 68.9
TIM | 59.7 | 67.6 | 35.4 | 82.2 | 69.3 | 87.4 | 85.5 | 95.1 | 91.4 | 53.2 | 78.6 | 73.2
CoOp + UPL | 76.1 | 73.4 | 39.9 | 72.3 | 81.4 | 90.3 | 92.5 | 94.0 | 94.7 | 62.0 | 82.2 | 78.1
TransCLIP-FS | 76.8 | 75.1 | 40.0 | 82.1 | 79.9 | 91.8 | 95.0 | 96.6 | 95.9 | 62.6 | 83.2 | 79.9
4 | TF | 61.6 | 66.5 | 40.6 | 71.4 | 69.6 | 81.9 | 79.0 | 96.4 | 94.4 | 58.5 | 77.5 | 72.5
BD-CSPN | 64.3 | 67.8 | 40.6 | 71.4 | 72.2 | 84.7 | 82.8 | 96.7 | 95.2 | 56.9 | 79.6 | 73.8
LaplacianShot | 63.8 | 67.6 | 40.0 | 78.9 | 72.0 | 85.4 | 85.7 | 97.3 | 95.2 | 56.7 | 79.6 | 74.7
PT-MAP | 68.0 | 72.7 | 41.7 | 77.4 | 73.8 | 88.9 | 89.9 | 78.3 | 62.9 | 60.1 | 79.2 | 72.1
TIM | 68.9 | 72.7 | 42.0 | 78.4 | 77.8 | 90.0 | 92.3 | 97.4 | 91.1 | 63.5 | 83.7 | 78.0
CoOp + UPL | 76.5 | 75.1 | 44.1 | 79.3 | 83.1 | 90.1 | 92.6 | 95.2 | 95.3 | 65.8 | 83.9 | 80.1
TransCLIP-FS | 76.9 | 76.2 | 45.9 | 81.5 | 81.2 | 91.4 | 94.3 | 98.2 | 96.1 | 66.8 | 84.9 | 81.2
8 | TF | 67.4 | 72.0 | 45.6 | 76.1 | 76.5 | 86.2 | 85.1 | 97.2 | 95.1 | 65.1 | 81.5 | 77.1
BD-CSPN | 68.0 | 71.5 | 44.8 | 76.1 | 76.5 | 86.8 | 86.8 | 97.3 | 94.9 | 63.8 | 81.3 | 77.1
LaplacianShot | 67.3 | 70.4 | 43.6 | 78.2 | 75.9 | 87.3 | 88.3 | 97.0 | 94.9 | 61.2 | 80.8 | 76.8
PT-MAP | 70.7 | 74.6 | 44.1 | 78.4 | 77.1 | 89.2 | 91.3 | 79.5 | 64.5 | 65.1 | 79.7 | 74.0
TIM | 73.1 | 76.4 | 46.7 | 86.8 | 83.2 | 89.5 | 92.7 | 96.9 | 94.4 | 70.2 | 81.3 | 81.0
CoOp + UPL | 76.9 | 75.8 | 49.6 | 81.7 | 85.5 | 90.1 | 93.2 | 95.9 | 95.3 | 65.6 | 84.0 | 81.2
TransCLIP-FS | 77.2 | 77.3 | 50.0 | 82.6 | 84.1 | 91.6 | 94.5 | 98.5 | 97.0 | 70.7 | 86.0 | 82.7
16 | TF | 71.1 | 74.9 | 50.1 | 78.6 | 81.5 | 88.1 | 88.6 | 98.5 | 96.1 | 67.3 | 83.0 | 79.8
BD-CSPN | 71.1 | 74.4 | 49.4 | 78.1 | 81.2 | 88.0 | 89.8 | 98.4 | 95.8 | 66.5 | 82.5 | 79.6
LaplacianShot | 69.8 | 72.7 | 47.0 | 81.7 | 80.2 | 88.0 | 90.1 | 98.0 | 95.7 | 63.3 | 82.8 | 79.0
PT-MAP | 72.9 | 75.9 | 48.1 | 79.1 | 79.9 | 89.4 | 92.0 | 80.5 | 66.0 | 65.6 | 80.5 | 75.4
TIM | 76.4 | 78.7 | 52.5 | 89.4 | 86.5 | 91.0 | 92.0 | 98.2 | 94.5 | 73.2 | 84.8 | 83.4
CoOp + UPL | 76.9 | 77.2 | 54.1 | 85.9 | 87.8 | 90.6 | 93.2 | 97.1 | 95.6 | 72.8 | 86.2 | 83.4
TransCLIP-FS | 77.8 | 78.7 | 53.0 | 84.4 | 86.3 | 91.6 | 94.8 | 98.8 | 97.3 | 71.2 | 86.5 | 83.7

Table 22: UPL∗ top-1 accuracy on ImageNet for 8, 16 and 32 top-confidence pseudo-labels drawn from the test set. Architecture | $N=8$ | $N=16$ | $N=32$
---|---|---|---
ResNet-50 | 60.60 | 61.60 | 59.66
ViT-B/16 | 68.92 | 69.62 | 68.87
Table 23: Prompt templates for each dataset.

(a) Prompt templates used in the experiments unless otherwise specified.

Dataset | Prompt template
---|---
ImageNet | "a photo of a []."
SUN397 | "a photo of a []."
Aircraft | "a photo of a [], a type of aircraft.",
EuroSAT | "a centered satellite photo of [].",
Cars | "a photo of a [].",
Food101 | "a photo of [], a type of food.",
Pets | "a photo of [], a type of pet.",
Flower102 | "a photo of a [], a type of flower.",
Caltech101 | "a photo of a [].",
DTD | "[] texture.",
UCF101 | "a photo of a person doing [].",

(b) Custom prompt templates for ImageNet dataset [49].

"itap of a []."
---
"a bad photo of the []."
"a origami []."
"a photo of the large []."
"a [] in a video game."
"art of the []."
"a photo of the small []."