# Evaluating the Performance of Large Language Models via Debates

Behrad Moniri Hamed Hassani Edgar Dobriban
University of Pennsylvania
{bemoniri<EMAIL_ADDRESS><EMAIL_ADDRESS>
###### Abstract

Large Language Models (LLMs) are rapidly evolving and impacting various
fields, necessitating the development of effective methods to evaluate and
compare their performance. Most current approaches for performance evaluation
are either based on fixed, domain-specific questions that lack the flexibility
required in many real-world applications where tasks are not always from a
single domain, or rely on human input, making them unscalable. We propose an
automated benchmarking framework based on debates between LLMs, judged by
another LLM. This method assesses not only domain knowledge, but also skills
such as problem definition and inconsistency recognition. We evaluate the
performance of various state-of-the-art LLMs using the debate framework and
achieve rankings that align closely with popular rankings based on human
input, eliminating the need for costly human crowdsourcing.

Evaluating the Performance of Large Language Models via Debates

Behrad Moniri Hamed Hassani Edgar Dobriban University of Pennsylvania
{bemoniri<EMAIL_ADDRESS><EMAIL_ADDRESS>

##  1 Introduction

Although still in their infancy, large language models (LLMs) have emerged as
a tool with the potential to transform human-computer interaction and
significantly impact various aspects of work and daily life (see e.g., Bubeck
et al. (2023)). New models are being developed at a rapid pace and are
beginning to be applied to a wide range of tasks (for some applications, see
e.g., Yuan et al. (2022); Kaddour et al. (2023); Kasneci et al. (2023);
Thirunavukarasu et al. (2023)).

Due to this widespread use and the existence of a wide variety of models, it
is crucial to establish a standardized method for evaluating and ranking these
models based on their performance. Improved evaluation will provide guidance
for future interaction design and implementation. Many benchmarks have been
proposed to evaluate the performance of LLMs in various domains, such as
medical applications (Singhal et al. (2023); Cascella et al. (2023); Liévin et
al. (2024)), legal applications (Hendrycks et al. (2021); Guha et al. (2024)),
trustworthiness (Chao et al. (2024); Zhang et al. (2023)), reasoning abilities
(Sawada et al. (2023); Valmeekam et al. (2022)), and coding abilities (Liu et
al. (2024a); Du et al. (2024); Carlini (2024)). See Chang et al. (2024) for a
detailed survey of LLM evaluation methods.

However, these benchmarks have several limitations. While static and domain-
specific benchmarks are effective in evaluating the performance of models on
specific tasks, they fail to capture the flexibility and interactivity of
real-world scenarios. Additionally, these benchmarks may become contaminated
over time as new language models are introduced with the benchmarks
potentially included as training data (see e.g., Bubeck et al. (2023); Ibrahim
et al. (2024)).

To address these limitations, Chiang et al. (2024) introduced Chatbot Arena, a
platform for evaluating LLMs based on human preferences. In this benchmark,
models are ranked based on their performance in battles. During each battle,
two anonymous models are sampled. The user provides an input to the models,
which then generate their respective outputs. The user compares the responses
side-by-side and votes for the preferred answer, choosing one model as the
winner. Models are scored and ranked using data from all battles. This
benchmark leverages human input for prompts, making it more relevant for
typical LLM use cases.

Chatbot Arena has attracted significant attention and media coverage (see,
e.g., Yang and Cui (2024); Roose (2024)). However, its reliance on human
crowdsourcing, requiring users to read and rank responses, limits its
scalability.

In this paper, we introduce a flexible automatic benchmarking framework based
on debates between language models as an alternative to human-based evaluation
methods.

Debate and other argumentative practice has been a longstanding tradition
since antiquity (Dutilh Novaes, 2022, Historical Supplement). It serves as a
structured forum for testing conversational and reasoning skills, and has been
integral to philosophical discourse, legal proceedings, and civic engagement
(Proksch and Slapin (2015); Holbrook (1999); Benoit et al. (2003)).

Although success in debates requires mastery of the debate topic and domain
knowledge, it also necessitates skills such as defining the problem,
identifying and challenging assumptions, recognizing inconsistencies, and
prioritizing the relevance of various details within the overall argument Roy
and Macchiette (2005); Kennedy (2009). These skills are crucial for the
effective application of language models, motivating the use of a debate
framework to evaluate the performance of LLMs.

In this paper, we propose a setup for debate between models on various
predetermined topics. The script of each debate is then given to a judge,
which is also an LLM, to evaluate and score the arguments presented by each
side. Based on these evaluations, the language model with the better overall
performance is announced as the winner. This framework does not require human
users to read the responses; human input is only needed to create a list of
debate topics. This eliminates the need for heavy human crowdsourcing, and
resolves the scalability issue of Chatbot Arena. Also, the list of topics in
the debate can be chosen based on the specific applications in mind.

Through experiments with state-of-the-art language models, we demonstrate that
this fully automated setup can be used to rank these LLMs, producing rankings
generally consistent with those of Chatbot Arena.

Figure 1: A snippet of debates. Two language models engage in debates on a
list of topics, and a judge model announces the winner for each topic. The
language model with the most wins across all topics is declared the overall
winner.

###  1.1 Related Works

Collaboration and debates have been used as a framework to enhance the
performance of language models. Liang et al. (2023); De Ridder (2024) propose
multi-agent debate frameworks in which models express their solutions to a
problem to encourage divergent thinking. Xiong et al. (2023) uses a formal
debate framework to examine whether LLMs can collaborate to reach a consensus
for a shared goal. Chern et al. (2024) proposes multi-round discussions
between models to assist human annotators in finding the most capable LLM to
be used as an evaluator. Khan et al. (2024) shows that having access to the a
debate between two strong LLMs that posses the necessary information to answer
the question of the topic will result in more truthful answers from a weak LLM
or a human expert that do not have that piece of information. Lee et al.
(2024) study the applications of LLMs in debate education. See also Pham et
al. (2023); Fu et al. (2023); Madaan et al. (2024); Chao et al. (2024) for
other results leveraging the interactions between language models to achieve a
given goal.

In this work, instead of using debates between LLMs as a type of interaction
to improve their performance, we use a debate framework with an LLM as a judge
to evaluate their performance.

##  2 Debate Framework

Assume that $\mathcal{T}$ is a pre-defined list of debate topics and
$\mathcal{LM}$ is a set of large language models that we want to rank based on
their performance. The topics are open-ended questions like “Can alternative
energy effectively replace fossil fuels?" that have two possible sides. We
assume that we have black-box query access to all the language models. The
proposed ranking is based on multiple debates between the language models on
different topics.

Each debate is a multi-round interaction on a topic $t\in\mathcal{T}$ between
two models, a language model $\mathrm{LM}_{1}\in\mathcal{LM}$ that goes first
and support one side of the argument, and a language model
$\mathrm{LM}_{2}\in\mathcal{LM}$ that goes second and supports the other side.

The debate will go in rounds. In the first round, $\mathrm{LM}_{1}$ is asked
to start the debate by providing the arguments to supports their side based on
logic, facts, and evidence. Then, in the next round $\mathrm{LM}_{2}$
responds, refutes the arguments raised, and provides new evidence supporting
the other side. The debate between the models continues for a predefined
number $T$ of rounds. Finally, the model $\mathrm{LM}_{2}$ is asked to
conclude the debate. All prompts used in our experiments can be found in
Section A.

At the end of each debate, the script of the $T$ rounds is given to a judge
language model, which is asked to consider specific factors, to score
$\mathrm{LM}_{1}$ and $\mathrm{LM}_{2}$, and to announce the winner.

In this framework, to compare two models $\mathrm{LM}_{a}$ and
$\mathrm{LM}_{b}$ from the set $\mathcal{L}$, we conduct two debates on each
topic $t\in\mathcal{T}$. In the first debate, we set
$\mathrm{LM}_{1}=\mathrm{LM}_{a}$, and in the second debate, we set
$\mathrm{LM}_{1}=\mathrm{LM}_{b}$. The judge language models evaluate both
debates. Based on their assessments, one of the models $\mathrm{LM}_{1}$ or
$\mathrm{LM}_{2}$ is declared the winner for the topic $t$, or the result is a
draw. We run two debates because the two sides of the argument might not be
equally hard to argue for. Also, the judge could be biased and favor the model
that goes first (or last). By running the debate with the role of the models
flipped, we account for these biases.

This process is repeated for all topics $t\in\mathcal{T}$. The model with the
highest number of wins across different topics is declared the overall winner.
Finally, after comparing all pairs $(\mathrm{LM}_{a},\mathrm{LM}_{b})$ of
models, the overall ranking of the models in $\mathcal{L}$ is generated.

###  2.1 Algorithm Details

Since LLMs are typically not directly trained to debate, specifying the rules
of the task is crucial. To effectively do this, we provide a detailed system
prompt to the models. The systems prompts ask the models to support a side;
ask that the arguments and rebuttals should be backed by logic, facts, and
evidence; and that the answers should be convincing, factual and concise. The
history of all previous rounds of the debate is given to the debating language
models in the prompts.

The same is also true for the judge language model. We set a detailed system
prompt for the judge so that it considers factors such as clarity of
arguments, factuality and use of evidence, rebuttal and counterarguments,
logical consistency, persuasiveness, conciseness, and coherence in the
evaluation. Further, in the system prompt for the judge, we specify the exact
format for the output. The script of the debate is given to the judge model
using its prompt. The judge model announces a winner for each side of the
debate and also gives scores to each side.

Some LLMs (e.g., GPT-4) are specifically trained for instruction-following;
and in all cases that we used GPT-4 as the judge, the output exactly matched
the template specified in the system prompt. However, in the experiments with
Llama-3-70b used at judge, there were few instances of small deviations from
the template in the output. In these cases, we manually fixed the issue.

###  2.2 The Choice of the Judge LLM

Zheng et al. (2024) demonstrate that in many applications, GPT-4 Achiam et al.
(2023) matches closely with human intentions when acting as a judge. Moreover,
in the context of evaluating debates, Liu et al. (2024b) show that of GPT-4
outperforms humans and other state-of-the-art LLMs fine-tuned on extensive
datasets in debate evaluation. Based on these findings, we choose GPT-4 as the
judge model in our experiments. We also conduct some experiments with
Llama-3-70b as the judge to demonstrate that the rankings are relatively
robust to the choice of the judge model.

Table 1: The experimental results based on the debate framework with GPT-4 as
judge. (Left) The number of topics in which each model has won against other
models. (Right) The ranking on different language models.

|  Llama-2-7b |  Llama-2-13b |  Llama-2-70b |  Llama-3-70b |  Vicuna-7b |  Vicuna-13b |  Mixtral-8x7B |  GPT-3.5 |  GPT-4
---|---|---|---|---|---|---|---|---|---
Llama-2-7b | 1-0 | 0-6 | 0-9 | 0-11 | 9-0 | 6-2 | 1-8 | 0-5 | 0-24
Llama-2-13b |  | 0-2 | 0-7 | 2-13 | 14-0 | 8-0 | 0-5 | 0-7 | 0-22
Llama-2-70b |  |  | 1-1 | 0-9 | 13-0 | 12-0 | 2-1 | 1-2 | 0-21
Llama-3-70b |  |  |  | 0-1 | 23-0 | 17-0 | 6-0 | 5-0 | 0-13
Vicuna-7b |  |  |  |  | 2-1 | 0-3 | 0-11 | 0-18 | 0-24
Vicuna-13b |  |  |  |  |  | 0-0 | 0-13 | 0-13 | 0-23
Mixtral-8x7B |  |  |  |  |  |  | 3-1 | 0-3 | 0-24
GPT-3.5 |  |  |  |  |  |  |  | 3-2 | 1-14
GPT-4 |  |  |  |  |  |  |  |  | 2-2

Rank | Model Name | Wins
---|---|---
1 | gpt-4-0125-preview | 8
2 | Llama-3-70b | 7
4 | gpt-3.5-turbo-0125 | 6
3 | Llama-2-70b | 5
5 | Mixtral-8x7B-Instruct-v0.1 | 4
6 | Llama-2-13b | 3
7 | Llama-2-7b | 2
8 | Vicuna-13b-v1.5 | 1
9 | Vicuna-7b-v1.5 | 0

##  3 Experiments

In this section, we consider the list of debate topics from Section B and run
debates with four rounds, i.e., $T=4$. Our topics were selected to cover open-
ended questions on a wide range of topics. As the debating models, we use
Llama-2-7b, Llama-2-13b, Llama-2-70b Touvron et al. (2023), Llama-3-70b Meta
AI (2024), Vicuna-7b-v1.5,Vicuna-13b-v1.5 Chiang et al. (2023),
Mixtral-8x7B-Instruct-v0.1 Jiang et al. (2024), gpt-4-0125-preview, and
gpt-3.5-turbo-0125 Achiam et al. (2023). To access GPT-3.5 and GPT-4, we use
the OpenAI API. We use the API from https://www.together.ai/ to access other
models.

###  3.1 Results

We run a total of $50$ debates on $25$ topics (Section B) between each pair of
models. In this section we use gpt-4-0125-preview as the judge. On each topic,
the model that wins both rounds is considered the winner. Table 1 (Left) shows
the number of wins in the debates between various model pairs.

For example, Llama-2-7b has won in no topics against Llama-2-70b, whereas
Llama-2-70b has won in nine debates against Llama-2-7b. The detailed results
in different topics can be found in Section C. Ranking models based on their
number of wins, we arrive at the ranking in Table 1 (Right).

From these results, as a sanity check, we see that in debates between two
instances of the same model (diagonals of Table 1 (Left)), each side achieves
almost the same number of wins. It is also seen that for different families of
models (Llama-2, GPT, Vicuna), models with more parameters rank better; i.e.,
Llama-2-70b ranks better compared to Llama-2-7b. Also, newer generations of
each model rank better than their older counterpart; i.e., GPT-4 ranks better
compared to GPT-3.5. Similarly, Llama-3-70b ranks better compared to
Llama-2-70b.

Comparing this ranking with the rankings available on the Chatbot Arena
leaderboard website111https://huggingface.co/spaces/lmsys/chatbot-Arena-
leaderboard, accessed on June 14th, 2024, we see that the rankings in Table 1
are generally consistent with Chatbot Arena. Specifically, the differences are
as follows: In Chatbot Arena, Llama-2-7b ranks below Vicuna-13b-v1.5 (rank
seven and eight are swapped). Also, Mixtral08x7B is under-performing in the
debates; in Chatbot Arena it is in the third place instead of the fifth. Other
rankings are all consistent with Chatbot Arena.

###  3.2 Other Judge Models

In this section, we conduct the same set of experiments, but with Llama-3-70b
as the judge. Llama-3-70b does not always give its decision in the format
specified in its system prompt, which makes it difficult to re-run the whole
debates with Llama-3-70b as the judge. Thus, we only rerun the debates between
Llama-2-13b with all other models. The results can be found in Table 2.

Table 2: Number of topics in which Llama-2-13b has won against other models,
with Llama-3-70b as judge.

Llama-2-7b |  Llama-2-70b |  Llama-3-70b |  Vicuna-7b |  Vicuna-13b |  Mixtral-8x7B |  GPT-3.5 |  GPT-4
---|---|---|---|---|---|---|---
7-0 | 0-4 | 0-6 | 16-2 | 17-0 | 8 - 4 | 0 - 4 | 0 - 21

The winners in this experiment are identical to the winners announced by
GPT-4, in all but one opponent models (Mixtral).

##  4 Conclusion and Future Work

In this paper, we developed an automated framework to rank the performance of
LLMs, based on a multi-round debate between LLMs on different topics, and an
evaluation by a judge LLM. We showed that this framework can yield rankings
consistent with rankings that rely on human crowdsourcing, while being more
scalable.

##  5 Limitations

The method proposed in this paper requires human input to create the list of
debate topics. While this is significantly less time-consuming and less
expensive than reading and scoring the debates, it can still pose some
scalability issues. We leave the task of automating topic generation for
future work.

Our method has been primarily evaluated on English, which is a language with
relatively limited morphological complexity. This could restrict the
applicability of our approach to other languages.

## Acknowledgements

Behrad Moniri and Hamed Hassani are supported by The Institute for Learning-
enabled Optimization at Scale (TILOS), under award number NSF-CCF-2112665.
Edgar Dobriban’s work is supported in part by the ARO, the ONR, the NSF, and
the Sloan Foundation. Any opinions, findings and conclusions or
recommendations expressed in this material are those of the authors and do not
necessarily reflect the views of the Army Research Office (ARO), or the
Department of Defense, or the United States Government.

## References

  * Achiam et al. (2023) Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. 2023.  GPT-4 technical report.  _arXiv preprint arXiv:2303.08774_.
  * Benoit et al. (2003) William L Benoit, Glenn J Hansen, and Rebecca M Verser. 2003.  A meta-analysis of the effects of viewing us presidential debates.  _Communication monographs_ , 70(4):335–350.
  * Bubeck et al. (2023) Sébastien Bubeck, Varun Chandrasekaran, Ronen Eldan, Johannes Gehrke, Eric Horvitz, Ece Kamar, Peter Lee, Yin Tat Lee, Yuanzhi Li, Scott Lundberg, et al. 2023.  Sparks of artificial general intelligence: Early experiments with GPT-4.  _arXiv preprint arXiv:2303.12712_.
  * Carlini (2024) Nicholas Carlini. 2024.  My benchmark for large language models.  Accessed: 06-03-2024.
  * Cascella et al. (2023) Marco Cascella, Jonathan Montomoli, Valentina Bellini, and Elena Bignami. 2023.  Evaluating the feasibility of chatgpt in healthcare: an analysis of multiple clinical and research scenarios.  _Journal of medical systems_ , 47(1):33.
  * Chang et al. (2024) Yupeng Chang, Xu Wang, Jindong Wang, Yuan Wu, Linyi Yang, Kaijie Zhu, Hao Chen, Xiaoyuan Yi, Cunxiang Wang, Yidong Wang, Wei Ye, Yue Zhang, Yi Chang, Philip S. Yu, Qiang Yang, and Xing Xie. 2024.  A survey on evaluation of large language models.  _ACM Trans. Intell. Syst. Technol._ , 15(3).
  * Chao et al. (2024) Patrick Chao, Edoardo Debenedetti, Alexander Robey, Maksym Andriushchenko, Francesco Croce, Vikash Sehwag, Edgar Dobriban, Nicolas Flammarion, George J Pappas, Florian Tramer, et al. 2024.  Jailbreakbench: An open robustness benchmark for jailbreaking large language models.  _arXiv preprint arXiv:2404.01318_.
  * Chern et al. (2024) Steffi Chern, Ethan Chern, Graham Neubig, and Pengfei Liu. 2024.  Can large language models be trusted for evaluation? scalable meta-evaluation of llms as evaluators via agent debate.  _arXiv preprint arXiv:2401.16788_.
  * Chiang et al. (2023) Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E. Gonzalez, Ion Stoica, and Eric P. Xing. 2023.  Vicuna: An open-source chatbot impressing GPT-4 with 90%* ChatGPT quality.
  * Chiang et al. (2024) Wei-Lin Chiang, Lianmin Zheng, Ying Sheng, Anastasios Nikolas Angelopoulos, Tianle Li, Dacheng Li, Hao Zhang, Banghua Zhu, Michael Jordan, Joseph E Gonzalez, et al. 2024.  Chatbot arena: An open platform for evaluating LLMs by human preference.  _arXiv preprint arXiv:2403.04132_.
  * De Ridder (2024) Alexander De Ridder. 2024.  Ai-driven debates as a tool for advancing understanding and decision-making.
  * Du et al. (2024) Xueying Du, Mingwei Liu, Kaixin Wang, Hanlin Wang, Junwei Liu, Yixuan Chen, Jiayi Feng, Chaofeng Sha, Xin Peng, and Yiling Lou. 2024.  Evaluating large language models in class-level code generation.  In _Proceedings of the IEEE/ACM 46th International Conference on Software Engineering_ , pages 1–13.
  * Dutilh Novaes (2022) Catarina Dutilh Novaes. 2022.  Argument and Argumentation.  In Edward N. Zalta and Uri Nodelman, editors, _The Stanford Encyclopedia of Philosophy_ , Fall 2022 edition. Metaphysics Research Lab, Stanford University.
  * Fu et al. (2023) Yao Fu, Hao Peng, Tushar Khot, and Mirella Lapata. 2023.  Improving language model negotiation with self-play and in-context learning from ai feedback.  _arXiv preprint arXiv:2305.10142_.
  * Guha et al. (2024) Neel Guha, Julian Nyarko, Daniel Ho, Christopher Ré, Adam Chilton, Alex Chohlas-Wood, Austin Peters, Brandon Waldon, Daniel Rockmore, Diego Zambrano, et al. 2024.  Legalbench: A collaboratively built benchmark for measuring legal reasoning in large language models.  In _Advances in Neural Information Processing Systems_.
  * Hendrycks et al. (2021) Dan Hendrycks, Collin Burns, Anya Chen, and Spencer Ball. 2021.  Cuad: An expert-annotated nlp dataset for legal contract review.  _arXiv preprint arXiv:2103.06268_.
  * Holbrook (1999) Thomas M Holbrook. 1999.  Political learning from presidential debates.  _Political Behavior_ , 21:67–89.
  * Ibrahim et al. (2024) Lujain Ibrahim, Saffron Huang, Lama Ahmad, and Markus Anderljung. 2024.  Beyond static AI evaluations: advancing human interaction evaluations for LLM harms and risks.  _arXiv preprint arXiv:2405.10632_.
  * Jiang et al. (2024) Albert Q Jiang, Alexandre Sablayrolles, Antoine Roux, Arthur Mensch, Blanche Savary, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Emma Bou Hanna, Florian Bressand, et al. 2024.  Mixtral of experts.  _arXiv preprint arXiv:2401.04088_.
  * Kaddour et al. (2023) Jean Kaddour, Joshua Harris, Maximilian Mozes, Herbie Bradley, Roberta Raileanu, and Robert McHardy. 2023.  Challenges and applications of large language models.  _arXiv preprint arXiv:2307.10169_.
  * Kasneci et al. (2023) Enkelejda Kasneci, Kathrin Seßler, Stefan Küchemann, Maria Bannert, Daryna Dementieva, Frank Fischer, Urs Gasser, Georg Groh, Stephan Günnemann, Eyke Hüllermeier, et al. 2023.  Chatgpt for good? on opportunities and challenges of large language models for education.  _Learning and individual differences_ , 103:102274.
  * Kennedy (2009) Ruth R Kennedy. 2009.  The power of in-class debates.  _Active learning in higher education_ , 10(3):225–236.
  * Khan et al. (2024) Akbir Khan, John Hughes, Dan Valentine, Laura Ruis, Kshitij Sachan, Ansh Radhakrishnan, Edward Grefenstette, Samuel R Bowman, Tim Rocktäschel, and Ethan Perez. 2024.  Debating with more persuasive llms leads to more truthful answers.  _arXiv preprint arXiv:2402.06782_.
  * Lee et al. (2024) Unggi Lee, Yeil Jeong, Junbo Koh, Gyuri Byun, Yunseo Lee, Youngsun Hwang, Hyeoncheol Kim, and Cheolil Lim. 2024.  Can chatgpt be a debate partner? developing chatgpt-based application “debo” for debate education, findings and limitations.  _Educational Technology & Society_, 27(2):pp. 321–346.
  * Liang et al. (2023) Tian Liang, Zhiwei He, Wenxiang Jiao, Xing Wang, Yan Wang, Rui Wang, Yujiu Yang, Zhaopeng Tu, and Shuming Shi. 2023.  Encouraging divergent thinking in large language models through multi-agent debate.  _arXiv preprint arXiv:2305.19118_.
  * Liévin et al. (2024) Valentin Liévin, Christoffer Egeberg Hother, Andreas Geert Motzfeldt, and Ole Winther. 2024.  Can large language models reason about medical questions?  _Patterns_ , 5(3).
  * Liu et al. (2024a) Jiawei Liu, Chunqiu Steven Xia, Yuyao Wang, and Lingming Zhang. 2024a.  Is your code generated by chatGPT really correct? rigorous evaluation of large language models for code generation.  In _Advances in Neural Information Processing Systems_.
  * Liu et al. (2024b) Xinyi Liu, Pinxin Liu, and Hangfeng He. 2024b.  An empirical analysis on large language models in debate evaluation.  _arXiv preprint arXiv:2406.00050_.
  * Madaan et al. (2024) Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, et al. 2024.  Self-refine: Iterative refinement with self-feedback.  In _Advances in Neural Information Processing Systems_.
  * Meta AI (2024) Meta AI. 2024.  Introducing Meta Llama 3: The most capable openly available LLM to date.
  * Pham et al. (2023) Chau Pham, Boyi Liu, Yingxiang Yang, Zhengyu Chen, Tianyi Liu, Jianbo Yuan, Bryan A Plummer, Zhaoran Wang, and Hongxia Yang. 2023.  Let models speak ciphers: Multiagent debate through embeddings.  _arXiv preprint arXiv:2310.06272_.
  * Proksch and Slapin (2015) Sven-Oliver Proksch and Jonathan B Slapin. 2015.  _The politics of parliamentary debate_.  Cambridge University Press.
  * Roose (2024) Kevin Roose. 2024.  A.I. has a measurement problem.  _New York Times_.
  * Roy and Macchiette (2005) Abhijit Roy and Bart Macchiette. 2005.  Debating the issues: A tool for augmenting critical thinking skills of marketing students.  _Journal of Marketing Education_ , 27(3):264–276.
  * Sawada et al. (2023) Tomohiro Sawada, Daniel Paleka, Alexander Havrilla, Pranav Tadepalli, Paula Vidas, Alexander Kranias, John J Nay, Kshitij Gupta, and Aran Komatsuzaki. 2023.  Arb: Advanced reasoning benchmark for large language models.  _arXiv preprint arXiv:2307.13692_.
  * Singhal et al. (2023) Karan Singhal, Shekoofeh Azizi, Tao Tu, S Sara Mahdavi, Jason Wei, Hyung Won Chung, Nathan Scales, Ajay Tanwani, Heather Cole-Lewis, Stephen Pfohl, et al. 2023.  Large language models encode clinical knowledge.  _Nature_ , 620(7972):172–180.
  * Thirunavukarasu et al. (2023) Arun James Thirunavukarasu, Darren Shu Jeng Ting, Kabilan Elangovan, Laura Gutierrez, Ting Fang Tan, and Daniel Shu Wei Ting. 2023.  Large language models in medicine.  _Nature medicine_ , 29(8):1930–1940.
  * Touvron et al. (2023) Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al. 2023.  Llama 2: Open foundation and fine-tuned chat models.  _arXiv preprint arXiv:2307.09288_.
  * Valmeekam et al. (2022) Karthik Valmeekam, Alberto Olmo, Sarath Sreedharan, and Subbarao Kambhampati. 2022.  Large language models still can’t plan (a benchmark for LLMs on planning and reasoning about change).  _arXiv preprint arXiv:2206.10498_.
  * Xiong et al. (2023) Kai Xiong, Xiao Ding, Yixin Cao, Ting Liu, and Bing Qin. 2023.  Examining inter-consistency of large language models collaboration: An in-depth analysis via debate.  In _The 2023 Conference on Empirical Methods in Natural Language Processing_.
  * Yang and Cui (2024) Angela Yang and Jasmine Cui. 2024.  ChatGPT still reigns supreme in many AI rankings, but the competition is on.  _NBC News_.
  * Yuan et al. (2022) Ann Yuan, Andy Coenen, Emily Reif, and Daphne Ippolito. 2022.  Wordcraft: story writing with large language models.  In _27th International Conference on Intelligent User Interfaces_ , pages 841–852.
  * Zhang et al. (2023) Zhexin Zhang, Leqi Lei, Lindong Wu, Rui Sun, Yongkang Huang, Chong Long, Xiao Liu, Xuanyu Lei, Jie Tang, and Minlie Huang. 2023.  Safetybench: Evaluating the safety of large language models with multiple choice questions.  _arXiv preprint arXiv:2309.07045_.
  * Zheng et al. (2024) Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric Xing, et al. 2024.  Judging LLM-as-a-judge with mt-bench and chatbot arena.  _Advances in Neural Information Processing Systems_ , 36.

##  Appendix A System Prompts and Prompts

In this section, we list the system prompts and prompts used in the
experiments.

###  A.1 Debating Models

The first language model $\mathrm{LM}_{1}$ is asked to start the debate. This
language model will have the following system prompt.

System Prompt for $\mathrm{LM}_{1}$ We are having a debate and the topic is
“TOPIC". You are representing “SIDE 1" and you should zealously support it.
This the first round and you are going first. You must bring-up arguments
supporting your side backed by logic, facts and evidence. Your answer should
also be convincing, factual and concise.

We will prompt $\mathrm{LM}_{1}$ as follows.

Prompt for $\mathrm{LM}_{1}$ Please start the debate.

In the second part of the debate, the second language model $\mathrm{LM}_{2}$
will be given the response of $\mathrm{LM}_{1}$. The second model is asked to
provide a rebuttal to the points raised by $\mathrm{LM}_{1}$. Also, it is
asked to provide new arguments supporting the second side. This language model
will have the following system prompt.

System Prompt for $\mathrm{LM}_{2}$ We are having a debate and the topic is
“TOPIC". You are representing “SIDE 2" and you should zealously support it.
The other side has started the debate and you will be given their arguments.
You must first provide a rebuttal to the points raised by them, and then
provide new arguments supporting your side. All your arguments should be
backed by logic, facts and evidence. Your answer should also be convincing,
factual and concise.

We prompt $\mathrm{LM}_{2}$ as follows.

Prompt for $\mathrm{LM}_{2}$ The other side said: “Response of
$\mathrm{LM}_{1}$ in Part 1".

In all following steps, we use the following system prompts for the models.

System Prompt We are having a debate and the topic is “TOPIC". You are
representing “SIDE" and you should zealously support it. You will be given all
the arguments so far. In your response, you should support your side and
refute the points raised by the other side. Your arguments should be backed by
logic, facts and evidence. Your answer should also be convincing, factual and
concise.

We prompt the models $\mathrm{LM}_{1}$ and $\mathrm{LM}_{2}$ as follows.

Prompt for $\mathrm{LM}_{1}$ You initially said: “Response of
$\mathrm{LM}_{1}$ in Part 1". You the other side responded: “Response of
$\mathrm{LM}_{2}$ in Part 2". Then you said: “Response of $\mathrm{LM}_{1}$ in
Part 3", ….

Prompt for $\mathrm{LM}_{2}$ The other side initially said: “Response of
$\mathrm{LM}_{1}$ in Part 1". You then responded: “Response of
$\mathrm{LM}_{2}$ in Part 2". The other side said: “Response of
$\mathrm{LM}_{1}$ in Part 3", ….

###  A.2 Judge Model

A judge language model gives scores from 1 to 10 to each debate participant
based on the following criteria: (1) Clarity of arguments (2) Factuality and
use of evidence (3) Rebuttal and counterarguments (4) Logical consistency (5)
Persuasiveness and impact (6) Conciseness (7) Coherence. The judges will have
the following system prompt.

System Prompt for the Judge We had a debate and the topic was “TOPIC". The two
sides in the debate each provided arguments to prove their side and refute the
points raised by the opponent. You are a judge for this debate. You should be
impartial and as objective as possible. The debate script will be given. You
should give a score from 1 to 10 to each side of the debate. In your
judgement, you should take into account the following criteria: clarity of
arguments, factuality and use of evidence, rebuttal and counterarguments,
logical consistency, persuasiveness and impact, conciseness, coherence. Also,
you should choose the side who you think is the overall winner. Your answer
MUST follow the following format: "side1: [[score of side 1]], side2: [[score
of side 2]], winner: [[name of winner]]" where score of side 1 and score of
side 2 are numbers from 1 to 10 and name of winner is either "1" or "2".

The judge generates the scores given the whole script of the debate, using the
following prompt.

Prompt for the Judge The script of the debate is as follows: Side 1: “Response
of $\mathrm{LM}_{1}$ in Part 1". Side 2: “Response of $\mathrm{LM}_{2}$ in
Part 2". Side 1: “Response of $\mathrm{LM}_{1}$ in Part 3". Side 2: “Response
of $\mathrm{LM}_{2}$ in Part 4".

##  Appendix B Topic of Debates

The twenty-five debate topics used in the experiments are as follows.

  1. 1.

Can alternative energy effectively replace fossil fuels?

  2. 2.

Should K-12 students dissect animals in science classrooms?

  3. 3.

Is artificial intelligence good for society?

  4. 4.

Should bottled water be banned?

  5. 5.

Is a college education worth it?

  6. 6.

Should the United States keep daylight saving time?

  7. 7.

Should school dress codes be implemented and enforced?

  8. 8.

Should the drinking age be lowered from 21 to a younger age?

  9. 9.

Should the election day be made a national holiday?

  10. 10.

Should the governments use Large Language Models for advice?

  11. 11.

Should employers be able to mandate vaccinations?

  12. 12.

Should fighting be allowed in hockey?

  13. 13.

Should fur clothing be banned?

  14. 14.

Should genetically modified organisms (GMOs) be grown?

  15. 15.

Is golf a sport and are golfers athletes?

  16. 16.

Is homework beneficial?

  17. 17.

Is the internet “making us stupid?”

  18. 18.

Should medical aid in dying be legal?

  19. 19.

Is obesity a disease?

  20. 20.

Should the penny stay in circulation?

  21. 21.

Are the Olympic games an overall benefit for their host countries and cities?

  22. 22.

Is there really a Santa Claus?

  23. 23.

Should Halloween be moved permanently to Saturday?

  24. 24.

Should students have to wear school uniforms?

  25. 25.

Is social media good for society?

##  Appendix C Experimental Results

In this section, we report the experimental results with GPT-4 as judge. Each
table is the result of the debates between two models on all topics. Home and
Away correspond to to runs of the debate on each topic, each time with one LLM
going first.

###  C.1 Llama-2-7b vs Llama-2-7b

| Home | Away
---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2
Topic | Winner | Llama-2-7b | Llama-2-7b | Winner | Llama-2-7b | Llama-2-7b
1 | Side 1 | 8 | 7 | Side 1 | 9 | 7
2 | Side 2 | 7 | 8 | Side 2 | 8 | 9
3 | Side 1 | 8 | 7 | Side 1 | 8 | 7
4 | Side 1 | 8 | 7 | Side 1 | 8 | 7
5 | Side 1 | 8 | 7 | Side 2 | 8 | 9
6 | Side 1 | 8 | 7 | Side 1 | 8 | 7
7 | Side 2 | 7 | 8 | Side 2 | 7 | 8
8 | Side 2 | 7 | 8 | Side 2 | 6 | 8
9 | Side 1 | 8 | 7 | Side 1 | 8 | 7
10 | Side 1 | 8 | 7 | Side 1 | 8 | 7
11 | Side 1 | 9 | 7 | Side 1 | 8 | 7
12 | Side 2 | 7 | 8 | Side 2 | 7 | 8
13 | Side 1 | 8 | 7 | Side 1 | 8 | 7
14 | Side 1 | 8 | 7 | Side 1 | 8 | 7
15 | Side 1 | 8 | 6 | Side 1 | 8 | 5
16 | Side 2 | 7 | 8 | Side 2 | 7 | 8
17 | Side 2 | 7 | 8 | Side 2 | 7 | 9
18 | Side 1 | 8 | 7 | Side 1 | 8 | 7
19 | Side 1 | 9 | 7 | Side 1 | 9 | 7
20 | Side 2 | 7 | 8 | Side 2 | 7 | 8
21 | Side 2 | 7 | 8 | Side 2 | 8 | 9
22 | Side 2 | 6 | 8 | Side 2 | 6 | 8
23 | Side 1 | 8 | 7 | Side 1 | 8 | 7
24 | Side 2 | 7 | 8 | Side 2 | 7 | 8
25 | Side 1 | 8 | 7 | Side 1 | 8 | 7

###  C.2 Llama-2-7b vs Llama-2-13b

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-2-13b | Llama-2-7b | Winner | Llama-2-7b | Llama-2-13b | Overall
1 | Llama-2-13b | 8 | 7 | Llama-2-7b | 8 | 7 | Tie
2 | Llama-2-7b | 7 | 8 | Llama-2-13b | 7 | 8 | Tie
3 | Llama-2-13b | 8 | 7 | Llama-2-7b | 8 | 7 | Tie
4 | Llama-2-13b | 8 | 7 | Llama-2-7b | 8 | 7 | Tie
5 | Llama-2-13b | 8 | 7 | Llama-2-7b | 8 | 7 | Tie
6 | Llama-2-13b | 8 | 7 | Tie | 8 | 8 | Llama-2-13b
7 | Llama-2-7b | 8 | 9 | Llama-2-13b | 7 | 9 | Tie
8 | Llama-2-7b | 6 | 8 | Llama-2-13b | 7 | 8 | Tie
9 | Llama-2-13b | 8 | 7 | Llama-2-7b | 8 | 7 | Tie
10 | Llama-2-13b | 8 | 7 | Llama-2-7b | 8 | 7 | Tie
11 | Llama-2-13b | 8 | 7 | Llama-2-7b | 8 | 7 | Tie
12 | Llama-2-7b | 7 | 8 | Llama-2-13b | 7 | 8 | Tie
13 | Llama-2-13b | 8 | 7 | Llama-2-7b | 8 | 7 | Tie
14 | Llama-2-13b | 8 | 7 | Llama-2-13b | 7 | 8 | Llama-2-13b
15 | Llama-2-13b | 8 | 7 | Llama-2-7b | 8 | 7 | Tie
16 | Llama-2-13b | 8 | 7 | Llama-2-7b | 8 | 7 | Tie
17 | Llama-2-7b | 6 | 8 | Llama-2-13b | 7 | 8 | Tie
18 | Llama-2-13b | 8 | 7 | Llama-2-7b | 8 | 7 | Tie
19 | Llama-2-13b | 9 | 7 | Llama-2-7b | 8 | 7 | Tie
20 | Llama-2-7b | 6 | 8 | Llama-2-13b | 7 | 8 | Tie
21 | Llama-2-13b | 8 | 7 | Llama-2-13b | 8 | 9 | Llama-2-13b
22 | Llama-2-7b | 6 | 8 | Llama-2-13b | 6 | 8 | Tie
23 | Llama-2-13b | 8 | 7 | Llama-2-13b | 7 | 8 | Llama-2-13b
24 | Llama-2-13b | 8 | 7 | Llama-2-13b | 8 | 9 | Llama-2-13b
25 | Llama-2-13b | 8 | 7 | Llama-2-13b | 8 | 9 | Llama-2-13b

###  C.3 Llama-2-7b vs. Llama-2-70b

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-2-7b | Llama-2-70b | Winner | Llama-2-70b | Llama-2-7b | Overall
1 | Llama-2-7b | 8 | 7 | Llama-2-70b | 9 | 7 | Tie
2 | Llama-2-70b | 7 | 9 | Llama-2-7b | 7 | 8 | Tie
3 | Llama-2-7b | 8 | 7 | Llama-2-70b | 8 | 7 | Tie
4 | Llama-2-7b | 8 | 7 | Llama-2-70b | 8 | 7 | Tie
5 | Llama-2-70b | 8 | 9 | Llama-2-70b | 8 | 7 | Llama-2-70b
6 | Llama-2-70b | 7 | 8 | Llama-2-70b | 8 | 7 | Llama-2-70b
7 | Llama-2-70b | 7 | 8 | Llama-2-70b | 8 | 7 | Llama-2-70b
8 | Llama-2-70b | 6 | 8 | Llama-2-7b | 7 | 8 | Tie
9 | Llama-2-7b | 8 | 7 | Llama-2-70b | 8 | 7 | Tie
10 | Llama-2-70b | 8 | 8 | Llama-2-70b | 8 | 8 | Llama-2-70b
11 | Llama-2-7b | 8 | 7 | Llama-2-70b | 8 | 7 | Tie
12 | Llama-2-70b | 7 | 9 | Llama-2-7b | 8 | 9 | Tie
13 | Llama-2-70b | 7 | 8 | Llama-2-70b | 8 | 7 | Llama-2-70b
14 | Llama-2-7b | 8 | 7 | Llama-2-70b | 8 | 7 | Tie
15 | Llama-2-7b | 8 | 7 | Llama-2-70b | 8 | 7 | Tie
16 | Llama-2-7b | 8 | 8 | Llama-2-70b | 8 | 7 | Tie
17 | Llama-2-70b | 7 | 8 | Llama-2-7b | 7 | 8 | Tie
18 | Llama-2-7b | 8 | 7 | Llama-2-70b | 8 | 7 | Tie
19 | Llama-2-7b | 9 | 8 | Llama-2-70b | 8 | 7 | Tie
20 | Llama-2-70b | 6 | 8 | Llama-2-7b | 7 | 8 | Tie
21 | Llama-2-70b | 8 | 9 | Llama-2-70b | 8 | 7 | Llama-2-70b
22 | Llama-2-70b | 6 | 8 | Llama-2-70b | 8 | 7 | Llama-2-70b
23 | Llama-2-7b | 8 | 7 | Llama-2-70b | 8 | 7 | Tie
24 | Llama-2-70b | 7 | 8 | Llama-2-70b | 8 | 7 | Llama-2-70b
25 | Llama-2-70b | 7 | 8 | Llama-2-70b | 9 | 8 | Llama-2-70b

###  C.4 Llama-2-7b vs. Llama-3-70b

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-3-70b | Llama-2-7b | Winner | Llama-2-7b | Llama-3-70b | Overall
1 | Llama-3-70b | 9 | 8 | Llama-2-7b | 9 | 8 | Tie
2 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
3 | Llama-2-7b | 8 | 9 | Llama-3-70b | 8 | 9 | Tie
4 | Llama-3-70b | 8 | 6 | Llama-2-7b | 8 | 7 | Tie
5 | Llama-3-70b | 8 | 7 | Llama-2-7b | 8 | 7 | Tie
6 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
7 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 9 | Llama-3-70b
8 | Llama-3-70b | 8 | 7 | Llama-3-70b | 6 | 8 | Llama-3-70b
9 | Llama-3-70b | 8 | 7 | Llama-2-7b | 8 | 7 | Tie
10 | Llama-3-70b | 8 | 7 | Llama-3-70b | 8 | 9 | Llama-3-70b
11 | Llama-3-70b | 8 | 7 | Llama-2-7b | 8 | 7 | Tie
12 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
13 | Llama-3-70b | 8 | 6 | Llama-2-7b | 8 | 7 | Tie
14 | Llama-3-70b | 8 | 7 | Llama-2-7b | 8 | 7 | Tie
15 | Llama-3-70b | 9 | 7 | Llama-2-7b | 8 | 7 | Tie
16 | tie | 8 | 8 | Llama-3-70b | 8 | 9 | Llama-3-70b
17 | Llama-2-7b | 7 | 8 | Llama-3-70b | 7 | 9 | Tie
18 | Llama-3-70b | 8 | 7 | Llama-2-7b | 8 | 7 | Tie
19 | Llama-3-70b | 9 | 8 | Llama-2-7b | 9 | 7 | Tie
20 | Llama-2-7b | 7 | 8 | Llama-3-70b | 6 | 8 | Tie
21 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
22 | Llama-2-7b | 7 | 8 | Llama-3-70b | 6 | 8 | Tie
23 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
24 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
25 | Llama-3-70b | 8 | 7 | Llama-3-70b | 8 | 9 | Llama-3-70b

###  C.5 Llama-2-7b vs. Vicuna-7b-v1.5

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-2-7b | Vicuna-7b-v1.5 | Winner | Vicuna-7b-v1.5 | Llama-2-7b | Overall
1 | Llama-2-7b | 9 | 7 | Vicuna-7b-v1.5 | 8 | 7 | Tie
2 | Vicuna-7b-v1.5 | 6 | 8 | Llama-2-7b | 7 | 8 | Tie
3 | Llama-2-7b | 8 | 7 | tie | 8 | 8 | Llama-2-7b
4 | Llama-2-7b | 8 | 7 | Vicuna-7b-v1.5 | 8 | 7 | Tie
5 | Llama-2-7b | 9 | 8 | Llama-2-7b | 8 | 9 | Llama-2-7b
6 | Llama-2-7b | 8 | 7 | Llama-2-7b | 7 | 8 | Llama-2-7b
7 | Vicuna-7b-v1.5 | 7 | 8 | Llama-2-7b | 7 | 8 | Tie
8 | Vicuna-7b-v1.5 | 7 | 8 | Llama-2-7b | 7 | 8 | Tie
9 | Llama-2-7b | 8 | 7 | Vicuna-7b-v1.5 | 8 | 7 | Tie
10 | Llama-2-7b | 8 | 7 | Llama-2-7b | 7 | 8 | Llama-2-7b
11 | Llama-2-7b | 8 | 7 | tie | 8 | 8 | Llama-2-7b
12 | Vicuna-7b-v1.5 | 7 | 8 | Llama-2-7b | 6 | 8 | Tie
13 | Llama-2-7b | 9 | 7 | Llama-2-7b | 7 | 8 | Llama-2-7b
14 | Llama-2-7b | 8 | 7 | Vicuna-7b-v1.5 | 8 | 7 | Tie
15 | Llama-2-7b | 8 | 7 | Vicuna-7b-v1.5 | 8 | 7 | Tie
16 | Llama-2-7b | 7 | 6 | Llama-2-7b | 7 | 8 | Llama-2-7b
17 | Vicuna-7b-v1.5 | 6 | 8 | Llama-2-7b | 6 | 8 | Tie
18 | Llama-2-7b | 9 | 7 | Vicuna-7b-v1.5 | 8 | 7 | Tie
19 | Llama-2-7b | 9 | 7 | Llama-2-7b | 8 | 9 | Llama-2-7b
20 | Llama-2-7b | 8 | 7 | Llama-2-7b | 6 | 8 | Llama-2-7b
21 | Llama-2-7b | 8 | 7 | Llama-2-7b | 8 | 9 | Llama-2-7b
22 | Vicuna-7b-v1.5 | 6 | 8 | Llama-2-7b | 5 | 7 | Tie
23 | Vicuna-7b-v1.5 | 6 | 8 | Llama-2-7b | 6 | 8 | Tie
24 | Llama-2-7b | 8 | 7 | Llama-2-7b | 7 | 8 | Llama-2-7b
25 | Vicuna-7b-v1.5 | 7 | 8 | Llama-2-7b | 7 | 8 | Tie

###  C.6 Llama-2-7b vs. Vicuna-13b-v1.5

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-2-7b | Vicuna-13b-v1.5 | Winner | Vicuna-13b-v1.5 | Llama-2-7b | Overall
1 | Llama-2-7b | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
2 | Vicuna-13b-v1.5 | 7 | 8 | Llama-2-7b | 7 | 8 | Tie
3 | Llama-2-7b | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
4 | Llama-2-7b | 8 | 7 | Llama-2-7b | 7 | 8 | Llama-2-7b
5 | Llama-2-7b | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
6 | Llama-2-7b | 8 | 7 | Llama-2-7b | 7 | 8 | Llama-2-7b
7 | Vicuna-13b-v1.5 | 8 | 9 | Llama-2-7b | 7 | 8 | Tie
8 | Vicuna-13b-v1.5 | 6 | 8 | Llama-2-7b | 7 | 8 | Tie
9 | Llama-2-7b | 8 | 7 | Vicuna-13b-v1.5 | 7 | 6 | Tie
10 | Llama-2-7b | 8 | 7 | Llama-2-7b | 8 | 9 | Llama-2-7b
11 | Llama-2-7b | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
12 | Vicuna-13b-v1.5 | 8 | 9 | Llama-2-7b | 6 | 9 | Tie
13 | Llama-2-7b | 8 | 7 | Llama-2-7b | 7 | 8 | Llama-2-7b
14 | Llama-2-7b | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
15 | Llama-2-7b | 8 | 6 | Llama-2-7b | 7 | 8 | Llama-2-7b
16 | Vicuna-13b-v1.5 | 8 | 8 | Llama-2-7b | 7 | 8 | Tie
17 | Vicuna-13b-v1.5 | 7 | 8 | Llama-2-7b | 7 | 9 | Tie
18 | Llama-2-7b | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
19 | Llama-2-7b | 9 | 7 | Llama-2-7b | 8 | 9 | Llama-2-7b
20 | Vicuna-13b-v1.5 | 7 | 8 | Llama-2-7b | 6 | 8 | Tie
21 | Vicuna-13b-v1.5 | 8 | 9 | Llama-2-7b | 7 | 8 | Tie
22 | Vicuna-13b-v1.5 | 7 | 8 | Llama-2-7b | 7 | 8 | Tie
23 | Vicuna-13b-v1.5 | 7 | 8 | Vicuna-13b-v1.5 | 8 | 7 | Vicuna-13b-v1.5
24 | Llama-2-7b | 8 | 7 | Llama-2-7b | 6 | 8 | Llama-2-7b
25 | tie | 8 | 8 | Vicuna-13b-v1.5 | 8 | 7 | Vicuna-13b-v1.5

###  C.7 Llama-2-7b vs. Mixtral-8x7B

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-2-7b | Mixtral-8x7B | Winner | Mixtral-8x7B | Llama-2-7b | Overall
1 | Llama-2-7b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
2 | Mixtral-8x7B | 7 | 8 | Llama-2-7b | 7 | 8 | Tie
3 | Llama-2-7b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
4 | Llama-2-7b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
5 | Llama-2-7b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
6 | Llama-2-7b | 8 | 7 | Llama-2-7b | 8 | 9 | Llama-2-7b
7 | Mixtral-8x7B | 7 | 8 | Llama-2-7b | 7 | 8 | Tie
8 | Mixtral-8x7B | 7 | 8 | Llama-2-7b | 7 | 8 | Tie
9 | Mixtral-8x7B | 8 | 9 | Draw | 8 | 8 | Mixtral-8x7B
10 | Llama-2-7b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
11 | Llama-2-7b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
12 | Mixtral-8x7B | 7 | 8 | Llama-2-7b | 8 | 9 | Tie
13 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
14 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
15 | Llama-2-7b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
16 | Mixtral-8x7B | 8 | 9 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
17 | Mixtral-8x7B | 7 | 8 | Llama-2-7b | 7 | 8 | Tie
18 | Llama-2-7b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
19 | Llama-2-7b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
20 | Mixtral-8x7B | 7 | 8 | Llama-2-7b | 7 | 8 | Tie
21 | Mixtral-8x7B | 8 | 9 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
22 | Mixtral-8x7B | 6 | 8 | Llama-2-7b | 7 | 8 | Tie
23 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
24 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
25 | Mixtral-8x7B | 8 | 9 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B

###  C.8 Llama-2-7b vs GPT 3.5

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-2-7b | GPT-3.5 | Winner | GPT-3.5 | Llama-2-7b | Overall
1 | Llama-2-7b | 8 | 7 | GPT-3.5 | 9 | 7 | Tie
2 | GPT-3.5 | 7 | 8 | Llama-2-7b | 7 | 8 | Tie
3 | GPT-3.5 | 8 | 9 | Llama-2-7b | 8 | 9 | Tie
4 | Llama-2-7b | 8 | 7 | Llama-2-7b | 7 | 8 | Llama-2-7b
5 | GPT-3.5 | 8 | 9 | GPT-3.5 | 8 | 7 | GPT-3.5
6 | GPT-3.5 | 8 | 9 | Llama-2-7b | 7 | 8 | Tie
7 | GPT-3.5 | 7 | 8 | Llama-2-7b | 7 | 8 | Tie
8 | GPT-3.5 | 6 | 8 | Llama-2-7b | 8 | 7 | Tie
9 | Llama-2-7b | 8 | 7 | GPT-3.5 | 8 | 7 | Tie
10 | GPT-3.5 | 8 | 9 | GPT-3.5 | 8 | 7 | GPT-3.5
11 | Llama-2-7b | 8 | 7 | GPT-3.5 | 8 | 7 | Tie
12 | GPT-3.5 | 7 | 9 | Llama-2-7b | 7 | 9 | Tie
13 | Llama-2-7b | 8 | 7 | GPT-3.5 | 8 | 7 | Tie
14 | GPT-3.5 | 8 | 9 | GPT-3.5 | 8 | 7 | GPT-3.5
15 | Llama-2-7b | 8 | 7 | GPT-3.5 | 8 | 7 | Tie
16 | GPT-3.5 | 8 | 9 | Llama-2-7b | 8 | 9 | Tie
17 | GPT-3.5 | 7 | 9 | Llama-2-7b | 7 | 8 | Tie
18 | Llama-2-7b | 8 | 7 | GPT-3.5 | 8 | 7 | Tie
19 | Llama-2-7b | 8 | 7 | GPT-3.5 | 8 | 7 | Tie
20 | GPT-3.5 | 7 | 8 | Llama-2-7b | 7 | 8 | Tie
21 | GPT-3.5 | 8 | 9 | GPT-3.5 | 8 | 7 | GPT-3.5
22 | GPT-3.5 | 6 | 8 | Llama-2-7b | 7 | 8 | Tie
23 | GPT-3.5 | 7 | 8 | GPT-3.5 | 8 | 7 | GPT-3.5
24 | GPT-3.5 | 7 | 8 | Llama-2-7b | 7 | 8 | Tie
25 | GPT-3.5 | 8 | 9 | Llama-2-7b | 8 | 9 | Tie

###  C.9 Llama-2-7b vs GPT 4

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-2-7b | GPT-4 | Winner | GPT-4 | Llama-2-7b | Overall
1 | Llama-2-7b | 9 | 8 | GPT-4 | 9 | 7 | Tie
2 | GPT-4 | 7 | 9 | GPT-4 | 8 | 7 | GPT-4
3 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4
4 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4
5 | GPT-4 | 8 | 9 | GPT-4 | 9 | 8 | GPT-4
6 | GPT-4 | 7 | 9 | GPT-4 | 8 | 7 | GPT-4
7 | GPT-4 | 7 | 9 | GPT-4 | 8 | 7 | GPT-4
8 | GPT-4 | 6 | 8 | GPT-4 | 8 | 7 | GPT-4
9 | GPT-4 | 7 | 8 | GPT-4 | 9 | 7 | GPT-4
10 | GPT-4 | 7 | 8 | GPT-4 | 8 | 7 | GPT-4
11 | GPT-4 | 7 | 8 | GPT-4 | 8 | 7 | GPT-4
12 | GPT-4 | 6 | 9 | GPT-4 | 8 | 7 | GPT-4
13 | GPT-4 | 7 | 8 | GPT-4 | 9 | 7 | GPT-4
14 | GPT-4 | 7 | 9 | GPT-4 | 9 | 7 | GPT-4
15 | GPT-4 | 7 | 8 | GPT-4 | 9 | 7 | GPT-4
16 | GPT-4 | 7 | 9 | GPT-4 | 8 | 7 | GPT-4
17 | GPT-4 | 7 | 9 | GPT-4 | 8 | 7 | GPT-4
18 | GPT-4 | 8 | 9 | GPT-4 | 9 | 7 | GPT-4
19 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4
20 | GPT-4 | 6 | 8 | GPT-4 | 8 | 7 | GPT-4
21 | GPT-4 | 7 | 9 | GPT-4 | 8 | 7 | GPT-4
22 | GPT-4 | 7 | 9 | GPT-4 | 8 | 7 | GPT-4
23 | GPT-4 | 7 | 8 | GPT-4 | 8 | 7 | GPT-4
24 | GPT-4 | 7 | 9 | GPT-4 | 8 | 7 | GPT-4
25 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4

###  C.10 Llama-2-13b vs Llama-2-13b

| Home | Away
---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2
Topic | Winner | Llama-2-13b | Llama-2-13b | Winner | Llama-2-13b | Llama-2-13b
1 | Side 1 | 8 | 7 | Side 1 | 8 | 7
2 | Side 2 | 8 | 9 | Side 2 | 7 | 8
3 | Side 1 | 8 | 7 | Side 1 | 8 | 7
4 | Side 1 | 8 | 7 | Side 1 | 8 | 7
5 | Side 1 | 8 | 7 | Side 1 | 8 | 7
6 | Side 2 | 8 | 9 | Side 1 | 8 | 7
7 | Side 1 | 9 | 8 | Side 1 | 8 | 7
8 | Side 2 | 7 | 8 | Side 2 | 7 | 8
9 | Side 1 | 8 | 7 | Side 1 | 8 | 7
10 | Side 1 | 8 | 7 | Side 1 | 8 | 7
11 | Side 2 | 7 | 8 | Side 1 | 8 | 7
12 | Side 2 | 7 | 8 | Side 2 | 7 | 8
13 | Side 1 | 8 | 7 | Side 1 | 8 | 7
14 | Side 1 | 8 | 7 | Side 1 | 8 | 7
15 | Side 1 | 8 | 7 | Side 1 | 8 | 7
16 | Side 1 | 8 | 8 | Side 1 | 8 | 8
17 | Side 2 | 7 | 8 | Side 2 | 7 | 8
18 | Side 1 | 8 | 7 | Side 1 | 8 | 7
19 | Side 1 | 9 | 7 | Side 1 | 9 | 7
20 | Side 2 | 6 | 8 | Side 2 | 7 | 8
21 | Side 2 | 8 | 9 | Side 2 | 8 | 9
22 | Side 2 | 6 | 8 | Side 2 | 6 | 8
23 | Side 1 | 8 | 7 | Side 1 | 8 | 7
24 | Side 2 | 8 | 9 | Side 2 | 8 | 9
25 | Side 2 | 8 | 9 | Side 2 | 8 | 9

###  C.11 Llama-2-13b vs Llama-2-70b

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-2-13b | Llama-2-70b | Winner | Llama-2-70b | Llama-2-13b | Overall
1 | Llama-2-13b | 8 | 6 | Llama-2-70b | 8 | 7 | Tie
2 | Llama-2-70b | 7 | 8 | Llama-2-13b | 8 | 9 | Tie
3 | Llama-2-70b | 8 | 9 | Llama-2-70b | 8 | 7 | Llama-2-70b
4 | Llama-2-13b | 8 | 7 | Llama-2-70b | 8 | 7 | Tie
5 | Llama-2-13b | 8 | 7 | Llama-2-70b | 8 | 7 | Tie
6 | Llama-2-70b | 8 | 9 | Llama-2-70b | 8 | 7 | Llama-2-70b
7 | Llama-2-70b | 7 | 8 | Llama-2-70b | 8 | 7 | Llama-2-70b
8 | Llama-2-70b | 7 | 8 | Llama-2-70b | 8 | 7 | Llama-2-70b
9 | Llama-2-70b | 7 | 8 | Llama-2-70b | 8 | 7 | Llama-2-70b
10 | Llama-2-13b | 8 | 7 | Llama-2-70b | 8 | 7 | Tie
11 | Llama-2-13b | 8 | 7 | Llama-2-70b | 8 | 7 | Tie
12 | Llama-2-70b | 7 | 8 | Llama-2-13b | 8 | 9 | Tie
13 | Llama-2-13b | 8 | 7 | Llama-2-70b | 8 | 7 | Tie
14 | Llama-2-13b | 8 | 7 | Llama-2-70b | 8 | 7 | Tie
15 | Llama-2-13b | 8 | 6 | Llama-2-70b | 8 | 6 | Tie
16 | Llama-2-70b | 8 | 9 | Llama-2-70b | 8 | 7 | Llama-2-70b
17 | Llama-2-70b | 7 | 8 | Llama-2-13b | 7 | 8 | Tie
18 | Llama-2-13b | 8 | 7 | Llama-2-70b | 8 | 7 | Tie
19 | Llama-2-13b | 8 | 6 | Llama-2-70b | 8 | 6 | Tie
20 | Llama-2-70b | 6 | 8 | Llama-2-13b | 7 | 8 | Tie
21 | Llama-2-70b | 8 | 9 | Llama-2-70b | 8 | 7 | Llama-2-70b
22 | Llama-2-70b | 6 | 8 | Llama-2-13b | 7 | 8 | Tie
23 | Llama-2-13b | 8 | 7 | Llama-2-70b | 8 | 7 | Tie
24 | Llama-2-70b | 7 | 8 | Llama-2-13b | 8 | 9 | Tie
25 | Llama-2-13b | 8 | 7 | Llama-2-70b | 8 | 8 | Tie

###  C.12 Llama-2-13b vs. Llama-3-70b

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-3-70b | Llama-2-13b | Winner | Llama-2-13b | Llama-3-70b | Overall
1 | Llama-3-70b | 9 | 7 | Llama-2-13b | 8 | 7 | Tie
2 | tie | 8 | 8 | Llama-3-70b | 7 | 8 | Llama-3-70b
3 | Llama-3-70b | 8 | 7 | Llama-3-70b | 8 | 9 | Llama-3-70b
4 | Llama-3-70b | 8 | 7 | Llama-2-13b | 8 | 7 | Tie
5 | Llama-3-70b | 8 | 7 | Llama-2-13b | 8 | 7 | Tie
6 | Llama-2-13b | 8 | 9 | Llama-2-13b | 8 | 7 | Llama-2-13b
7 | Llama-3-70b | 8 | 7 | Llama-3-70b | 8 | 9 | Llama-3-70b
8 | Llama-2-13b | 7 | 8 | Llama-3-70b | 6 | 8 | Tie
9 | Llama-3-70b | 8 | 7 | Llama-3-70b | 8 | 9 | Llama-3-70b
10 | Llama-3-70b | 8 | 7 | Llama-2-13b | 8 | 7 | Llama-2-13b
11 | Llama-3-70b | 8 | 6 | Llama-3-70b | 7 | 8 | Llama-3-70b
12 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 9 | Llama-3-70b
13 | Llama-3-70b | 8 | 6 | Llama-3-70b | 7 | 8 | Llama-3-70b
14 | Llama-3-70b | 8 | 7 | Llama-2-13b | 8 | 7 | Tie
15 | Llama-3-70b | 9 | 7 | Llama-2-13b | 8 | 7 | Tie
16 | Llama-3-70b | 8 | 7 | Llama-3-70b | 8 | 9 | Llama-3-70b
17 | Llama-2-13b | 7 | 8 | Llama-3-70b | 7 | 9 | Tie
18 | Llama-3-70b | 9 | 8 | Llama-3-70b | 7 | 8 | Llama-3-70b
19 | Llama-3-70b | 9 | 7 | Llama-2-13b | 8 | 7 | Tie
20 | Llama-2-13b | 7 | 8 | Llama-3-70b | 6 | 8 | Tie
21 | Llama-3-70b | 9 | 8 | Llama-3-70b | 7 | 8 | Llama-3-70b
22 | Llama-2-13b | 6 | 8 | Llama-3-70b | 6 | 8 | Ties
23 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
24 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
25 | Llama-3-70b | 8 | 7 | Llama-3-70b | 8 | 9 | Llama-3-70b

###  C.13 Llama-2-13b vs. Vicuna-7b-v1.5

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-2-13b | Vicuna-7b-v1.5 | Winner | Vicuna-7b-v1.5 | Llama-2-13b | Overall
1 | Llama-2-13b | 8 | 7 | Vicuna-7b-v1.5 | 8 | 7 | Tie
2 | Vicuna-7b-v1.5 | 7 | 8 | Llama-2-13b | 7 | 8 | Tie
3 | Llama-2-13b | 9 | 8 | Vicuna-7b-v1.5 | 8 | 8 | Tie
4 | Llama-2-13b | 8 | 7 | Vicuna-7b-v1.5 | 8 | 7 | Tie
5 | Llama-2-13b | 8 | 7 | Vicuna-7b-v1.5 | 8 | 7 | Tie
6 | Llama-2-13b | 8 | 7 | Llama-2-13b | 7 | 8 | Llama-2-13b
7 | Llama-2-13b | 8 | 7 | Llama-2-13b | 7 | 8 | Llama-2-13b
8 | Llama-2-13b | 8 | 7 | Llama-2-13b | 7 | 8 | Llama-2-13b
9 | Llama-2-13b | 8 | 7 | Vicuna-7b-v1.5 | 8 | 7 | Tie
10 | Llama-2-13b | 8 | 7 | Llama-2-13b | 7 | 8 | Llama-2-13b
11 | Llama-2-13b | 8 | 7 | Llama-2-13b | 7 | 8 | Llama-2-13b
12 | Llama-2-13b | 8 | 7 | Llama-2-13b | 6 | 8 | Llama-2-13b
13 | Llama-2-13b | 9 | 7 | Llama-2-13b | 7 | 8 | Llama-2-13b
14 | Llama-2-13b | 8 | 7 | Vicuna-7b-v1.5 | 8 | 7 | Tie
15 | Llama-2-13b | 8 | 6 | Vicuna-7b-v1.5 | 8 | 7 | Tie
16 | Llama-2-13b | 8 | 7 | Llama-2-13b | 7 | 8 | Llama-2-13b
17 | Llama-2-13b | 8 | 7 | Llama-2-13b | 6 | 9 | Llama-2-13b
18 | Llama-2-13b | 8 | 6 | Vicuna-7b-v1.5 | 8 | 7 | Tie
19 | Llama-2-13b | 8 | 7 | Llama-2-13b | 7 | 8 | Llama-2-13b
20 | Vicuna-7b-v1.5 | 6 | 8 | Llama-2-13b | 6 | 8 | Tie
21 | Llama-2-13b | 8 | 7 | Llama-2-13b | 6 | 8 | Llama-2-13b
22 | Vicuna-7b-v1.5 | 6 | 8 | Llama-2-13b | 6 | 8 | Tie
23 | Llama-2-13b | 8 | 7 | Llama-2-13b | 7 | 8 | Llama-2-13b
24 | Llama-2-13b | 8 | 7 | Llama-2-13b | 8 | 9 | Llama-2-13b
25 | Llama-2-13b | 8 | 7 | Llama-2-13b | 7 | 8 | Llama-2-13b

###  C.14 Llama-2-13b vs. Vicuna-13b-v1.5

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-2-13b | Vicuna-13b-v1.5 | Winner | Vicuna-13b-v1.5 | Llama-2-13b | Overall
1 | Llama-2-13b | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
2 | Vicuna-13b-v1.5 | 8 | 9 | Llama-2-13b | 7 | 8 | Tie
3 | Llama-2-13b | 8 | 7 | Llama-2-13b | 7 | 8 | Llama-2-13b
4 | Llama-2-13b | 8 | 7 | Llama-2-13b | 7 | 8 | Llama-2-13b
5 | Llama-2-13b | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
6 | Vicuna-13b-v1.5 | 7 | 8 | Llama-2-13b | 7 | 8 | Tie
7 | Vicuna-13b-v1.5 | 8 | 9 | Llama-2-13b | 7 | 8 | Tie
8 | Vicuna-13b-v1.5 | 7 | 8 | Llama-2-13b | 6 | 8 | Tie
9 | Llama-2-13b | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
10 | Llama-2-13b | 8 | 7 | Llama-2-13b | 7 | 8 | Llama-2-13b
11 | Llama-2-13b | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
12 | Vicuna-13b-v1.5 | 8 | 9 | Llama-2-13b | 6 | 8 | Tie
13 | Llama-2-13b | 8 | 6 | Vicuna-13b-v1.5 | 8 | 7 | Tie
14 | Llama-2-13b | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
15 | Llama-2-13b | 8 | 6 | Vicuna-13b-v1.5 | 8 | 7 | Tie
16 | Llama-2-13b | 8 | 7 | Llama-2-13b | 7 | 8 | Llama-2-13b
17 | Vicuna-13b-v1.5 | 7 | 8 | Llama-2-13b | 6 | 8 | Tie
18 | Llama-2-13b | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
19 | Llama-2-13b | 9 | 7 | Llama-2-13b | 7 | 8 | Llama-2-13b
20 | Vicuna-13b-v1.5 | 7 | 8 | Llama-2-13b | 6 | 8 | Tie
21 | Llama-2-13b | 8 | 7 | Llama-2-13b | 7 | 8 | Llama-2-13b
22 | Vicuna-13b-v1.5 | 6 | 8 | Llama-2-13b | 7 | 8 | Tie
23 | Llama-2-13b | 8 | 7 | Llama-2-13b | 7 | 8 | Llama-2-13b
24 | Llama-2-13b | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
25 | Llama-2-13b | 8 | 7 | Llama-2-13b | 8 | 9 | Llama-2-13b

###  C.15 Llama-2-13b vs Mixtral-8x7B

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-2-13b | Mixtral-8x7B | Winner | Mixtral-8x7B | Llama-2-13b | Overall
1 | Llama-2-13b | 8 | 7 | Mixtral-8x7B | 9 | 7 | Tie
2 | Mixtral-8x7B | 7 | 8 | Llama-2-13b | 8 | 9 | Tie
3 | Llama-2-13b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
4 | Mixtral-8x7B | 8 | 9 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
5 | Llama-2-13b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
6 | Mixtral-8x7B | 8 | 9 | Llama-2-13b | 7 | 8 | Tie
7 | Mixtral-8x7B | 8 | 9 | Llama-2-13b | 7 | 8 | Tie
8 | Mixtral-8x7B | 7 | 8 | Llama-2-13b | 6 | 8 | Tie
9 | Llama-2-13b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
10 | Llama-2-13b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
11 | Llama-2-13b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
12 | Mixtral-8x7B | 6 | 8 | Llama-2-13b | 8 | 9 | Tie
13 | Llama-2-13b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
14 | Llama-2-13b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
15 | Llama-2-13b | 8 | 6 | Mixtral-8x7B | 8 | 7 | Tie
16 | Llama-2-13b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
17 | Mixtral-8x7B | 7 | 8 | Llama-2-13b | 7 | 8 | Tie
18 | Llama-2-13b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
19 | Llama-2-13b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
20 | Mixtral-8x7B | 6 | 8 | Llama-2-13b | 6 | 9 | Tie
21 | Mixtral-8x7B | 8 | 9 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
22 | Mixtral-8x7B | 6 | 8 | Llama-2-13b | 6 | 8 | Tie
23 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
24 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
25 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B

###  C.16 Llama-2-13b vs. GPT 3.5

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-2-13b | GPT 3.5 | Winner | GPT 3.5 | Llama-2-13b | Overall
1 | Llama-2-13b | 8 | 7 | GPT 3.5 | 9 | 7 | Tie
2 | GPT 3.5 | 7 | 9 | Llama-2-13b | 8 | 9 | Tie
3 | Llama-2-13b | 8 | 7 | GPT 3.5 | 8 | 7 | Tie
4 | Llama-2-13b | 8 | 7 | GPT 3.5 | 8 | 7 | Tie
5 | GPT 3.5 | 8 | 9 | GPT 3.5 | 8 | 7 | GPT 3.5
6 | GPT 3.5 | 8 | 9 | Llama-2-13b | 7 | 8 | Tie
7 | GPT 3.5 | 8 | 9 | Llama-2-13b | 7 | 8 | Tie
8 | GPT 3.5 | 7 | 9 | GPT 3.5 | 8 | 7 | GPT 3.5
9 | Llama-2-13b | 8 | 7 | GPT 3.5 | 8 | 7 | Tie
10 | Llama-2-13b | 8 | 7 | GPT 3.5 | 8 | 7 | Tie
11 | GPT 3.5 | 8 | 9 | Llama-2-13b | 7 | 8 | Tie
12 | GPT 3.5 | 8 | 9 | Llama-2-13b | 7 | 8 | Tie
13 | GPT 3.5 | 7 | 8 | GPT 3.5 | 8 | 7 | GPT 3.5
14 | tie | 8 | 8 | GPT 3.5 | 8 | 7 | GPT 3.5
15 | Llama-2-13b | 8 | 7 | GPT 3.5 | 9 | 7 | Tie
16 | GPT 3.5 | 8 | 9 | GPT 3.5 | 8 | 7 | GPT 3.5
17 | GPT 3.5 | 6 | 8 | Llama-2-13b | 8 | 9 | Tie
18 | Llama-2-13b | 8 | 7 | GPT 3.5 | 8 | 7 | Tie
19 | Llama-2-13b | 8 | 7 | GPT 3.5 | 8 | 7 | Tie
20 | GPT 3.5 | 6 | 8 | Llama-2-13b | 6 | 9 | Tie
21 | GPT 3.5 | 8 | 9 | Llama-2-13b | 7 | 8 | Tie
22 | GPT 3.5 | 6 | 8 | Llama-2-13b | 7 | 8 | Tie
23 | GPT 3.5 | 8 | 9 | GPT 3.5 | 8 | 7 | GPT 3.5
24 | GPT 3.5 | 7 | 8 | Llama-2-13b | 8 | 9 | Tie
25 | GPT 3.5 | 7 | 8 | GPT 3.5 | 8 | 7 | GPT 3.5

###  C.17 Llama-2-13b vs. GPT 4

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-2-13b | GPT-4 | Winner | GPT-4 | Llama-2-13b | Overall
1 | GPT-4 | 8 | 9 | GPT-4 | 9 | 6 | GPT-4
2 | GPT-4 | 6 | 9 | Llama-2-13b | 8 | 9 | Tie
3 | GPT-4 | 8 | 9 | GPT-4 | 9 | 8 | GPT-4
4 | GPT-4 | 7 | 8 | GPT-4 | 8 | 7 | GPT-4
5 | GPT-4 | 8 | 9 | GPT-4 | 9 | 8 | GPT-4
6 | GPT-4 | 7 | 9 | GPT-4 | 8 | 7 | GPT-4
7 | GPT-4 | 7 | 9 | GPT-4 | 8 | 7 | GPT-4
8 | GPT-4 | 7 | 8 | GPT-4 | 8 | 7 | GPT-4
9 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4
10 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4
11 | GPT-4 | 7 | 8 | GPT-4 | 9 | 7 | GPT-4
12 | GPT-4 | 7 | 9 | Llama-2-13b | 8 | 9 | Tie
13 | GPT-4 | 7 | 8 | GPT-4 | 8 | 7 | GPT-4
14 | GPT-4 | 7 | 9 | GPT-4 | 9 | 8 | GPT-4
15 | GPT-4 | 8 | 9 | GPT-4 | 9 | 7 | GPT-4
16 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4
17 | GPT-4 | 6 | 9 | GPT-4 | 8 | 7 | GPT-4
18 | GPT-4 | 8 | 9 | GPT-4 | 9 | 7 | GPT-4
19 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4
20 | GPT-4 | 6 | 9 | Llama-2-13b | 8 | 9 | Tie
21 | GPT-4 | 7 | 9 | GPT-4 | 8 | 7 | GPT-4
22 | GPT-4 | 5 | 8 | GPT-4 | 8 | 7 | GPT-4
23 | GPT-4 | 7 | 8 | GPT-4 | 8 | 7 | GPT-4
24 | GPT-4 | 7 | 8 | GPT-4 | 8 | 7 | GPT-4
25 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4

###  C.18 Llama-2-70b vs. Llama-2-70b

| Home | Away
---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2
Topic | Winner | Llama-2-70b | Llama-2-70b | Winner | Llama-2-70b | Llama-2-70b
1 | 1 | 9 | 7 | 1 | 8 | 7
2 | 2 | 7 | 8 | 2 | 7 | 8
3 | 2 | 8 | 9 | 2 | 8 | 9
4 | 1 | 8 | 7 | 1 | 8 | 7
5 | 1 | 8 | 7 | 1 | 8 | 7
6 | 2 | 8 | 9 | 2 | 8 | 9
7 | 2 | 8 | 9 | 2 | 8 | 9
8 | 2 | 8 | 9 | 1 | 8 | 7
9 | 1 | 9 | 7 | 1 | 8 | 7
10 | 2 | 8 | 9 | 2 | 8 | 9
11 | 1 | 8 | 7 | 1 | 8 | 7
12 | 2 | 8 | 9 | 2 | 8 | 9
13 | 1 | 8 | 7 | 1 | 9 | 7
14 | 1 | 8 | 7 | 1 | 8 | 7
15 | 1 | 8 | 7 | 1 | 9 | 7
16 | 1 | 8 | 7 | 1 | 9 | 8
17 | 2 | 7 | 8 | 2 | 8 | 9
18 | 1 | 8 | 7 | 1 | 8 | 7
19 | 1 | 8 | 7 | 1 | 8 | 7
20 | 2 | 6 | 8 | 2 | 7 | 8
21 | 1 | 8 | 7 | 2 | 8 | 9
22 | 2 | 7 | 8 | 2 | 7 | 8
23 | 1 | 8 | 7 | 1 | 8 | 7
24 | 1 | 8 | 7 | 1 | 8 | 7
25 | 2 | 8 | 9 | 2 | 8 | 9

###  C.19 Llama-2-70b vs. Llama-3-70b

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-3-70b | Llama-2-70b | Winner | Llama-2-70b | Llama-3-70b | Overall
1 | Llama-3-70b | 9 | 7 | Llama-2-70b | 8 | 7 | Tie
2 | Llama-2-70b | 8 | 9 | Llama-3-70b | 7 | 9 | Tie
3 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
4 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
5 | Llama-3-70b | 8 | 7 | Llama-3-70b | 8 | 9 | Llama-3-70b
6 | Llama-2-70b | 8 | 9 | Llama-3-70b | 7 | 8 | Tie
7 | Llama-2-70b | 7 | 9 | Llama-3-70b | 7 | 8 | Tie
8 | Llama-2-70b | 7 | 8 | Llama-3-70b | 7 | 8 | Tie
9 | Llama-3-70b | 8 | 7 | Llama-2-70b | 8 | 7 | Tie
10 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
11 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
12 | Llama-2-70b | 8 | 9 | Llama-3-70b | 7 | 8 | Tie
13 | Llama-3-70b | 9 | 7 | Llama-3-70b | 8 | 9 | Llama-3-70b
14 | Llama-3-70b | 8 | 7 | Llama-2-70b | 8 | 7 | Tie
15 | Llama-3-70b | 9 | 6 | Llama-2-70b | 9 | 8 | Tie
16 | Llama-2-70b | 8 | 9 | Llama-2-70b | 8 | 7 | Tie
17 | Llama-2-70b | 7 | 8 | Llama-3-70b | 7 | 8 | Tie
18 | Llama-3-70b | 8 | 7 | Llama-2-70b | 8 | 7 | Tie
19 | Llama-3-70b | 8 | 7 | Llama-2-70b | 8 | 7 | Tie
20 | Llama-2-70b | 8 | 9 | Llama-3-70b | 7 | 9 | Tie
21 | Tie | 8 | 8 | Llama-3-70b | 8 | 9 | Llama-3-70b
22 | Llama-2-70b | 7 | 8 | Llama-3-70b | 6 | 8 | Tie
23 | Llama-3-70b | 8 | 7 | Llama-2-70b | 8 | 7 | Tie
24 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
25 | Llama-3-70b | 8 | 7 | Llama-3-70b | 8 | 9 | Llama-3-70b

###  C.20 Llama-2-70b vs. Vicuna-7b-v1.5

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-2-70b | Vicuna-7b-v1.5 | Winner | Vicuna-7b-v1.5 | Llama-2-70b | Overall
1 | Llama-2-70b | 9 | 7 | Vicuna-7b-v1.5 | 8 | 7 | Tie
2 | Vicuna-7b-v1.5 | 8 | 9 | Llama-2-70b | 7 | 8 | Tie
3 | Llama-2-70b | 9 | 8 | Llama-2-70b | 8 | 9 | Llama-2-70b
4 | Llama-2-70b | 8 | 7 | Llama-2-70b | 7 | 8 | Llama-2-70b
5 | Llama-2-70b | 9 | 8 | Vicuna-7b-v1.5 | 8 | 7 | Tie
6 | Llama-2-70b | 8 | 7 | Llama-2-70b | 8 | 9 | Llama-2-70b
7 | Llama-2-70b | 8 | 7 | Llama-2-70b | 7 | 8 | Llama-2-70b
8 | Llama-2-70b | 8 | 7 | Llama-2-70b | 7 | 8 | Llama-2-70b
9 | Llama-2-70b | 8 | 7 | Llama-2-70b | 7 | 9 | Llama-2-70b
10 | Llama-2-70b | 8 | 7 | Llama-2-70b | 7 | 8 | Llama-2-70b
11 | Llama-2-70b | 8 | 7 | Vicuna-7b-v1.5 | 8 | 7 | Tie
12 | Llama-2-70b | 8 | 7 | Llama-2-70b | 6 | 8 | Llama-2-70b
13 | Llama-2-70b | 8 | 7 | Llama-2-70b | 7 | 8 | Llama-2-70b
14 | Llama-2-70b | 9 | 7 | Vicuna-7b-v1.5 | 8 | 7 | Tie
15 | Llama-2-70b | 8 | 6 | Vicuna-7b-v1.5 | 8 | 7 | Tie
16 | Llama-2-70b | 9 | 8 | Llama-2-70b | 7 | 9 | Llama-2-70b
17 | Vicuna-7b-v1.5 | 7 | 8 | Llama-2-70b | 7 | 8 | Tie
18 | Llama-2-70b | 9 | 7 | Vicuna-7b-v1.5 | 8 | 7 | Tie
19 | Llama-2-70b | 9 | 7 | Vicuna-7b-v1.5 | 8 | 7 | Tie
20 | Vicuna-7b-v1.5 | 7 | 8 | Llama-2-70b | 6 | 8 | Tie
21 | Llama-2-70b | 8 | 7 | Llama-2-70b | 8 | 9 | Llama-2-70b
22 | Vicuna-7b-v1.5 | 7 | 8 | Llama-2-70b | 5 | 8 | Tie
23 | Llama-2-70b | 8 | 7 | Llama-2-70b | 6 | 8 | Llama-2-70b
24 | Llama-2-70b | 8 | 7 | Vicuna-7b-v1.5 | 8 | 7 | Tie
25 | Llama-2-70b | 8 | 7 | Llama-2-70b | 7 | 8 | Llama-2-70b

###  C.21 Llama-2-70b vs. Vicuna-13b-v1.5

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-2-70b | Vicuna-13b-v1.5 | Winner | Vicuna-13b-v1.5 | Llama-2-70b | Overall
1 | Llama-2-70b | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
2 | Vicuna-13b-v1.5 | 7 | 8 | Llama-2-70b | 7 | 8 | Tie
3 | Llama-2-70b | 8 | 7 | Llama-2-70b | 7 | 8 | Llama-2-70b
4 | Llama-2-70b | 8 | 7 | Llama-2-70b | 7 | 8 | Llama-2-70b
5 | Llama-2-70b | 8 | 7 | Llama-2-70b | 7 | 8 | Llama-2-70b
6 | Llama-2-70b | 8 | 7 | Llama-2-70b | 7 | 9 | Llama-2-70b
7 | Llama-2-70b | 8 | 7 | Llama-2-70b | 7 | 8 | Llama-2-70b
8 | Vicuna-13b-v1.5 | 7 | 8 | Llama-2-70b | 6 | 8 | Tie
9 | Llama-2-70b | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
10 | Llama-2-70b | 8 | 7 | Llama-2-70b | 7 | 8 | Llama-2-70b
11 | Llama-2-70b | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
12 | Vicuna-13b-v1.5 | 8 | 9 | Llama-2-70b | 6 | 9 | Tie
13 | Llama-2-70b | 8 | 7 | Llama-2-70b | 7 | 8 | Llama-2-70b
14 | Llama-2-70b | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
15 | Llama-2-70b | 9 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
16 | Llama-2-70b | 8 | 7 | Llama-2-70b | 7 | 8 | Llama-2-70b
17 | Vicuna-13b-v1.5 | 7 | 8 | Llama-2-70b | 7 | 8 | Tie
18 | Llama-2-70b | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
19 | Llama-2-70b | 9 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
20 | Vicuna-13b-v1.5 | 7 | 8 | Llama-2-70b | 6 | 8 | Tie
21 | Vicuna-13b-v1.5 | 8 | 9 | Llama-2-70b | 7 | 8 | Tie
22 | Llama-2-70b | 8 | 7 | Llama-2-70b | 6 | 7 | Llama-2-70b
23 | Llama-2-70b | 8 | 7 | Llama-2-70b | 7 | 8 | Llama-2-70b
24 | Llama-2-70b | 8 | 7 | Llama-2-70b | 8 | 9 | Llama-2-70b
25 | Vicuna-13b-v1.5 | 7 | 8 | Llama-2-70b | 7 | 8 | Tie

###  C.22 Llama-2-70b vs. Mixtral-8x7B

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-2-70b | Mixtral-8x7B | Winner | Mixtral-8x7B | Llama-2-70b | Overall
1 | Llama-2-70b | 9 | 7 | Mixtral-8x7B | 8 | 7 | Tie
2 | Mixtral-8x7B | 8 | 9 | Llama-2-70b | 7 | 8 | Tie
3 | Llama-2-70b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
4 | Llama-2-70b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
5 | Llama-2-70b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
6 | Mixtral-8x7B | 8 | 9 | Llama-2-70b | 8 | 9 | Tie
7 | Llama-2-70b | 8 | 7 | Llama-2-70b | 8 | 9 | Llama-2-70b
8 | Mixtral-8x7B | 8 | 9 | Llama-2-70b | 7 | 8 | Tie
9 | Llama-2-70b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
10 | Llama-2-70b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
11 | Llama-2-70b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
12 | Mixtral-8x7B | 8 | 9 | Llama-2-70b | 8 | 9 | Tie
13 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
14 | tie | 8 | 8 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
15 | Llama-2-70b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
16 | Mixtral-8x7B | 8 | 9 | Llama-2-70b | 8 | 9 | Tie
17 | Mixtral-8x7B | 7 | 8 | Llama-2-70b | 7 | 8 | Tie
18 | Llama-2-70b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
19 | Llama-2-70b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
20 | Mixtral-8x7B | 7 | 8 | Llama-2-70b | 7 | 9 | Tie
21 | tie | 8 | 8 | Llama-2-70b | 8 | 9 | Llama-2-70b
22 | Mixtral-8x7B | 6 | 8 | Llama-2-70b | 6 | 8 | Tie
23 | Llama-2-70b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
24 | Llama-2-70b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
25 | Mixtral-8x7B | 8 | 9 | Llama-2-70b | 8 | 9 | Tie

###  C.23 Llama-2-70b vs. GPT 3.5

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-2-70b | GPT 3.5 | Winner | GPT 3.5 | Llama-2-70b | Overall
1 | GPT 3.5 | 7 | 9 | Llama-2-70b | 8 | 9 | Tie
2 | Llama-2-70b | 8 | 7 | GPT 3.5 | 8 | 7 | Tie
3 | Llama-2-70b | 9 | 8 | Llama-2-70b | 7 | 8 | Llama-2-70b
4 | GPT 3.5 | 7 | 8 | Llama-2-70b | 7 | 8 | Tie
5 | GPT 3.5 | 8 | 9 | GPT 3.5 | 9 | 8 | GPT 3.5
6 | Llama-2-70b | 9 | 8 | GPT 3.5 | 8 | 7 | Tie
7 | Llama-2-70b | 9 | 8 | GPT 3.5 | 8 | 7 | Tie
8 | Llama-2-70b | 8 | 7 | GPT 3.5 | 8 | 7 | Tie
9 | GPT 3.5 | 8 | 9 | Llama-2-70b | 7 | 8 | Tie
10 | GPT 3.5 | 7 | 8 | GPT 3.5 | 8 | 7 | GPT 3.5
11 | GPT 3.5 | 7 | 8 | Llama-2-70b | 7 | 8 | Tie
12 | Llama-2-70b | 8 | 7 | GPT 3.5 | 8 | 6 | Tie
13 | GPT 3.5 | 7 | 8 | Llama-2-70b | 7 | 8 | Tie
14 | Llama-2-70b | 9 | 8 | GPT 3.5 | 9 | 8 | Tie
15 | GPT 3.5 | 7 | 8 | Llama-2-70b | 7 | 8 | Tie
16 | Llama-2-70b | 9 | 8 | GPT 3.5 | 8 | 7 | Tie
17 | Llama-2-70b | 9 | 8 | GPT 3.5 | 8 | 6 | Tie
18 | GPT 3.5 | 7 | 8 | Llama-2-70b | 7 | 8 | Tie
19 | GPT 3.5 | 7 | 8 | Llama-2-70b | 7 | 8 | Tie
20 | Llama-2-70b | 8 | 6 | GPT 3.5 | 8 | 6 | Tie
21 | Llama-2-70b | 9 | 8 | GPT 3.5 | 8 | 7 | Tie
22 | Llama-2-70b | 8 | 7 | GPT 3.5 | 8 | 6 | Tie
23 | Llama-2-70b | 9 | 8 | GPT 3.5 | 8 | 7 | Tie
24 | Llama-2-70b | 9 | 8 | GPT 3.5 | 8 | 7 | Tie
25 | Llama-2-70b | 9 | 8 | GPT 3.5 | 9 | 8 | Tie

###  C.24 Llama-2-70b vs. GPT 4

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-2-70b | GPT 4 | Winner | GPT 4 | Llama-2-70b | Over
1 | Llama-2-70b | 8 | 7 | GPT 4 | 9 | 7 | Tie
2 | GPT 4 | 8 | 9 | Llama-2-70b | 8 | 9 | Tie
3 | GPT 4 | 7 | 8 | GPT 4 | 9 | 8 | GPT 4
4 | GPT 4 | 7 | 8 | GPT 4 | 8 | 7 | GPT 4
5 | GPT 4 | 8 | 9 | GPT 4 | 8 | 7 | GPT 4
6 | GPT 4 | 8 | 9 | GPT 4 | 8 | 7 | GPT 4
7 | GPT 4 | 7 | 8 | GPT 4 | 8 | 7 | GPT 4
8 | GPT 4 | 7 | 8 | GPT 4 | 8 | 7 | GPT 4
9 | GPT 4 | 8 | 9 | GPT 4 | 9 | 7 | GPT 4
10 | GPT 4 | 7 | 8 | GPT 4 | 8 | 7 | GPT 4
11 | GPT 4 | 7 | 8 | GPT 4 | 8 | 7 | GPT 4
12 | GPT 4 | 7 | 9 | Llama-2-70b | 7 | 9 | Tie
13 | GPT 4 | 7 | 8 | GPT 4 | 9 | 7 | GPT 4
14 | GPT 4 | 8 | 9 | GPT 4 | 9 | 7 | GPT 4
15 | GPT 4 | 8 | 9 | GPT 4 | 8 | 7 | GPT 4
16 | GPT 4 | 8 | 9 | Llama-2-70b | 8 | 9 | Tie
17 | GPT 4 | 7 | 8 | tie | 8 | 8 | GPT 4
18 | GPT 4 | 8 | 9 | GPT 4 | 8 | 7 | GPT 4
19 | GPT 4 | 8 | 9 | GPT 4 | 8 | 7 | GPT 4
20 | GPT 4 | 7 | 9 | GPT 4 | 8 | 7 | GPT 4
21 | GPT 4 | 7 | 9 | GPT 4 | 8 | 7 | GPT 4
22 | GPT 4 | 6 | 9 | GPT 4 | 8 | 7 | GPT 4
23 | GPT 4 | 8 | 9 | GPT 4 | 8 | 7 | GPT 4
24 | GPT 4 | 7 | 9 | GPT 4 | 8 | 7 | GPT 4
25 | GPT 4 | 8 | 9 | GPT 4 | 9 | 8 | GPT 4

###  C.25 Llama-3-70b vs. Vicuna-7b-v1.5

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-3-70b | Vicuna-7b-v1.5 | Winner | Vicuna-7b-v1.5 | Llama-3-70b | Overall
1 | Llama-3-70b | 8 | 7 | Llama-3-70b | 4 | 7 | Llama-3-70b
2 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 9 | Llama-3-70b
3 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
4 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
5 | Llama-3-70b | 9 | 8 | Llama-3-70b | 8 | 9 | Llama-3-70b
6 | Llama-3-70b | 8 | 7 | Llama-3-70b | 6 | 8 | Llama-3-70b
7 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
8 | Llama-3-70b | 8 | 7 | Llama-3-70b | 6 | 8 | Llama-3-70b
9 | Llama-3-70b | 9 | 7 | Llama-3-70b | 8 | 9 | Llama-3-70b
10 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
11 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
12 | Llama-3-70b | 9 | 7 | Llama-3-70b | 6 | 9 | Llama-3-70b
13 | Llama-3-70b | 9 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
14 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
15 | Llama-3-70b | 8 | 6 | Llama-3-70b | 7 | 8 | Llama-3-70b
16 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
17 | Vicuna-7b-v1.5 | 7 | 8 | Llama-3-70b | 6 | 9 | Tie
18 | Llama-3-70b | 9 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
19 | Llama-3-70b | 8 | 7 | Vicuna-7b-v1.5 | 8 | 7 | Tie
20 | Llama-3-70b | 8 | 7 | Llama-3-70b | 6 | 9 | Llama-3-70b
21 | Llama-3-70b | 8 | 7 | Llama-3-70b | 6 | 8 | Llama-3-70b
22 | Llama-3-70b | 8 | 7 | Llama-3-70b | 6 | 9 | Llama-3-70b
23 | Llama-3-70b | 8 | 6 | Llama-3-70b | 6 | 8 | Llama-3-70b
24 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 9 | Llama-3-70b
25 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 9 | Llama-3-70b

###  C.26 Llama-3-70b vs. Vicuna-13b-v1.5

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-3-70b | Vicuna-13b-v1.5 | Winner | Vicuna-13b-v1.5 | Llama-3-70b | Overall
1 | Llama-3-70b | 9 | 7 | Llama-3-70b | 8 | 9 | Llama-3-70b
2 | Vicuna-13b-v1.5 | 7 | 8 | Llama-3-70b | 7 | 8 | Tie
3 | Vicuna-13b-v1.5 | 8 | 9 | Llama-3-70b | 7 | 8 | Tie
4 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
5 | Llama-3-70b | 8 | 7 | Llama-3-70b | 8 | 9 | Llama-3-70b
6 | Vicuna-13b-v1.5 | 8 | 9 | Llama-3-70b | 7 | 8 | Tie
7 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 9 | Llama-3-70b
8 | Llama-3-70b | 8 | 7 | Llama-3-70b | 6 | 8 | Llama-3-70b
9 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
10 | tie | 8 | 8 | Llama-3-70b | 7 | 8 | Tie
11 | Llama-3-70b | 8 | 7 | Llama-3-70b | 8 | 9 | Llama-3-70b
12 | Vicuna-13b-v1.5 | 8 | 9 | Llama-3-70b | 6 | 9 | Tie
13 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 9 | Llama-3-70b
14 | Llama-3-70b | 9 | 8 | Llama-3-70b | 7 | 8 | Llama-3-70b
15 | Llama-3-70b | 9 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
16 | tie | 8 | 8 | Llama-3-70b | 7 | 9 | Llama-3-70b
17 | Vicuna-13b-v1.5 | 7 | 8 | Llama-3-70b | 6 | 9 | Tie
18 | Llama-3-70b | 9 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
19 | Llama-3-70b | 9 | 7 | Llama-3-70b | 8 | 9 | Llama-3-70b
20 | Vicuna-13b-v1.5 | 7 | 8 | Llama-3-70b | 6 | 9 | Tie
21 | tie | 8 | 8 | Llama-3-70b | 7 | 9 | Llama-3-70b
22 | Vicuna-13b-v1.5 | 7 | 8 | Llama-3-70b | 6 | 8 | Tie
23 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
24 | Llama-3-70b | 9 | 8 | Llama-3-70b | 7 | 8 | Llama-3-70b
25 | Llama-3-70b | 8 | 7 | Llama-3-70b | 8 | 9 | Llama-3-70b

###  C.27 Llama-3-70b vs. Mixtral-8x7B

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-3-70b | Mixtral-8x7B | Winner | Mixtral-8x7B | Llama-3-70b | Overall
1 | Llama-3-70b | 9 | 8 | Mixtral-8x7B | 8 | 7 | Tie
2 | Llama-3-70b | 8 | 7 | Llama-3-70b | 8 | 9 | Llama-3-70b
3 | Llama-3-70b | 8 | 7 | Llama-3-70b | 8 | 9 | Llama-3-70b
4 | Llama-3-70b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
5 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
6 | Mixtral-8x7B | 8 | 9 | Llama-3-70b | 8 | 9 | Tie
7 | Mixtral-8x7B | 7 | 8 | Llama-3-70b | 7 | 8 | Tie
8 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
9 | Mixtral-8x7B | 8 | 9 | Llama-3-70b | 8 | 9 | Tie
10 | Llama-3-70b | 8 | 7 | Llama-3-70b | 8 | 9 | Llama-3-70b
11 | Llama-3-70b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
12 | Mixtral-8x7B | 7 | 9 | Llama-3-70b | 7 | 8 | Tie
13 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
14 | Llama-3-70b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
15 | Llama-3-70b | 9 | 8 | Mixtral-8x7B | 8 | 7 | Tie
16 | Mixtral-8x7B | 8 | 9 | Llama-3-70b | 8 | 9 | Tie
17 | Mixtral-8x7B | 8 | 9 | Llama-3-70b | 7 | 8 | Tie
18 | Llama-3-70b | 9 | 8 | Mixtral-8x7B | 8 | 7 | Tie
19 | Llama-3-70b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
20 | Mixtral-8x7B | 7 | 8 | Llama-3-70b | 6 | 8 | Tie
21 | Mixtral-8x7B | 7 | 8 | Llama-3-70b | 8 | 9 | Tie
22 | Mixtral-8x7B | 7 | 8 | Llama-3-70b | 6 | 9 | Tie
23 | Mixtral-8x7B | 7 | 8 | Llama-3-70b | 8 | 9 | Tie
24 | Mixtral-8x7B | 8 | 9 | Llama-3-70b | 7 | 8 | Tie
25 | Mixtral-8x7B | 7 | 8 | Llama-3-70b | 7 | 8 | Tie

###  C.28 Llama-3-70b vs. GPT-3.5

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-3-70b | GPT-3.5 | Winner | GPT-3.5 | Llama-3-70b | Overall
1 | Llama-3-70b | 8 | 7 | GPT-3.5 | 8 | 7 | Tie
2 | GPT-3.5 | 8 | 9 | Llama-3-70b | 7 | 8 | Tie
3 | GPT-3.5 | 8 | 9 | Llama-3-70b | 8 | 9 | Tie
4 | Llama-3-70b | 8 | 7 | GPT-3.5 | 8 | 7 | Tie
5 | tie | 8 | 8 | Llama-3-70b | 8 | 9 | Llama-3-70b
6 | GPT-3.5 | 7 | 8 | Llama-3-70b | 7 | 8 | Tie
7 | GPT-3.5 | 8 | 9 | Llama-3-70b | 7 | 9 | Tie
8 | GPT-3.5 | 7 | 8 | Llama-3-70b | 6 | 8 | Tie
9 | Llama-3-70b | 8 | 7 | GPT-3.5 | 8 | 7 | Tie
10 | GPT-3.5 | 8 | 9 | Llama-3-70b | 8 | 9 | Tie
11 | Llama-3-70b | 8 | 7 | GPT-3.5 | 8 | 7 | Tie
12 | GPT-3.5 | 8 | 9 | Llama-3-70b | 6 | 9 | Tie
13 | Llama-3-70b | 8 | 7 | GPT-3.5 | 8 | 7 | Tie
14 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
15 | Llama-3-70b | 9 | 8 | GPT-3.5 | 8 | 7 | Tie
16 | Llama-3-70b | 9 | 8 | Llama-3-70b | 7 | 8 | Llama-3-70b
17 | GPT-3.5 | 8 | 9 | Llama-3-70b | 7 | 9 | Tie
18 | Llama-3-70b | 8 | 7 | Llama-3-70b | 8 | 9 | Llama-3-70b
19 | Llama-3-70b | 8 | 7 | GPT-3.5 | 8 | 7 | Tie
20 | GPT-3.5 | 7 | 8 | Llama-3-70b | 7 | 9 | Tie
21 | GPT-3.5 | 8 | 9 | Llama-3-70b | 7 | 8 | Tie
22 | GPT-3.5 | 7 | 9 | Llama-3-70b | 6 | 9 | Tie
23 | Llama-3-70b | 8 | 7 | Llama-3-70b | 7 | 8 | Llama-3-70b
24 | GPT-3.5 | 8 | 9 | Llama-3-70b | 7 | 8 | Tie
25 | GPT-3.5 | 8 | 9 | Llama-3-70b | 8 | 9 | Tie

###  C.29 Llama-3-70b vs. GPT-4

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama-3-70b | GPT-4 | Winner | GPT-4 | Llama-3-70b | Overall
1 | Llama-3-70b | 8 | 7 | GPT-4 | 9 | 7 | Tie
2 | GPT-4 | 7 | 9 | Llama-3-70b | 7 | 8 | Tie
3 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4
4 | GPT-4 | 7 | 8 | GPT-4 | 8 | 7 | GPT-4
5 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4
6 | GPT-4 | 7 | 8 | Llama-3-70b | 8 | 9 | Tie
7 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4
8 | GPT-4 | 7 | 8 | GPT-4 | 8 | 7 | GPT-4
9 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4
10 | GPT-4 | 8 | 9 | Llama-3-70b | 8 | 9 | Tie
11 | Llama-3-70b | 8 | 7 | GPT-4 | 8 | 7 | Tie
12 | GPT-4 | 7 | 8 | Llama-3-70b | 8 | 9 | Tie
13 | Llama-3-70b | 8 | 7 | GPT-4 | 8 | 7 | Tie
14 | GPT-4 | 8 | 9 | GPT-4 | 9 | 8 | GPT-4
15 | GPT-4 | 8 | 9 | GPT-4 | 9 | 7 | GPT-4
16 | GPT-4 | 8 | 9 | Llama-3-70b | 8 | 9 | Tie
17 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4
18 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4
19 | Llama-3-70b | 8 | 7 | GPT-4 | 9 | 8 | Tie
20 | GPT-4 | 7 | 9 | Llama-3-70b | 7 | 8 | Tie
21 | GPT-4 | 7 | 8 | Llama-3-70b | 8 | 9 | Tie
22 | GPT-4 | 7 | 9 | GPT-4 | 8 | 7 | GPT-4
23 | GPT-4 | 7 | 9 | GPT-4 | 8 | 7 | GPT-4
24 | GPT-4 | 8 | 9 | Llama-3-70b | 8 | 9 | Tie
25 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4

###  C.30 Vicuna-7b-v1.5 vs. Vicuna-7b-v1.5

| Home | Away
---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2
Topic | Winner | Vicuna-7b-v1.5 | Vicuna-7b-v1.5 | Winner | Vicuna-7b-v1.5 | Vicuna-7b-v1.5
1 | 1 | 8 | 7 | 1 | 8 | 7
2 | 2 | 7 | 8 | 2 | 7 | 8
3 | 1 | 8 | 7 | 1 | 8 | 7
4 | 1 | 8 | 7 | 1 | 8 | 7
5 | 1 | 8 | 7 | 1 | 8 | 7
6 | 1 | 8 | 7 | 2 | 7 | 8
7 | 1 | 8 | 7 | 2 | 8 | 9
8 | 2 | 7 | 8 | 2 | 7 | 8
9 | 1 | 8 | 7 | 1 | 8 | 7
10 | 1 | 8 | 7 | 1 | 8 | 7
11 | 1 | 8 | 7 | 1 | 8 | 7
12 | 2 | 6 | 8 | 2 | 7 | 8
13 | 2 | 7 | 8 | 2 | 7 | 8
14 | 2 | 7 | 8 | 1 | 8 | 7
15 | 1 | 8 | 7 | 1 | 8 | 7
16 | 1 | 8 | 7 | 1 | 8 | 7
17 | 2 | 8 | 9 | 2 | 7 | 8
18 | 1 | 8 | 7 | 1 | 8 | 7
19 | 1 | 8 | 7 | 1 | 8 | 7
20 | 2 | 7 | 8 | 2 | 6 | 8
21 | 1 | 8 | 7 | 1 | 8 | 7
22 | 2 | 7 | 8 | 2 | 6 | 8
23 | 1 | 8 | 7 | 1 | 8 | 7
24 | 1 | 8 | 7 | 1 | 8 | 7
25 | 2 | 8 | 9 | 2 | 8 | 9

###  C.31 Vicuna-7b-v1.5 vs. Vicuna-13b-v1.5

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Vicuna-7b-v1.5 | Vicuna-13b-v1.5 | Winner | Vicuna-13b-v1.5 | Vicuna-7b-v1.5 | Overall
1 | Vicuna-7b-v1.5 | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
2 | Vicuna-13b-v1.5 | 7 | 8 | Vicuna-7b-v1.5 | 7 | 8 | Tie
3 | Vicuna-13b-v1.5 | 8 | 9 | Vicuna-13b-v1.5 | 8 | 7 | Vicuna-13b-v1.5
4 | Vicuna-7b-v1.5 | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
5 | Vicuna-7b-v1.5 | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
6 | Vicuna-13b-v1.5 | 6 | 8 | Vicuna-7b-v1.5 | 7 | 8 | Tie
7 | Vicuna-13b-v1.5 | 8 | 9 | Vicuna-7b-v1.5 | 8 | 9 | Tie
8 | Vicuna-13b-v1.5 | 7 | 8 | Vicuna-7b-v1.5 | 7 | 8 | Tie
9 | Vicuna-7b-v1.5 | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
10 | Vicuna-13b-v1.5 | 8 | 9 | tie | 8 | 8 | Vicuna-13b-v1.5
11 | Vicuna-7b-v1.5 | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
12 | Vicuna-13b-v1.5 | 6 | 8 | Vicuna-7b-v1.5 | 6 | 8 | Tie
13 | Vicuna-7b-v1.5 | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
14 | Vicuna-13b-v1.5 | 8 | 9 | Vicuna-13b-v1.5 | 8 | 7 | Vicuna-13b-v1.5
15 | Vicuna-7b-v1.5 | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
16 | Vicuna-13b-v1.5 | 7 | 8 | Vicuna-7b-v1.5 | 8 | 9 | Tie
17 | Vicuna-13b-v1.5 | 7 | 8 | Vicuna-7b-v1.5 | 7 | 8 | Tie
18 | Vicuna-7b-v1.5 | 8 | 7 | Vicuna-13b-v1.5 | 8 | 6 | Tie
19 | Vicuna-7b-v1.5 | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
20 | Vicuna-13b-v1.5 | 7 | 8 | Vicuna-7b-v1.5 | 6 | 7 | Tie
21 | Vicuna-13b-v1.5 | 7 | 8 | Vicuna-7b-v1.5 | 7 | 8 | Tie
22 | Vicuna-13b-v1.5 | 6 | 8 | Vicuna-7b-v1.5 | 7 | 8 | Tie
23 | Vicuna-13b-v1.5 | 7 | 8 | Vicuna-7b-v1.5 | 7 | 8 | Tie
24 | Vicuna-7b-v1.5 | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
25 | Vicuna-7b-v1.5 | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie

###  C.32 Vicuna-7b-v1.5 vs. Mixtral-8x7B

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Vicuna-7b-v1.5 | Mixtral-8x7B | Winner | Mixtral-8x7B | Vicuna-7b-v1.5 | Overall
1 | Vicuna-7b-v1.5 | 8 | 7 | Mixtral-8x7B | 9 | 7 | Tie
2 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
3 | Vicuna-7b-v1.5 | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
4 | Vicuna-7b-v1.5 | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
5 | tie | 8 | 8 | Mixtral-8x7B | 9 | 7 | Mixtral-8x7B
6 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
7 | Mixtral-8x7B | 7 | 8 | Vicuna-7b-v1.5 | 8 | 9 | Tie
8 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
9 | Vicuna-7b-v1.5 | 8 | 7 | Mixtral-8x7B | 9 | 7 | Tie
10 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
11 | Vicuna-7b-v1.5 | 8 | 7 | Mixtral-8x7B | 8 | 6 | Tie
12 | Mixtral-8x7B | 6 | 8 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
13 | Vicuna-7b-v1.5 | 8 | 7 | Mixtral-8x7B | 8 | 6 | Tie
14 | Mixtral-8x7B | 8 | 9 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
15 | Vicuna-7b-v1.5 | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
16 | Mixtral-8x7B | 7 | 8 | Vicuna-7b-v1.5 | 8 | 9 | Tie
17 | Mixtral-8x7B | 7 | 9 | Vicuna-7b-v1.5 | 8 | 9 | Tie
18 | Vicuna-7b-v1.5 | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
19 | Vicuna-7b-v1.5 | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
20 | Mixtral-8x7B | 7 | 9 | Vicuna-7b-v1.5 | 7 | 8 | Tie
21 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
22 | Mixtral-8x7B | 6 | 8 | Vicuna-7b-v1.5 | 7 | 8 | Tie
23 | Vicuna-7b-v1.5 | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
24 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
25 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 8 | 8 | Mixtral-8x7B

###  C.33 Vicuna-7b-v1.5 vs. GPT 3.5

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Vicuna-7b-v1.5 | GPT 3.5 | Winner | GPT 3.5 | Vicuna-7b-v1.5 | Overall
1 | Vicuna-7b-v1.5 | 8 | 7 | GPT 3.5 | 9 | 8 | Tie
2 | GPT 3.5 | 7 | 8 | Vicuna-7b-v1.5 | 7 | 8 | Tie
3 | GPT 3.5 | 8 | 7 | GPT 3.5 | 8 | 7 | GPT 3.5
4 | GPT 3.5 | 8 | 7 | GPT 3.5 | 8 | 7 | GPT 3.5
5 | GPT 3.5 | 8 | 8 | GPT 3.5 | 8 | 7 | GPT 3.5
6 | GPT 3.5 | 7 | 8 | tie | 8 | 8 | GPT 3.5
7 | GPT 3.5 | 7 | 8 | GPT 3.5 | 8 | 7 | GPT 3.5
8 | GPT 3.5 | 7 | 8 | GPT 3.5 | 8 | 7 | GPT 3.5
9 | GPT 3.5 | 8 | 7 | GPT 3.5 | 8 | 7 | GPT 3.5
10 | GPT 3.5 | 7 | 8 | GPT 3.5 | 8 | 7 | GPT 3.5
11 | GPT 3.5 | 8 | 7 | GPT 3.5 | 8 | 7 | GPT 3.5
12 | GPT 3.5 | 6 | 8 | Vicuna-7b-v1.5 | 7 | 8 | Tie
13 | GPT 3.5 | 8 | 7 | GPT 3.5 | 8 | 7 | GPT 3.5
14 | GPT 3.5 | 8 | 9 | GPT 3.5 | 8 | 7 | GPT 3.5
15 | Vicuna-7b-v1.5 | 8 | 7 | GPT 3.5 | 9 | 6 | Tie
16 | GPT 3.5 | 7 | 8 | GPT 3.5 | 8 | 7 | GPT 3.5
17 | GPT 3.5 | 7 | 9 | Vicuna-7b-v1.5 | 7 | 8 | Tie
18 | Vicuna-7b-v1.5 | 8 | 7 | GPT 3.5 | 8 | 7 | Tie
19 | Vicuna-7b-v1.5 | 8 | 7 | GPT 3.5 | 8 | 7 | Tie
20 | GPT 3.5 | 7 | 9 | GPT 3.5 | 8 | 7 | GPT 3.5
21 | GPT 3.5 | 7 | 8 | GPT 3.5 | 8 | 7 | GPT 3.5
22 | GPT 3.5 | 6 | 8 | GPT 3.5 | 8 | 7 | GPT 3.5
23 | GPT 3.5 | 8 | 7 | GPT 3.5 | 8 | 7 | GPT 3.5
24 | GPT 3.5 | 7 | 8 | GPT 3.5 | 8 | 7 | GPT 3.5
25 | GPT 3.5 | 7 | 8 | tie | 8 | 8 | GPT 3.5

###  C.34 Vicuna-7b-v1.5 vs. GPT 4

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Vicuna-7b-v1.5 | GPT 4 | Winner | GPT 4 | Vicuna-7b-v1.5 | Overall
1 | GPT 4 | 8 | 9 | GPT 4 | 9 | 7 | GPT 4
2 | GPT 4 | 7 | 9 | GPT 4 | 9 | 7 | GPT 4
3 | GPT 4 | 8 | 9 | GPT 4 | 9 | 7 | GPT 4
4 | GPT 4 | 7 | 9 | GPT 4 | 9 | 8 | GPT 4
5 | GPT 4 | 7 | 9 | GPT 4 | 9 | 8 | GPT 4
6 | GPT 4 | 7 | 9 | GPT 4 | 9 | 7 | GPT 4
7 | GPT 4 | 7 | 9 | Vicuna-7b-v1.5 | 8 | 9 | Tie
8 | GPT 4 | 6 | 8 | GPT 4 | 8 | 7 | GPT 4
9 | GPT 4 | 7 | 8 | GPT 4 | 9 | 7 | GPT 4
10 | GPT 4 | 7 | 8 | GPT 4 | 8 | 7 | GPT 4
11 | GPT 4 | 7 | 9 | GPT 4 | 8 | 7 | GPT 4
12 | GPT 4 | 6 | 9 | GPT 4 | 8 | 7 | GPT 4
13 | GPT 4 | 7 | 8 | GPT 4 | 9 | 7 | GPT 4
14 | GPT 4 | 7 | 8 | GPT 4 | 9 | 8 | GPT 4
15 | GPT 4 | 7 | 9 | GPT 4 | 9 | 6 | GPT 4
16 | GPT 4 | 7 | 9 | GPT 4 | 9 | 8 | GPT 4
17 | GPT 4 | 7 | 9 | GPT 4 | 8 | 7 | GPT 4
18 | GPT 4 | 8 | 9 | GPT 4 | 9 | 7 | GPT 4
19 | GPT 4 | 8 | 9 | GPT 4 | 9 | 8 | GPT 4
20 | GPT 4 | 6 | 9 | GPT 4 | 8 | 7 | GPT 4
21 | GPT 4 | 7 | 8 | GPT 4 | 8 | 7 | GPT 4
22 | GPT 4 | 6 | 9 | GPT 4 | 8 | 7 | GPT 4
23 | GPT 4 | 7 | 9 | GPT 4 | 9 | 8 | GPT 4
24 | GPT 4 | 7 | 9 | GPT 4 | 9 | 7 | GPT 4
25 | GPT 4 | 7 | 9 | GPT 4 | 8 | 7 | GPT 4

###  C.35 Vicuna-13b-v1.5 vs. Vicuna-13b-v1.5

| Home | Away
---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2
Topic | Winner | Vicuna-13b-v1.5 | Vicuna-13b-v1.5 | Winner | Vicuna-13b-v1.5 | Vicuna-13b-v1.5
1 | 1 | 9 | 7 | 1 | 9 | 7
2 | 2 | 7 | 8 | 2 | 7 | 8
3 | 1 | 8 | 7 | 1 | 8 | 7
4 | 1 | 8 | 7 | 1 | 8 | 7
5 | 1 | 8 | 7 | 1 | 8 | 7
6 | 2 | 8 | 9 | 2 | 7 | 8
7 | 2 | 7 | 8 | 2 | 7 | 8
8 | 2 | 7 | 8 | 2 | 7 | 8
9 | 1 | 8 | 7 | 1 | 8 | 7
10 | 1 | 8 | 7 | 1 | 8 | 7
11 | 1 | 8 | 7 | 1 | 8 | 7
12 | 2 | 7 | 9 | 2 | 6 | 8
13 | 1 | 8 | 7 | 1 | 8 | 7
14 | 1 | 8 | 7 | 1 | 8 | 7
15 | 1 | 8 | 7 | 1 | 8 | 7
16 | 1 | 8 | 7 | 1 | 8 | 7
17 | 2 | 7 | 8 | 2 | 7 | 8
18 | 1 | 8 | 7 | 1 | 8 | 7
19 | 1 | 8 | 7 | 1 | 8 | 6
20 | 2 | 6 | 8 | 2 | 6 | 8
21 | 1 | 8 | 7 | 1 | 8 | 7
22 | 2 | 6 | 7 | 2 | 7 | 8
23 | 1 | 8 | 7 | 1 | 8 | 7
24 | 2 | 7 | 8 | 2 | 7 | 8
25 | 2 | 8 | 9 | 1 | 8 | 8

###  C.36 Vicuna-13b-v1.5 vs. Mixtral-8x7B

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Vicuna-13b-v1.5 | Mixtral-8x7B | Winner | Mixtral-8x7B | Vicuna-13b-v1.5 | Overall
1 | Vicuna-13b-v1.5 | 9 | 8 | Mixtral-8x7B | 9 | 8 | Tie
2 | Mixtral-8x7B | 7 | 9 | Vicuna-13b-v1.5 | 8 | 9 | Tie
3 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 9 | 8 | Mixtral-8x7B
4 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 9 | 7 | Mixtral-8x7B
5 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
6 | Mixtral-8x7B | 7 | 8 | Vicuna-13b-v1.5 | 7 | 8 | Tie
7 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
8 | Mixtral-8x7B | 7 | 8 | Vicuna-13b-v1.5 | 7 | 8 | Tie
9 | Mixtral-8x7B | 8 | 9 | Mixtral-8x7B | 9 | 7 | Mixtral-8x7B
10 | Mixtral-8x7B | 8 | 9 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
11 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
12 | Mixtral-8x7B | 7 | 8 | Vicuna-13b-v1.5 | 7 | 8 | Tie
13 | Vicuna-13b-v1.5 | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
14 | Mixtral-8x7B | 8 | 9 | Mixtral-8x7B | 9 | 8 | Mixtral-8x7B
15 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 8 | 5 | Mixtral-8x7B
16 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
17 | Mixtral-8x7B | 6 | 8 | Vicuna-13b-v1.5 | 7 | 8 | Tie
18 | Vicuna-13b-v1.5 | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
19 | Vicuna-13b-v1.5 | 8 | 7 | Mixtral-8x7B | 9 | 8 | Tie
20 | Mixtral-8x7B | 6 | 8 | Vicuna-13b-v1.5 | 7 | 8 | Tie
21 | Mixtral-8x7B | 8 | 9 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
22 | Mixtral-8x7B | 6 | 8 | Vicuna-13b-v1.5 | 7 | 8 | Tie
23 | Mixtral-8x7B | 7 | 8 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
24 | Mixtral-8x7B | 8 | 9 | Vicuna-13b-v1.5 | 8 | 9 | Tie
25 | Mixtral-8x7B | 8 | 9 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B

###  C.37 Vicuna-13b-v1.5 vs. GPT 3.5

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Vicuna-13b-v1.5 | GPT 3.5 | Winner | GPT 3.5 | Vicuna-13b-v1.5 | Overall
1 | Vicuna-13b-v1.5 | 8 | 7 | GPT 3.5 | 8 | 7 | Tie
2 | GPT 3.5 | 7 | 9 | Vicuna-13b-v1.5 | 7 | 8 | Tie
3 | GPT 3.5 | 8 | 9 | Vicuna-13b-v1.5 | 8 | 9 | Tie
4 | Vicuna-13b-v1.5 | 8 | 7 | GPT 3.5 | 8 | 7 | Tie
5 | GPT 3.5 | 8 | 9 | GPT 3.5 | 8 | 7 | GPT 3.5
6 | GPT 3.5 | 7 | 9 | Vicuna-13b-v1.5 | 7 | 8 | Tie
7 | GPT 3.5 | 7 | 8 | GPT 3.5 | 8 | 7 | GPT 3.5
8 | GPT 3.5 | 6 | 9 | GPT 3.5 | 8 | 7 | GPT 3.5
9 | GPT 3.5 | 8 | 9 | GPT 3.5 | 8 | 7 | GPT 3.5
10 | GPT 3.5 | 7 | 8 | GPT 3.5 | 8 | 7 | GPT 3.5
11 | GPT 3.5 | 7 | 8 | GPT 3.5 | 8 | 7 | GPT 3.5
12 | GPT 3.5 | 6 | 8 | Vicuna-13b-v1.5 | 7 | 8 | Tie
13 | GPT 3.5 | 7 | 8 | GPT 3.5 | 8 | 6 | GPT 3.5
14 | GPT 3.5 | 8 | 9 | GPT 3.5 | 9 | 7 | GPT 3.5
15 | Vicuna-13b-v1.5 | 8 | 7 | GPT 3.5 | 9 | 7 | Tie
16 | Vicuna-13b-v1.5 | 8 | 7 | GPT 3.5 | 8 | 7 | Tie
17 | GPT 3.5 | 7 | 9 | Vicuna-13b-v1.5 | 7 | 8 | Tie
18 | GPT 3.5 | 8 | 9 | GPT 3.5 | 9 | 8 | GPT 3.5
19 | Vicuna-13b-v1.5 | 8 | 7 | GPT 3.5 | 9 | 7 | Tie
20 | GPT 3.5 | 6 | 8 | Vicuna-13b-v1.5 | 6 | 8 | Tie
21 | GPT 3.5 | 8 | 9 | GPT 3.5 | 8 | 7 | GPT 3.5
22 | GPT 3.5 | 7 | 8 | Vicuna-13b-v1.5 | 7 | 8 | Tie
23 | GPT 3.5 | 7 | 8 | GPT 3.5 | 8 | 7 | GPT 3.5
24 | GPT 3.5 | 7 | 8 | GPT 3.5 | 8 | 7 | GPT 3.5
25 | GPT 3.5 | 8 | 9 | tie | 8 | 8 | GPT 3.5

###  C.38 Vicuna-13b-v1.5 vs. GPT 4

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Vicuna-13b-v1.5 | GPT 4 | Winner | GPT 4 | Vicuna-13b-v1.5 | Overall
1 | GPT 4 | 8 | 9 | GPT 4 | 9 | 7 | GPT 4
2 | GPT 4 | 6 | 9 | Vicuna-13b-v1.5 | 8 | 9 | Tie
3 | GPT 4 | 7 | 8 | GPT 4 | 8 | 7 | GPT 4
4 | GPT 4 | 7 | 8 | GPT 4 | 8 | 7 | GPT 4
5 | GPT 4 | 7 | 8 | GPT 4 | 9 | 8 | GPT 4
6 | GPT 4 | 7 | 9 | tie | 8 | 8 | GPT 4
7 | GPT 4 | 7 | 9 | Vicuna-13b-v1.5 | 8 | 9 | Tie
8 | GPT 4 | 6 | 9 | GPT 4 | 8 | 7 | GPT 4
9 | GPT 4 | 8 | 9 | GPT 4 | 9 | 7 | GPT 4
10 | GPT 4 | 7 | 9 | GPT 4 | 8 | 7 | GPT 4
11 | GPT 4 | 7 | 8 | GPT 4 | 9 | 7 | GPT 4
12 | GPT 4 | 6 | 9 | GPT 4 | 9 | 8 | GPT 4
13 | GPT 4 | 7 | 8 | GPT 4 | 9 | 7 | GPT 4
14 | GPT 4 | 7 | 9 | GPT 4 | 9 | 7 | GPT 4
15 | GPT 4 | 7 | 8 | GPT 4 | 9 | 7 | GPT 4
16 | GPT 4 | 7 | 9 | GPT 4 | 9 | 8 | GPT 4
17 | GPT 4 | 6 | 8 | GPT 4 | 8 | 7 | GPT 4
18 | GPT 4 | 8 | 9 | GPT 4 | 9 | 8 | GPT 4
19 | GPT 4 | 7 | 8 | GPT 4 | 9 | 7 | GPT 4
20 | GPT 4 | 6 | 9 | GPT 4 | 8 | 7 | GPT 4
21 | GPT 4 | 7 | 9 | GPT 4 | 8 | 7 | GPT 4
22 | GPT 4 | 6 | 8 | GPT 4 | 8 | 7 | GPT 4
23 | GPT 4 | 7 | 9 | GPT 4 | 8 | 7 | GPT 4
24 | GPT 4 | 7 | 9 | GPT 4 | 8 | 7 | GPT 4
25 | GPT 4 | 7 | 9 | tie | 8 | 8 | GPT 4

###  C.39 Mixtral-8x7B vs. Mixtral-8x7B

| Home | Away
---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2
Topic | Winner | Mixtral-8x7B | Mixtral-8x7B | Winner | Mixtral-8x7B | Mixtral-8x7B
1 | 1 | 8 | 7 | 1 | 8 | 7
2 | 2 | 8 | 9 | 2 | 7 | 8
3 | 2 | 8 | 9 | 2 | 8 | 9
4 | 1 | 8 | 7 | 1 | 8 | 7
5 | 1 | 9 | 8 | 1 | 9 | 8
6 | 2 | 8 | 9 | 2 | 8 | 9
7 | 2 | 8 | 9 | 2 | 7 | 8
8 | 1 | 8 | 7 | 1 | 8 | 7
9 | 1 | 8 | 7 | 1 | 8 | 7
10 | 1 | 8 | 8 | 2 | 8 | 9
11 | 1 | 8 | 7 | 1 | 8 | 7
12 | 2 | 8 | 9 | 2 | 7 | 8
13 | 1 | 8 | 7 | 1 | 8 | 7
14 | 1 | 8 | 7 | 1 | 8 | 7
15 | 1 | 9 | 7 | 1 | 8 | 7
16 | 2 | 8 | 9 | 2 | 8 | 9
17 | 2 | 7 | 8 | 1 | 8 | 7
18 | 1 | 8 | 7 | 1 | 8 | 7
19 | 1 | 8 | 7 | 1 | 8 | 7
20 | 2 | 6 | 8 | 2 | 7 | 8
21 | 1 | 8 | 7 | 2 | 8 | 9
22 | 2 | 7 | 8 | 2 | 7 | 8
23 | 1 | 8 | 7 | 1 | 8 | 7
24 | 1 | 8 | 7 | Tie | 8 | 8
25 | 2 | 8 | 9 | 2 | 8 | 9

###  C.40 Mixtral-8x7B vs. GPT 3.5

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Mixtral-8x7B | GPT 3.5 | Winner | GPT 3.5 | Mixtral-8x7B | Overall
1 | Mixtral-8x7B | 8 | 7 | GPT 3.5 | 8 | 7 | Tie
2 | GPT 3.5 | 7 | 9 | Mixtral-8x7B | 7 | 8 | Tie
3 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B | 8 | 9 | Mixtral-8x7B
4 | Mixtral-8x7B | 8 | 7 | GPT 3.5 | 8 | 7 | Tie
5 | GPT 3.5 | 8 | 9 | Mixtral-8x7B | 8 | 9 | Tie
6 | GPT 3.5 | 8 | 9 | Mixtral-8x7B | 8 | 9 | Tie
7 | GPT 3.5 | 8 | 9 | Mixtral-8x7B | 8 | 9 | Tie
8 | GPT 3.5 | 7 | 8 | Mixtral-8x7B | 7 | 8 | Tie
9 | Mixtral-8x7B | 8 | 7 | GPT 3.5 | 8 | 7 | Tie
10 | GPT 3.5 | 8 | 9 | Mixtral-8x7B | 8 | 9 | Tie
11 | Mixtral-8x7B | 8 | 7 | GPT 3.5 | 8 | 7 | Tie
12 | GPT 3.5 | 7 | 9 | Mixtral-8x7B | 7 | 8 | Tie
13 | GPT 3.5 | 7 | 8 | GPT 3.5 | 8 | 7 | Mixtral-8x7B
14 | GPT 3.5 | 8 | 9 | GPT 3.5 | 8 | 8 | Mixtral-8x7B
15 | Mixtral-8x7B | 8 | 7 | GPT 3.5 | 8 | 7 | Tie
16 | GPT 3.5 | 8 | 9 | Mixtral-8x7B | 8 | 9 | Tie
17 | GPT 3.5 | 7 | 8 | Mixtral-8x7B | 7 | 9 | Tie
18 | Mixtral-8x7B | 8 | 7 | GPT 3.5 | 8 | 7 | Tie
19 | Mixtral-8x7B | 8 | 7 | GPT 3.5 | 8 | 7 | Tie
20 | GPT 3.5 | 7 | 9 | Mixtral-8x7B | 7 | 8 | Tie
21 | GPT 3.5 | 7 | 8 | Mixtral-8x7B | 8 | 9 | Tie
22 | GPT 3.5 | 7 | 8 | Mixtral-8x7B | 7 | 8 | Tie
23 | tie | 8 | 8 | GPT 3.5 | 8 | 7 | Mixtral-8x7B
24 | GPT 3.5 | 8 | 9 | Mixtral-8x7B | 7 | 8 | Tie
25 | GPT 3.5 | 8 | 9 | Mixtral-8x7B | 8 | 9 | Tie

###  C.41 Mixtral-8x7B vs. GPT 4

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Mixtral-8x7B | GPT 4 | Winner | GPT 4 | Mixtral-8x7B | Overall
1 | GPT 4 | 8 | 9 | GPT 4 | 9 | 7 | GPT 4
2 | GPT 4 | 6 | 9 | Mixtral-8x7B | 8 | 9 | Tie
3 | GPT 4 | 7 | 8 | GPT 4 | 8 | 7 | GPT 4
4 | GPT 4 | 7 | 8 | GPT 4 | 8 | 7 | GPT 4
5 | GPT 4 | 7 | 8 | GPT 4 | 9 | 8 | GPT 4
6 | GPT 4 | 7 | 9 | tie | 8 | 8 | GPT 4
7 | GPT 4 | 7 | 9 | Mixtral-8x7B | 8 | 9 | Tie
8 | GPT 4 | 6 | 9 | GPT 4 | 8 | 7 | GPT 4
9 | GPT 4 | 8 | 9 | GPT 4 | 9 | 7 | GPT 4
10 | GPT 4 | 7 | 9 | GPT 4 | 8 | 7 | GPT 4
11 | GPT 4 | 7 | 8 | GPT 4 | 9 | 7 | GPT 4
12 | GPT 4 | 6 | 9 | GPT 4 | 9 | 8 | GPT 4
13 | GPT 4 | 7 | 8 | GPT 4 | 9 | 7 | GPT 4
14 | GPT 4 | 7 | 9 | GPT 4 | 9 | 7 | GPT 4
15 | GPT 4 | 7 | 8 | GPT 4 | 9 | 7 | GPT 4
16 | GPT 4 | 7 | 9 | GPT 4 | 9 | 8 | GPT 4
17 | GPT 4 | 6 | 8 | GPT 4 | 8 | 7 | GPT 4
18 | GPT 4 | 8 | 9 | GPT 4 | 9 | 8 | GPT 4
19 | GPT 4 | 7 | 8 | GPT 4 | 9 | 7 | GPT 4
20 | GPT 4 | 6 | 9 | GPT 4 | 8 | 7 | GPT 4
21 | GPT 4 | 7 | 9 | GPT 4 | 8 | 7 | GPT 4
22 | GPT 4 | 6 | 8 | GPT 4 | 8 | 7 | GPT 4
23 | GPT 4 | 7 | 9 | GPT 4 | 8 | 7 | GPT 4
24 | GPT 4 | 7 | 9 | GPT 4 | 8 | 7 | GPT 4
25 | GPT 4 | 7 | 9 | tie | 8 | 8 | GPT 4

###  C.42 GPT 3.5 vs. GPT 3.5

| Home | Away
---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2
Topic | Winner | GPT 3.5 | GPT 3.5 | Winner | GPT 3.5 | GPT 3.5
1 | 1 | 9 | 8 | 1 | 8 | 7
2 | 2 | 7 | 9 | 2 | 8 | 9
3 | 2 | 8 | 9 | 2 | 8 | 9
4 | 2 | 7 | 8 | 1 | 8 | 7
5 | 2 | 8 | 9 | 2 | 8 | 9
6 | 2 | 8 | 9 | 2 | 7 | 8
7 | 2 | 7 | 8 | 2 | 7 | 8
8 | 2 | 7 | 8 | 2 | 7 | 8
9 | 1 | 8 | 7 | 2 | 8 | 9
10 | 1 | 8 | 7 | 2 | 8 | 9
11 | 1 | 8 | 7 | 2 | 8 | 9
12 | 2 | 7 | 8 | 2 | 7 | 8
13 | 1 | 8 | 7 | 1 | 8 | 7
14 | 2 | 8 | 9 | 2 | 8 | 9
15 | 1 | 8 | 7 | 1 | 8 | 7
16 | 2 | 8 | 9 | 1 | 8 | 7
17 | 2 | 7 | 8 | 2 | 7 | 8
18 | 1 | 8 | 7 | 1 | 8 | 8
19 | 1 | 8 | 7 | 1 | 8 | 7
20 | 2 | 7 | 9 | 2 | 7 | 9
21 | 2 | 7 | 8 | 2 | 8 | 9
22 | 2 | 7 | 8 | 2 | 6 | 8
23 | 1 | 8 | 7 | 1 | 8 | 7
24 | 2 | 8 | 9 | 2 | 8 | 9
25 | 2 | 8 | 9 | 2 | 7 | 8

###  C.43 GPT 3.5 vs. GPT 4

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | GPT 3.5 | GPT 4 | Winner | GPT 4 | GPT 3.5 | Overall
1 | GPT 4 | 8 | 9 | GPT 4 | 9 | 8 | GPT 4
2 | GPT 4 | 7 | 9 | GPT 3.5 | 8 | 9 | Tie
3 | GPT 4 | 8 | 9 | GPT 4 | 9 | 8 | GPT 4
4 | GPT 4 | 7 | 8 | GPT 4 | 8 | 7 | GPT 4
5 | GPT 4 | 8 | 9 | GPT 4 | 8 | 7 | GPT 4
6 | GPT 4 | 7 | 9 | GPT 3.5 | 8 | 9 | Tie
7 | GPT 4 | 7 | 9 | GPT 3.5 | 8 | 9 | Tie
8 | GPT 4 | 7 | 8 | GPT 3.5 | 7 | 8 | Tie
9 | GPT 4 | 8 | 9 | GPT 4 | 9 | 8 | GPT 4
10 | GPT 4 | 8 | 9 | GPT 4 | 9 | 8 | GPT 4
11 | GPT 4 | 8 | 9 | GPT 4 | 9 | 7 | GPT 4
12 | GPT 4 | 6 | 9 | GPT 3.5 | 8 | 9 | Tie
13 | GPT 4 | 7 | 8 | GPT 4 | 8 | 7 | GPT 4
14 | GPT 4 | 8 | 9 | GPT 4 | 9 | 8 | GPT 4
15 | GPT 4 | 8 | 9 | GPT 4 | 9 | 8 | GPT 4
16 | GPT 4 | 7 | 9 | GPT 4 | 9 | 8 | GPT 4
17 | GPT 4 | 7 | 9 | GPT 3.5 | 8 | 9 | Tie
18 | GPT 4 | 8 | 9 | GPT 4 | 9 | 8 | GPT 4
19 | GPT 3.5 | 8 | 7 | GPT 3.5 | 9 | 7 | GPT 3.5
20 | GPT 4 | 7 | 9 | GPT 3.5 | 7 | 8 | Tie
21 | GPT 4 | 7 | 8 | GPT 3.5 | 8 | 9 | Tie
22 | GPT 4 | 6 | 8 | GPT 3.5 | 8 | 9 | Tie
23 | GPT 4 | 8 | 9 | GPT 4 | 8 | 7 | GPT 4
24 | GPT 4 | 7 | 8 | GPT 3.5 | 8 | 9 | Tie
25 | GPT 4 | 7 | 8 | GPT 4 | 8 | 7 | GPT 4

###  C.44 GPT 4 vs. GPT 4

| Home | Away
---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2
Topic | Winner | GPT 4 | GPT 4 | Winner | GPT 4 | GPT 4
1 | 1 | 8 | 8 | 1 | 8 | 7
2 | 2 | 7 | 8 | 2 | 8 | 9
3 | 2 | 8 | 9 | 2 | 8 | 9
4 | 1 | 8 | 7 | 1 | 8 | 7
5 | 2 | 8 | 9 | 1 | 9 | 8
6 | 2 | 7 | 8 | 2 | 8 | 9
7 | 2 | 8 | 9 | 2 | 7 | 8
8 | 2 | 7 | 8 | 2 | 7 | 8
9 | 2 | 8 | 9 | 1 | 8 | 7
10 | 2 | 8 | 9 | 2 | 8 | 9
11 | 1 | 8 | 7 | 1 | 8 | 7
12 | 2 | 8 | 9 | 2 | 8 | 9
13 | 1 | 8 | 7 | 1 | 8 | 7
14 | 1 | 8 | 7 | 2 | 8 | 9
15 | 1 | 8 | 7 | 1 | 9 | 8
16 | 2 | 8 | 9 | 2 | 8 | 9
17 | 2 | 8 | 9 | 2 | 7 | 8
18 | 1 | 9 | 8 | 1 | 8 | 7
19 | 1 | 8 | 7 | 1 | 9 | 8
20 | 2 | 8 | 9 | 2 | 8 | 9
21 | 2 | 8 | 9 | 2 | 8 | 9
22 | 2 | 8 | 9 | 2 | 8 | 9
23 | 1 | 9 | 8 | 2 | 8 | 9
24 | 2 | 8 | 9 | 2 | 8 | 9
25 | 2 | 8 | 9 | 2 | 8 | 9

##  Appendix D Other Judges

In this section, we report the results of experiment from Section 3.2 with
Llama-3-70b as judge.

###  D.1 Llama2-13b vs. Llama2-7b

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama2-7b | Llama2-13b | Winner | Llama2-13b | Llama2-7b | Overall
1 | Llama2-7b | 8 | 7 | Llama2-13b | 8 | 7 | Tie
2 | Llama2-13b | 8 | 9 | Llama2-7b | 8 | 9 | Tie
3 | Llama2-7b | 8 | 7 | Llama2-13b | 8 | 7 | Tie
4 | Llama2-7b | 8 | 6 | Llama2-13b | 8 | 6 | Tie
5 | Llama2-7b | 8 | 7 | Llama2-13b | 8 | 7 | Tie
6 | Llama2-7b | 8 | 7 | Llama2-13b | 8 | 7 | Tie
7 | Llama2-13b | 8 | 9 | Llama2-7b | 8 | 9 | Tie
8 | Llama2-13b | 8 | 9 | Llama2-7b | 8 | 9 | Tie
9 | Llama2-7b | 8 | 7 | Llama2-13b | 8 | 7 | Tie
10 | Llama2-13b | 8 | 9 | Llama2-13b | 8 | 7 | Llama2-13b
11 | Llama2-7b | 8 | 7 | Llama2-13b | 8 | 6 | Tie
12 | Llama2-13b | 8 | 9 | Llama2-13b | 8 | 7 | Llama2-13b
13 | Llama2-7b | 8 | 7 | Llama2-13b | 8 | 6 | Tie
14 | Llama2-7b | 8 | 7 | Llama2-13b | 8 | 7 | Tie
15 | Llama2-7b | 8 | 6 | Llama2-13b | 8 | 6 | Tie
16 | Llama2-7b | 8 | 7 | Llama2-13b | 8 | 7 | Tie
17 | Llama2-13b | 8 | 9 | Llama2-13b | 8 | 7 | Llama2-13b
18 | Llama2-7b | 8 | 7 | Llama2-13b | 8 | 7 | Tie
19 | Llama2-7b | 8 | 7 | Llama2-13b | 8 | 6 | Tie
20 | Llama2-13b | 7 | 8 | Llama2-7b | 8 | 9 | Tie
21 | Llama2-13b | 8 | 9 | Llama2-13b | 8 | 7 | Llama2-13b
22 | Llama2-13b | 7 | 8 | Llama2-7b | 6 | 8 | Llama2-13b
23 | Llama2-13b | 8 | 9 | Llama2-13b | 8 | 7 | Llama2-13b
24 | Llama2-13b | 8 | 9 | Llama2-13b | 8 | 7 | Llama2-13b
25 | Llama2-7b | 8 | 7 | Llama2-13b | 8 | 7 | Tie

###  D.2 Llama2-13b vs. Llama2-70b

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama2-13b | Llama2-70b | Winner | Llama2-70b | Llama2-13b | Overall
1 | Llama2-13b | 8 | 7 | Llama2-70b | 8 | 7 | Tie
2 | Llama2-70b | 7 | 8 | Llama2-70b | 8 | 7 | Llama2-70b
3 | Llama2-70b | 8 | 9 | Llama2-13b | 8 | 9 | Tie
4 | Llama2-13b | 8 | 7 | Llama2-70b | 8 | 7 | Tie
5 | Llama2-13b | 8 | 7 | Llama2-70b | 8 | 7 | Tie
6 | Llama2-70b | 8 | 9 | Llama2-70b | 8 | 7 | Llama2-70b
7 | Llama2-13b | 8 | 7 | Llama2-70b | 8 | 7 | Tie
8 | Llama2-13b | 8 | 7 | Llama2-70b | 8 | 7 | Tie
9 | Llama2-13b | 8 | 7 | Llama2-70b | 8 | 7 | Tie
10 | Llama2-70b | 8 | 9 | Llama2-13b | 8 | 9 | Tie
11 | Llama2-13b | 8 | 7 | Llama2-70b | 8 | 7 | Tie
12 | Llama2-70b | 8 | 9 | Llama2-13b | 8 | 9 | Tie
13 | Llama2-13b | 8 | 7 | Llama2-70b | 8 | 7 | Tie
14 | Llama2-13b | 8 | 7 | Llama2-70b | 8 | 7 | Tie
15 | Llama2-13b | 8 | 6 | Llama2-70b | 8 | 6 | Tie
16 | Llama2-70b | 7 | 8 | Llama2-70b | 8 | 7 | Llama2-70b
17 | Llama2-13b | 8 | 6 | Llama2-70b | 8 | 7 | Tie
18 | Llama2-13b | 8 | 7 | Llama2-70b | 8 | 7 | Tie
19 | Llama2-13b | 8 | 6 | Llama2-70b | 8 | 6 | Tie
20 | Llama2-70b | 7 | 8 | Llama2-13b | 8 | 9 | Tie
21 | Llama2-13b | 8 | 7 | Llama2-70b | 8 | 7 | Tie
22 | Llama2-70b | 6 | 8 | Llama2-13b | 7 | 8 | Tie
23 | Llama2-13b | 8 | 7 | Llama2-70b | 8 | 7 | Tie
24 | Llama2-70b | 8 | 9 | Llama2-13b | 8 | 9 | Tie
25 | Llama2-70b | 8 | 9 | Llama2-70b | 8 | 7 | Llama2-70b

###  D.3 Llama2-13b vs. Llama3-70b

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama3-70b | Llama2-13b | Winner | Llama2-13b | Llama3-70b | Overall
1 | Llama3-70b | 8 | 7 | Llama2-13b | 8 | 7 | Tie
2 | Llama2-13b | 8 | 9 | Llama3-70b | 8 | 9 | Tie
3 | Llama3-70b | 8 | 7 | Llama2-13b | 8 | 7 | Tie
4 | Llama3-70b | 8 | 6 | Llama2-13b | 8 | 7 | Tie
5 | Llama3-70b | 8 | 7 | Llama2-13b | 8 | 7 | Tie
6 | Llama2-13b | 8 | 9 | Llama2-13b | 8 | 7 | Llama2-13b
7 | Llama2-13b | 8 | 9 | Llama3-70b | 8 | 9 | Tie
8 | Llama2-13b | 8 | 9 | Llama3-70b | 8 | 9 | Tie
9 | Llama3-70b | 8 | 7 | Llama2-13b | 8 | 7 | Tie
10 | Llama2-13b | 8 | 9 | Llama3-70b | 7 | 8 | Tie
11 | Llama3-70b | 8 | 7 | Llama2-13b | 8 | 7 | Tie
12 | Llama2-13b | 8 | 9 | Llama3-70b | 8 | 9 | Tie
13 | Llama3-70b | 8 | 7 | Llama2-13b | 8 | 7 | Tie
14 | Llama3-70b | 8 | 7 | Llama3-70b | 8 | 9 | Llama3-70b
15 | Llama3-70b | 8 | 7 | Llama2-13b | 8 | 7 | Tie
16 | Llama2-13b | 8 | 9 | Llama2-13b | 8 | 7 | Llama2-13b
17 | Llama2-13b | 8 | 9 | Llama3-70b | 7 | 8 | Tie
18 | Llama3-70b | 8 | 7 | Llama2-13b | 8 | 7 | Tie
19 | Llama3-70b | 8 | 7 | Llama2-13b | 8 | 6 | Tie
20 | Llama3-70b | 8 | 7 | Llama3-70b | 8 | 9 | Llama3-70b
21 | Llama3-70b | 8 | 7 | Llama3-70b | 8 | 9 | Llama3-70b
22 | Llama2-13b | 8 | 9 | Llama3-70b | 7 | 8 | Tie
23 | Llama3-70b | 8 | 7 | Llama3-70b | 8 | 9 | Llama3-70b
24 | Llama3-70b | 8 | 7 | Llama2-13b | 8 | 7 | Tie
25 | Llama2-13b | 8 | 9 | Llama3-70b | 8 | 9 | Tie

###  D.4 Llama2-13b vs. Vicuna-7b-v1.5

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama2-13b | Vicuna-7b-v1.5 | Winner | Vicuna-7b-v1.5 | Llama2-13b | Overall
1 | Llama2-13b | 8 | 7 | Vicuna-7b-v1.5 | 8 | 7 | Tie
2 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
3 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
4 | Llama2-13b | 8 | 6 | Vicuna-7b-v1.5 | 8 | 7 | Tie
5 | Llama2-13b | 8 | 7 | Vicuna-7b-v1.5 | 8 | 7 | Tie
6 | Llama2-13b | 8 | 7 | Llama2-13b | 7 | 9 | Llama2-13b
7 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
8 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
9 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
10 | Llama2-13b | 8 | 7 | Llama2-13b | 7 | 8 | Llama2-13b
11 | Llama2-13b | 8 | 6 | Vicuna-7b-v1.5 | 8 | 7 | Tie
12 | Llama2-13b | 8 | 7 | Llama2-13b | 7 | 9 | Llama2-13b
13 | Llama2-13b | 8 | 6 | Vicuna-7b-v1.5 | 8 | 7 | Tie
14 | Llama2-13b | 8 | 6 | Llama2-13b | 8 | 9 | Llama2-13b
15 | Llama2-13b | 8 | 6 | Vicuna-7b-v1.5 | 8 | 7 | Tie
16 | Llama2-13b | 8 | 6 | Llama2-13b | 8 | 9 | Llama2-13b
17 | Llama2-13b | 8 | 6 | Llama2-13b | 7 | 9 | Llama2-13b
18 | Llama2-13b | 8 | 6 | Llama2-13b | 8 | 9 | Llama2-13b
19 | Llama2-13b | 8 | 6 | Vicuna-7b-v1.5 | 8 | 7 | Tie
20 | Vicuna-7b-v1.5 | 8 | 9 | Vicuna-7b-v1.5 | 7 | 8 | Vicuna-7b-v1.5
21 | Llama2-13b | 8 | 7 | Llama2-13b | 7 | 9 | Llama2-13b
22 | Vicuna-7b-v1.5 | 7 | 8 | Vicuna-7b-v1.5 | 6 | 8 | Vicuna-7b-v1.5
23 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
24 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
25 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b

###  D.5 Llama2-13b vs. Vicuna-13b-v1.5

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama2-13b | Vicuna-13b-v1.5 | Winner | Vicuna-13b-v1.5 | Llama2-13b | Overall
1 | Llama2-13b | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
2 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
3 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
4 | Llama2-13b | 8 | 6 | Llama2-13b | 8 | 9 | Llama2-13b
5 | Llama2-13b | 8 | 7 | Vicuna-13b-v1.5 | 8 | 7 | Tie
6 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
7 | Vicuna-13b-v1.5 | 8 | 9 | Llama2-13b | 8 | 9 | Tie
8 | Llama2-13b | 8 | 7 | Llama2-13b | 7 | 9 | Llama2-13b
9 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
10 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
11 | Llama2-13b | 8 | 6 | Llama2-13b | 8 | 9 | Llama2-13b
12 | Vicuna-13b-v1.5 | 8 | 9 | Llama2-13b | 7 | 9 | Tie
13 | Llama2-13b | 8 | 6 | Llama2-13b | 8 | 9 | Llama2-13b
14 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
15 | Llama2-13b | 8 | 6 | Vicuna-13b-v1.5 | 8 | 7 | Tie
16 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
17 | Llama2-13b | 8 | 6 | Llama2-13b | 7 | 8 | Llama2-13b
18 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
19 | Llama2-13b | 8 | 6 | Vicuna-13b-v1.5 | 8 | 7 | Tie
20 | Vicuna-13b-v1.5 | 8 | 9 | Llama2-13b | 7 | 8 | Tie
21 | Llama2-13b | 8 | 7 | Llama2-13b | 7 | 8 | Llama2-13b
22 | Vicuna-13b-v1.5 | 7 | 8 | Llama2-13b | 8 | 9 | Tie
23 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
24 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
25 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b

###  D.6 Llama2-13b vs. Mixtral-8x7B

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama2-13b | Mixtral-8x7B | Winner | Mixtral-8x7B | Llama2-13b | Overall
1 | Mixtral-8x7B | 8 | 9 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
2 | Mixtral-8x7B | 8 | 9 | Llama2-13b | 8 | 9 | Tie
3 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
4 | Llama2-13b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
5 | Llama2-13b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
6 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
7 | Mixtral-8x7B | 8 | 9 | Llama2-13b | 8 | 9 | Tie
8 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
9 | Llama2-13b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
10 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
11 | Mixtral-8x7B | 8 | 9 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
12 | Mixtral-8x7B | 8 | 9 | Llama2-13b | 8 | 9 | Tie
13 | Llama2-13b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
14 | Mixtral-8x7B | 8 | 9 | Mixtral-8x7B | 8 | 7 | Mixtral-8x7B
15 | Llama2-13b | 8 | 6 | Mixtral-8x7B | 8 | 6 | Tie
16 | Llama2-13b | 9 | 9 | Llama2-13b | 8 | 9 | Llama2-13b
17 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
18 | Llama2-13b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
19 | Llama2-13b | 8 | 7 | Mixtral-8x7B | 8 | 7 | Tie
20 | Mixtral-8x7B | 8 | 9 | Llama2-13b | 7 | 8 | Tie
21 | Mixtral-8x7B | 8 | 9 | Llama2-13b | 8 | 9 | Tie
22 | Mixtral-8x7B | 6 | 8 | Llama2-13b | 7 | 8 | Tie
23 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
24 | Llama2-13b | 8 | 7 | Llama2-13b | 8 | 9 | Llama2-13b
25 | Mixtral-8x7B | 6 | 8 | Mixtral-8x7B | 9 | 7 | Mixtral-8x7B

###  D.7 Llama2-13b vs. GPT-3.5

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama2-13b | GPT-3.5 | Winner | GPT-3.5 | Llama2-13b | Overall
1 | GPT-3.5 | 8 | 9 | GPT-3.5 | 8 | 7 | GPT-3.5
2 | GPT-3.5 | 8 | 9 | Llama2-13b | 8 | 9 | Tie
3 | GPT-3.5 | 8 | 9 | Llama2-13b | 8 | 9 | Tie
4 | Llama2-13b | 8 | 7 | GPT-3.5 | 8 | 7 | Tie
5 | Llama2-13b | 8 | 7 | GPT-3.5 | 8 | 7 | Tie
6 | GPT-3.5 | 8 | 9 | Llama2-13b | 8 | 9 | Tie
7 | GPT-3.5 | 8 | 9 | Llama2-13b | 7 | 8 | Tie
8 | GPT-3.5 | 8 | 9 | Llama2-13b | 8 | 9 | Tie
9 | Llama2-13b | 8 | 7 | GPT-3.5 | 9 | 8 | Tie
10 | GPT-3.5 | 8 | 9 | Llama2-13b | 8 | 9 | Tie
11 | GPT-3.5 | 8 | 9 | Llama2-13b | 8 | 9 | Tie
12 | GPT-3.5 | 8 | 9 | Llama2-13b | 7 | 9 | Tie
13 | Llama2-13b | 8 | 7 | GPT-3.5 | 8 | 7 | Tie
14 | GPT-3.5 | 8 | 9 | Llama2-13b | 8 | 9 | Tie
15 | Llama2-13b | 8 | 7 | GPT-3.5 | 8 | 6 | Tie
16 | GPT-3.5 | 8 | 9 | Llama2-13b | 8 | 9 | Tie
17 | GPT-3.5 | 8 | 9 | GPT-3.5 | 8 | 7 | GPT-3.5
18 | GPT-3.5 | 8 | 9 | Llama2-13b | 8 | 9 | Tie
19 | Llama2-13b | 8 | 7 | GPT-3.5 | 8 | 7 | Tie
20 | GPT-3.5 | 7 | 9 | Llama2-13b | 7 | 8 | Tie
21 | GPT-3.5 | 8 | 9 | Llama2-13b | 8 | 9 | Tie
22 | GPT-3.5 | 6 | 8 | Llama2-13b | 7 | 9 | Tie
23 | GPT-3.5 | 8 | 9 | GPT-3.5 | 9 | 8 | GPT-3.5
24 | GPT-3.5 | 8 | 9 | GPT-3.5 | 9 | 8 | GPT-3.5
25 | GPT-3.5 | 8 | 9 | Llama2-13b | 7 | 8 | Tie

###  D.8 Llama2-13b vs. GPT-4

| Home | Away |
---|---|---|---
|  | Side 1 | Side 2 |  | Side 1 | Side 2 |
Topic | Winner | Llama2-13b | GPT-4 | Winner | GPT-4 | Llama2-13b | Overall
1 | GPT-4 | 8 | 9 | GPT-4 | 9 | 7 | GPT-4
2 | GPT-4 | 8 | 9 | Llama2-13b | 8 | 9 | Tie
3 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4
4 | GPT-4 | 8 | 9 | GPT-4 | 8 | 6 | GPT-4
5 | GPT-4 | 8 | 9 | GPT-4 | 8.5 | 7.5 | GPT-4
6 | GPT-4 | 7 | 9 | GPT-4 | 8 | 7 | GPT-4
7 | GPT-4 | 8 | 9 | Llama2-13b | 8 | 9 | Tie
8 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4
9 | GPT-4 | 8 | 9 | GPT-4 | 8 | 6 | GPT-4
10 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4
11 | GPT-4 | 8 | 9 | GPT-4 | 8.5 | 7.5 | GPT-4
12 | GPT-4 | 7 | 9 | Llama2-13b | 8 | 9 | Tie
13 | GPT-4 | 8 | 9 | GPT-4 | 8 | 6 | GPT-4
14 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4
15 | GPT-4 | 8 | 9 | GPT-4 | 9 | 7 | GPT-4
16 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4
17 | GPT-4 | 7 | 9 | GPT-4 | 8 | 6 | GPT-4
18 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4
19 | GPT-4 | 8 | 9 | GPT-4 | 8.5 | 7.5 | GPT-4
20 | GPT-4 | 7 | 9 | Llama2-13b | 8 | 9 | Tie
21 | GPT-4 | 7 | 9 | GPT-4 | 8 | 7 | GPT-4
22 | GPT-4 | 6 | 8 | GPT-4 | 8 | 7 | GPT-4
23 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4
24 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4
25 | GPT-4 | 8 | 9 | GPT-4 | 8 | 7 | GPT-4