Update README.md
Browse files
README.md
CHANGED
|
@@ -16,22 +16,14 @@ LLM4Decompile aims to decompile x86 assembly instructions into C. The newly rele
|
|
| 16 |
|
| 17 |
### 2. Evaluation Results
|
| 18 |
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
|
|
| 23 |
-
|
| 24 |
-
|
|
| 25 |
-
|
| 26 |
-
|
|
| 27 |
-
+------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
|
| 28 |
-
| LLM4Decompile-End-1.3B | 0.4720 | 0.2061 | 0.2122 | 0.2024 | 0.2732 | 0.1786 | 0.1362 | 0.1320 | 0.1328 | 0.1449 |
|
| 29 |
-
+------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
|
| 30 |
-
| LLM4Decompile-End-6.7B | 0.6805 | 0.3951 | 0.3671 | 0.3720 | 0.4537 | 0.2289 | 0.1660 | 0.1618 | 0.1625 | 0.1798 |
|
| 31 |
-
+------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
|
| 32 |
-
| LLM4Decompile-End-33B | 0.5168 | 0.2956 | 0.2815 | 0.2675 | 0.3404 | 0.1886 | 0.1465 | 0.1396 | 0.1411 | 0.1540 |
|
| 33 |
-
+------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
|
| 34 |
-
|
| 35 |
|
| 36 |
### 3. How to Use
|
| 37 |
Here is an example of how to use our model (Revised for V1.5).
|
|
|
|
| 16 |
|
| 17 |
### 2. Evaluation Results
|
| 18 |
|
| 19 |
+
| Model/Benchmark | HumanEval-Decompile | | | | | ExeBench | | | | |
|
| 20 |
+
|:----------------------:|:-------------------:|:-------:|:-------:|:-------:|:-------:|:--------:|:-------:|:-------:|:-------:|:-------:|
|
| 21 |
+
| Optimization Level | O0 | O1 | O2 | O3 | AVG | O0 | O1 | O2 | O3 | AVG |
|
| 22 |
+
| DeepSeek-Coder-6.7B | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.0000 |
|
| 23 |
+
| GPT-4o | 0.3049 | 0.1159 | 0.1037 | 0.1159 | 0.1601 | 0.0443 | 0.0328 | 0.0397 | 0.0343 | 0.0378 |
|
| 24 |
+
| LLM4Decompile-End-1.3B | 0.4720 | 0.2061 | 0.2122 | 0.2024 | 0.2732 | 0.1786 | 0.1362 | 0.1320 | 0.1328 | 0.1449 |
|
| 25 |
+
| LLM4Decompile-End-6.7B | 0.6805 | 0.3951 | 0.3671 | 0.3720 | 0.4537 | 0.2289 | 0.1660 | 0.1618 | 0.1625 | 0.1798 |
|
| 26 |
+
| LLM4Decompile-End-33B | 0.5168 | 0.2956 | 0.2815 | 0.2675 | 0.3404 | 0.1886 | 0.1465 | 0.1396 | 0.1411 | 0.1540 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 27 |
|
| 28 |
### 3. How to Use
|
| 29 |
Here is an example of how to use our model (Revised for V1.5).
|