muhammad-mujtaba-ai commited on
Commit
5ae874c
·
verified ·
1 Parent(s): 4c44977

Upload folder using huggingface_hub

Browse files
Files changed (2) hide show
  1. Benchmark.png +0 -0
  2. README.md +2 -2
Benchmark.png CHANGED
README.md CHANGED
@@ -274,9 +274,9 @@ contract DecentralizedLibrary is Ownable(msg.sender) {
274
  ```
275
 
276
  # Evaluation Matrics
277
- To evaluate the performance of our fine-tuned LLM specialized in Solidity smart contract generation, we used **[Slither](https://github.com/crytic/slither)**, a static analysis framework widely used for analyzing Solidity code. Additionally, we used both automated LLM-based assessments and expert human evaluations to ensure a comprehensive benchmarking approach.
278
 
279
- We focused on six key evaluation criteria:
280
 
281
  - **Compilation Success Rate**
282
  We measured the percentage of generated smart contracts that compile successfully without modification. This helps assess the syntactic and structural correctness of the model outputs.
 
274
  ```
275
 
276
  # Evaluation Matrics
277
+ To evaluate the performance of our fine-tuned LLM specialized in Solidity smart contract generation, we used **[Slither](https://github.com/crytic/slither)**, a static analysis framework widely used for analyzing Solidity code.
278
 
279
+ We focused on following key evaluation criteria:
280
 
281
  - **Compilation Success Rate**
282
  We measured the percentage of generated smart contracts that compile successfully without modification. This helps assess the syntactic and structural correctness of the model outputs.