muhammad-mujtaba-ai commited on
Commit
8668039
·
verified ·
1 Parent(s): 601a46a

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +7 -5
README.md CHANGED
@@ -50,7 +50,6 @@ Model is deployed on huggingface space for inference
50
 
51
  # Model Comparison
52
  We have compared our model with the following models
53
- - Solidity LLM 2B
54
  - GPT 4.5 Preview
55
  - GPT 4o mini
56
  - Gwen 2.5-Coder-7B
@@ -66,10 +65,13 @@ On the following parameters
66
  ## Benchmark
67
  Below is a figure summarizing the performance of each model across the four evaluation metrics.
68
  ![Benchmark](Benchmark.png)
69
- - Solidity LLM consistently achieved the highest compilation success rate.
70
- - It frequently adhered to OpenZeppelin standards, using appropriate imports and contract structures.
71
- - The contracts it produced were gas-efficient, as identified by Slither's optimization suggestions.
72
- - While some security vulnerabilities were detected, the overall security posture was acceptable, and the code quality remained high.
 
 
 
73
 
74
 
75
  # Uses
 
50
 
51
  # Model Comparison
52
  We have compared our model with the following models
 
53
  - GPT 4.5 Preview
54
  - GPT 4o mini
55
  - Gwen 2.5-Coder-7B
 
65
  ## Benchmark
66
  Below is a figure summarizing the performance of each model across the four evaluation metrics.
67
  ![Benchmark](Benchmark.png)
68
+
69
+ Following obvservation were made regarding Solidity LLM.
70
+ - Highest Compilation Success Rate (~83%), demonstrating strong Solidity syntax and structure generation.
71
+ - Good OpenZeppelin Compliance (~65%), indicating frequent use of standard libraries and contract patterns.
72
+ - Top Gas Efficiency (~72%), producing optimized code as evaluated by tools like Slither.
73
+ - Moderate Security Score (~58%), showing acceptable security posture but room for improvement.
74
+ - Concise Code (~70% LOC score), generating relatively compact and efficient smart contracts.
75
 
76
 
77
  # Uses