BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks
•
52
AI & ML interests
None defined yet.
Recent Activity
View all activity
Articles
Running
12
BigCodeArena
🚀
Compare two AI models by sending them code
Running
BigCodeBench Evaluator
🥇
Evaluate code samples using specified parameters
Running
on
CPU Upgrade
18
BigCodeBench Evaluator
🥇
Evaluate code samples using specified parameters
Running
222
BigCodeBench Leaderboard
🥇
Explore and analyze code completion benchmarks
Running
25
BigCode Model License Agreement
🤝
Display a PDF file in a web app
Runtime error
BigCodeBench Interaction
🥇
Running
1.43k
Big Code Models Leaderboard
📈
Submit code models for evaluation and view leaderboard
Runtime error
BigCodeBench Evaluator
🥇
Running
README
✨
Running
on
CPU Upgrade
90
Am I in The Stack?
📑
Check if your GitHub repo is in The Stack dataset
Running
14
StarCoder2 Search
🔎
Search for code snippets in a dataset
Sleeping
3
Data Inspection
🕵
Running
40
StarCoder Search
🔎
Search for code snippets in a dataset
Runtime error
15
Near Deduplication
⚡
Runtime error
13
OctoCoder Demo
🐙
Runtime error
1
In The CommitPack
👁
Sleeping
Stack V2 Extensions
🏆
Runtime error
414
BigCode - Playground
🪐
Running
32
Reasoning With StarCoder
🧐
Generate code and answers from questions
Running
54
BigCode - Editor
💻
Start a web server for an app
Runtime error
10
Santa Explains Code
🎅
Runtime error
169
SantaCoder Demo
🎅
Generate code snippets in Python, Java, JavaScript
Build error
Tokenizer Testing
😻
Runtime error
Bot Issues Visualization
🐨