Topic: "program-synthesis"
fchollet/ARC-AGI
The Abstraction and Reasoning Corpus
Language: JavaScript - Size: 441 KB - Last synced at: 11 days ago - Pushed at: 2 months ago - Stars: 4,408 - Forks: 663
evalplus/evalplus
Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024
Language: Python - Size: 5.29 MB - Last synced at: 15 days ago - Pushed at: 15 days ago - Stars: 1,467 - Forks: 151
primaryobjects/AI-Programmer
Using artificial intelligence and genetic algorithms to automatically write programs. Tutorial: http://www.primaryobjects.com/cms/article149
Language: C# - Size: 6.47 MB - Last synced at: 15 days ago - Pushed at: over 2 years ago - Stars: 1,093 - Forks: 264
microsoft/PythonProgrammingPuzzles
A Dataset of Python Challenges for AI Research
Language: Python - Size: 242 MB - Last synced at: 3 days ago - Pushed at: about 1 year ago - Stars: 980 - Forks: 95
microsoft/prose
Microsoft Program Synthesis using Examples SDK is a framework of technologies for the automatic generation of programs from input-output examples. This repo includes samples and sample data for the Microsoft Program Synthesis using Example SDK.
Language: C# - Size: 81.6 MB - Last synced at: 3 days ago - Pushed at: 4 days ago - Stars: 643 - Forks: 99
ravichugh/sketch-n-sketch
Direct Manipulation Programming for HTML/SVG
Language: Elm - Size: 126 MB - Last synced at: 5 days ago - Pushed at: about 1 year ago - Stars: 555 - Forks: 31
Inventitech/strans
Performs string manipulation tasks by learning from the provided example(s), instead of having to program them out explicitly.
Language: Roff - Size: 824 KB - Last synced at: 2 months ago - Pushed at: about 5 years ago - Stars: 548 - Forks: 17
hendrycks/apps
APPS: Automated Programming Progress Standard (NeurIPS 2021)
Language: Python - Size: 43.9 KB - Last synced at: 14 days ago - Pushed at: 12 months ago - Stars: 462 - Forks: 61
microsoft/rat-sql
A relation-aware semantic parsing model from English to SQL
Language: Python - Size: 110 KB - Last synced at: 3 days ago - Pushed at: almost 2 years ago - Stars: 427 - Forks: 119
crazydonkey200/neural-symbolic-machines
Neural Symbolic Machines is a framework to integrate neural networks and symbolic representations using reinforcement learning, with applications in program synthesis and semantic parsing.
Language: Python - Size: 53.5 MB - Last synced at: 7 months ago - Pushed at: over 2 years ago - Stars: 378 - Forks: 69
ezelikman/parsel
Code for Parsel 🐍 - generate complex programs with language models
Language: Python - Size: 170 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 377 - Forks: 32
Wilfred/suggest.el
discover elisp functions that do what you want
Language: Emacs Lisp - Size: 171 KB - Last synced at: 13 days ago - Pushed at: over 1 year ago - Stars: 370 - Forks: 14
bigcode-project/bigcodebench
[ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI
Language: Python - Size: 6.57 MB - Last synced at: 17 days ago - Pushed at: about 2 months ago - Stars: 367 - Forks: 45
microsoft/multilspy
multilspy is a lsp client library in Python intended to be used to build applications around language servers.
Language: Python - Size: 265 KB - Last synced at: 3 days ago - Pushed at: about 2 months ago - Stars: 339 - Forks: 62
microsoft/monitors4codegen
Code and Data artifact for NeurIPS 2023 paper - "Monitor-Guided Decoding of Code LMs with Static Analysis of Repository Context". `multispy` is a lsp client library in Python intended to be used to build applications around language servers.
Language: Python - Size: 6.18 MB - Last synced at: 3 days ago - Pushed at: 10 months ago - Stars: 260 - Forks: 32
logic-and-learning-lab/Popper
An inductive logic programming system
Language: Python - Size: 21.2 MB - Last synced at: 20 days ago - Pushed at: 20 days ago - Stars: 223 - Forks: 43
autogoal/autogoal
A Python framework for program synthesis with a focus on Automated Machine Learning.
Language: Python - Size: 12.5 MB - Last synced at: 23 days ago - Pushed at: 4 months ago - Stars: 211 - Forks: 65
CozySynthesizer/cozy
The collection synthesizer
Language: Python - Size: 3.35 MB - Last synced at: 6 months ago - Pushed at: over 4 years ago - Stars: 210 - Forks: 18
metagol/metagol 📦
Metagol - an inductive logic programming system
Language: Prolog - Size: 213 KB - Last synced at: 2 days ago - Pushed at: over 3 years ago - Stars: 201 - Forks: 27
fuzz4all/fuzz4all
🌌️Fuzz4All: Universal Fuzzing with Large Language Models
Language: Python - Size: 9.84 MB - Last synced at: 5 months ago - Pushed at: 8 months ago - Stars: 200 - Forks: 28
GrammaTech/sel
Programmatic modification and evaluation of software
Language: Common Lisp - Size: 18.8 MB - Last synced at: 17 days ago - Pushed at: 18 days ago - Stars: 175 - Forks: 22
nearai/program_synthesis
Program Synthesis
Language: Jupyter Notebook - Size: 838 KB - Last synced at: 13 days ago - Pushed at: over 4 years ago - Stars: 145 - Forks: 27
ise-uiuc/Repilot
Repilot, a patch generation tool introduced in the ESEC/FSE'23 paper "Copiloting the Copilots: Fusing Large Language Models with Completion Engines for Automated Program Repair"
Language: Python - Size: 958 KB - Last synced at: 23 days ago - Pushed at: over 1 year ago - Stars: 132 - Forks: 12
TyGuS/suslik
Synthesis of Heap-Manipulating Programs from Separation Logic
Language: Scala - Size: 8.07 MB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 121 - Forks: 19
deep-symbolic-mathematics/LLM-SR
[ICLR 2025 Oral] This is the official repo for the paper "LLM-SR" on Scientific Equation Discovery and Symbolic Regression with Large Language Models
Language: Python - Size: 8.82 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 108 - Forks: 13
HiroakiMikami/deep-coder
Re-implement DeepCoder (https://openreview.net/pdf?id=ByldLrqlx)
Language: Python - Size: 18.9 MB - Last synced at: about 2 months ago - Pushed at: almost 6 years ago - Stars: 107 - Forks: 30
shaohua0116/demo2program
An official TensorFlow implementation of "Neural Program Synthesis from Diverse Demonstration Videos" (ICML 2018) by Shao-Hua Sun, Hyeonwoo Noh, Sriram Somasundaram, and Joseph J. Lim
Language: Python - Size: 16.2 MB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 102 - Forks: 24
dkamm/deepcoder
Deepcoder paper implementation
Language: Python - Size: 68.4 KB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 101 - Forks: 29
ku-progsys/rbsyn
Program synthesis for Ruby
Language: Ruby - Size: 1.08 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 95 - Forks: 6
evoasm/evoasm.rb
An AIMGP (Automatic Induction of Machine code by Genetic Programming) engine
Language: Ruby - Size: 5.61 MB - Last synced at: 3 months ago - Pushed at: over 6 years ago - Stars: 92 - Forks: 13
google-research/plur 📦
PLUR (Programming-Language Understanding and Repair) is a collection of source code datasets suitable for graph-based machine learning. We provide scripts for downloading, processing, and loading the datasets. This is done by offering a unified API and data structures for all datasets.
Language: Python - Size: 183 KB - Last synced at: about 1 month ago - Pushed at: about 3 years ago - Stars: 88 - Forks: 17
nju-websoft/PairCoder
A Pair Programming Framework for Code Generation via Multi-Plan Exploration and Feedback-Driven Refinement, ASE 2024
Language: Python - Size: 22.2 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 85 - Forks: 2
volotat/ARC-Game
The Abstraction and Reasoning Corpus made into a web game
Language: JavaScript - Size: 8.7 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 82 - Forks: 5
chasenorman/CanonicalLean
A Lean tactic for Canonical, a search procedure for terms in dependent type theory.
Language: Lean - Size: 8.79 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 69 - Forks: 4
praveenkulkarni1996/awesome-program-synthesis
An curated list of papers on program synthesis.
Size: 15.6 KB - Last synced at: about 1 month ago - Pushed at: almost 6 years ago - Stars: 69 - Forks: 3
jfeser/L2
λ² is a tool for synthesizing functional programs from input-output examples.
Language: OCaml - Size: 7.15 MB - Last synced at: about 2 months ago - Pushed at: over 2 years ago - Stars: 68 - Forks: 7
ConfeitoHS/arcle
A Gymnasium-based Environment of the Abstraction and Reasoning Corpus (ARC)
Language: Python - Size: 3.49 MB - Last synced at: about 1 month ago - Pushed at: 9 months ago - Stars: 64 - Forks: 9
evo-eval/evoeval
EvoEval: Evolving Coding Benchmarks via LLM
Language: Python - Size: 17.5 MB - Last synced at: 7 months ago - Pushed at: about 1 year ago - Stars: 60 - Forks: 5
TyGuS/hoogle_plus
Type-driven, component based synthesis, showcasing TYpe Guided Abstract Refinement (TYGAR)
Language: Haskell - Size: 122 MB - Last synced at: about 1 year ago - Pushed at: about 2 years ago - Stars: 59 - Forks: 8
volotat/GAS
Generative Art Synthesizer - a python program that generates python programs that generates generative art
Language: Python - Size: 45.7 MB - Last synced at: 29 days ago - Pushed at: over 3 years ago - Stars: 56 - Forks: 6
UChicago-PL/smyth
Programming-by-example in a typed functional language with sketches. Smyth = Sketching + Myth.
Language: OCaml - Size: 10.7 MB - Last synced at: 5 days ago - Pushed at: about 4 years ago - Stars: 54 - Forks: 5
nerdimite/neuro-symbolic-ai-soc
Neuro-Symbolic Visual Question Answering on Sort-of-CLEVR using PyTorch
Language: Jupyter Notebook - Size: 8.99 MB - Last synced at: about 1 year ago - Pushed at: over 3 years ago - Stars: 52 - Forks: 13
aixcoder-plugin/nl2code-dataset
Aix-bench, the Java benchmark for code synthesis problem.
Language: Java - Size: 7.05 MB - Last synced at: 12 months ago - Pushed at: almost 3 years ago - Stars: 51 - Forks: 1
gussmith23/lakeroad
FPGA synthesis tool powered by program synthesis
Language: Racket - Size: 4.36 MB - Last synced at: 6 days ago - Pushed at: 18 days ago - Stars: 48 - Forks: 8
chasenorman/Canonical
Canonical is a performant sound and complete type inhabitation solver for dependent type theory.
Language: Lean - Size: 169 KB - Last synced at: 2 days ago - Pushed at: 3 days ago - Stars: 47 - Forks: 4
alcides/GeneticEngine
Program Synthesis framework that features heuristics methods (e.g., Genetic Programming) and grammars are defined in Python dataclasses
Language: Python - Size: 54.5 MB - Last synced at: 16 days ago - Pushed at: 19 days ago - Stars: 45 - Forks: 7
xionluhnis/neural_inverse_knitting
Code for Neural Inverse Knitting: From Images to Manufacturing Instructions
Language: Python - Size: 3.36 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 44 - Forks: 11
flxsosa/ProgramSearch
A public repository for "Write, Execute, Assess: Program Synthesis With a REPL" project by Kevin Ellis, Max Nye, Yewen Pu, Felix Sosa, Josh Tenenbaum, and Armando Solar-Lezama. Presented at NeurIPS 2019.
Language: Python - Size: 581 KB - Last synced at: almost 2 years ago - Pushed at: about 5 years ago - Stars: 31 - Forks: 6
Mondego/dafny-synthesis
Towards AI-Assisted Synthesis of Verified Dafny Methods
Language: Dafny - Size: 778 KB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 26 - Forks: 0
rbavishi/autopandas
OOPSLA 2019 Artifact for AutoPandas. Website at https://rbavishi.github.io/autopandas
Language: Python - Size: 322 KB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 26 - Forks: 4
rbavishi/atlas
A Framework for Model-Backed Generators. Backend for AutoPandas (https://autopandas.io)
Language: Python - Size: 1.53 MB - Last synced at: 6 days ago - Pushed at: almost 4 years ago - Stars: 21 - Forks: 7
Baltoli/accsynt
Program synthesis tools and utilities for LLVM.
Language: C++ - Size: 8.95 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 19 - Forks: 3
HiroakiMikami/mlprogram
PyTorch library for synthesizing programs from natural language
Language: Python - Size: 9.03 MB - Last synced at: about 2 months ago - Pushed at: 11 months ago - Stars: 18 - Forks: 3
raeidsaqur/mgn
Multimodal Graph Network (MGN): Code repo, examples from the paper
Language: Python - Size: 1.36 MB - Last synced at: over 2 years ago - Pushed at: about 4 years ago - Stars: 18 - Forks: 4
sanctuuary/APE
Tool for automated generation of computational workflows.
Language: Java - Size: 62.2 MB - Last synced at: 11 days ago - Pushed at: 5 months ago - Stars: 17 - Forks: 7
celinehocquette/magicpopper
C. Hocquette and A. Cropper, Learning programs with magic values.
Language: Prolog - Size: 1.16 GB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 17 - Forks: 1
albertusk95/intention-to-code-lstm
Source Code Generation Based On User Intention Using LSTM Networks
Language: Python - Size: 2.17 MB - Last synced at: over 2 years ago - Pushed at: over 7 years ago - Stars: 17 - Forks: 3
SynthesisLab/DeepSynth2
General purpose program synthetiser with existing Programming By Examples (PBE) pipeline
Language: Python - Size: 220 MB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 16 - Forks: 5
msv-lab/f1x
Efficient patch generation engine for C/C++ programs
Language: C++ - Size: 798 KB - Last synced at: 10 months ago - Pushed at: over 2 years ago - Stars: 16 - Forks: 3
damianomarsili/VADAR
Program synthesis for 3D spatial reasoning
Language: Jupyter Notebook - Size: 6.18 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 15 - Forks: 0
RU-Automated-Reasoning-Group/pi-PRL
ICLR'22 Programmatic Reinforcement Learning
Language: Python - Size: 10.4 MB - Last synced at: almost 2 years ago - Pushed at: about 2 years ago - Stars: 13 - Forks: 2
aig-upf/automated-programming-framework
Automated Programming Framework
Language: Shell - Size: 123 MB - Last synced at: about 1 year ago - Pushed at: about 5 years ago - Stars: 13 - Forks: 2
jfeser/castor
Deductive synthesis and compilation of specialized databases.
Language: OCaml - Size: 28.8 MB - Last synced at: about 2 months ago - Pushed at: almost 2 years ago - Stars: 12 - Forks: 1
celinehocquette/numsynth-aaai23
C. Hocquette and A. Cropper, Relational program synthesis with numerical reasoning, AAAI23.
Language: Prolog - Size: 85.5 MB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 12 - Forks: 0
akothen/Hydride
A retargetable and extensible synthesis-based compiler for modern hardware architectures
Language: LLVM - Size: 391 MB - Last synced at: 29 days ago - Pushed at: 29 days ago - Stars: 10 - Forks: 1
pauljblazek/deepdistilling
Mechanistically interpretable neural networks losslessly compressed to computer code, discovering new algorithms that generalize out-of-distribution and outperform human-designed algorithms
Language: Python - Size: 1.35 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 10 - Forks: 0
yjl9903/FlashFill
A Rust implementation of Sumit Gulwani. Automating string processing in spreadsheets using input-output examples. POPL'11.
Language: Rust - Size: 7.94 MB - Last synced at: 2 months ago - Pushed at: over 2 years ago - Stars: 10 - Forks: 2
Demfier/PsyNLP
Python module with Program Synthesis Techniques for NLP
Language: Python - Size: 5.65 MB - Last synced at: 3 days ago - Pushed at: about 7 years ago - Stars: 10 - Forks: 2
lorepozo/ec Fork of ellisk42/jetty
Learning programs with the Exploration-Compression algorithm
Language: OCaml - Size: 297 KB - Last synced at: about 2 years ago - Pushed at: about 7 years ago - Stars: 9 - Forks: 0
jyoo980/TypeScript.ts
a DSL (domain specific language) for generating TypeScript projects
Language: TypeScript - Size: 359 KB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 7 - Forks: 4
zaxtax/bustle
Bustle: Botton-up Program Synthesis Through Learning-Guided Exploration
Language: Python - Size: 300 KB - Last synced at: about 3 hours ago - Pushed at: over 1 year ago - Stars: 7 - Forks: 0
unitn-sml/syn-interventions-algorithmic-recourse
Synthesizing explainable counterfactual policies for algorithmic recourse with program synthesis.
Language: Python - Size: 3.32 MB - Last synced at: almost 2 years ago - Pushed at: about 2 years ago - Stars: 7 - Forks: 1
frankaging/BabyARC
Baby Abstract Reasoning Corpus (BabyARC) dataset engine, for generating grid-world-based abstract reasoning tasks on a large scale.
Language: Python - Size: 2.85 MB - Last synced at: about 1 month ago - Pushed at: over 3 years ago - Stars: 7 - Forks: 1
microsoft/generator-prose 📦
Yeoman generator for PRogram Synthesis by Examples DSL projects.
Language: JavaScript - Size: 24.4 KB - Last synced at: 3 days ago - Pushed at: over 4 years ago - Stars: 7 - Forks: 7
thufv/automerge
Resolve conflicts via version space algebra in structured merge.
Language: Java - Size: 14.8 MB - Last synced at: about 1 year ago - Pushed at: over 6 years ago - Stars: 7 - Forks: 2
gomahajan/formal-uav
UAV control with formal guarantees
Language: Python - Size: 68.4 MB - Last synced at: about 1 year ago - Pushed at: over 7 years ago - Stars: 7 - Forks: 1
MrVPlusOne/Escher-Scala
Recursive Program Synthesis using input-output examples
Language: Scala - Size: 3.56 MB - Last synced at: 2 months ago - Pushed at: about 8 years ago - Stars: 7 - Forks: 5
mfornet/tcgen
Program synthesis tool. Read a list of strings and create a generator that sample strings from the same distribution as input strings. Focused on test cases of competitive programming problems.
Language: Python - Size: 22.5 KB - Last synced at: 10 days ago - Pushed at: about 6 years ago - Stars: 6 - Forks: 0
plasma-umass/Tortoise 📦
Tortoise: Interactive System Configuration Repair
Language: Scala - Size: 430 KB - Last synced at: about 1 year ago - Pushed at: over 7 years ago - Stars: 6 - Forks: 0
default01234/COOL-DSL
COOL (Chain-Oriented Objective Logic) - Advanced DSL programming system
Language: C++ - Size: 123 MB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 5 - Forks: 0
datvo06/VRDSynth
Synthesizing programs to link visually-rich document entities. This is the replication code for VRDSynth paper, accepted in ISSTA'24
Language: Python - Size: 3.19 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 5 - Forks: 0
justinlubin/cobbler
Refactor programs to use library functions
Language: OCaml - Size: 34.1 MB - Last synced at: 5 days ago - Pushed at: 11 months ago - Stars: 5 - Forks: 0
haisi/jPBE
A library helping you transform strings by providing examples instead of coding (PBE)
Language: Java - Size: 934 KB - Last synced at: over 2 years ago - Pushed at: over 3 years ago - Stars: 5 - Forks: 0
ics-jku/epex-formal-rv32-model
A RISC-V RV32 model ready for SMT program synthesis.
Language: C - Size: 6.84 KB - Last synced at: over 1 year ago - Pushed at: almost 4 years ago - Stars: 5 - Forks: 1
Mateusz-Grzelinski/program-synthesis-documentation
Many resources about program synthesis
Language: Python - Size: 45.9 KB - Last synced at: 2 months ago - Pushed at: over 4 years ago - Stars: 5 - Forks: 0
kupl/synthrl
SynthRL [ˈsɪnθrɪl]
Language: Python - Size: 335 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 5 - Forks: 1
SimonOuellette35/GridCoder2024
Code for my ARC Prize 2024 submission
Language: Python - Size: 222 KB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 4 - Forks: 0
BudEcosystem/code-millenials
SOTA OpenSource code generation model on par with GPT-4 & Beating Google Gemini Ultra, Claude -2 etc.
Language: Python - Size: 217 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 2
celestebarnaby/ImageEye
Language: Python - Size: 1.32 GB - Last synced at: 10 months ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 1
ThousandMonkeysTypewriter/Deployer
Machine Learning functions inside Java objects
Size: 214 MB - Last synced at: almost 2 years ago - Pushed at: over 7 years ago - Stars: 4 - Forks: 0
google/ARC-GEN
A Mimetic Procedural Benchmark Generator for the Abstraction and Reasoning Corpus
Language: Python - Size: 7.88 MB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 3 - Forks: 1
SynthesisLab/wikicoder
Synthesis of string manipulation programs from examples with outside knowledge!
Language: Python - Size: 742 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 3 - Forks: 0
mj33rice/SimCoPilot
SimCoPilot is a benchmark for evaluating LLMs to perform as a "copilot"-style, interactive coding assistant, testing their ability to add and complete code in complex real-world software environments.
Language: Python - Size: 141 MB - Last synced at: 6 months ago - Pushed at: 7 months ago - Stars: 3 - Forks: 0
jsego/bfgp-pp
A framework based on Best-First Generalized Planning where solutions are either assembly-like programs, or structured programs that are syntactically terminating.
Language: PDDL - Size: 58.8 MB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 3 - Forks: 3
killthebuddh4/gadfly
A system 2 compiler for language models.
Language: TypeScript - Size: 1.65 MB - Last synced at: 6 days ago - Pushed at: about 1 year ago - Stars: 3 - Forks: 0
pbelcak/disper
End-to-End Neural Permutation Program Synthesis with Disentanglement
Language: Python - Size: 46.9 KB - Last synced at: almost 2 years ago - Pushed at: almost 3 years ago - Stars: 3 - Forks: 0
RU-Automated-Reasoning-Group/dPads
NeurIPS'21 Differentiable Program Synthesis
Language: Python - Size: 146 KB - Last synced at: almost 2 years ago - Pushed at: over 3 years ago - Stars: 3 - Forks: 2
kiridi/inductive-haskell
Inductive Haskell
Language: Haskell - Size: 1.34 MB - Last synced at: 3 months ago - Pushed at: about 5 years ago - Stars: 3 - Forks: 0
azhirnov/ProgramSynthesis 📦
GPU accelerated program synthesis
Language: C++ - Size: 79.1 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 3 - Forks: 0
mj33rice/Sim-CoPilot
SimCoPilot is a benchmark for evaluating LLMs to perform as a "copilot"-style, interactive coding assistant, testing their ability to add and complete code in complex real-world software environments.
Language: Python - Size: 104 MB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 2 - Forks: 0