tioannid/geordfbench

GeoRDFBench Framework: Geospatial Semantic Benchmarking Simplified

Language: Java - Size: 20.9 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 1 - Forks: 1

blooop/bencher

A package for benchmarking the characteristics of arbitrary functions

Language: HTML - Size: 33.3 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 3 - Forks: 2

pyrddlgym-project/pyRDDLGym

A toolkit for auto-generation of OpenAI Gym environments from RDDL description files.

Language: Python - Size: 64.3 MB - Last synced at: 2 days ago - Pushed at: 29 days ago - Stars: 83 - Forks: 22

microsoft/VirtualClient

Benchmarking and monitoring automation, designed for cloud, built with .NET.

Language: C# - Size: 144 MB - Last synced at: 2 days ago - Pushed at: 3 days ago - Stars: 101 - Forks: 51

uber/bayesmark

Benchmark framework to easily compare Bayesian optimization methods on real machine learning tasks

Language: Python - Size: 209 KB - Last synced at: 3 days ago - Pushed at: almost 4 years ago - Stars: 146 - Forks: 33

optiprofiler/optiprofiler

Benchmarking optimization solvers.

Language: MATLAB - Size: 36.4 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 9 - Forks: 1

graphdeeplearning/benchmarking-gnns

Repository for benchmarking graph neural networks (JMLR 2023)

Language: Jupyter Notebook - Size: 3.21 MB - Last synced at: 1 day ago - Pushed at: almost 2 years ago - Stars: 2,586 - Forks: 456

spcl/serverless-benchmarks

SeBS: serverless benchmarking suite for automatic performance analysis of FaaS platforms.

Language: Python - Size: 2.9 MB - Last synced at: about 5 hours ago - Pushed at: 2 days ago - Stars: 165 - Forks: 78

google/fuzzbench

FuzzBench - Fuzzer benchmarking as a service.

Language: Python - Size: 37.1 MB - Last synced at: 2 days ago - Pushed at: 3 months ago - Stars: 1,145 - Forks: 282

TimeEval/TimeEval

Evaluation Tool for Anomaly Detection Algorithms on Time Series

Language: Jupyter Notebook - Size: 24.7 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 123 - Forks: 18

WenyXu/metrics-bench-suite

Metrics Bench Suite is a set of tools designed to benchmark the storage and querying of metrics data in time-series databases

Language: Go - Size: 1.49 MB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 1 - Forks: 2

Infleqtion/client-superstaq

https://superstaq.readthedocs.io

Language: Python - Size: 44.2 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 97 - Forks: 20

Picovoice/voice-activity-benchmark

Voice activity engine benchmark framework

Language: Python - Size: 297 KB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 13 - Forks: 3

sosy-lab/benchexec

BenchExec: A Framework for Reliable Benchmarking and Resource Measurement

Language: Python - Size: 27 MB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 257 - Forks: 211

proto-lab-ro/jobshoplab

Language: Python - Size: 15.5 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 3 - Forks: 0

sean-lamont/bait

Language: Standard ML - Size: 81.4 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 5 - Forks: 2

phpbench/phpbench

PHP Benchmarking framework

Language: PHP - Size: 6.53 MB - Last synced at: 6 days ago - Pushed at: 2 months ago - Stars: 1,942 - Forks: 123

LSeu-Open/LLMScoreEngine

A comprehensive system for evaluating and scoring large language models based on multiple criteria.

Language: Python - Size: 74.2 KB - Last synced at: 10 days ago - Pushed at: 11 days ago - Stars: 0 - Forks: 0

itlab-vision/dl-benchmark

Deep Learning Inference benchmark. Supports OpenVINO™ toolkit, TensorFlow, TensorFlow Lite, ONNX Runtime, OpenCV DNN, MXNet, PyTorch, Apache TVM, ncnn, PaddlePaddle, etc.

Language: HTML - Size: 141 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 32 - Forks: 38

JohnSnowLabs/langtest

Deliver safe & effective language models

Language: Python - Size: 157 MB - Last synced at: 2 days ago - Pushed at: 8 days ago - Stars: 522 - Forks: 46

eddelbuettel/rcppgeiger

Rcpp Bindings to C++14 Micro-Benchmarking Library

Language: C++ - Size: 25.4 KB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 3 - Forks: 1

graphnex/privacy-from-visual-entities

Official source code of the article "Learning Privacy from Visual Entities" accepted at Privacy Enhancing Technologies Symposium (PETS) 2025 and published in the journal Proceedings on Privacy Enhancing Technologies (PoPETs), Volume 2025, Issue 3, 2025 (to appear).

Language: Python - Size: 626 KB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 0 - Forks: 0

ordo-one/package-benchmark

Swift benchmark runner with many performance metrics and great CI support

Language: Swift - Size: 1.09 MB - Last synced at: 7 days ago - Pushed at: 14 days ago - Stars: 370 - Forks: 26

atomind-ai/mlip-arena

Fair and transparent benchmark of machine learning interatomic potentials (MLIPs), beyond basic error metrics

Language: Python - Size: 19 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 56 - Forks: 2

langchain-ai/langchain-benchmarks

🦜💯 Flex those feathers!

Language: Python - Size: 16.2 MB - Last synced at: 1 day ago - Pushed at: 7 months ago - Stars: 246 - Forks: 50

ConduitIO/benchi

Benchmark any tool from the CLI

Language: Go - Size: 14.5 MB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 117 - Forks: 2

gdmnl/Spectral-GNN-Benchmark

A PyG-based package of spectral GNNs with benchmark evaluations.

Language: Jupyter Notebook - Size: 14.4 MB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 14 - Forks: 3

RLE-Foundation/rllte

Long-Term Evolution Project of Reinforcement Learning

Language: Python - Size: 96.5 MB - Last synced at: 18 days ago - Pushed at: about 1 month ago - Stars: 474 - Forks: 87

MayankShrivastavaa/Salesforce-Benchmarker

A real-time, off-platform local utility designed to benchmark Apex logic. It allows developers to measure performance impact prior to deployment and compare execution times of different implementations to check for overhead caused by new frameworks, utilities, or features.

Language: JavaScript - Size: 8.79 KB - Last synced at: 22 days ago - Pushed at: 22 days ago - Stars: 0 - Forks: 0

blocksense-network/zkVMs-benchmarks

Setups and programs for zero-knowledge virtual machine benchmarking

Language: Rust - Size: 770 KB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 2 - Forks: 3

KumarRobotics/kr_param_map

A parameterized map generator for planning evaluations and benchmarking

Language: C++ - Size: 100 MB - Last synced at: 23 days ago - Pushed at: 23 days ago - Stars: 23 - Forks: 6

VectorInstitute/VLDBench

VLDBench: A large-scale benchmark for evaluating Vision-Language Models (VLMs) and Large Language Models (LLMs) on multimodal disinformation detection.

Language: Python - Size: 259 MB - Last synced at: 28 days ago - Pushed at: 29 days ago - Stars: 3 - Forks: 0

Bodigrim/tasty-bench

Featherlight benchmark framework, drop-in replacement for criterion and gauge.

Language: Haskell - Size: 247 KB - Last synced at: 2 days ago - Pushed at: about 1 month ago - Stars: 81 - Forks: 13

chronoxor/CppBenchmark

Performance benchmark framework for C++ with nanoseconds measure precision

Language: C++ - Size: 43.2 MB - Last synced at: 30 days ago - Pushed at: about 1 month ago - Stars: 295 - Forks: 48

myzhan/boomer

A better load generator for locust, written in golang.

Language: Go - Size: 381 KB - Last synced at: 2 days ago - Pushed at: 9 months ago - Stars: 1,204 - Forks: 243

cookrn/mruby-bench-tool

A simple tool to benchmark Ruby scripts in cruby vs. mruby

Language: Ruby - Size: 12.7 KB - Last synced at: 2 days ago - Pushed at: almost 7 years ago - Stars: 7 - Forks: 0

attila-balint-kul/energy-forecast-benchmark-toolkit

Energy Forecast Benchmark Toolkit is a Python project that aims to provide common tools to benchmark forecast models.

Language: Jupyter Notebook - Size: 5.45 MB - Last synced at: 3 days ago - Pushed at: about 1 month ago - Stars: 14 - Forks: 4

dries007/FPGAPerformanceSuite

FPGA Benchmarking Software - Thesis project (2019) MSC @KULeuven - De Nayer

Language: VHDL - Size: 7.77 MB - Last synced at: about 1 month ago - Pushed at: almost 6 years ago - Stars: 1 - Forks: 0

TimeEval/TimeEval-GUI

[Read-Only Mirror] Benchmarking Toolkit for Time Series Anomaly Detection Algorithms using TimeEval and GutenTAG

Language: Python - Size: 701 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 27 - Forks: 8

tudelft/AvoidBench

AvoidBench

Language: C++ - Size: 274 MB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 71 - Forks: 16

ThangLeQuoc/timer-ninja

A handy Java utility for measuring execution time easily with annotation-based tracking, multiple time units, and stacktrace tree visualization.

Language: Java - Size: 264 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 4 - Forks: 0

google/swift-benchmark

A swift library to benchmark code snippets.

Language: Swift - Size: 166 KB - Last synced at: 1 day ago - Pushed at: about 3 years ago - Stars: 929 - Forks: 50

oracle/rwloadsim

RWP*Load Simulator - your tool for scripting, simulation and much more. Like having a bit of bash and SQL, a nip of C or Java, a dash of awk, a grain of sed plus drops of secret sauce in one single tool. See https://blogs.oracle.com/database/rwploadsim-oracle-db-performance-simluator for the announcement on the Oracle database blog.

Language: C - Size: 4.93 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 51 - Forks: 19

ziyadedher/evm-bench

🚀🪑 evm-bench is a suite of Ethereum Virtual Machine stress tests and benchmarks.

Language: Solidity - Size: 2 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 212 - Forks: 23

OATML/bdl-benchmarks

Bayesian Deep Learning Benchmarks

Language: Jupyter Notebook - Size: 1.64 MB - Last synced at: 15 days ago - Pushed at: about 2 years ago - Stars: 670 - Forks: 94

penfever/sos-bench

This codebase stores the complete artifacts and describes how to reproduce or extend the results from the paper "Style Outweighs Substance: Failure modes of LLM judges in alignment benchmarking", including the SOS-Bench meta-benchmark.

Language: Python - Size: 5.74 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 4 - Forks: 2

CeLuigi/models-comparison.pytorch

Code for the paper Benchmark Analysis of Representative Deep Neural Network Architectures

Language: Python - Size: 473 KB - Last synced at: about 1 month ago - Pushed at: over 4 years ago - Stars: 164 - Forks: 31

thu-ml/ares

A Python library for adversarial machine learning focusing on benchmarking adversarial robustness.

Language: Python - Size: 378 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 502 - Forks: 88

iMeanAI/WebCanvas

All-in-one Web Agent framework for post-training. Start building with a few clicks!

Language: Python - Size: 5.84 MB - Last synced at: about 2 months ago - Pushed at: 3 months ago - Stars: 239 - Forks: 17

NyanKiyoshi/pytest-django-queries

Generate performance reports from your django database performance tests.

Language: Python - Size: 521 KB - Last synced at: 9 days ago - Pushed at: about 4 years ago - Stars: 83 - Forks: 2

ivafanas/sltbench

C++ benchmark tool. Practical, stable and fast performance testing framework.

Language: C++ - Size: 341 KB - Last synced at: 8 days ago - Pushed at: over 2 years ago - Stars: 150 - Forks: 10

GMAP/SPBench

SPBench: A Framework for Benchmarking Stream Processing Applications

Language: C++ - Size: 3.64 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 11 - Forks: 3

sheredom/ubench.h

⏱️ single header benchmark framework for C and C++

Language: C++ - Size: 69.3 KB - Last synced at: about 1 month ago - Pushed at: 9 months ago - Stars: 230 - Forks: 19

mims-harvard/SPECTRA

SPECTRA: Spectral framework for evaluation of biomedical AI models

Language: Jupyter Notebook - Size: 70.1 MB - Last synced at: 7 days ago - Pushed at: 2 months ago - Stars: 38 - Forks: 7

JinukMoon/CatBench

CatBench - Benchmark Framework for Machine Learning Potentials in Adsorption Energy Predictions

Language: Python - Size: 32 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 8 - Forks: 0

nerdroychan/kvbench

A key-value store benchmark framework with customizable workloads

Language: Rust - Size: 1.88 MB - Last synced at: 28 days ago - Pushed at: 2 months ago - Stars: 17 - Forks: 0

pathwaycom/pathway-benchmarks

Benchmarks for data processing systems: Pathway, Spark, Flink, Kafka Streams

Language: Python - Size: 4.7 MB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 68 - Forks: 4

Picovoice/wake-word-benchmark

wake word engine benchmark framework

Language: Python - Size: 96.9 MB - Last synced at: about 1 month ago - Pushed at: over 3 years ago - Stars: 133 - Forks: 28

MatheusRich/benchable

Write benchmarks without the hassle.

Language: Ruby - Size: 45.9 KB - Last synced at: 12 days ago - Pushed at: 5 months ago - Stars: 75 - Forks: 1

carrotdata/membench

Various memory usage - related benchmarks for Memcached and Redis

Language: Java - Size: 3.1 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 4 - Forks: 0

JieyuZ2/wrench

[NeurIPS 2021] WRENCH: Weak supeRvision bENCHmark

Language: Python - Size: 1.81 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 224 - Forks: 33

Bodigrim/tasty-bench-fit

Benchmark a given function for variable input sizes and find out its time complexity

Language: Haskell - Size: 20.5 KB - Last synced at: 19 days ago - Pushed at: 3 months ago - Stars: 25 - Forks: 2

anupli/running-ng

Running next generation

Language: Python - Size: 2.52 MB - Last synced at: 4 days ago - Pushed at: 9 months ago - Stars: 5 - Forks: 8

RECeSS-EU-Project/benchmark-code

Code associated with "Comprehensive evaluation of collaborative filtering in drug repurposing"

Language: Python - Size: 138 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0

icebob/benchmarkify

:zap: Benchmark framework for NodeJS

Language: JavaScript - Size: 135 KB - Last synced at: 1 day ago - Pushed at: over 1 year ago - Stars: 47 - Forks: 3

leon0399/benchmarks

World's complete programming language benchmark

Language: Python - Size: 1.17 MB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 4 - Forks: 1

myzhan/locust4j

Locust4j is a load generator for locust, written in Java.

Language: Java - Size: 272 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 81 - Forks: 33

domsolutions/gopayloader

HTTP/S benchmark/load testing cross-platform tool with optional jwt generation - supports HTTP/1.1, HTTP/2, HTTP/3

Language: Go - Size: 329 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 18 - Forks: 2

ohkami-rs/framework_benchmarks

Language: Rust - Size: 122 KB - Last synced at: 2 days ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

JohannesBuchner/nested-sampling

Pythonic Nested Sampling Development Framework & UltraNest

Language: Python - Size: 215 MB - Last synced at: about 1 month ago - Pushed at: over 6 years ago - Stars: 7 - Forks: 4

w3f/polkadot-lab

Testing framework for Polkadot networks

Language: TypeScript - Size: 1.59 MB - Last synced at: about 1 month ago - Pushed at: almost 2 years ago - Stars: 12 - Forks: 10

hexuandeng/NewTerm

Implementation for our paper “NewTerm: Benchmarking Real-Time New Terms for Large Language Models with Annual Updates,” accepted to NeurIPS 2024 D&B. 🎉

Language: Python - Size: 15.4 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 4 - Forks: 0

jeffzi/luamark

A lightweight, portable microbenchmarking library for Lua

Language: Lua - Size: 111 KB - Last synced at: 24 days ago - Pushed at: 25 days ago - Stars: 1 - Forks: 0

contour-terminal/termbench-pro

Terminal Benchmarking as CLI and library.

Language: C++ - Size: 99.6 KB - Last synced at: 1 day ago - Pushed at: 5 months ago - Stars: 9 - Forks: 3

JoeyHendricks/python-benchmark-harness

A micro/macro benchmark framework for the Python programming language that helps with optimizing your software.

Language: Python - Size: 20.1 MB - Last synced at: about 2 hours ago - Pushed at: 17 days ago - Stars: 157 - Forks: 13

ansible-lockdown/RHEL8-STIG-Audit

Audit control files for rhel8 stig - utilising goss

Language: YAML - Size: 826 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 14 - Forks: 5

ansible-lockdown/UBUNTU22-CIS-Audit

Audit for Ubuntu 22 CIS

Language: YAML - Size: 498 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 39 - Forks: 15

Lenochxd/PyBench

Easy python benchmarking

Language: Python - Size: 22.5 KB - Last synced at: 26 days ago - Pushed at: over 1 year ago - Stars: 7 - Forks: 0

tweag/hyperion

A lab for future Criterion features.

Language: Haskell - Size: 104 KB - Last synced at: 21 days ago - Pushed at: over 6 years ago - Stars: 28 - Forks: 1

biobakery/maaslin2_benchmark

Large-scale Benchmarking of Microbial Multivariable Association Methods

Language: R - Size: 32.2 KB - Last synced at: 2 months ago - Pushed at: over 4 years ago - Stars: 4 - Forks: 0

Dru-Mara/EvalNE

Source code for EvalNE, a Python library for evaluating Network Embedding methods.

Language: Python - Size: 849 KB - Last synced at: 15 days ago - Pushed at: about 1 year ago - Stars: 106 - Forks: 26

wtanaka/ansible-role-ab

Ansible role to install ab -- ApacheBench benchmarking tool

Size: 9.77 KB - Last synced at: 2 months ago - Pushed at: almost 6 years ago - Stars: 2 - Forks: 0

NNPDF/banana

Benchmarking AgaiNst Apfel aNd Anything

Language: Python - Size: 60.8 MB - Last synced at: 6 days ago - Pushed at: 7 months ago - Stars: 2 - Forks: 1

jalalmostafa/SciTS

A tool to benchmark Time-series databases

Language: Jupyter Notebook - Size: 130 MB - Last synced at: 17 days ago - Pushed at: 9 months ago - Stars: 13 - Forks: 4

ibmcb/cbtool

Cloud Rapid Experimentation and Analysis Toolkit

Language: Python - Size: 45.6 MB - Last synced at: 4 days ago - Pushed at: 11 months ago - Stars: 79 - Forks: 49

awadell1/PkgJogger.jl

Take your packages for a jog!

Language: Julia - Size: 908 KB - Last synced at: 1 day ago - Pushed at: 10 months ago - Stars: 23 - Forks: 0

wichtounet/cpm

Continuous Perfomance Monitor (CPM) for C++ code

Language: C++ - Size: 187 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 40 - Forks: 7

GatlenCulp/homebrew-vivaria

Homebrew tap for vivaria, METR's AI evaluation tool

Language: Ruby - Size: 35.8 MB - Last synced at: about 2 months ago - Pushed at: 8 months ago - Stars: 2 - Forks: 0

Lightstreamer/lightstreamer-kafka-connector-loadtest

Kafka load and stress testing

Language: Java - Size: 1.96 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 1 - Forks: 0

Glopix/Cloreco

Clone Recognizer Comparator platform

Language: Python - Size: 4.04 MB - Last synced at: 3 days ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

mariaangelapellegrino/Evaluation-Framework

It is an evaluation framework for evaluating and comparing graph embedding techniques

Language: Jupyter Notebook - Size: 46.5 MB - Last synced at: 9 months ago - Pushed at: almost 2 years ago - Stars: 10 - Forks: 8

ellerbrock/perfkit-alicloud

:mahjong: PerfKit Benchmarker for Alibaba Cloud Dockerized

Language: Shell - Size: 7.81 KB - Last synced at: about 2 months ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 0

UDC-GAC/MARTA

MARTA - Multi-configuration Assembly pRofiler and Toolkit for performance Analysis

Language: Python - Size: 18.8 MB - Last synced at: 3 months ago - Pushed at: about 1 year ago - Stars: 4 - Forks: 0

drish/ben

Your benchmark assistant, written in Go.

Language: Go - Size: 12.6 MB - Last synced at: about 1 month ago - Pushed at: over 7 years ago - Stars: 66 - Forks: 1

qianghuangwhu/benchtemp

BenchTemp: A General Benchmark for Evaluating Temporal Graph Neural Networks

Language: Python - Size: 4.93 MB - Last synced at: 9 months ago - Pushed at: about 1 year ago - Stars: 15 - Forks: 3

OptiMaL-PSE-Lab/EvalRetro

A repository for evaluating single-step retrosynthesis algorithms

Language: Python - Size: 142 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 13 - Forks: 2

0xFFFC0000/benchmark-project

This is ongoing project. Some feature might not work.

Language: C++ - Size: 18.6 KB - Last synced at: about 2 months ago - Pushed at: about 1 year ago - Stars: 3 - Forks: 0

graalvm/CLAMH 📦

CLAMH (Cross-LAnguage Microbenchmark Harness) is a language-independent benchmark harness design and the implementation of that design for different languages.

Language: C++ - Size: 3.84 MB - Last synced at: about 1 month ago - Pushed at: almost 4 years ago - Stars: 7 - Forks: 3

ghar1821/ParetoBench

Benchmarking framework based on Pareto front concept

Language: Python - Size: 680 MB - Last synced at: about 1 year ago - Pushed at: almost 4 years ago - Stars: 5 - Forks: 3

gkiril/benchie

Comprehensive evaluation framework for Open Information Extraction.

Language: Python - Size: 340 KB - Last synced at: 11 months ago - Pushed at: almost 3 years ago - Stars: 38 - Forks: 8