benchmark-framework | Topic | Ecosyste.ms: Repos

Topic: "benchmark-framework"

graphdeeplearning/benchmarking-gnns

Repository for benchmarking graph neural networks (JMLR 2023)

Language: Jupyter Notebook - Size: 3.21 MB - Last synced at: about 1 month ago - Pushed at: almost 2 years ago - Stars: 2,578 - Forks: 455

phpbench/phpbench

PHP Benchmarking framework

Language: PHP - Size: 6.53 MB - Last synced at: 4 days ago - Pushed at: 2 months ago - Stars: 1,942 - Forks: 123

myzhan/boomer

A better load generator for locust, written in golang.

Language: Go - Size: 381 KB - Last synced at: 1 day ago - Pushed at: 9 months ago - Stars: 1,204 - Forks: 243

google/fuzzbench

FuzzBench - Fuzzer benchmarking as a service.

Language: Python - Size: 37.1 MB - Last synced at: about 9 hours ago - Pushed at: 3 months ago - Stars: 1,145 - Forks: 282

google/swift-benchmark

A swift library to benchmark code snippets.

Language: Swift - Size: 166 KB - Last synced at: 25 days ago - Pushed at: about 3 years ago - Stars: 929 - Forks: 51

OATML/bdl-benchmarks

Bayesian Deep Learning Benchmarks

Language: Jupyter Notebook - Size: 1.64 MB - Last synced at: 13 days ago - Pushed at: about 2 years ago - Stars: 670 - Forks: 94

JohnSnowLabs/langtest

Deliver safe & effective language models

Language: Python - Size: 157 MB - Last synced at: about 4 hours ago - Pushed at: 6 days ago - Stars: 522 - Forks: 46

thu-ml/ares

A Python library for adversarial machine learning focusing on benchmarking adversarial robustness.

Language: Python - Size: 378 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 502 - Forks: 88

RLE-Foundation/rllte

Long-Term Evolution Project of Reinforcement Learning

Language: Python - Size: 96.5 MB - Last synced at: 16 days ago - Pushed at: about 1 month ago - Stars: 474 - Forks: 87

ordo-one/package-benchmark

Swift benchmark runner with many performance metrics and great CI support

Language: Swift - Size: 1.09 MB - Last synced at: 5 days ago - Pushed at: 12 days ago - Stars: 370 - Forks: 26

chronoxor/CppBenchmark

Performance benchmark framework for C++ with nanoseconds measure precision

Language: C++ - Size: 43.2 MB - Last synced at: 28 days ago - Pushed at: 28 days ago - Stars: 295 - Forks: 48

sosy-lab/benchexec

BenchExec: A Framework for Reliable Benchmarking and Resource Measurement

Language: Python - Size: 27 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 257 - Forks: 211

langchain-ai/langchain-benchmarks

🦜💯 Flex those feathers!

Language: Python - Size: 16.2 MB - Last synced at: 30 days ago - Pushed at: 7 months ago - Stars: 244 - Forks: 51

iMeanAI/WebCanvas

All-in-one Web Agent framework for post-training. Start building with a few clicks!

Language: Python - Size: 5.84 MB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 239 - Forks: 17

sheredom/ubench.h

⏱️ single header benchmark framework for C and C++

Language: C++ - Size: 69.3 KB - Last synced at: about 1 month ago - Pushed at: 8 months ago - Stars: 230 - Forks: 19

JieyuZ2/wrench

[NeurIPS 2021] WRENCH: Weak supeRvision bENCHmark

Language: Python - Size: 1.81 MB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 224 - Forks: 33

ziyadedher/evm-bench

🚀🪑 evm-bench is a suite of Ethereum Virtual Machine stress tests and benchmarks.

Language: Solidity - Size: 2 MB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 212 - Forks: 23

spcl/serverless-benchmarks

SeBS: serverless benchmarking suite for automatic performance analysis of FaaS platforms.

Language: Python - Size: 2.88 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 165 - Forks: 78

CeLuigi/models-comparison.pytorch

Code for the paper Benchmark Analysis of Representative Deep Neural Network Architectures

Language: Python - Size: 473 KB - Last synced at: 30 days ago - Pushed at: over 4 years ago - Stars: 164 - Forks: 31

JoeyHendricks/python-benchmark-harness

A micro/macro benchmark framework for the Python programming language that helps with optimizing your software.

Language: Python - Size: 20.1 MB - Last synced at: 14 days ago - Pushed at: 15 days ago - Stars: 157 - Forks: 13

ivafanas/sltbench

C++ benchmark tool. Practical, stable and fast performance testing framework.

Language: C++ - Size: 341 KB - Last synced at: 6 days ago - Pushed at: over 2 years ago - Stars: 150 - Forks: 10

uber/bayesmark

Benchmark framework to easily compare Bayesian optimization methods on real machine learning tasks

Language: Python - Size: 209 KB - Last synced at: about 20 hours ago - Pushed at: almost 4 years ago - Stars: 146 - Forks: 33

Picovoice/wake-word-benchmark

wake word engine benchmark framework

Language: Python - Size: 96.9 MB - Last synced at: about 1 month ago - Pushed at: over 3 years ago - Stars: 133 - Forks: 28

vanatka/pulkovo

Kotlin friendly library to measure elapsed time for methods, code blocks, RxJava chains

Language: Kotlin - Size: 114 KB - Last synced at: about 1 year ago - Pushed at: about 6 years ago - Stars: 125 - Forks: 3

TimeEval/TimeEval

Evaluation Tool for Anomaly Detection Algorithms on Time Series

Language: Jupyter Notebook - Size: 24.7 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 123 - Forks: 18

ConduitIO/benchi

Benchmark any tool from the CLI

Language: Go - Size: 14.5 MB - Last synced at: 15 days ago - Pushed at: 15 days ago - Stars: 117 - Forks: 2

Dru-Mara/EvalNE

Source code for EvalNE, a Python library for evaluating Network Embedding methods.

Language: Python - Size: 849 KB - Last synced at: 13 days ago - Pushed at: about 1 year ago - Stars: 106 - Forks: 26

microsoft/VirtualClient

Benchmarking and monitoring automation, designed for cloud, built with .NET.

Language: C# - Size: 143 MB - Last synced at: 7 days ago - Pushed at: 12 days ago - Stars: 101 - Forks: 50

Infleqtion/client-superstaq

https://superstaq.readthedocs.io

Language: Python - Size: 44.2 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 97 - Forks: 20

arturjordao/WearableSensorData

This repository provides the codes and data used in our paper "Human Activity Recognition Based on Wearable Sensor Data: A Standardization of the State-of-the-Art", where we implement and evaluate several state-of-the-art approaches, ranging from handcrafted-based methods to convolutional neural networks.

Language: Python - Size: 155 MB - Last synced at: over 1 year ago - Pushed at: over 5 years ago - Stars: 84 - Forks: 26

pyrddlgym-project/pyRDDLGym

A toolkit for auto-generation of OpenAI Gym environments from RDDL description files.

Language: Python - Size: 64.3 MB - Last synced at: about 5 hours ago - Pushed at: 27 days ago - Stars: 83 - Forks: 22

NyanKiyoshi/pytest-django-queries

Generate performance reports from your django database performance tests.

Language: Python - Size: 521 KB - Last synced at: 7 days ago - Pushed at: about 4 years ago - Stars: 83 - Forks: 2

Bodigrim/tasty-bench

Featherlight benchmark framework, drop-in replacement for criterion and gauge.

Language: Haskell - Size: 246 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 81 - Forks: 13

myzhan/locust4j

Locust4j is a load generator for locust, written in Java.

Language: Java - Size: 272 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 81 - Forks: 33

ibmcb/cbtool

Cloud Rapid Experimentation and Analysis Toolkit

Language: Python - Size: 45.6 MB - Last synced at: 1 day ago - Pushed at: 11 months ago - Stars: 79 - Forks: 49

MatheusRich/benchable

Write benchmarks without the hassle.

Language: Ruby - Size: 45.9 KB - Last synced at: 10 days ago - Pushed at: 5 months ago - Stars: 75 - Forks: 1

tudelft/AvoidBench

AvoidBench

Language: C++ - Size: 274 MB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 71 - Forks: 16

pathwaycom/pathway-benchmarks

Benchmarks for data processing systems: Pathway, Spark, Flink, Kafka Streams

Language: Python - Size: 4.7 MB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 68 - Forks: 4

drish/ben

Your benchmark assistant, written in Go.

Language: Go - Size: 12.6 MB - Last synced at: about 1 month ago - Pushed at: over 7 years ago - Stars: 66 - Forks: 1

atomind-ai/mlip-arena

Fair and transparent benchmark of machine learning interatomic potentials (MLIPs), beyond basic error metrics

Language: Python - Size: 19 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 56 - Forks: 2

oracle/rwloadsim

RWP*Load Simulator - your tool for scripting, simulation and much more. Like having a bit of bash and SQL, a nip of C or Java, a dash of awk, a grain of sed plus drops of secret sauce in one single tool. See https://blogs.oracle.com/database/rwploadsim-oracle-db-performance-simluator for the announcement on the Oracle database blog.

Language: C - Size: 4.93 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 51 - Forks: 19

icebob/benchmarkify

:zap: Benchmark framework for NodeJS

Language: JavaScript - Size: 135 KB - Last synced at: 24 days ago - Pushed at: over 1 year ago - Stars: 47 - Forks: 3

empiricalci/emp

:microscope: Empirical CLI

Language: JavaScript - Size: 233 KB - Last synced at: about 1 month ago - Pushed at: over 4 years ago - Stars: 42 - Forks: 7

wichtounet/cpm

Continuous Perfomance Monitor (CPM) for C++ code

Language: C++ - Size: 187 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 40 - Forks: 7

ppgia-unifor/Broadmark

A framework for the development, testing and evaluation of broad phase collision detection algorithms

Language: C# - Size: 101 MB - Last synced at: over 1 year ago - Pushed at: about 5 years ago - Stars: 40 - Forks: 3

ansible-lockdown/UBUNTU22-CIS-Audit

Audit for Ubuntu 22 CIS

Language: YAML - Size: 498 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 39 - Forks: 15

mims-harvard/SPECTRA

SPECTRA: Spectral framework for evaluation of biomedical AI models

Language: Jupyter Notebook - Size: 70.1 MB - Last synced at: 5 days ago - Pushed at: 2 months ago - Stars: 38 - Forks: 7

gkiril/benchie

Comprehensive evaluation framework for Open Information Extraction.

Language: Python - Size: 340 KB - Last synced at: 11 months ago - Pushed at: almost 3 years ago - Stars: 38 - Forks: 8

mslinn/ExecutorBenchmark 📦

Language: Scala - Size: 528 KB - Last synced at: about 1 month ago - Pushed at: about 12 years ago - Stars: 38 - Forks: 18

Spratiher9/SparkDataset

Instant search for and access to many datasets in Pyspark.

Language: Jupyter Notebook - Size: 14.9 MB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 34 - Forks: 8

dair-iitd/CaRB

CaRB - A Crowdsourced Benchmark for Open IE

Language: Python - Size: 5.83 MB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 34 - Forks: 8

itlab-vision/dl-benchmark

Deep Learning Inference benchmark. Supports OpenVINO™ toolkit, TensorFlow, TensorFlow Lite, ONNX Runtime, OpenCV DNN, MXNet, PyTorch, Apache TVM, ncnn, PaddlePaddle, etc.

Language: HTML - Size: 141 MB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 32 - Forks: 38

tweag/hyperion

A lab for future Criterion features.

Language: Haskell - Size: 104 KB - Last synced at: 19 days ago - Pushed at: over 6 years ago - Stars: 28 - Forks: 1

TimeEval/TimeEval-GUI

[Read-Only Mirror] Benchmarking Toolkit for Time Series Anomaly Detection Algorithms using TimeEval and GutenTAG

Language: Python - Size: 701 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 27 - Forks: 8

uber/uber-graph-benchmark

A framework to benchmark different graph databases, based on generated data from customizable schema, distribution, and size.

Language: Java - Size: 661 KB - Last synced at: about 1 year ago - Pushed at: over 6 years ago - Stars: 26 - Forks: 10

Bodigrim/tasty-bench-fit

Benchmark a given function for variable input sizes and find out its time complexity

Language: Haskell - Size: 20.5 KB - Last synced at: 17 days ago - Pushed at: 2 months ago - Stars: 25 - Forks: 2

KumarRobotics/kr_param_map

A parameterized map generator for planning evaluations and benchmarking

Language: C++ - Size: 100 MB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 23 - Forks: 6

awadell1/PkgJogger.jl

Take your packages for a jog!

Language: Julia - Size: 908 KB - Last synced at: about 1 month ago - Pushed at: 10 months ago - Stars: 23 - Forks: 0

eXascaleInfolab/clubmark

Clubmark: a Parallel Isolation Framework for Benchmarking and Profiling of Clustering (Community Detection) Algorithms Considering Overlaps (Covers)

Language: Python - Size: 7.66 MB - Last synced at: about 1 year ago - Pushed at: about 4 years ago - Stars: 20 - Forks: 2

ansible-lockdown/RHEL7-CIS-Audit

Audit configurations for RHEL7 CIS

Language: YAML - Size: 290 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 19 - Forks: 10

domsolutions/gopayloader

HTTP/S benchmark/load testing cross-platform tool with optional jwt generation - supports HTTP/1.1, HTTP/2, HTTP/3

Language: Go - Size: 329 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 18 - Forks: 2

Data-Science-Platform/tpch-pgsql

Implements the [TPCH benchmark](http://www.tpc.org/tpch/) for Postgres

Language: Python - Size: 755 KB - Last synced at: about 2 years ago - Pushed at: about 3 years ago - Stars: 18 - Forks: 15

nerdroychan/kvbench

A key-value store benchmark framework with customizable workloads

Language: Rust - Size: 1.88 MB - Last synced at: 25 days ago - Pushed at: about 2 months ago - Stars: 17 - Forks: 0

mousepawmedia/pawlib

Performance meets elegance.

Language: C++ - Size: 12.1 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 17 - Forks: 3

dasec/unlinkability-metric

Implementation of the local and global unlinkability metrics for biometric template protection systems

Language: Python - Size: 2.67 MB - Last synced at: about 2 years ago - Pushed at: almost 6 years ago - Stars: 16 - Forks: 5

qianghuangwhu/benchtemp

BenchTemp: A General Benchmark for Evaluating Temporal Graph Neural Networks

Language: Python - Size: 4.93 MB - Last synced at: 9 months ago - Pushed at: about 1 year ago - Stars: 15 - Forks: 3

MushroomRL/mushroom-rl-benchmark

Benchmarking suite for MushroomRL Deep RL algorithms

Language: Python - Size: 155 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 15 - Forks: 4

gdmnl/Spectral-GNN-Benchmark

A PyG-based package of spectral GNNs with benchmark evaluations.

Language: Jupyter Notebook - Size: 14.4 MB - Last synced at: 15 days ago - Pushed at: 15 days ago - Stars: 14 - Forks: 3

attila-balint-kul/energy-forecast-benchmark-toolkit

Energy Forecast Benchmark Toolkit is a Python project that aims to provide common tools to benchmark forecast models.

Language: Jupyter Notebook - Size: 5.45 MB - Last synced at: about 12 hours ago - Pushed at: about 1 month ago - Stars: 14 - Forks: 4

ansible-lockdown/RHEL8-STIG-Audit

Audit control files for rhel8 stig - utilising goss

Language: YAML - Size: 826 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 14 - Forks: 5

getsentry/sentry-sdk-benchmark 📦

Reproducible benchmarks to evaluate Sentry SDKs

Language: C# - Size: 402 KB - Last synced at: 7 days ago - Pushed at: over 2 years ago - Stars: 14 - Forks: 6

Picovoice/voice-activity-benchmark

Voice activity engine benchmark framework

Language: Python - Size: 297 KB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 13 - Forks: 3

jalalmostafa/SciTS

A tool to benchmark Time-series databases

Language: Jupyter Notebook - Size: 130 MB - Last synced at: 15 days ago - Pushed at: 9 months ago - Stars: 13 - Forks: 4

OptiMaL-PSE-Lab/EvalRetro

A repository for evaluating single-step retrosynthesis algorithms

Language: Python - Size: 142 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 13 - Forks: 2

BaseMax/RunBenchmarkJs

Tiny Library for benchmark javascript code.

Language: JavaScript - Size: 30.3 KB - Last synced at: 9 days ago - Pushed at: over 6 years ago - Stars: 13 - Forks: 0

dejurin/php-micro-router-framework-benchmark

PHP Micro & Router Framework Benchmark

Language: PHP - Size: 6.69 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 12 - Forks: 2

w3f/polkadot-lab

Testing framework for Polkadot networks

Language: TypeScript - Size: 1.59 MB - Last synced at: about 1 month ago - Pushed at: almost 2 years ago - Stars: 12 - Forks: 10

GMAP/SPBench

SPBench: A Framework for Benchmarking Stream Processing Applications

Language: C++ - Size: 3.64 MB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 11 - Forks: 3

mariaangelapellegrino/Evaluation-Framework

It is an evaluation framework for evaluating and comparing graph embedding techniques

Language: Jupyter Notebook - Size: 46.5 MB - Last synced at: 9 months ago - Pushed at: almost 2 years ago - Stars: 10 - Forks: 8

optiprofiler/optiprofiler

Benchmarking optimization solvers.

Language: MATLAB - Size: 36.4 MB - Last synced at: about 7 hours ago - Pushed at: about 8 hours ago - Stars: 9 - Forks: 1

contour-terminal/termbench-pro

Terminal Benchmarking as CLI and library.

Language: C++ - Size: 99.6 KB - Last synced at: 8 days ago - Pushed at: 4 months ago - Stars: 9 - Forks: 3

JinukMoon/CatBench

CatBench - Benchmark Framework for Machine Learning Potentials in Adsorption Energy Predictions

Language: Python - Size: 32 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 8 - Forks: 0

sumitsk20/backend_server_benchmark

Backend Server and frameworks comparison.

Language: Python - Size: 1.64 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 8 - Forks: 0

EdoardoGruppi/Deep_Understanding_of_AI_Based_Drug_Discovery

The present study is finalised to determine the most advanced models in the literature capable of producing new high-quality molecules starting from well-known datasets. The selection is carried out through a series of evaluation processes. At first, the output samples of each method are evaluated according to certain physico-chemical properties such as Quantitative Estimation of Drug-likeness (QED) and Synthetic Accessibility (SA). Then, in a successive step, the assessment also includes the predicted activity towards one target protein. The final aim of the project actually is to better understand whether and how the performance of each model varies when the typology of the target protein is changed. The modified code used to run the models is provided in the GitHub repo provided in description.

Language: Python - Size: 8.31 MB - Last synced at: about 1 year ago - Pushed at: over 3 years ago - Stars: 8 - Forks: 2

xrally/xrally-docs

xRally Documentation

Language: Python - Size: 6.71 MB - Last synced at: almost 2 years ago - Pushed at: over 6 years ago - Stars: 8 - Forks: 2

xrally/xrally-docker

A set of xRally plugins to run workloads against Docker platform.

Language: Python - Size: 87.9 KB - Last synced at: almost 2 years ago - Pushed at: almost 7 years ago - Stars: 8 - Forks: 1

Lenochxd/PyBench

Easy python benchmarking

Language: Python - Size: 22.5 KB - Last synced at: 24 days ago - Pushed at: over 1 year ago - Stars: 7 - Forks: 0

sonata-nfv/tng-sdk-benchmark

5GTANGO SDK tool for fully automated VNF and network service benchmarking and profiling.

Language: Python - Size: 877 KB - Last synced at: 9 days ago - Pushed at: over 1 year ago - Stars: 7 - Forks: 10

VRatPolito/LET-VR

The Locomotion Evaluation Testbed VR (or LET-VR) is a tool which helps to select the best suitable locomotion technique to adopt in a given VR application scenario.

Language: C# - Size: 597 MB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 7 - Forks: 2

graalvm/CLAMH 📦

CLAMH (Cross-LAnguage Microbenchmark Harness) is a language-independent benchmark harness design and the implementation of that design for different languages.

Language: C++ - Size: 3.84 MB - Last synced at: about 1 month ago - Pushed at: almost 4 years ago - Stars: 7 - Forks: 3

JohannesBuchner/nested-sampling

Pythonic Nested Sampling Development Framework & UltraNest

Language: Python - Size: 215 MB - Last synced at: about 1 month ago - Pushed at: over 6 years ago - Stars: 7 - Forks: 4

akolb1/hclient

Stand alone Thrift HMS client and benchmarking tools

Language: Java - Size: 288 KB - Last synced at: 1 day ago - Pushed at: over 6 years ago - Stars: 7 - Forks: 12

cookrn/mruby-bench-tool

A simple tool to benchmark Ruby scripts in cruby vs. mruby

Language: Ruby - Size: 12.7 KB - Last synced at: about 7 hours ago - Pushed at: almost 7 years ago - Stars: 7 - Forks: 0

ismail0234/php-performance-benchmark

BB PHP Performance Benchmark. This project was distributed free and open source. You can follow the document installation and usage instructions in the port.

Language: PHP - Size: 482 KB - Last synced at: 5 days ago - Pushed at: over 2 years ago - Stars: 6 - Forks: 2