Data

Tools

Indexes

Applications

Experiments

Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: prompt-perturbation

SuperBruceJia/promptcraft

PromptCraft is a prompt perturbation toolkit from the character, word, and sentence levels for prompt robustness analysis. PyPI Package: pypi.org/project/promptcraft

Language: Python - Size: 86.9 KB - Last synced at: about 4 hours ago - Pushed at: over 1 year ago - Stars: 17 - Forks: 1

SuperBruceJia/GSM8K-Consistency

GSM8K-Consistency is a benchmark database for analyzing the consistency of Arithmetic Reasoning on GSM8K.

Size: 9.77 KB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0

Related Keywords
large-language-models 2 prompt-toolkit 2 prompt 2 prompt-engineering 2 prompt-perturbation 2 factual-consistency 1 foundation-models 1 grade 1 grade-school-math 1 gsm8k 1 logical-consistency 1 mathematical-reasoning 1 reasoning 1 self-consistency 1 self-consistency-benchmark 1 semantics-consistency 1 semantics-preserving-transformations 1 semantics-similar 1 arithmetic-reasoning 1 arithmetic-consistency 1 word-manipulation 1 sentence-paraphrasing 1 prompt-robustness 1 prompt-optimization 1 prompt-generator 1 natural-language-prompts 1 llms-adversarial-attack 1 llms 1 llm-robustness 1 llm 1 character-editing 1