An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: text-compression

aredesrafa/logslimmer

Save massive token costs while coding or vibe-coding by semantically compressing console and terminal logs with up to 90% reduction, preserving all relevant information for AI agents.

Language: JavaScript - Size: 525 KB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 1 - Forks: 0

jparkerweb/llm-distillery

🍶 llm-distillery ⇢ use LLMs to run map-reduce summarization tasks on large documents until a target token size is met.

Language: JavaScript - Size: 287 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 11 - Forks: 1

onesy-me/zip

Zip / Unzip

Language: TypeScript - Size: 624 KB - Last synced at: 28 days ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

JanBremec/txc-compressor

TXC – High-performance token-based text and log compressor with superior compression ratios and competitive speed.

Language: Python - Size: 463 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

onesy-me/lz77

LZ77

Language: TypeScript - Size: 561 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

GotthardtZ/paq8px Fork of hxim/paq8px

PAQ8PX compression archiver

Language: C - Size: 3.65 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 3 - Forks: 0

antilneeraj/HuffmanCompressor

A simple, lossless text file compressor and decompressor built in Java using Huffman Coding. It shrinks files by giving shorter codes to frequent characters, and restores them exactly when decompressed. Features include a command‑line interface, clean modular design, and efficient bit‑level file handling

Language: Java - Size: 143 KB - Last synced at: about 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

Ferki-git-creator/fsp

Easy data compression algorithm.

Language: HTML - Size: 13.7 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 3 - Forks: 0

Huzaifa785/context-compressor

AI-powered text compression library for RAG systems and API calls. Reduce token usage by up to 50-60% while preserving semantic meaning with advanced compression strategies.

Language: Python - Size: 181 KB - Last synced at: 2 months ago - Pushed at: 3 months ago - Stars: 62 - Forks: 10

onesy-me/huffman-code

Huffman code

Language: TypeScript - Size: 723 KB - Last synced at: 2 months ago - Pushed at: 12 months ago - Stars: 5 - Forks: 0

rfel13/context-compressor

🗜️ Compress text effectively with this AI-powered library, reducing token usage by up to 80% while maintaining semantic meaning for RAG systems and APIs.

Language: Python - Size: 146 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

brown9804/Text-Compression-Decompression

This repository contains a text compression and decompression algorithm based on replacements.

Language: C++ - Size: 6.32 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 1

SatvikG7/LLM-Text-Compressor

LLM based text compressor which performs better than SOTA text compression algorithms

Language: Python - Size: 26.4 KB - Last synced at: 4 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

wolfie-things/lz77-algorithm

LZ77 compression-decompression alghoritm implemented for my assignment project

Language: C++ - Size: 539 KB - Last synced at: 4 months ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

yuzaiakira/huffman-compressor

A simple Python implementation of Huffman Coding for text compression. This project reads a text file, compresses it using the Huffman algorithm, saves the encoded content and tree structure, and can decompress it back to the original text.

Language: Python - Size: 7.81 KB - Last synced at: 5 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

themysterysolver/HUFFMAN-ENCODING

"Huffman encoding is implemented"

Language: JavaScript - Size: 13.7 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

dr-vega-punk/QubitText-Compressor

QubitText Compressor: A Python-based lossless text compressor using variable bit-length encoding (e.g., 5 bits for a-z,space). Compresses "hello world" from 11 to 8 bytes (ratio 1.38) with a custom table and EOS marker. No dependencies, ideal for constrained systems.

Language: Python - Size: 8.79 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

Qubitbytesltd/QubitText-Compressor

QubitText Compressor: A Python-based lossless text compressor using variable bit-length encoding (e.g., 5 bits for a-z,space). Compresses "hello world" from 11 to 8 bytes (ratio 1.38) with a custom table and EOS marker. No dependencies, ideal for constrained systems.

Language: Python - Size: 8.79 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

rahulrathod315/iCompress-The-File-Compressor

iCompress is a Python-based text file compression tool that uses the Huffman coding algorithm to compress and decompress text files. The tool takes an input file, compresses it using Huffman coding, and generates a compressed output file. It can also decompress a compressed file and retrieve the original file.

Language: Python - Size: 5.18 MB - Last synced at: 2 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

mr-ravin/ravdecjs 📦

RavdecJS is a JavaScript module implementing a lossless data compression algorithm designed by Ravin Kumar on September 19, 2016. This algorithm is designed exclusively for textual data, including alphabets, numbers, and symbols.

Language: JavaScript - Size: 68.4 KB - Last synced at: about 2 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

mr-ravin/ravdec 📦

Ravdec is a Python module implementing a lossless data compression algorithm designed by Ravin Kumar on September 19, 2016. This algorithm is designed exclusively for textual data, including alphabets, numbers, and symbols.

Language: Python - Size: 78.1 KB - Last synced at: about 2 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 2

rcrym/Huffman_Encoding

Javascript implementation of the Huffman Encoding algorithm (lossless data compression).

Language: JavaScript - Size: 2.23 MB - Last synced at: 10 months ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0

eyaler/ztml

Extreme inline text compression for HTML / JS. A custom pipeline that generates stand-alone HTML or JS files which embed competitively compressed self-extracting text, with file sizes of 25% - 40% the original.

Language: Python - Size: 3.73 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 11 - Forks: 0

VirajMadhu/pdf_key_matcher

Highlights the key matches between your Given PDF and the description text

Language: Python - Size: 19.5 KB - Last synced at: 8 months ago - Pushed at: 12 months ago - Stars: 2 - Forks: 0

rmariano/compr

A text compression tool & library

Language: Python - Size: 157 KB - Last synced at: 3 months ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 0

root-hunter/tc

tc - Text Compressor

Language: Rust - Size: 359 KB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

typio/entreepy

Text compression tool ⚡

Language: Zig - Size: 104 KB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 9 - Forks: 0

rwanwork/Re-Pair

Offline Dictionary-based Compression (Re-Pair, Recursive Pairing)

Language: C - Size: 108 KB - Last synced at: 12 months ago - Pushed at: over 2 years ago - Stars: 24 - Forks: 3

jsngn/huffman-compression

Text File Huffman Compression

Language: Java - Size: 1.14 MB - Last synced at: over 1 year ago - Pushed at: about 6 years ago - Stars: 0 - Forks: 0

Sahil-4555/lZ77_Compression_Decompression

LZ77 algorithm, providing efficient lossless data compression and decompression capabilities. It offers a reliable and flexible solution for reducing file sizes in various programming languages.

Language: C++ - Size: 2.93 KB - Last synced at: 7 months ago - Pushed at: over 2 years ago - Stars: 5 - Forks: 0

Gabirodz/tcomp

Simple Huffman coding-based text compressor.

Language: C - Size: 275 KB - Last synced at: over 1 year ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

areeba0/Huffman-Coding-Algorithm-for-Text-Compression-and-Decompression-in-CPP

This code provides an implementation of Huffman Coding using C++. It enables efficient text compression and decompression through frequency-based encoding, constructing a Huffman Tree, assigning variable-length codes, and translating text to and from its binary representation.

Language: C++ - Size: 9.77 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

kashwa/backendIntegration

Integration between Various Backend technologies for learning purposes

Language: PHP - Size: 5.49 MB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

CoolCat467/Magic-Text

Magic Text is able to Magicify Text into letters and numbers, and Un-Magicify letters and numbers back into readable text

Language: Python - Size: 4.81 MB - Last synced at: 8 months ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 1

RuxinQu/fithub Fork of TikoMyster/fithub

A fitness app that allows users to search for workouts and save or remove the ones they like or dislike. This is a group project of 4 members.

Language: JavaScript - Size: 22.2 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

tarek99samy/Huffman-Code-Visulizer

A simple visualization for huffman tree, which is used in encoding text.

Language: JavaScript - Size: 137 KB - Last synced at: 3 months ago - Pushed at: about 3 years ago - Stars: 10 - Forks: 5

TejveerSingh13/Image-Steganography

Using Huffman code to encode and compress the secret text data along with using histogram shifting to encode the data into the image.

Language: Python - Size: 3.72 MB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 5 - Forks: 0

sherifabdlnaby/Lossless-Text-Compression-App

A Java program that implements (4) four lossless text compression techniques for ASCII Text and compares compression ratio.

Language: Java - Size: 20.5 KB - Last synced at: 9 months ago - Pushed at: almost 8 years ago - Stars: 3 - Forks: 1

thezaza101/textdiffcore

Cross platform diff engine for .net core used to compare string values and generate a comparison output

Language: C# - Size: 151 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 5 - Forks: 4

nihelkb/Compresor-Texto

Proyecto en ensamblador que permite aplicar una compresión y descompresión a un texto almacenado en memoria. Estructura de Computadores - UPM

Size: 960 KB - Last synced at: almost 2 years ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0

Matthew-Mosior/text-compression

Language: Haskell - Size: 134 KB - Last synced at: 28 days ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 2

jovanepires/java-getting-started

Language: HTML - Size: 104 KB - Last synced at: over 2 years ago - Pushed at: over 7 years ago - Stars: 0 - Forks: 0

stephen29xie/text-compression

Lossless Text Compression

Language: C++ - Size: 4.88 KB - Last synced at: over 2 years ago - Pushed at: over 9 years ago - Stars: 0 - Forks: 0

VoxBorealis/text_compressor_tira

Text compression algorithm(s) developed as a part of a Data structures and Algorithms project at University of Helsinki

Language: Python - Size: 1.67 MB - Last synced at: over 2 years ago - Pushed at: about 3 years ago - Stars: 0 - Forks: 0

iamsdas/Text-Compression

This is a simple text compression utility using the lzw algorithm in c++

Language: C++ - Size: 12.7 KB - Last synced at: 8 months ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 0

karimkohel/DCW

The DCW stands for Damn Compression Wizard and is basically what it sounds like, a compression app that can compress a text file using Huffman Code (Lossless))

Language: C - Size: 1.05 MB - Last synced at: over 2 years ago - Pushed at: over 5 years ago - Stars: 2 - Forks: 1

WaleedAhmed05/File-Compressor-Using-Clojure-COMP6411

Text file compressor build on completely functional language clojure. | COMP6411 | Assignment - Comparative Study Of Programming Language.

Language: Clojure - Size: 5.49 MB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

kkn1125/text-compress-upgrade

기존 카카오 문자열 문제에서 더 세밀하게 압축하는 알고리즘 테스트

Language: HTML - Size: 14.6 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

Stareru/NeighboringDistributionDivergence

Official Implementation of Paper "A Novel Metric for Evaluating Semantics Preservation"

Language: Python - Size: 12.7 KB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 0

tarek99samy/LZW-Text-Compression

A simple python implementation for the well-known compression algorithm LZW

Language: Python - Size: 8.79 KB - Last synced at: 8 months ago - Pushed at: over 5 years ago - Stars: 3 - Forks: 2

IAMIQBAL/Hybrid-Text-Compression

Hybrid text compression pipeline using Burrows Wheelers Transform, Huffman encoding, Run-length encoding, Lempel-Ziv-Welch compression and Delta encoding

Language: C++ - Size: 175 KB - Last synced at: over 2 years ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 0

kaneda2004/ReinforcementLearningTextCompression

A rudimentary implementation of DQN RL for Text Compression

Language: Python - Size: 6.84 KB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

fehmisener/LZ77-and-Deflate-Compressor

This project is about the implementation of the LZ77 and Deflate COMPRESSION algorithm.

Language: C - Size: 381 KB - Last synced at: over 2 years ago - Pushed at: over 5 years ago - Stars: 8 - Forks: 1

gabrielSantosLima/algoritmos-de-compressao-de-dados

🧾 Algoritmos de compressão de texto em C

Language: C - Size: 32.2 KB - Last synced at: 6 months ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

DrewHans/HuffmanCompression

A Java 8 program for compressing ANSI (8-bit ASCII) text files using the Huffman Coding algorithm.

Language: Java - Size: 158 KB - Last synced at: over 2 years ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 0

DrewHans/C-AwayExtendedASCII

A CLI program written in C for compressing ANSI (8-bit ASCII) text files to 7-bit ASCII.

Language: C++ - Size: 93.8 KB - Last synced at: over 2 years ago - Pushed at: over 6 years ago - Stars: 1 - Forks: 0

alantudyk/kek

Compressor for UTF-8 encoded text

Language: C - Size: 16.6 KB - Last synced at: over 2 years ago - Pushed at: about 3 years ago - Stars: 3 - Forks: 1

kszabova/huffman

Simple text compression written in Haskell

Language: Haskell - Size: 23.4 KB - Last synced at: over 2 years ago - Pushed at: over 5 years ago - Stars: 2 - Forks: 0

shaurya-src/Text-Compression-using-Huffman-Coding

A Data Structures and Algorithms Project using the concept of heaps and Huffman coding to compress text files.

Language: C++ - Size: 1.3 MB - Last synced at: over 2 years ago - Pushed at: over 5 years ago - Stars: 1 - Forks: 1

anrikus/BlockSortingCompression

A block sorting lossless data compression algorithm

Language: Jupyter Notebook - Size: 37.1 KB - Last synced at: over 2 years ago - Pushed at: over 5 years ago - Stars: 1 - Forks: 0

rupesh-dharme/Data-Compression

Text file compressor using Huffman compression algorithm.

Language: C++ - Size: 623 KB - Last synced at: over 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

siara-cc/FirestoreCompress

Store compressed text in Firestore

Size: 8.79 KB - Last synced at: 6 months ago - Pushed at: almost 4 years ago - Stars: 1 - Forks: 0

AbdallahHemdan/enwik8-compression

📦 Compressing of the challenge enwik8 (100MB of wikipedia) using LZW(Lempel–Ziv–Welch) compression algorithm using cpp...

Language: C++ - Size: 66.9 MB - Last synced at: 5 months ago - Pushed at: over 5 years ago - Stars: 1 - Forks: 0

josgard94/Text-compressor-using-huffman-codes

This source code implements the huffman algorithm to perform the compression of a plain text file. for this a file is generated which contains the probabilities of each of the symbols defined in the symbols dictionary.

Language: C++ - Size: 1.6 MB - Last synced at: 9 months ago - Pushed at: over 6 years ago - Stars: 1 - Forks: 0

shashank98giri/ALgo_project

Algorithm Project on Text Compression

Language: C++ - Size: 1.93 MB - Last synced at: over 2 years ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 1

Pendulun/CompressorLZ78

Um compressor com base em LZ78. Feito para a matéria Algoritmos 2

Language: C++ - Size: 11.3 MB - Last synced at: over 2 years ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 0

barnabycollins/Codes-Crypto

Y3 Codes and Cryptography coursework. Codes = designing a custom lossless text compression algorithm; Crypto = decrypting an encrypted what3words address!

Language: TeX - Size: 41.3 MB - Last synced at: 12 months ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0

fabiofdsantos/palz

Compress and decompress text files using an algorithm similar to the LZ77/LZ78.

Language: C - Size: 54.7 KB - Last synced at: about 2 months ago - Pushed at: almost 6 years ago - Stars: 0 - Forks: 0

DevAqsaShahzad/Text-Compressor-in-CSharp

In this term project we as a group, tried to revise the Huffman Algorithm of compression and implement it for encoding and decoding data by using the frequency of letters on the binary tree data structure.

Language: C# - Size: 530 KB - Last synced at: 6 months ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 0

aashrafh/enwik8

An attempt to compress the enwik8 file

Language: C++ - Size: 427 KB - Last synced at: 7 months ago - Pushed at: over 5 years ago - Stars: 4 - Forks: 1

avinashshenoy97/Text-Compression

Text compression using Huffman Coding; enhanced using Burrows-Wheeler Transforms and other algorithms. Compressor program opens and reads a file named “comp.txt” placed in the same folder as the executable “a.out” and generates a compressed file named “compi.bin”. Decompressor programs opens and reads a file named “compi.bin” that was previously created by the compressor program and decompresses it into a text file, named “decomp.txt” by default, in the same folder as the executable “a.out”. This project was done as part of a “Data Structures” course in an Undergraduate program.

Language: C - Size: 470 KB - Last synced at: over 2 years ago - Pushed at: over 8 years ago - Stars: 1 - Forks: 0

dido1998/TextCompression

Data driven approach for compressing text using an encoder-decoder architecture and word-level embeddings.

Language: Python - Size: 201 KB - Last synced at: over 2 years ago - Pushed at: over 7 years ago - Stars: 3 - Forks: 0

stoufa/Huffman-Data-Compression-Algorithm

[EN] Implementation of the Huffman compression algorithm in Java | [FR] Implémentation de l'algorithme de compression de Huffman en Java

Language: Java - Size: 5.94 MB - Last synced at: 8 months ago - Pushed at: over 5 years ago - Stars: 0 - Forks: 0

azhussainn/Huffman_coding_project

This repository contains implementation of Huffman-coding algorithm.

Language: Jupyter Notebook - Size: 148 KB - Last synced at: over 2 years ago - Pushed at: over 5 years ago - Stars: 1 - Forks: 0

psaikko/human-zip

Text compression by abbreviation

Language: Python - Size: 3.91 KB - Last synced at: over 2 years ago - Pushed at: over 5 years ago - Stars: 0 - Forks: 0

shashank-bairy/huffman-compression

File compression software for Text files using Huffman coding algorithm.

Language: C++ - Size: 68.4 KB - Last synced at: 5 months ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0

Related Keywords
compression 21 huffman-coding 19 compression-algorithm 14 data-compression 12 python 10 huffman-compression-algorithm 8 c 8 algorithm 7 huffman 7 java 6 js 5 cpp 5 lz77 5 javascript 5 lzw 5 move-to-front 4 encoding 4 decoding 4 python3 4 open-source 4 lossless-compression 4 binary-compression 4 lz77-compression-algorithm 4 llm 3 algorithms 3 burrows-wheeler-transform 3 web 3 typescript 3 lossless-compression-algorithm 3 amaui 3 backend 3 browser 3 compression-implementations 3 file-compression 3 byte-compression 3 frontend 3 data 3 data-compressor 3 text-processing 3 enwik8 2 anthropic 2 lzz 2 delta-encoding 2 deflate-compare-lz77 2 lz77-encoding 2 lz77-compress 2 lz78 2 entropy 2 custom-alphabet 2 eos-marker 2 no-dependencies 2 variable-bit-encoding 2 huffman-tree 2 ascii 2 javascript-library 2 tokenization 2 text-compression-algorithm 2 utf-8 2 lzw-compression 2 rag 2 multimedia 2 semantic-compression 2 transformers 2 huffman-decoder 2 fast-compression 2 compressor 2 token-reduction 2 neural-networks 2 gzip-compression 2 langchain 2 data-structures 2 summarization 2 compress 2 cost-optimization 2 deflate 2 ecb-mode 1 node 1 dictionary-attack 1 efficient-compresssion 1 decryption 1 javascript-libraries 1 opensource 1 lossless-data-compression 1 npm 1 npm-package 1 what3words 1 npm-module 1 information-theory 1 lempel-ziv 1 rle 1 binary-search-tree 1 data-structures-and-algorithms 1 dictionary 1 magicify-letters 1 maths 1 database-compression 1 firebase 1 firestore 1 firestore-database 1 string-compression 1