GitHub topics: de-duplication
ChenghaoMou/text-dedup
All-in-one text de-duplication
Language: Python - Size: 5.87 MB - Last synced at: 3 days ago - Pushed at: 12 months ago - Stars: 674 - Forks: 75
saltudelft/CD4Py
CD4Py: Code De-Duplication for Python
Language: Python - Size: 37.1 KB - Last synced at: 6 days ago - Pushed at: over 4 years ago - Stars: 24 - Forks: 3
hamedrnik/dedup_signature
A collection of algorithms to generate a signature/fingerprint/hash in order to be used for detecting duplicate/near duplicate documents.
Language: Rust - Size: 40 KB - Last synced at: 11 days ago - Pushed at: almost 8 years ago - Stars: 7 - Forks: 1
ktock/container-bootfs
Container image converter aiming to minimize image size and speed up boot time dramatically with block-level de-dupliction and lazy-pull technology.
Language: C - Size: 220 KB - Last synced at: about 1 month ago - Pushed at: about 6 years ago - Stars: 20 - Forks: 2
ananthrn/Duplicrypt
A secure image storage application written in Python
Language: Python - Size: 4.73 MB - Last synced at: almost 2 years ago - Pushed at: over 7 years ago - Stars: 0 - Forks: 1
thc2cat/go-dedup
portable file de-duplication tool
Language: Go - Size: 18.6 KB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0
Dreffed/misc
A misc project of python based function to track, survey and manage files from mutiple systems
Language: Python - Size: 144 KB - Last synced at: almost 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0
hariohmprasath/events-streamlined-with-dedups
Efficient Event Streamlining and Dynamic De-Duplication Across Message Brokers - A Technology-Agnostic approach
Language: TypeScript - Size: 18.3 MB - Last synced at: about 2 months ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0
cheefoo/centos
Repository contains java application code to stream records to a Kinesis Stream, consume , de-duplicate and strictly order records and display records on a dashboard
Language: Java - Size: 3.58 MB - Last synced at: about 2 years ago - Pushed at: about 8 years ago - Stars: 1 - Forks: 3
