Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: digital-preservation

artefactual/archivematica

Free and open-source digital preservation system designed to maintain standards-based, long-term access to collections of digital objects.

Language: Python - Size: 39.2 MB - Last synced: 2 days ago - Pushed: 3 days ago - Stars: 405 - Forks: 104

artefactual-labs/enduro

A tool to aid automation of Archivematica and surrounding workflows

Language: Go - Size: 3.62 MB - Last synced: 3 days ago - Pushed: 3 days ago - Stars: 11 - Forks: 8

phaidra/phaidra

Mirror of the official development repository of PHAIDRA. We monitor our public github repo, so contributions via issues & pull requests are welcome.

Language: JavaScript - Size: 165 MB - Last synced: 4 days ago - Pushed: 4 days ago - Stars: 6 - Forks: 0

WikiTeam/wikiteam

Tools for downloading and preserving wikis. We archive wikis, from Wikipedia to tiniest wikis. As of 2023, WikiTeam has preserved more than 350,000 wikis.

Language: Python - Size: 53.6 MB - Last synced: 4 days ago - Pushed: about 1 month ago - Stars: 692 - Forks: 144

digital-guard/preserv

Digital Preservation Project

Language: PLpgSQL - Size: 17.6 MB - Last synced: 6 days ago - Pushed: 6 days ago - Stars: 0 - Forks: 0

exponential-decay/demystify

Engine for analysis of Siegfried export files and DROID CSV. The tool has three purposes, break the export into its components and store them within a SQLite database; create additional columns to augment the output where useful; and query the SQLite database, outputting results in a readable form useful for analysis by researchers and archivists within digital preservation departments in memory institutions. The tool will find duplicates, unidentified files, blacklisted objects, character encoding issues, and more.

Language: HTML - Size: 6.66 MB - Last synced: 5 days ago - Pushed: 6 days ago - Stars: 23 - Forks: 5

davidfstr/Crystal-Web-Archiver

Downloads websites for long-term archival.

Language: Python - Size: 6.51 MB - Last synced: 7 days ago - Pushed: 7 days ago - Stars: 49 - Forks: 4

srerickson/ocfl-go

OCFL implementation for Go

Language: Go - Size: 2.28 MB - Last synced: 9 days ago - Pushed: 9 days ago - Stars: 10 - Forks: 0

keeps/roda

RODA - Repository of Authentic Digital Objects

Language: Java - Size: 221 MB - Last synced: 10 days ago - Pushed: 11 days ago - Stars: 66 - Forks: 46

ArchiveBox/archivebox-proxy

Official ArchiveBox MITM proxy: saves URLs of all requests passing through to an ArchiveBox server for archival.

Language: Python - Size: 8.79 KB - Last synced: 10 days ago - Pushed: 4 months ago - Stars: 7 - Forks: 0

digital-guard/preserv-VE

Digital Preservation of Venezuela metadata of donated maps.

Language: Shell - Size: 972 KB - Last synced: 12 days ago - Pushed: 8 months ago - Stars: 0 - Forks: 2

PermanentOrg/yearbook-starter 📦

Building a digital school yearbook on the permanent.org platform

Language: JavaScript - Size: 900 KB - Last synced: 12 days ago - Pushed: over 3 years ago - Stars: 0 - Forks: 0

digital-guard/preserv-MX

Digital Preservation of Mexico metadata of donated maps.

Language: Shell - Size: 2.65 MB - Last synced: 12 days ago - Pushed: 12 days ago - Stars: 0 - Forks: 0

wellcomecollection/storage-service

🗃️ Managing the safe, long-term storage of our digital collections in the cloud

Language: Scala - Size: 22.4 MB - Last synced: 23 days ago - Pushed: 25 days ago - Stars: 31 - Forks: 5

ArchiveBox/archivebox-browser-extension

Official ArchiveBox browser extension: automatically/manually preserve your browsing history using ArchiveBox.

Language: TypeScript - Size: 114 KB - Last synced: 10 days ago - Pushed: about 1 month ago - Stars: 159 - Forks: 13

Xiphoseer/sdo-tool

Tool to process Signum! 1/2 document files (*.SDO)

Language: Rust - Size: 3.23 MB - Last synced: 15 days ago - Pushed: 15 days ago - Stars: 9 - Forks: 1

digital-guard/preserv-BR

Digital Preservation of Brazilian metadata of donated maps.

Language: Shell - Size: 88.8 MB - Last synced: 12 days ago - Pushed: 16 days ago - Stars: 3 - Forks: 0

artefactual-labs/a3m

Lightweight Archivematica — 8 less than a11m.

Language: Python - Size: 34.1 MB - Last synced: 27 days ago - Pushed: 29 days ago - Stars: 7 - Forks: 4

wellcomecollection/archivematica-infrastructure

Our Archivematica deployment, for processing and storing born-digital archives

Language: Python - Size: 11.9 MB - Last synced: 23 days ago - Pushed: 3 months ago - Stars: 2 - Forks: 2

openpreserve/jhove

File validation and characterisation.

Language: Java - Size: 199 MB - Last synced: 24 days ago - Pushed: 2 months ago - Stars: 156 - Forks: 78

artefactual-labs/amclient

Archivematica API client module

Language: Python - Size: 5.27 MB - Last synced: 26 days ago - Pushed: 26 days ago - Stars: 1 - Forks: 4

digipres/digipres.github.io

Auto-generated static web site digipres.org

Language: Jupyter Notebook - Size: 457 MB - Last synced: 28 days ago - Pushed: 29 days ago - Stars: 24 - Forks: 18

emijrp/all-human-knowledge

Like all persons of the Library, I have traveled in my youth; I have wandered in search of a book, perhaps the catalogue of catalogues...

Language: Python - Size: 455 KB - Last synced: 2 days ago - Pushed: over 1 year ago - Stars: 102 - Forks: 9

davidfstr/webcrystal

An archiving HTTP proxy and on-disk archival format for websites.

Language: Python - Size: 227 KB - Last synced: 26 days ago - Pushed: over 1 year ago - Stars: 27 - Forks: 1

digipres/awesome-digital-preservation

Carefully curated list of awesome digital preservation resources.

Language: JavaScript - Size: 802 KB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 51 - Forks: 6

marco-schmidt/messy

a tool suite for electronic messages

Language: Java - Size: 430 KB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 0 - Forks: 0

rochester-rcl/premis-generator

A Python utility for creating PREMIS records from a CSV file

Language: Python - Size: 62.5 KB - Last synced: 27 days ago - Pushed: 3 months ago - Stars: 10 - Forks: 0

infoculture/nationaldigitalarchive 📦

Russian national digital archive

Language: HTML - Size: 1.32 MB - Last synced: about 2 months ago - Pushed: about 2 years ago - Stars: 2 - Forks: 1

exponential-decay/vizdiff

Compare two identically sized files for byte by byte differences, e.g. floppy disk extracts

Language: Python - Size: 195 KB - Last synced: about 2 months ago - Pushed: about 7 years ago - Stars: 0 - Forks: 0

exponential-decay/skeleton-container-test-suite-generator

Amendment to the Skeleton Test Suite, creating OLE2 and ZIP container file types.

Language: Python - Size: 1.11 MB - Last synced: about 2 months ago - Pushed: about 2 years ago - Stars: 1 - Forks: 0

exponential-decay/signature-development-utility

PRONOM, DROID Signature Development Utility source code.

Language: PHP - Size: 407 KB - Last synced: about 2 months ago - Pushed: over 3 years ago - Stars: 4 - Forks: 1

exponential-decay/droid-signature-files

Listing custom DROID signature files

Size: 23.4 KB - Last synced: about 2 months ago - Pushed: almost 8 years ago - Stars: 1 - Forks: 1

exponential-decay/oais-du-jour

Keep track of the OAIS consulation from the DPC via Twitter, http://wiki.dpconline.org/index.php?title=OAIS_Community

Language: Python - Size: 25.4 KB - Last synced: about 2 months ago - Pushed: over 7 years ago - Stars: 1 - Forks: 0

exponential-decay/pathlesstaken

Profile strings, e.g. file paths for digital preservation considerations, e.g. characters that you want to preserve, or characters that you don't want to preserve.

Language: Python - Size: 254 KB - Last synced: about 2 months ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0

exponential-decay/pronom-archive-and-skeleton-test-suite 📦

Release repository for The Skeleton Test Suite. Contains an Archive of PRONOM, and skeleton files for testing DROID from The National Archives, UK.

Size: 12.7 KB - Last synced: about 2 months ago - Pushed: 8 months ago - Stars: 5 - Forks: 0

exponential-decay/digital-preservation-stage-boss-one

Checksum calculation and format identification performance results for improving dynamic management of digital repositories.

Language: HTML - Size: 36.9 MB - Last synced: about 2 months ago - Pushed: over 6 years ago - Stars: 0 - Forks: 0

exponential-decay/detect-empty-folders

Detect empty folders in a DROID CSV through ID heuristic...

Language: Python - Size: 22.5 KB - Last synced: about 2 months ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

artefactual-labs/rdss-archivematica-test-data-corpus

A collection of research dataset files used for testing Archivematica integration and functionality in the JISC Research Data Shared Service (RDSS).

Language: HTML - Size: 83.6 MB - Last synced: about 2 months ago - Pushed: almost 7 years ago - Stars: 0 - Forks: 1

tw4l/brunnhilde

Siegfried-based characterization tool for directories and disk images

Language: Python - Size: 7.19 MB - Last synced: 18 days ago - Pushed: 7 months ago - Stars: 78 - Forks: 11

archivematica/archivematica-case-studies

Collection of resources, papers, blog posts, and other documentation around working on and with Archivematica.

Language: HTML - Size: 14.6 MB - Last synced: 23 days ago - Pushed: 4 months ago - Stars: 17 - Forks: 0

avivace/pv2023

Paper submission for the PV2023 conference - "The Challenge of Digital Preservation at CERN"

Language: TeX - Size: 18.6 MB - Last synced: 10 days ago - Pushed: 6 months ago - Stars: 1 - Forks: 0

exponential-decay/the-format-registry

A mirror of the PRONOM file format registry in Linked Open Data format. The Format Registry is a linked (open) data file format repository. The work is the result of a four-day hack during November 2013. Its goal is to influence the rapid development of further format registries and linked open data initiatives within the digital preservation community.

Language: PHP - Size: 2.24 MB - Last synced: about 2 months ago - Pushed: 11 months ago - Stars: 9 - Forks: 1

digipres/policies

Digital preservation policies and strategies

Size: 91.8 KB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 9 - Forks: 5

hannahlwang/mets-validator

A Python validation tool for METS packages

Language: Python - Size: 46.9 KB - Last synced: 2 months ago - Pushed: over 4 years ago - Stars: 1 - Forks: 0

Irish-Film-Institute/IFIscripts

IFIscripts is an open-source digital preservation tool which facilitates collection management workflows within the IFI and further afield. It is freely available from the GitHub repository and subject to modification depending on the progressive needs of collections and based upon policies and preservation standards.

Language: Python - Size: 4.59 MB - Last synced: 25 days ago - Pushed: about 2 months ago - Stars: 25 - Forks: 6

artefactual-labs/pygfried

Siegfried as a Python extension

Language: Go - Size: 182 KB - Last synced: 20 days ago - Pushed: 5 months ago - Stars: 6 - Forks: 1

digital-preservation-is-people/digipres-codes-of-conduct

A community owned list of codes of conduct implemented in the digital preservation community

Size: 48.8 KB - Last synced: about 2 months ago - Pushed: over 2 years ago - Stars: 4 - Forks: 7

ffdev-info/pronom-release-tools

Tools for working with PRONOM releases

Language: Python - Size: 115 KB - Last synced: 23 days ago - Pushed: 3 months ago - Stars: 1 - Forks: 0

realgoodegg/another-checksum-application

aca is a simple GUI application designed to generate MD5 checksums, copy files, and verify their integrity within a unified process. It is a "one-click" solution to securely back-up digital files with minimal friction

Language: Python - Size: 471 KB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 0 - Forks: 0

digital-guard/preserv-AR

Digital Preservation of Argentina metadata of donated maps.

Language: Makefile - Size: 35.2 KB - Last synced: 12 days ago - Pushed: 8 months ago - Stars: 1 - Forks: 2

ruarxive/awesome-digital-preservation

Awesome list dedicated to digital and data preservation tools, sources, services and so on.

Size: 7.81 KB - Last synced: about 4 hours ago - Pushed: over 1 year ago - Stars: 14 - Forks: 2

OCFL/spec

The Oxford Common File Layout (OCFL) specifications

Language: HTML - Size: 2.29 MB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 51 - Forks: 14

MetaArchive/public-documentation

Public documentation for the MetaArchive Cooperative, a non-profit digital preservation cooperative.

Language: HTML - Size: 4.2 MB - Last synced: about 2 months ago - Pushed: 3 months ago - Stars: 1 - Forks: 0

richardlehane/siegfried

signature-based file format identification

Language: Go - Size: 213 MB - Last synced: 5 months ago - Pushed: 5 months ago - Stars: 187 - Forks: 29

kieranjol/IFIscripts

Detailed documentation is available here: http://ifiscripts.readthedocs.io/en/latest/index.html

Language: Python - Size: 1.8 MB - Last synced: about 1 month ago - Pushed: almost 4 years ago - Stars: 49 - Forks: 28

httpreserve/linkstat

CLI implementation of httpreserve that can test links and retrieve internet archive replacements

Language: Go - Size: 35.2 KB - Last synced: 4 days ago - Pushed: 9 months ago - Stars: 7 - Forks: 0

MarcusBarnes/mik

The Move to Islandora Kit is an extensible PHP command-line tool for converting source content and metadata into packages suitable for importing into Islandora (or other digital repository and preservations systems).

Language: PHP - Size: 1.5 MB - Last synced: 9 days ago - Pushed: about 1 year ago - Stars: 34 - Forks: 11

emijrp/flickr-timecapsule

Some of my pictures on Flickr

Language: Python - Size: 40.2 MB - Last synced: 7 months ago - Pushed: over 4 years ago - Stars: 1 - Forks: 0

emijrp/dictionaries-timecapsule

A Rosetta Stone for future generations.

Language: Python - Size: 942 MB - Last synced: 7 months ago - Pushed: over 4 years ago - Stars: 6 - Forks: 0

emijrp/internet-archive 📦

Scripts for Internet Archive

Language: Python - Size: 239 KB - Last synced: 7 months ago - Pushed: almost 4 years ago - Stars: 12 - Forks: 5

bagit-profiles/bagit-profiles-validator

A simple Python module for validating BagIt Profiles.

Language: Python - Size: 3.07 MB - Last synced: 17 days ago - Pushed: about 4 years ago - Stars: 13 - Forks: 6

seanpm2001/EMAIL_2.0_Stamps_Docs

❇️📧️✴️📖️ The official documentation source repository for the EMAIL 2.0 stamp specification.

Language: Markdown - Size: 45.7 MB - Last synced: 14 days ago - Pushed: 8 months ago - Stars: 2 - Forks: 1

seanpm2001/EMAIL_2.0_Stamps

❇️📧️✴️ The official EMAIL 2.0 stamp specification source repository.

Language: Markdown - Size: 23.4 MB - Last synced: 14 days ago - Pushed: 8 months ago - Stars: 2 - Forks: 1

ruarxive/wparc

Wordpress API data and files archival command line tool

Language: Python - Size: 22.5 KB - Last synced: 6 days ago - Pushed: almost 2 years ago - Stars: 7 - Forks: 1

enrimilan/DP-SS2016 📦

Course "Digital Preservation - Übung" at Vienna University of Technology

Language: Java - Size: 4.09 MB - Last synced: 8 months ago - Pushed: almost 8 years ago - Stars: 0 - Forks: 0

digital-guard/preserv-PY

Digital Preservation of Paraguay metadata of donated maps.

Language: Makefile - Size: 17.6 KB - Last synced: 8 months ago - Pushed: 8 months ago - Stars: 0 - Forks: 0

digital-guard/preserv-SR

Digital Preservation of Suriname metadata of donated maps.

Language: Makefile - Size: 26.4 KB - Last synced: 8 months ago - Pushed: 8 months ago - Stars: 0 - Forks: 0

digital-guard/preserv-BO

Digital Preservation of Bolivia metadata of donated maps.

Language: Makefile - Size: 52.7 KB - Last synced: 8 months ago - Pushed: 8 months ago - Stars: 0 - Forks: 0

digital-guard/preserv-CO

Preservación digital de las principales fuentes de la base de datos AddressForAll-Colombia.

Language: Shell - Size: 3.7 MB - Last synced: 12 days ago - Pushed: 6 months ago - Stars: 0 - Forks: 0

digital-guard/preserv-PE

Language: Shell - Size: 98.6 KB - Last synced: 12 days ago - Pushed: 8 months ago - Stars: 0 - Forks: 0

digital-guard/preserv-EC

Digital Preservation of Ecuador metadata of donated maps.

Language: Shell - Size: 589 KB - Last synced: 12 days ago - Pushed: 8 months ago - Stars: 1 - Forks: 1

digital-guard/preserv-CL

Digital Preservation of Chile metadata of donated maps.

Language: Shell - Size: 1.38 MB - Last synced: 12 days ago - Pushed: 3 months ago - Stars: 0 - Forks: 2

emijrp/arctic-timecapsule

Some content I would like to preserve in GitHub Arctic Code Vault.

Language: Python - Size: 79.9 MB - Last synced: 7 months ago - Pushed: over 4 years ago - Stars: 5 - Forks: 0

bagit-profiles/bagit-profiles-specification

Language: HTML - Size: 77.1 KB - Last synced: 26 days ago - Pushed: 6 months ago - Stars: 34 - Forks: 11

oduwsdl/oduwsdl.github.io

ODU Web Science and Digital Libraries Research Group (WS-DL) home page.

Language: HTML - Size: 47.1 MB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 2 - Forks: 36

eprintsug/EPrintsArchivematica

Digital Preservation through EPrints-Archivematica Integration - An EPrints export plugin to Archivematica

Language: Perl - Size: 983 KB - Last synced: 9 months ago - Pushed: over 1 year ago - Stars: 4 - Forks: 1

exponential-decay/sqlitefid

Normalize file format identification results (DROID, Siegfried) into a single SQLite DB

Language: Python - Size: 153 KB - Last synced: 15 days ago - Pushed: about 2 months ago - Stars: 4 - Forks: 0

ross-spencer/sumfolder1

What is the checksum of a directory?

Language: Python - Size: 111 KB - Last synced: 16 days ago - Pushed: about 2 months ago - Stars: 6 - Forks: 0

steffenfritz/bagit

gobagit is a library and command line tool to work with the BagIt format

Language: Go - Size: 11 MB - Last synced: 9 months ago - Pushed: about 2 years ago - Stars: 5 - Forks: 1

archives-new-zealand/demystify Fork of exponential-decay/demystify

Engine for analysis of Siegfried export files and DROID CSV. The tool has three purposes, break the export into its components and store them within a SQLite database; create additional columns to augment the output where useful; and query the SQLite database, outputting results in a readable form useful for analysis by researchers and archivists within digital preservation departments in memory institutions.

Language: HTML - Size: 5.18 MB - Last synced: 12 months ago - Pushed: 12 months ago - Stars: 0 - Forks: 0

Cadesius/ART

ART - The Archivist's Renaming Tool!

Language: Batchfile - Size: 81.1 KB - Last synced: 12 months ago - Pushed: 12 months ago - Stars: 0 - Forks: 0

digital-guard/preserv-CM

Digital Preservation of Cameroonian metadata of donated maps.

Size: 6.84 KB - Last synced: 7 months ago - Pushed: 7 months ago - Stars: 0 - Forks: 0

CCA-Public/diskimageprocessor

Tool for automated processing of disk images in BitCurator

Language: Python - Size: 92.5 MB - Last synced: 8 months ago - Pushed: 8 months ago - Stars: 22 - Forks: 6

ross-spencer/nibble-0001-hearts

A Nibble NFT

Language: Lua - Size: 27.3 KB - Last synced: 8 months ago - Pushed: 8 months ago - Stars: 0 - Forks: 0

tw4l/brunnhilde-gui

Graphical user interface for Brunnhilde

Language: Python - Size: 232 KB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 6 - Forks: 1

CCA-Public/folderprocessor

Tool for automated processing of directories in BitCurator

Language: Python - Size: 59.6 KB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 2 - Forks: 1

CCA-Public/sipcreator

Create Archivematica-packaged SIPs/transfers from user-selected files and directories in BitCurator

Language: Python - Size: 67.4 KB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 2 - Forks: 2

tw4l/dfxml-reader 📦

Tool for reading DFXML files in Bitcurator, with focus on MAC dates

Language: Python - Size: 11.7 KB - Last synced: about 1 year ago - Pushed: about 6 years ago - Stars: 0 - Forks: 0

steffenfritz/nslredis 📦

A script that downloads the NSRL RDS Modern and feeds the SHA-1 as key to a redis server

Language: Shell - Size: 4.88 KB - Last synced: about 1 year ago - Pushed: almost 4 years ago - Stars: 2 - Forks: 1

SergiyKolesnikov/ddi2raw

ddi2raw converts a floppy disk image in DDI (DiskDupe) format to a raw floppy disk image.

Language: Python - Size: 13.7 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 10 - Forks: 2

emijrp/species-timecapsule

A Noah's Ark for future generations.

Language: Python - Size: 201 MB - Last synced: 4 months ago - Pushed: over 4 years ago - Stars: 4 - Forks: 0

ross-spencer/brainscape-digital-preservation

An open source set of decks for learning about digital preservation.

Size: 152 KB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 18 - Forks: 0

the-danish-national-archives/concept-model

Presenting the Danish National Archives' Concept Model for Development of Preservation Plans.

Size: 6.27 MB - Last synced: 12 months ago - Pushed: 12 months ago - Stars: 10 - Forks: 0

ross-spencer/hmmunpack

Unpack script for HMM packfiles

Language: Python - Size: 25.5 MB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

exponential-decay/skeleton-test-suite-generator

DROID Skeleton Test Suite Generator (skeleton-test-suite-generator): Tool for the automated generation of digital objects based on the digital signatures documented in the PRONOM database maintained by The National Archives, UK. The skeleton-test-suite-generator serves to fill the gap that exists whereby the community requires a corpus of digital objects for the validation and evaluation of format identification tools and techniques. The tool should be used to complement a methodology whereby skeleton files are also generated manually by signature developers. The tool takes a signature specified for a digital object in PRONOM and constructs a digital object that will match its footprint. For more information, see the README.md associated with the project...

Language: Python - Size: 8.77 MB - Last synced: about 2 months ago - Pushed: about 1 year ago - Stars: 7 - Forks: 2

lglanville/Pyservica

Language: Python - Size: 188 KB - Last synced: 12 months ago - Pushed: over 2 years ago - Stars: 2 - Forks: 1

digital-guard/preserv-UY

Digital Preservation of Uruguay metadata of donated maps.

Language: Makefile - Size: 1.31 MB - Last synced: 12 days ago - Pushed: 8 months ago - Stars: 0 - Forks: 2

ruarxive/ruarxive

Проект по цифровому сохранению знаний связанных с материалами на русском языке, созданным в России или с Россией связанных — http://ruarxive.org

Language: HTML - Size: 1.33 MB - Last synced: 6 months ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 1

ross-spencer/nibble

Nibble in Cyberspace: #Digipres Adventures

Language: Lua - Size: 2.01 MB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 1 - Forks: 3

marco-schmidt/ufxcoder

Universal File Transcoder

Language: Java - Size: 767 KB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 0 - Forks: 0