Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
Package Usage: go: github.com/whyrusleeping/chunker
Package chunker implements Content Defined Chunking (CDC) based on a rolling
Rabin Checksum.
The function RandomPolynomial() returns a new random polynomial of degree 53
for use with the chunker. The degree 53 is chosen because it is the largest
prime below 64-8 = 56, so that the top 8 bits of an uint64 can be used for
optimising calculations in the chunker.
A random polynomial is chosen selecting 64 random bits, masking away bits
64..54 and setting bit 53 to one (otherwise the polynomial is not of the
desired degree) and bit 0 to one (otherwise the polynomial is trivially
reducible), so that 51 bits are chosen at random.
This process is repeated until Irreducible() returns true, then this
polynomials is returned. If this doesn't happen after 1 million tries, the
function returns an error. The probability for selecting an irreducible
polynomial at random is about 7.5% ( (2^53-2)/53 / 2^51), so the probability
that no irreducible polynomial has been found after 100 tries is lower than
0.04%.
During development the results have been verified using the computational
discrete algebra system GAP, which can be obtained from the website at
http://www.gap-system.org/.
For filtering a given list of polynomials in hexadecimal coefficient notation,
the following script can be used:
All irreducible polynomials from the list are written to the output.
An introduction to Rabin Fingerprints/Checksums can be found in the following articles:
Michael O. Rabin (1981): "Fingerprinting by Random Polynomials"
http://www.xmailserver.org/rabin.pdf
Ross N. Williams (1993): "A Painless Guide to CRC Error Detection Algorithms"
http://www.zlib.net/crc_v3.txt
Andrei Z. Broder (1993): "Some Applications of Rabin's Fingerprinting Method"
http://www.xmailserver.org/rabin_apps.pdf
Shuhong Gao and Daniel Panario (1997): "Tests and Constructions of Irreducible Polynomials over Finite Fields"
http://www.math.clemson.edu/~sgao/papers/GP97a.pdf
Andrew Kadatch, Bob Jenkins (2007): "Everything we know about CRC but afraid to forget"
http://crcutil.googlecode.com/files/crc-doc.1.0.pdf
1 version
Latest release: over 5 years ago
446 dependent packages
View more package details: https://packages.ecosyste.ms/registries/proxy.golang.org/packages/github.com/whyrusleeping/chunker
View more repository details: https://repos.ecosyste.ms/hosts/GitHub/repositories/whyrusleeping%2Fchunker
Dependent Repos 1,099
Zondax/rosetta-filecoin-lib
- v0.0.0-20181014151217-fe64bd25879f go.sum
Size: 337 KB - Last synced: 10 days ago - Pushed: 10 days ago
berty/labs
Berty Labs is a mobile app to explore IPFS on mobile- v0.0.0-20181014151217-fe64bd25879f go.mod
- v0.0.0-20181014151217-fe64bd25879f go.sum
Size: 3.44 MB - Last synced: about 23 hours ago - Pushed: about 1 year ago
pickkaa/berty Fork of berty/berty
Berty is a secure peer-to-peer messaging app that works with or without internet access, cellular data or trust in the network- v0.0.0-20181014151217-fe64bd25879f go.sum
- v0.0.0-20181014151217-fe64bd25879f tool/go.sum
Size: 84.2 MB - Last synced: about 1 hour ago - Pushed: about 1 year ago
zaibon/go-ipfs Fork of ipfs/kubo
IPFS implementation in Go- v0.0.0-20181014151217-fe64bd25879f docs/examples/go-ipfs-as-a-library/go.sum
- v0.0.0-20181014151217-fe64bd25879f go.sum
- v0.0.0-20181014151217-fe64bd25879f test/dependencies/go.sum
Size: 40.8 MB - Last synced: about 1 year ago - Pushed: over 1 year ago
meonBot/go-ipfs Fork of devcode1981/go-ipfs
IPFS implementation in Go- v0.0.0-20181014151217-fe64bd25879f docs/examples/go-ipfs-as-a-library/go.sum
- v0.0.0-20181014151217-fe64bd25879f go.sum
- v0.0.0-20181014151217-fe64bd25879f test/dependencies/go.sum
Size: 40.8 MB - Last synced: about 1 year ago - Pushed: about 1 year ago
47-studio-org/go-ipfs Fork of MarcelRaschke/go-ipfs
IPFS implementation in Go- v0.0.0-20181014151217-fe64bd25879f docs/examples/go-ipfs-as-a-library/go.sum
- v0.0.0-20181014151217-fe64bd25879f go.sum
- v0.0.0-20181014151217-fe64bd25879f test/dependencies/go.sum
Size: 46.3 MB - Last synced: 5 months ago - Pushed: 5 months ago
filecoin-project/venus-wallet
a remote wallet for provider sign service- v0.0.0-20181014151217-fe64bd25879f go.sum
Size: 1.15 MB - Last synced: 11 days ago - Pushed: 11 days ago
jcomeauictx/go-ipfs Fork of ipfs/kubo
IPFS implementation in Go- v0.0.0-20181014151217-fe64bd25879f docs/examples/go-ipfs-as-a-library/go.sum
- v0.0.0-20181014151217-fe64bd25879f go.sum
- v0.0.0-20181014151217-fe64bd25879f test/dependencies/go.sum
Size: 40.8 MB - Last synced: 3 months ago - Pushed: over 1 year ago
molllyn1/go-ipfs Fork of ipfs/kubo
IPFS implementation in Go- v0.0.0-20181014151217-fe64bd25879f docs/examples/go-ipfs-as-a-library/go.sum
- v0.0.0-20181014151217-fe64bd25879f go.sum
- v0.0.0-20181014151217-fe64bd25879f test/dependencies/go.sum
Size: 40.9 MB - Last synced: about 1 year ago - Pushed: over 1 year ago
976047167/go-ipfs Fork of ipfs/kubo
IPFS implementation in Go- v0.0.0-20181014151217-fe64bd25879f docs/examples/go-ipfs-as-a-library/go.sum
- v0.0.0-20181014151217-fe64bd25879f go.sum
- v0.0.0-20181014151217-fe64bd25879f test/dependencies/go.sum
- v0.0.0-20181014151217-fe64bd25879f testplans/bitswap/go.sum
Size: 41 MB - Last synced: about 1 year ago - Pushed: about 1 year ago
jbarthelmes/go-ipfs Fork of ipfs/kubo π¦
Fork for ipfs/go-ipfs#4224. Built binaries are available: https://github.com/jbarthelmes/go-ipfs/actions?query=workflow%3ABuild+is%3Asuccess- v0.0.0-20181014151217-fe64bd25879f docs/examples/go-ipfs-as-a-library/go.sum
- v0.0.0-20181014151217-fe64bd25879f go.sum
- v0.0.0-20181014151217-fe64bd25879f test/dependencies/go.sum
- v0.0.0-20181014151217-fe64bd25879f testplans/bitswap/go.sum
Size: 44.4 MB - Last synced: about 1 year ago - Pushed: over 1 year ago
vocdoni/vocdoni-node
A set of libraries and tools for the Vocdoni decentralized backend infrastructure, the main ground of our universally verifiable, privacy-centric and scalable digital voting protocol- v0.0.0-20181014151217-fe64bd25879f go.mod
- v0.0.0-20181014151217-fe64bd25879f go.sum
Size: 16.3 MB - Last synced: 8 days ago - Pushed: 8 days ago
ipfs/test-plans π¦
Testground test plans for IPFS- v0.0.0-20181014151217-fe64bd25879f bitswap-tuning/go.sum
Size: 263 KB - Last synced: 1 day ago - Pushed: 10 months ago
application-research/estuary
A custom IPFS/Filecoin node that makes it easy to pin IPFS content and make Filecoin deals.- v0.0.0-20181014151217-fe64bd25879f go.sum
- v0.0.0-20181014151217-fe64bd25879f go.mod
Size: 5.3 MB - Last synced: about 1 month ago - Pushed: 8 months ago
tuyanbusah/go-swan-provider
- v0.0.0-20181014151217-fe64bd25879f go.sum
Size: 13.1 MB - Last synced: about 1 year ago - Pushed: almost 2 years ago
Zondax/filecoin-actors-cids
- v0.0.0-20181014151217-fe64bd25879f go.sum
Size: 139 KB - Last synced: 9 months ago - Pushed: about 1 year ago
filedrive-team/filfind
- v0.0.0-20181014151217-fe64bd25879f backend/go.sum
Size: 4.32 MB - Last synced: 3 months ago - Pushed: almost 2 years ago
renproject/lightnode
A simple node used for interacting with Darknodes- v0.0.0-20181014151217-fe64bd25879f go.sum
Size: 2.68 MB - Last synced: 10 months ago - Pushed: over 1 year ago
renproject/multichain
An abstraction over multiple different underlying blockchains (Bitcoin, Ethereum, Zcash, etc.)- v0.0.0-20181014151217-fe64bd25879f go.sum
Size: 23.3 MB - Last synced: 2 months ago - Pushed: 4 months ago
vkuzniet/stargz-snapshotter Fork of containerd/stargz-snapshotter
Fast container image distribution plugin with lazy pulling- v0.0.0-20181014151217-fe64bd25879f cmd/go.sum
- v0.0.0-20181014151217-fe64bd25879f ipfs/go.sum
Size: 11.5 MB - Last synced: about 1 year ago - Pushed: about 1 year ago
contropist/go-ipfs Fork of ipfs/kubo
IPFS implementation in Go- v0.0.0-20181014151217-fe64bd25879f docs/examples/go-ipfs-as-a-library/go.sum
- v0.0.0-20181014151217-fe64bd25879f go.sum
- v0.0.0-20181014151217-fe64bd25879f test/dependencies/go.sum
Size: 41.8 MB - Last synced: about 1 year ago - Pushed: about 1 year ago
httpsgithu/go-ipfs Fork of ipfs/kubo
IPFS implementation in go- v0.0.0-20181014151217-fe64bd25879f docs/examples/go-ipfs-as-a-library/go.sum
- v0.0.0-20181014151217-fe64bd25879f go.sum
- v0.0.0-20181014151217-fe64bd25879f test/dependencies/go.sum
Size: 40.9 MB - Last synced: about 1 year ago - Pushed: about 1 year ago
dennis-tra/go-ipfs Fork of ipfs/kubo
IPFS implementation in Go- v0.0.0-20181014151217-fe64bd25879f go.sum
- v0.0.0-20181014151217-fe64bd25879f test/dependencies/go.sum
- v0.0.0-20181014151217-fe64bd25879f testplans/bitswap/go.sum
Size: 46.1 MB - Last synced: 2 days ago - Pushed: 10 months ago
bjq/go-ipfs Fork of ipfs/kubo
IPFS implementation in Go- v0.0.0-20181014151217-fe64bd25879f docs/examples/go-ipfs-as-a-library/go.sum
- v0.0.0-20181014151217-fe64bd25879f go.sum
- v0.0.0-20181014151217-fe64bd25879f test/dependencies/go.sum
Size: 42 MB - Last synced: about 1 year ago - Pushed: over 1 year ago
pikejun/go-ipfs Fork of ipfs/kubo
IPFS implementation in Go- v0.0.0-20181014151217-fe64bd25879f docs/examples/go-ipfs-as-a-library/go.sum
- v0.0.0-20181014151217-fe64bd25879f go.sum
- v0.0.0-20181014151217-fe64bd25879f test/dependencies/go.sum
Size: 41 MB - Last synced: about 1 year ago - Pushed: about 1 year ago
InternetOfPeers/go-ipfs Fork of ipfs/kubo
IPFS implementation in go- v0.0.0-20181014151217-fe64bd25879f docs/examples/go-ipfs-as-a-library/go.sum
- v0.0.0-20181014151217-fe64bd25879f go.sum
- v0.0.0-20181014151217-fe64bd25879f test/dependencies/go.sum
Size: 45.1 MB - Last synced: 19 days ago - Pushed: about 1 year ago
whyros/IPFS
- v0.0.0-20181014151217-fe64bd25879f docs/examples/go-ipfs-as-a-library/go.sum
- v0.0.0-20181014151217-fe64bd25879f go.sum
- v0.0.0-20181014151217-fe64bd25879f test/dependencies/go.sum
Size: 2.28 MB - Last synced: about 1 year ago - Pushed: about 1 year ago
ironbeer/oasys-go-ipfs Fork of oasysgames/oasys-go-ipfs
IPFS implementation in Go- v0.0.0-20181014151217-fe64bd25879f docs/examples/go-ipfs-as-a-library/go.sum
- v0.0.0-20181014151217-fe64bd25879f go.sum
- v0.0.0-20181014151217-fe64bd25879f test/dependencies/go.sum
Size: 41 MB - Last synced: about 1 year ago - Pushed: about 1 year ago
cerc-io/eth-ipfs-state-validator
Read-only mirror of: https://git.vdb.to/cerc-io/eth-ipfs-state-validator (Uses ipfs-ethdb to validate completeness of IPFS Ethereum state data)- v0.0.0-20181014151217-fe64bd25879f go.mod
- v0.0.0-20181014151217-fe64bd25879f go.sum
Size: 479 KB - Last synced: about 1 month ago - Pushed: 7 months ago
Bloxxix/go-ipfs Fork of ipfs/kubo
IPFS implementation in Go- v0.0.0-20181014151217-fe64bd25879f docs/examples/go-ipfs-as-a-library/go.mod
- v0.0.0-20181014151217-fe64bd25879f docs/examples/go-ipfs-as-a-library/go.sum
- v0.0.0-20181014151217-fe64bd25879f go.mod
- v0.0.0-20181014151217-fe64bd25879f go.sum
- v0.0.0-20181014151217-fe64bd25879f test/dependencies/go.sum
Size: 51.4 MB - Last synced: 10 months ago - Pushed: 10 months ago
cerc-io/ipld-eth-server
Read-only mirror of https://git.vdb.to/cerc-io/ipld-eth-server (Server backend for indexed ETH IPLD objects)- v0.0.0-20181014151217-fe64bd25879f go.mod
- v0.0.0-20181014151217-fe64bd25879f go.sum
Size: 59.2 MB - Last synced: 9 days ago - Pushed: 10 days ago
cerc-io/eth-statediff-fill-service
Service to fill statediff gaps for watched addresses- v0.0.0-20181014151217-fe64bd25879f go.mod
- v0.0.0-20181014151217-fe64bd25879f go.sum
Size: 242 KB - Last synced: about 1 month ago - Pushed: about 1 year ago
me-loser/StorEasy Fork of surfer05/StorEasy
- v0.0.0-20181014151217-fe64bd25879f web2/Backend/node_modules/@filecoin-shipyard/lotus-client-schema/go-tsgen/go.sum
Size: 22.5 MB - Last synced: about 1 year ago - Pushed: about 1 year ago
web3-storage/web3.storage
DEPRECATED β The simple file storage service for IPFS & Filecoin- v0.0.0-20181014151217-fe64bd25879f packages/website/assets/code-snippets/how-to/golang/go.sum
Size: 142 MB - Last synced: about 19 hours ago - Pushed: about 2 months ago
RTradeLtd/Temporal π¦
βοΈ Temporal is an easy-to-use, enterprise-grade interface into distributed and decentralized storage- v0.0.0-20181014151217-fe64bd25879f go.sum
Size: 2 GB - Last synced: 19 days ago - Pushed: over 3 years ago
ipfs-and-filecoin/Coding-with-Filecoin-Homework
This is for homework submission of Filecoin Chinese Education Series - Coding with Filecoin.- v0.0.0-20181014151217-fe64bd25879f 5.εΊδΊLotusθηΉεΌε/cxytz01/go.sum
Size: 68.2 MB - Last synced: 10 months ago - Pushed: almost 2 years ago
ipni/storetheindex
A directory of CIDs- v0.0.0-20181014151217-fe64bd25879f go.mod
- v0.0.0-20181014151217-fe64bd25879f go.sum
Size: 21.3 MB - Last synced: 3 days ago - Pushed: 3 days ago
ipfs-force-community/sophon-miner
- v0.0.0-20181014151217-fe64bd25879f go.sum
Size: 1.55 MB - Last synced: 14 days ago - Pushed: 14 days ago
NpoolPlatform/cloud-hashing-apis-not-used
- v0.0.0-20181014151217-fe64bd25879f go.sum
Size: 1.15 MB - Last synced: 10 months ago - Pushed: over 1 year ago
filecoin-project/venus-sealer π¦
- v0.0.0-20181014151217-fe64bd25879f go.sum
Size: 2.11 MB - Last synced: 16 days ago - Pushed: over 1 year ago
ipfs-force-community/go-fvm-sdk
go-fvm-sdk generate wasm to run on fvm from golang code- v0.0.0-20181014151217-fe64bd25879f examples/erc20/gen/go.sum
- v0.0.0-20181014151217-fe64bd25879f examples/erc20/go.sum
- v0.0.0-20181014151217-fe64bd25879f examples/hellocontract/gen/go.sum
- v0.0.0-20181014151217-fe64bd25879f examples/hellocontract/go.sum
- v0.0.0-20181014151217-fe64bd25879f go.sum
- v0.0.0-20181014151217-fe64bd25879f sdk/gen/go.sum
Size: 23.6 MB - Last synced: 16 days ago - Pushed: about 1 year ago
NpoolPlatform/sphinx-plugin
- v0.0.0-20181014151217-fe64bd25879f go.sum
Size: 1.52 MB - Last synced: 2 months ago - Pushed: 2 months ago
ipfs-force-community/droplet
market for storage and retrieval- v0.0.0-20181014151217-fe64bd25879f go.mod
- v0.0.0-20181014151217-fe64bd25879f go.sum
Size: 6.44 MB - Last synced: 7 days ago - Pushed: 8 days ago
filecoin-project/statediff
State Inspector π΅οΈβ- v0.0.0-20181014151217-fe64bd25879f go.sum
Size: 3.71 MB - Last synced: 20 days ago - Pushed: about 2 months ago
hamster-shared/hamster-provider
- v0.0.0-20181014151217-fe64bd25879f go.sum
Size: 2.57 MB - Last synced: 2 months ago - Pushed: 6 months ago
filecoin-project/go-data-transfer
Data Transfer Shared Component for go-filecoin & go-lotus- v0.0.0-20181014151217-fe64bd25879f go.mod
- v0.0.0-20181014151217-fe64bd25879f go.sum
Size: 2.7 MB - Last synced: about 1 month ago - Pushed: 7 months ago
INFURA/go-ipfs-datadog-plugin
go-ipfs plugin to support Datadog APM tracing- v0.0.0-20181014151217-fe64bd25879f go.sum
Size: 897 KB - Last synced: 16 days ago - Pushed: about 2 months ago
bdengine/go-ipfs
- v0.0.0-20181014151217-fe64bd25879f docs/examples/go-ipfs-as-a-library/go.sum
Size: 38.9 MB - Last synced: 9 months ago - Pushed: over 1 year ago