DigitalPebble/spruce

SPRUCE is an open-source enrichment platform for GreenOps which helps quantify and reduce the environmental impact of cloud computing.

Language: Java - Size: 5.26 MB - Last synced at: 3 days ago - Pushed at: 14 days ago - Stars: 28 - Forks: 7

DigitalPebble/digitalpebble.github.io

Resources for the DigitalPebble website

Language: SCSS - Size: 8.1 MB - Last synced at: 27 days ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

DigitalPebble/behemoth 📦

Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.

Language: Java - Size: 7.45 MB - Last synced at: 1 day ago - Pushed at: over 8 years ago - Stars: 282 - Forks: 59

DigitalPebble/spruce-sql-advisor

AI Agent skill that provides accurate knowledge for writing and optimising SQL queries against AWS CUR 2.0 data enriched with SPRUCE. Works for FinOps as well as GreenOps.

Size: 2.39 MB - Last synced at: 4 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

DigitalPebble/tika Fork of apache/tika

The Apache Tika toolkit detects and extracts metadata and text from over a thousand different file types (such as PPT, XLS, and PDF).

Language: Java - Size: 301 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

DigitalPebble/TextClassification

A Text Classification API in Java originally developed by DigitalPebble Ltd. The API is independent from the ML implementations used and can be used as a front end to various ML algorithms. libSVM and liblinear are currently embedded.

Language: Java - Size: 367 KB - Last synced at: 15 days ago - Pushed at: about 5 years ago - Stars: 48 - Forks: 22

DigitalPebble/ginkgo

Estimate the environmental impact of GitHub Actions for your entire organization.

Language: Rust - Size: 55.7 KB - Last synced at: about 7 hours ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

DigitalPebble/stormcrawler-docker

Resources for running StormCrawler with Docker services

Language: Dockerfile - Size: 19.5 KB - Last synced at: 5 days ago - Pushed at: almost 2 years ago - Stars: 10 - Forks: 4

DigitalPebble/ngrams-api 📦

Java API for querying a N-Grams corpus. Uses Lucene for searching and indexing from the Google Web-1T format

Language: Java - Size: 104 KB - Last synced at: 8 months ago - Pushed at: over 14 years ago - Stars: 5 - Forks: 2

DigitalPebble/carbonara 📦

Enrichment pipeline for CUR / FOCUS reports which adds energy and carbon data allowing to report and reduce the impact of the your cloud usage.

Language: Java - Size: 317 KB - Last synced at: 8 months ago - Pushed at: about 1 year ago - Stars: 5 - Forks: 0

DigitalPebble/crawlurlfrontier 📦

Crawl config used to test URL Frontier on a large scale and produce WARCs for CommonCrawl.

Language: FLUX - Size: 16 MB - Last synced at: 8 months ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

DigitalPebble/stormcrawlerfight

Crawl configurations for benchmarking / testing StormCrawler

Language: Shell - Size: 8.53 MB - Last synced at: 8 months ago - Pushed at: about 7 years ago - Stars: 10 - Forks: 5

DigitalPebble/tika-detector-stormcrawler

Wraps the charset detection logic from StormCrawler as a Tika module

Language: Java - Size: 23.4 KB - Last synced at: 8 months ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 1

DigitalPebble/benchmark

StormCrawler topology to evaluate the performance of different backends and configurations

Language: Shell - Size: 43.9 KB - Last synced at: 8 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

DigitalPebble/docs Fork of docker-library/docs

Documentation for Docker Official Images in docker-library

Size: 60.2 MB - Last synced at: 8 months ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

DigitalPebble/urlfrontier-client

URLFrontier client written in Rust (mostly as a way of learning Rust)

Language: Rust - Size: 15.6 KB - Last synced at: 8 months ago - Pushed at: almost 4 years ago - Stars: 1 - Forks: 0

DigitalPebble/nutch Fork of apache/nutch

Apache Nutch is an extensible and scalable web crawler

Language: Java - Size: 128 MB - Last synced at: 8 months ago - Pushed at: almost 3 years ago - Stars: 1 - Forks: 0

DigitalPebble/ansible-storm

Ansible playbook for deploying a Storm cluster

Size: 27.3 KB - Last synced at: 8 months ago - Pushed at: almost 3 years ago - Stars: 7 - Forks: 1

DigitalPebble/storm Fork of apache/storm

Mirror of Apache Storm

Language: Java - Size: 76.9 MB - Last synced at: 8 months ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

DigitalPebble/behemoth-commoncrawl 📦

Support for old (pre 2013) CommonCrawl dataset in Behemoth

Language: Java - Size: 1.98 MB - Last synced at: 8 months ago - Pushed at: over 11 years ago - Stars: 4 - Forks: 0

DigitalPebble/behemoth-elasticsearch 📦

ElasticSearch module for Behemoth

Language: Java - Size: 137 KB - Last synced at: 8 months ago - Pushed at: over 12 years ago - Stars: 1 - Forks: 0

DigitalPebble/behemoth-textclassification 📦

Module for classifying Behemoth documents with a model from our Text Classification API

Language: Java - Size: 191 KB - Last synced at: 8 months ago - Pushed at: almost 14 years ago - Stars: 1 - Forks: 0

DigitalPebble/TextClassificationPlugin 📦

GATE Processing Resource wrapping DigitalPebble's TextClassification API

Language: Java - Size: 8.42 MB - Last synced at: 8 months ago - Pushed at: about 14 years ago - Stars: 5 - Forks: 3

DigitalPebble/tescobank 📦

Setup for crawling tescobank with SC

Language: Java - Size: 176 KB - Last synced at: 8 months ago - Pushed at: about 11 years ago - Stars: 4 - Forks: 2

DigitalPebble/crawler4j-frontier-battle Fork of rzo1/crawler4j-frontier-battle

Language: Java - Size: 8.05 MB - Last synced at: 8 months ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

DigitalPebble/textclassification-examples

Use cases for DigitalPebble's TextClassification API

Language: Java - Size: 17.2 MB - Last synced at: 2 months ago - Pushed at: about 11 years ago - Stars: 10 - Forks: 3

DigitalPebble/crawler-commons Fork of crawler-commons/crawler-commons

A set of reusable Java components that implement functionality common to any web crawler

Language: Java - Size: 1.78 MB - Last synced at: 8 months ago - Pushed at: over 9 years ago - Stars: 4 - Forks: 1

DigitalPebble/sc-warc

WARC resources for StormCrawler

Size: 49.8 KB - Last synced at: 8 months ago - Pushed at: almost 10 years ago - Stars: 2 - Forks: 1

DigitalPebble/tika-cc

resources for generating a corpus of docs from CC for Tika

Language: Shell - Size: 129 KB - Last synced at: 21 days ago - Pushed at: almost 12 years ago - Stars: 0 - Forks: 0

DigitalPebble/NutchFight

Resources for comparison between 1.8 and 2.x of Apache Nutch

Language: Java - Size: 223 KB - Last synced at: about 1 month ago - Pushed at: over 12 years ago - Stars: 4 - Forks: 0