Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / internetarchive / heritrix3

Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/internetarchive%2Fheritrix3

Stars: 2,698
Forks: 756
Open Issues: 48

License: other
Language: Java
Repo Size: 10.5 MB
Dependencies: 69

Created: over 12 years ago
Updated: about 17 hours ago
Last pushed: 28 days ago
Last synced: about 5 hours ago

Topics: heritrix, java, warc, webcrawling

Files

Loading...

Readme

Loading...

Dependencies

.github/workflows/docker-image.yml actions

actions/checkout v2 composite

.github/workflows/maven.yml actions

actions/cache v2 composite
actions/checkout v2 composite
actions/setup-java v2 composite

docker/Dockerfile docker

openjdk ${java} build

docker/docker-compose.yml docker

heritrix latest

commons/pom.xml maven

com.anotherbigidea:javaswf CVS-SNAPSHOT-1 compile
com.esotericsoftware:kryo 1.01 compile
com.lowagie:itext 1.3 compile
commons-cli:commons-cli 1.1 compile
commons-codec:commons-codec 1.6 compile
commons-collections:commons-collections 3.2.2 compile
commons-io:commons-io 2.7 compile
commons-lang:commons-lang 2.6 compile
commons-logging:commons-logging 1.0.4 compile
commons-net:commons-net 2.0 compile
dnsjava:dnsjava 3.3.1 compile
junit:junit compile
net.htmlparser.jericho:jericho-html 2.6.1 compile
poi:poi 2.5.1-final-20040804 compile
poi:poi-scratchpad 2.5.1-final-20040804 compile
com.esotericsoftware:minlog 1.2
com.esotericsoftware:reflectasm 0.8
com.jcraft:jsch 0.1.54
com.sleepycat:je 7.5.11
org.apache.httpcomponents:httpclient
org.apache.httpcomponents:httpmime
org.netpreserve.commons:webarchive-commons 1.1.8
org.springframework:spring-beans 5.3.20
org.springframework:spring-context 5.3.20
org.springframework:spring-core 5.3.20
org.springframework:spring-expression 5.3.20

engine/pom.xml maven

org.archive.heritrix:heritrix-modules 3.4.0-SNAPSHOT compile
javax.xml.bind:jaxb-api 2.3.1
joda-time:joda-time 1.6
org.eclipse.jetty:jetty-server ${jetty.version}
org.eclipse.jetty:jetty-util ${jetty.version}
org.freemarker:freemarker 2.3.19
org.glassfish.jaxb:jaxb-runtime 2.3.1
org.restlet.jse:org.restlet 2.4.0
org.restlet.jse:org.restlet.ext.crypto 2.4.0
org.restlet.jse:org.restlet.ext.jetty 2.4.0
org.restlet.jse:org.restlet.ext.xml 2.4.0
org.eclipse.jetty:jetty-servlet ${jetty.version} test
org.littleshoot:littleproxy 0.4 test
org.slf4j:slf4j-api 1.6.6 test
org.slf4j:slf4j-jdk14 1.6.6 test

modules/pom.xml maven

org.archive.heritrix:heritrix-commons 3.4.0-SNAPSHOT compile
org.beanshell:bsh 2.0b5 compile
com.github.crawler-commons:crawler-commons 1.0
com.jcraft:jsch 0.1.54
org.codehaus.groovy:groovy-jsr223 3.0.13
org.codehaus.groovy:groovy-templates 3.0.13
org.eclipse.jetty:jetty-security ${jetty.version}
org.eclipse.jetty:jetty-server ${jetty.version}
com.github.bbottema:java-socks-proxy-server 1.1.0 test
org.apache.ftpserver:ftpserver-core 1.1.1 test
org.littleshoot:littleproxy 0.4 test
org.slf4j:slf4j-api 1.6.6 test
org.slf4j:slf4j-jdk14 1.6.6 test

pom.xml maven

junit:junit 4.13.1
org.apache.httpcomponents:httpclient 4.5.13
org.apache.httpcomponents:httpmime 4.5.13
org.archive.heritrix:commons 3.4.0-SNAPSHOT
org.archive.heritrix:engine 3.4.0-SNAPSHOT
org.archive.heritrix:modules 3.4.0-SNAPSHOT

docs/requirements.txt pypi

beautifulsoup4 ==4.9.3
javalang ==0.13.0
sphinxcontrib-httpdomain ==1.7.0