Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / VadimBabich / java-web-crawler
This is a web crawling java library used to crawl a web domain and extract data from it pages.
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/VadimBabich%2Fjava-web-crawler
Stars: 1
Forks: 1
Open Issues: 0
License: apache-2.0
Language: Java
Repo Size: 4.19 MB
Dependencies:
29
Created: over 3 years ago
Updated: over 2 years ago
Last pushed: over 2 years ago
Last synced: over 1 year ago
Files
Loading...
Readme
Loading...
Dependencies
pom.xml
maven
- com.fasterxml.jackson.dataformat:jackson-dataformat-cbor 2.13.0 compile
- com.amazonaws:aws-java-sdk-core 1.11.106
- com.amazonaws:aws-java-sdk-s3 1.11.106
- com.codeborne:selenide 6.2.1
- com.fasterxml.jackson.core:jackson-annotations 2.13.0
- com.fasterxml.jackson.core:jackson-databind 2.13.0
- com.google.guava:guava 31.0.1-jre
- commons-io:commons-io 2.11.0
- commons-logging:commons-logging 1.2
- io.micrometer:micrometer-core 1.8.1
- io.micrometer:micrometer-registry-influx 1.8.1
- javax.xml.bind:jaxb-api 2.3.1
- org.apache.commons:commons-lang3 3.12.0
- org.apache.httpcomponents:httpclient 4.5.13
- org.jsoup:jsoup 1.14.3
- org.slf4j:slf4j-simple 1.7.32
- org.yaml:snakeyaml 1.30
- com.github.docker-java:docker-java-api 3.2.12 test
- org.awaitility:awaitility 4.1.1 test
- org.hamcrest:hamcrest-all 1.3 test
- org.junit.jupiter:junit-jupiter-engine 5.8.2 test
- org.junit.jupiter:junit-jupiter-params 5.8.2 test
- org.mockito:mockito-all 1.10.19 test
- org.testcontainers:junit-jupiter 1.16.3 test
- org.testcontainers:nginx 1.16.3 test
- org.testcontainers:selenium 1.16.3 test
- org.testcontainers:testcontainers 1.16.3 test
web-crawler-test/pom.xml
maven
- commons-cli:commons-cli 1.5.0
- org.babich:web-crawler-lib ${revision}