Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / arthur3486 / born2crawl

A highly performant and versatile crawling engine, designed with scalability and extensibility in mind.

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arthur3486%2Fborn2crawl

Stars: 8
Forks: 0
Open Issues: 0

License: apache-2.0
Language: Kotlin
Repo Size: 624 KB
Dependencies: 29

Created: about 1 year ago
Updated: 4 months ago
Last pushed: 4 months ago
Last synced: 4 months ago

Topics: crawler, crawlers, crawling, crawling-engine, data-mining, java, jvm, kotlin, library, mining, scraper, scraping, web-crawler, web-crawling, web-scraping

Files

Loading...

Readme

Loading...

Dependencies

.github/workflows/build.yml actions

actions/cache v2 composite
actions/checkout v2 composite
actions/setup-java v2 composite

.github/workflows/gradle-wrapper-validation.yml actions

actions/checkout v2 composite
gradle/wrapper-validation-action v1 composite

born2crawl-core/build.gradle maven

org.apache.logging.log4j:log4j-core 2.19.0 api
org.apache.logging.log4j:log4j-slf4j2-impl 2.19.0 api
org.jetbrains.kotlin:kotlin-stdlib * api
org.jetbrains.kotlinx:kotlinx-coroutines-core 1.6.4 api
org.slf4j:slf4j-api 2.0.6 api
org.jetbrains.kotlinx:kotlinx-coroutines-test 1.6.4 testImplementation
org.junit.jupiter:junit-jupiter-api 5.9.0 testImplementation
org.mockito.kotlin:mockito-kotlin 4.1.0 testImplementation
org.junit.jupiter:junit-jupiter-engine 5.9.0 testRuntimeOnly

born2crawl-data-store/build.gradle maven

com.google.code.gson:gson 2.10 implementation
org.jetbrains.kotlinx:kotlinx-coroutines-test 1.6.4 testImplementation
org.junit.jupiter:junit-jupiter-api 5.9.0 testImplementation
org.junit.jupiter:junit-jupiter-engine 5.9.0 testRuntimeOnly

born2crawl-samples/build.gradle maven

org.jetbrains.kotlin:kotlin-stdlib * implementation
org.jetbrains.kotlinx:kotlinx-coroutines-test 1.6.4 testImplementation
org.junit.jupiter:junit-jupiter-api 5.9.0 testImplementation
org.junit.jupiter:junit-jupiter-engine 5.9.0 testRuntimeOnly

born2crawl-web/build.gradle maven

com.squareup.okhttp3:okhttp 4.10.0 api
org.jsoup:jsoup 1.15.3 api
org.jetbrains.kotlinx:kotlinx-coroutines-test 1.6.4 testImplementation
org.junit.jupiter:junit-jupiter-api 5.9.0 testImplementation
org.junit.jupiter:junit-jupiter-engine 5.9.0 testRuntimeOnly

build.gradle maven

org.jetbrains.kotlin:kotlin-stdlib * implementation
junit:junit 4.13.2 testImplementation