Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / phymbert / spark-search

Spark Search - high performance advanced search features based on Apache Lucene

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/phymbert%2Fspark-search

Stars: 22
Forks: 1
Open Issues: 41

License: apache-2.0
Language: Scala
Repo Size: 785 KB
Dependencies: 55

Created: almost 4 years ago
Updated: over 1 year ago
Last pushed: over 1 year ago
Last synced: 10 months ago

Topics: deduplication, entity-matching, fulltext, lucene, lucenesearch, search, spark

Files

Loading...

Readme

Loading...

Dependencies

benchmark/pom.xml maven

org.apache.hadoop:hadoop-client provided
org.apache.hadoop:hadoop-common provided
org.apache.spark:spark-core_${scala.binary.version} provided
org.apache.spark:spark-sql_${scala.binary.version} provided
org.scala-lang:scala-library provided
org.scala-lang:scala-reflect provided
io.github.phymbert:spark-search-sql_2.12 ${project.version}
io.github.phymbert:spark-search_2.12 ${project.version}
org.apache.httpcomponents:httpclient 4.5.13
org.apache.lucene:lucene-analyzers-common
org.elasticsearch:elasticsearch-hadoop 7.14.0

core/pom.xml maven

org.apache.commons:commons-lang3 provided
org.apache.spark:spark-core_${scala.binary.version} provided
org.scala-lang:scala-library provided
org.scala-lang:scala-reflect provided
org.apache.lucene:lucene-core
org.apache.lucene:lucene-queryparser
org.apache.lucene:lucene-analyzers-common test
org.junit.jupiter:junit-jupiter test
org.scalatest:scalatest_${scala.binary.version} test

examples/pom.xml maven

commons-io:commons-io provided
org.apache.spark:spark-core_${scala.binary.version} provided
org.apache.spark:spark-sql_${scala.binary.version} provided
org.scala-lang:scala-library provided
org.scala-lang:scala-reflect provided
io.github.phymbert:spark-search-sql_2.12 ${project.version}
io.github.phymbert:spark-search_2.12 ${project.version}
org.apache.lucene:lucene-analyzers-common

pom.xml maven

org.junit:junit-bom 5.7.2 import
commons-io:commons-io 2.11.0
org.apache.commons:commons-lang3 3.10
org.apache.hadoop:hadoop-client 3.3.1
org.apache.hadoop:hadoop-common 3.3.1
org.apache.lucene:lucene-analyzers-common 8.9.0
org.apache.lucene:lucene-core 8.9.0
org.apache.lucene:lucene-queryparser 8.9.0
org.apache.spark:spark-core_2.12 3.1.2
org.apache.spark:spark-sql_2.12 3.1.2
org.scala-lang:scala-library 2.12.14
org.scala-lang:scala-reflect 2.12.14
org.scalatest:scalatest_2.12 3.1.2

sql/pom.xml maven

org.apache.spark:spark-sql_${scala.binary.version} provided
io.github.phymbert:spark-search_2.12 ${project.version}
org.apache.lucene:lucene-core
org.apache.lucene:lucene-analyzers-common test
org.junit.jupiter:junit-jupiter test
org.scalatest:scalatest_${scala.binary.version} test

python/setup.py pypi

pyspark ==2.4.8

.github/workflows/workflow-ci.yaml actions

actions/cache v2.1.6 composite
actions/checkout v2 composite
actions/setup-java v2.3.0 composite
codecov/codecov-action v2.0.3 composite

integration/Dockerfile docker

ubuntu bionic build

integration/docker-compose.yml docker

bde2020/spark-master 2.4.5-hadoop2.7
bde2020/spark-worker 2.4.5-hadoop2.7