An open API service providing repository metadata for many open source software ecosystems.

Topic: "product-quantization"

matsui528/faiss_tips

Some useful tips for faiss

Language: Shell - Size: 351 KB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 616 - Forks: 47

yahoo/lopq 📦

Training of Locally Optimized Product Quantization (LOPQ) models for approximate nearest neighbor search of high dimensional data in Python and Spark.

Language: Python - Size: 2.4 MB - Last synced at: 22 days ago - Pushed at: about 6 years ago - Stars: 566 - Forks: 130

matsui528/nanopq

Pure python implementation of product quantization for nearest neighbor search

Language: Python - Size: 99.6 KB - Last synced at: 9 days ago - Pushed at: over 1 year ago - Stars: 343 - Forks: 47

DwangoMediaVillage/pqkmeans

Fast and memory-efficient clustering

Language: Jupyter Notebook - Size: 563 KB - Last synced at: 8 days ago - Pushed at: over 1 year ago - Stars: 259 - Forks: 44

lxa9867/ImageFolder

High-performance Image Tokenizers for VAR and AR

Language: Python - Size: 3.97 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 248 - Forks: 5

jina-ai/annlite

⚡ A fast embedded library for approximate nearest neighbor search

Language: Python - Size: 2.7 MB - Last synced at: 10 days ago - Pushed at: almost 2 years ago - Stars: 230 - Forks: 24

matsui528/rii

Fast and memory-efficient ANN with a subset-search functionality

Language: C++ - Size: 281 KB - Last synced at: 22 days ago - Pushed at: 22 days ago - Stars: 154 - Forks: 20

guenthermi/postgres-word2vec

utils to use word embedding models like word2vec vectors in a PostgreSQL database

Language: C - Size: 917 KB - Last synced at: about 2 months ago - Pushed at: over 3 years ago - Stars: 143 - Forks: 19

jingtaozhan/RepCONC

WSDM'22 Best Paper: Learning Discrete Representations via Constrained Clustering for Effective and Efficient Dense Retrieval

Language: Python - Size: 479 KB - Last synced at: over 1 year ago - Pushed at: almost 3 years ago - Stars: 114 - Forks: 11

youngkyunJang/SPQ

Self-supervised Product Quantization for Deep Unsupervised Image Retrieval - ICCV2021

Language: Python - Size: 341 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 80 - Forks: 8

rixwew/elasticsearch-approximate-nearest-neighbor

Plugin to integrate approximate nearest neighbor(ANN) search with Elasticsearch

Language: Java - Size: 6.37 MB - Last synced at: about 2 months ago - Pushed at: over 6 years ago - Stars: 65 - Forks: 13

youngkyunJang/GPQ

Generalized Product Quantization Network For Semi-supervised Image Retrieval - CVPR 2020

Language: Python - Size: 4.12 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 63 - Forks: 11

technicolor-research/pq-fast-scan

PQ Fast Scan

Language: C++ - Size: 55.7 KB - Last synced at: about 1 year ago - Pushed at: almost 6 years ago - Stars: 55 - Forks: 14

xinyandai/product-quantization

Implementation of vector quantization algorithms, codes for Norm-Explicit Quantization: Improving Vector Quantization for Maximum Inner Product Search.

Language: Python - Size: 20.5 MB - Last synced at: about 1 year ago - Pushed at: over 4 years ago - Stars: 53 - Forks: 15

matsui528/pqtable

Fast search algorithm for product-quantized codes via hash-tables

Language: C++ - Size: 35.2 KB - Last synced at: about 2 years ago - Pushed at: almost 7 years ago - Stars: 49 - Forks: 11

jingtaozhan/JPQ

CIKM'21: JPQ substantially improves the efficiency of Dense Retrieval with 30x compression ratio, 10x CPU speedup and 2x GPU speedup.

Language: Python - Size: 301 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 43 - Forks: 12

dmllr/fast-lopq

Fast C++ implementation of https://github.com/yahoo/lopq: Locally Optimized Product Quantization (LOPQ) model and searcher for approximate nearest neighbor search of high dimensional data.

Language: C++ - Size: 85 KB - Last synced at: about 1 year ago - Pushed at: about 5 years ago - Stars: 33 - Forks: 3

technicolor-research/quick-adc

Quick ADC

Language: C++ - Size: 50.8 KB - Last synced at: about 1 year ago - Pushed at: almost 6 years ago - Stars: 23 - Forks: 0

jvdd/pqknn

Product Quantization k-Nearest Neighbors

Language: Jupyter Notebook - Size: 28.3 KB - Last synced at: about 2 months ago - Pushed at: almost 4 years ago - Stars: 20 - Forks: 4

JuliaNeighbors/IVFADC.jl

Inverted file system for billion-scale ANN search

Language: Julia - Size: 146 KB - Last synced at: 7 days ago - Pushed at: over 1 year ago - Stars: 19 - Forks: 0

thomasahle/tinyknn

A tiny approximate K-Nearest Neighbour library in Python based on Fast Product Quantization and IVF

Language: Python - Size: 1.38 MB - Last synced at: 17 days ago - Pushed at: about 2 years ago - Stars: 17 - Forks: 3

zgornel/QuantizedArrays.jl

Array quantization and compression

Language: Julia - Size: 146 KB - Last synced at: 3 days ago - Pushed at: over 1 year ago - Stars: 14 - Forks: 0

huyhoang17/Semantic_Search

[DEPRECATED] Baseline Project for Semantic Searching

Language: Python - Size: 4.88 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 10 - Forks: 3

nlpodyssey/gomaddness

Multiply-ADDitioN-lESS in Go.

Language: Go - Size: 21.5 KB - Last synced at: about 2 months ago - Pushed at: about 3 years ago - Stars: 9 - Forks: 1

moabitcoin/sisyphus

Scene similarity for weak object discovery & classification

Language: Python - Size: 2.89 MB - Last synced at: over 2 years ago - Pushed at: about 5 years ago - Stars: 8 - Forks: 2

Stick-To/product-quantization

product quantization image processing algorithm with matlab

Language: MATLAB - Size: 6.78 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 7 - Forks: 3

finalfusion/reductive

Vector quantization

Language: Rust - Size: 96.7 KB - Last synced at: 29 days ago - Pushed at: over 3 years ago - Stars: 7 - Forks: 1

mzhang367/opqn

Orthonormal Product Quantization Network for Scalable Face Image Retrieval

Language: Python - Size: 325 KB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 6 - Forks: 0

Stonesjtu/basis-embedding

basis embedding: a product quantization based model compression method for language models.

Language: Python - Size: 45.7 MB - Last synced at: about 2 months ago - Pushed at: 7 months ago - Stars: 5 - Forks: 0

TheDatumOrg/VAQ

Fast Adaptive Similarity Search through Variance‑Aware Quantization

Language: C++ - Size: 7.5 MB - Last synced at: about 1 year ago - Pushed at: about 2 years ago - Stars: 5 - Forks: 0

Bisonai/ncnn Fork of Tencent/ncnn

Modified inference engine for quantized convolution using product quantization

Language: C++ - Size: 7.96 MB - Last synced at: about 1 year ago - Pushed at: almost 3 years ago - Stars: 4 - Forks: 0

WallaceLiu/product-quantization

product quantization

Language: Python - Size: 19.6 MB - Last synced at: almost 2 years ago - Pushed at: almost 5 years ago - Stars: 3 - Forks: 1

anas-899/lopq Fork of yahoo/lopq

Converted version of yahoo LOPQ from python2.7 to python3.6

Language: Python - Size: 2.41 MB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 2 - Forks: 2

rifqifarhansyah/GIK-ProductQuantization

Product Quantization Apllication for KNN

Language: C++ - Size: 404 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0

TSPoulsen/SPQ

Simply Product Quantization - Standalone C++ implementation of 3 different product quantization methods

Language: C++ - Size: 236 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

iretes/IR-proj

📏 Implementation of Product Quantization for Nearest Neighbor Search, including replication of original experiments and exploration of alternative approaches.

Language: Jupyter Notebook - Size: 58.4 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

bariscamli/Vector-Search-with-FAISS

Vector search using embeddings, FAISS and Product Quantization with custom index & KMeans

Language: Python - Size: 424 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

huangqianfei0916/learn_nlp

Implementations of different NLP tasks

Language: Python - Size: 2.08 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

ytgui/SPT-proto

This repo includes a Sparse Transformer implementation which utilizes PQ to derive the sparsity.

Language: Python - Size: 296 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

scampion/pqjs

Transformer-based Embedding Retrieval with Product Quantization for Edge Computing (JavaScript)

Language: Python - Size: 52.7 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

USTCLLM/LISA

Pytorch implementation of LISA (Linear-Time Self Attention with Codeword Histogram for Efficient Recommendation. WWW 2021)

Language: Python - Size: 9.2 MB - Last synced at: 6 months ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

anvelezec/product_quantization

Product quantization using nearest neighbor search

Language: Python - Size: 11.7 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

WallaceLiu/pq

Product-Quantization

Language: Python - Size: 4.17 MB - Last synced at: almost 2 years ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0

Related Topics
nearest-neighbor-search 14 approximate-nearest-neighbor-search 12 clustering 6 deep-learning 5 data-compression 4 pytorch 4 hashing 4 information-retrieval 3 simd 3 lopq 3 faiss 3 vector-quantization 2 embeddings 2 transformers 2 vector-search 2 cpp 2 knn 2 machine-learning 2 language-model 2 similarity-search 2 inverted-index 2 cython 2 efficiency 2 dense-retrieval 2 pq 2 compression 2 quantization 2 image-retrieval 2 vision-transformer 1 ivf 1 pqknn-algorithm 1 k-nearest-neighbors 1 clustering-algorithm 1 l2r 1 deepwalk 1 ac-automaton 1 neural-search 1 image-search 1 hnsw 1 self-supervised-learning 1 representation-learning 1 iccv2021 1 billion-scale 1 nearest-neighbors 1 knn-algorithm 1 data-structures 1 semantic-tokenizer 1 large-language-model 1 image-tokenizer 1 image-generation 1 efficient-tokenizer 1 diffusion-models 1 conditional-generation 1 autoregressive-models 1 word2vec 1 word-embeddings 1 postgresql 1 knn-search 1 self-attention 1 efficient-transformers 1 efficient-recommendation 1 model-compression 1 maddness 1 hash 1 approximate 1 spark 1 python 1 polysemous-codes 1 content-based 1 cbir 1 object-classification 1 image-similarity 1 image-indexing 1 image-classification 1 cvpr2020 1 metric-learning 1 matrix-multiplication 1 vector-similarity 1 semi-supervised-learning 1 vector-database 1 tensorflow 1 huggingface 1 ann 1 bert 1 elasticsearch 1 elasticsearch-plugin 1 c-plus-plus 1 lsh 1 mobile-deep-learning 1 inference-optimization 1 inference-acceleration 1 edge-machine-learning 1 pybind11 1 matlab 1 cpp17 1 cmake 1 blaze 1 web-search 1 python3 1 arrays 1