Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: cross-modality

THUDM/CogVLM

a state-of-the-art-level open visual language model | 多模态预训练模型

Language: Python - Size: 25.8 MB - Last synced: 4 days ago - Pushed: 4 days ago - Stars: 5,375 - Forks: 377

haofanwang/awesome-conditional-content-generation

Update-to-data resources for conditional content generation, including human motion generation, image or video generation and editing.

Size: 128 KB - Last synced: 10 days ago - Pushed: 9 months ago - Stars: 220 - Forks: 22

mx-mark/SPMNet

Source code for "Visually aligned sound generation via sound-producing motion parsing" (Published at Neurocomputing)

Size: 4.88 KB - Last synced: 21 days ago - Pushed: about 2 years ago - Stars: 1 - Forks: 0

BEAM-Labs/CrossBind

Official Pytorch implementation of CrossBind: Collaborative Cross-Modal Identification of Protein Nucleic-Acid-Binding Residues.

Language: Python - Size: 7.79 MB - Last synced: 23 days ago - Pushed: 23 days ago - Stars: 1 - Forks: 0

KimMeen/Time-LLM

[ICLR 2024] Official implementation of " 🦙 Time-LLM: Time Series Forecasting by Reprogramming Large Language Models"

Language: Python - Size: 1.04 MB - Last synced: 29 days ago - Pushed: 29 days ago - Stars: 765 - Forks: 121

bismex/Awesome-cross-modality-person-re-identification

Awesome Cross-modality Person Re-identification

Size: 43.9 KB - Last synced: 4 days ago - Pushed: almost 2 years ago - Stars: 139 - Forks: 32

M-3LAB/awesome-multimodal-brain-image-systhesis

Size: 20.5 KB - Last synced: 10 days ago - Pushed: about 1 year ago - Stars: 25 - Forks: 6

jina-ai/clip-as-service

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

Language: Python - Size: 27.4 MB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 12,060 - Forks: 2,055

layumi/Image-Text-Embedding

TOMM2020 Dual-Path Convolutional Image-Text Embedding :feet: https://arxiv.org/abs/1711.05535

Language: MATLAB - Size: 6.02 MB - Last synced: 22 days ago - Pushed: 12 months ago - Stars: 280 - Forks: 73

hangzhaomit/Sound-of-Pixels

Codebase for ECCV18 "The Sound of Pixels"

Language: Python - Size: 1.24 MB - Last synced: 2 months ago - Pushed: about 2 years ago - Stars: 363 - Forks: 74

GuiyuZhao/VRHCF

[ICME 2024] VRHCF: Cross-Source Point Cloud Registration via Voxel Representation and Hierarchical Correspondence Filtering

Language: Python - Size: 482 MB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 4 - Forks: 0

ZYK100/LLCM

[CVPR 2023] Diverse Embedding Expansion Network and Low-Light Cross-Modality Benchmark for Visible-Infrared Person Re-identification

Language: Python - Size: 4.99 MB - Last synced: 5 months ago - Pushed: 5 months ago - Stars: 66 - Forks: 8

zjzsliyang/CrossLeak

Code for the WWW'20 paper "Nowhere to Hide: Cross-modal Identity Leakage between Biometrics and Devices"

Language: Python - Size: 47.9 KB - Last synced: 5 months ago - Pushed: over 1 year ago - Stars: 22 - Forks: 5

sail-sg/ptp

[CVPR2023] The code for 《Position-guided Text Prompt for Vision-Language Pre-training》

Language: Python - Size: 2.37 MB - Last synced: 6 months ago - Pushed: 12 months ago - Stars: 133 - Forks: 3

movienet/movienet-tools

Tools for movie and video research

Language: C++ - Size: 6.56 MB - Last synced: 7 months ago - Pushed: almost 2 years ago - Stars: 236 - Forks: 29

AnjanDutta/sem-pcyc

PyTorch implementation of the paper "Semantically Tied Paired Cycle Consistency for Zero-Shot Sketch-based Image Retrieval", CVPR 2019.

Language: Python - Size: 23 MB - Last synced: 7 months ago - Pushed: 11 months ago - Stars: 111 - Forks: 23

JacobYuan7/OCN-HOI-Benchmark

[AAAI 2022] Detecting Human-Object Interactions with Object-Guided Cross-Modal Calibrated Semantics.

Language: Python - Size: 1.33 MB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 13 - Forks: 1

catalina17/VideoNavQA

An alternative EQA paradigm and informative benchmark + models (BMVC 2019, ViGIL 2019 spotlight)

Language: Python - Size: 5.17 MB - Last synced: 8 months ago - Pushed: almost 2 years ago - Stars: 23 - Forks: 1

rhgao/co-separation

Co-Separating Sounds of Visual Objects (ICCV 2019)

Language: Python - Size: 465 KB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 78 - Forks: 24

ZYK100/MMN

Pytorch code for Towards a Unified Middle Modality Learning for Visible-Infrared Person Re-Identification

Language: Python - Size: 45.9 KB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 18 - Forks: 3

Mithunjha/EarEEG_KnowledgeDistillation

Official implementation of "A Knowledge Distillation Framework for Enhancing Ear-EEG based Sleep Staging with Scalp-EEG Data"

Language: Jupyter Notebook - Size: 174 MB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 5 - Forks: 2

JDAI-CV/CM-NAS

CM-NAS: Cross-Modality Neural Architecture Search for Visible-Infrared Person Re-Identification (ICCV2021)

Language: Python - Size: 33.2 KB - Last synced: about 1 year ago - Pushed: almost 3 years ago - Stars: 40 - Forks: 11

mangye16/Visible-Thermal-Person-Re-Identification

Demo code for visible thermal (cross-modality) person re-identification

Language: Python - Size: 195 KB - Last synced: about 1 year ago - Pushed: about 5 years ago - Stars: 87 - Forks: 18

Related Keywords
cross-modality 23 deep-learning 5 person-reidentification 3 visible-infrared 3 machine-learning 2 vireid 2 video-understanding 2 cross-modal-retrieval 2 sound-separation 2 computer-vision 2 reid 2 awesome-list 2 re-id 2 person-re-identification 2 language-model 2 shot-detection 1 person-analysis 1 movie 1 action-recognition 1 vlp 1 vision-language-pretraining 1 www 1 neural-architecture-search 1 t-sne 1 low-light 1 llcm 1 dataset 1 cvpr2023 1 point-cloud-registration 1 lidar 1 cross-source 1 self-supervised-learning 1 visual-semantic 1 matlab 1 matconvnet 1 language-retrieval 1 image-search 1 nas 1 cm-nas 1 sleep-staging 1 sleep-research 1 knowledge-distillation 1 eeg-signals-processing 1 ear-eeg 1 re-identification 1 audio-visual-learning 1 vqa 1 visual-reasoning 1 videonavqa 1 video 1 question-answering 1 navigation 1 multimodal 1 embodied 1 deep-neural-networks 1 conditioning 1 benchmark 1 human-object-interaction 1 end-to-end-pipeline 1 detr 1 detection 1 zero-shot-learning 1 sketch-based-image-retrieval 1 generative-model 1 cycle-gan 1 vision-language 1 image-retrieval 1 cross-modality-re-identification 1 awesome-reid 1 awesome 1 time-series-forecasting 1 time-series-forecast 1 time-series-analysis 1 time-series 1 prompt-tuning 1 multimodal-time-series 1 multimodal-deep-learning 1 large-language-models 1 cross-modal-learning 1 protein-rna-interactions 1 protein-dna-interactions 1 visual-to-sound 1 visual-audio 1 vas 1 synchronization 1 audioset 1 audio-generation 1 diffusion-models 1 controllable-generation 1 conditional-generation 1 aigc 1 visual-language-models 1 pretrained-models 1 multi-modal 1 bidirectional-retrieval 1 sentence2vec 1 sentence-encoding 1 pytorch 1 openai 1 onnx 1