Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: cross-modal-learning

Repositories

whwu95/Text4Vis

【AAAI'2023 & IJCV】Transferring Vision-Language Models for Visual Recognition: A Classifier Perspective

Language: Python - Size: 8.66 MB - Last synced: 6 months ago - Pushed: 6 months ago - Stars: 149 - Forks: 13

KimMeen/Time-LLM

[ICLR 2024] Official implementation of " 🦙 Time-LLM: Time Series Forecasting by Reprogramming Large Language Models"

Language: Python - Size: 1.04 MB - Last synced: 29 days ago - Pushed: 29 days ago - Stars: 765 - Forks: 121

RunpeiDong/ACT

[ICLR 2023] Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?

Language: Python - Size: 5.49 MB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 87 - Forks: 5

MohamedAfham/CrossPoint

Official implementation of "CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understanding" (CVPR, 2022)

Language: Python - Size: 1.99 MB - Last synced: 2 months ago - Pushed: about 1 year ago - Stars: 221 - Forks: 29

Toytiny/CMFlow

[CVPR 2023 Highlight] Hidden Gems: 4D Radar Scene Flow Learning Using Cross-Modal Supervision

Language: Python - Size: 289 MB - Last synced: 3 months ago - Pushed: 11 months ago - Stars: 101 - Forks: 12

[IJBHI 2023] This is the official implementation of CAMANet: Class Activation Map Guided Attention Network for Radiology Report Generation accepted to IEEE Journal of Biomedical and Health Informatics (J-BHI), 2023.

Language: Python - Size: 115 MB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 3 - Forks: 0

codiceSpaghetti/T4SA-2.0

This project creates the T4SA 2.0 dataset, i.e. a big set of data to train visual models for Sentiment Analysis in the Twitter domain using a cross-modal student-teacher approach.

Language: Jupyter Notebook - Size: 2.73 GB - Last synced: about 2 months ago - Pushed: over 1 year ago - Stars: 3 - Forks: 1

whwu95/Cap4Video

【CVPR'2023 Highlight】Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?

Language: Python - Size: 8.56 MB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 159 - Forks: 10

whwu95/BIKE

【CVPR'2023】Bidirectional Cross-Modal Knowledge Exploration for Video Recognition with Pre-trained Vision-Language Models

Language: Python - Size: 9.03 MB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 134 - Forks: 14

IGITUGraz/MemoryDependentComputation

Code for Limbacher, T., Özdenizci, O., & Legenstein, R. (2022). Memory-enriched computation and learning in spiking neural networks through Hebbian plasticity. arXiv preprint arXiv:2205.11276.

Language: Python - Size: 3.63 MB - Last synced: 8 months ago - Pushed: about 1 year ago - Stars: 6 - Forks: 3

verlab/StraightToThePoint_CVPR_2020

Original PyTorch implementation of the code for the paper "Straight to the Point: Fast-forwarding Videos via Reinforcement Learning Using Textual Data" at the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2020

Language: Python - Size: 27.4 MB - Last synced: 10 months ago - Pushed: about 2 years ago - Stars: 8 - Forks: 1

frank-chris/ImageTextRetrieval

In this work, we implement different cross-modal learning schemes such as Siamese Network, Correlational Network and Deep Cross-Modal Projection Learning model and study their performance. We also propose a modified Deep Cross-Modal Projection Learning model that uses a different image feature extractor. We evaluate the model’s performance on image-text retrieval on a fashion clothing dataset.

Language: Jupyter Notebook - Size: 6.88 MB - Last synced: about 1 year ago - Pushed: almost 3 years ago - Stars: 9 - Forks: 2