Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: video-prediction

thuml/iVideoGPT

Official repo for "iVideoGPT: Interactive VideoGPTs are Scalable World Models", https://arxiv.org/abs/2405.15223

Size: 1.44 MB - Last synced: about 15 hours ago - Pushed: 1 day ago - Stars: 9 - Forks: 0

JunyaoHu/common_metrics_on_video_quality

You can easily calculate FVD, PSNR, SSIM, LPIPS for evaluating the quality of generated or predicted videos.

Language: Python - Size: 44.2 MB - Last synced: 12 days ago - Pushed: 12 days ago - Stars: 115 - Forks: 4

danijar/dreamerv2

Mastering Atari with Discrete World Models

Language: Python - Size: 2.12 MB - Last synced: 10 days ago - Pushed: over 1 year ago - Stars: 860 - Forks: 192

google/e3d_lstm

e3d-lstm; Eidetic 3D LSTM A Model for Video Prediction and Beyond

Language: Python - Size: 97.7 KB - Last synced: 20 days ago - Pushed: almost 2 years ago - Stars: 186 - Forks: 58

nihaomiao/CVPR23_LFDM

The pytorch implementation of our CVPR 2023 paper "Conditional Image-to-Video Generation with Latent Flow Diffusion Models"

Language: Python - Size: 26.4 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 415 - Forks: 40

jeremy-collins/sd-video-gen

Video generation using Stable Diffusion.

Language: Python - Size: 374 MB - Last synced: about 1 month ago - Pushed: 9 months ago - Stars: 5 - Forks: 0

PRBonn/point-cloud-prediction

Self-supervised Point Cloud Prediction Using 3D Spatio-temporal Convolutional Networks

Language: Python - Size: 4.12 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 137 - Forks: 24

pairlab/SlotFormer

Code release for ICLR 2023 paper: SlotFormer on object-centric dynamics models

Language: Python - Size: 19.6 MB - Last synced: about 1 month ago - Pushed: 8 months ago - Stars: 91 - Forks: 19

Yunbo426/MIM

Code release for "Memory In Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity from Spatiotemporal Dynamics" (CVPR 2019)

Language: Python - Size: 112 KB - Last synced: about 2 months ago - Pushed: over 4 years ago - Stars: 144 - Forks: 38

thuml/predrnn-pytorch

Official implementation for NIPS'17 paper: PredRNN: Recurrent Neural Networks for Predictive Learning Using Spatiotemporal LSTMs.

Language: Python - Size: 26.9 MB - Last synced: about 2 months ago - Pushed: 7 months ago - Stars: 391 - Forks: 99

dadadadawjb/awesome-video-prediction

A curated list of awesome video prediction papers

Size: 227 KB - Last synced: about 2 months ago - Pushed: about 1 year ago - Stars: 9 - Forks: 1

taldatech/ddlp

[TMLR 2024] Official PyTorch Implementation of Deep Dynamic Latent Particles

Language: Jupyter Notebook - Size: 1.95 MB - Last synced: 23 days ago - Pushed: 4 months ago - Stars: 12 - Forks: 1

chengtan9907/OpenSTL

OpenSTL: A Comprehensive Benchmark of Spatio-Temporal Predictive Learning

Language: Python - Size: 2.45 MB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 548 - Forks: 90

xzr12/PredCNN

Code release for "PredCNN: Predictive Learning with Cascade Convolutions" (IJCAI 2018)

Language: Python - Size: 38.3 MB - Last synced: 2 months ago - Pushed: almost 6 years ago - Stars: 25 - Forks: 12

Westlake-AI/MogaNet

[ICLR 2024] MogaNet: Efficient Multi-order Gated Aggregation Network

Language: Jupyter Notebook - Size: 4.13 MB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 114 - Forks: 12

AIS-Bonn/vp-suite

A general framework for video prediction in PyTorch.

Language: Python - Size: 47.5 MB - Last synced: 26 days ago - Pushed: almost 2 years ago - Stars: 23 - Forks: 9

Westlake-AI/SEMA

Switch EMA: A Free Lunch for Better Flatness and Sharpness

Language: Python - Size: 2.19 MB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 1 - Forks: 0

Mahpara/Self-supervised-Video-Prediction

Language: Jupyter Notebook - Size: 417 KB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 0 - Forks: 0

angelvillar96/SynpickVP

Helpers for loading, perprocessing and visualizing the SynpickVP dataset for video-based prediciton tasks

Language: HTML - Size: 23.6 MB - Last synced: about 1 month ago - Pushed: 9 months ago - Stars: 1 - Forks: 0

angelvillar96/MSPred

Official implementation of "Video Prediction at Multiple Spatio-Temporal Scales with Hierarchical Recurrent Networks." by Villar-Corrales et al.

Language: Python - Size: 78.1 KB - Last synced: about 1 month ago - Pushed: 10 months ago - Stars: 5 - Forks: 0

kaanakan/slamp

SLAMP: Stochastic Latent Appearance and Motion Prediction

Language: Python - Size: 62.5 KB - Last synced: 4 months ago - Pushed: about 1 year ago - Stars: 40 - Forks: 3

johnjaejunlee95/SA_ConvLSTM

Language: Python - Size: 16.2 MB - Last synced: 5 months ago - Pushed: 5 months ago - Stars: 0 - Forks: 0

iarai/weather4cast

Code accompanying our IARAI Weather4cast Challenge

Language: Jupyter Notebook - Size: 4.36 MB - Last synced: 4 months ago - Pushed: about 2 years ago - Stars: 41 - Forks: 15

penn-pal-lab/robot_aware_control

Code for "Know Thyself: Transferable Visual Control Policies Through Robot-Awareness" (ICLR 22)

Language: Jupyter Notebook - Size: 85.7 MB - Last synced: 6 months ago - Pushed: over 1 year ago - Stars: 7 - Forks: 1

tsujuifu/pytorch_tvc

A PyTorch implementation of TVC

Language: Jupyter Notebook - Size: 8.56 MB - Last synced: 5 months ago - Pushed: 5 months ago - Stars: 14 - Forks: 0

alexlee-gk/video_prediction

Stochastic Adversarial Video Prediction

Language: Python - Size: 23.5 MB - Last synced: 7 months ago - Pushed: over 4 years ago - Stars: 299 - Forks: 65

AIS-Bonn/OCVP-object-centric-video-prediction

Official implementation of: "Object-Centric Video Prediction via Decoupling of Object Dynamics and Interactions" by Villar-Corrales et al. ICIP 2023

Language: Python - Size: 3.01 MB - Last synced: 7 months ago - Pushed: 8 months ago - Stars: 11 - Forks: 1

Yunbo426/predrnn-pp

Code release for "PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learning" (ICML 2018)

Language: Python - Size: 22.5 KB - Last synced: 7 months ago - Pushed: over 4 years ago - Stars: 230 - Forks: 85

AlexanderMelde/SPHAR-Dataset

Surveillance Perspective Human Action Recognition Dataset: 7759 Videos from 14 Action Classes, aggregated from multiple sources, all cropped spatio-temporally and filmed from a surveillance-camera like position.

Language: Python - Size: 5.47 GB - Last synced: 7 months ago - Pushed: over 3 years ago - Stars: 49 - Forks: 11

zcrwind/PredNet_pytorch

A pytorch reimplement of PredNet, which is a deep recurrent convolutional neural network for video prediction and unsupervised learning.

Language: Python - Size: 31.9 MB - Last synced: 9 months ago - Pushed: over 4 years ago - Stars: 23 - Forks: 11

juliuskunze/cwvae-jax

Clockwork VAEs in JAX/Flax

Language: Python - Size: 14.6 KB - Last synced: 10 months ago - Pushed: almost 3 years ago - Stars: 28 - Forks: 3

JunyaoHu/pred-vdm

PredVDM: A Video Prediction Model based on Latent Diffusion

Language: Python - Size: 656 KB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 1 - Forks: 0

thuml/MotionRNN

About Code release for "MotionRNN: A Flexible Model for Video Prediction with Spacetime-Varying Motions" (CVPR 2021) https://arxiv.org/abs/2103.02243

Language: Python - Size: 2.51 MB - Last synced: 11 months ago - Pushed: 11 months ago - Stars: 30 - Forks: 6

tumeteor/neurips2019challenge

Solution for our Neurips 2019 challenge on traffic movie forecasting

Language: Python - Size: 23.4 KB - Last synced: 9 months ago - Pushed: over 1 year ago - Stars: 8 - Forks: 1

Westlake-AI/UniWeat

Unified Framework for Weather Prediction

Language: Python - Size: 617 KB - Last synced: 12 months ago - Pushed: 12 months ago - Stars: 4 - Forks: 0

arnavkj1995/VSG

Learning Robust Dynamics Through Variational Sparse Gating

Language: Python - Size: 142 KB - Last synced: 10 months ago - Pushed: over 1 year ago - Stars: 19 - Forks: 1

edouardelasalles/srvp

Official implementation of the paper Stochastic Latent Residual Video Prediction

Language: Python - Size: 127 KB - Last synced: about 1 year ago - Pushed: about 2 years ago - Stars: 74 - Forks: 16

Eliyas0007/MovingMNIST-Generator

This is a MovingMNIST dataset generator

Language: Python - Size: 90.8 KB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 5 - Forks: 1

Eliyas0007/RNNbasedVideoPrediction

RNN based video next frame prediction

Language: Python - Size: 1.06 MB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 7 - Forks: 1

adnortje/deepvideo

Deep learning for video compression.

Language: Jupyter Notebook - Size: 1.2 MB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 39 - Forks: 8

halixness/deepSWE

Flood prediction on aerial-views with deep learning. Based on PARFLOOD from HyLab, University of Parma.

Language: Python - Size: 93.8 MB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 2 - Forks: 0

SSU-CVLAB/Video_Prediction_Overview

Quick Overview of Video Prediction with Deep Learning

Size: 24.4 KB - Last synced: 12 months ago - Pushed: almost 4 years ago - Stars: 5 - Forks: 2

aserdega/convlstmgru

Pytorch implementations of ConvLSTM and ConvGRU modules with examples

Language: Python - Size: 86.9 KB - Last synced: about 1 year ago - Pushed: almost 3 years ago - Stars: 51 - Forks: 15

iamrakesh28/Video-Prediction

Implementation of Transformer Encoder Decoder Architecture for Video Predictions

Language: Python - Size: 4.17 MB - Last synced: over 1 year ago - Pushed: almost 3 years ago - Stars: 24 - Forks: 5

sangmin-git/LMC-Memory

Official PyTorch implementation of "Video Prediction Recalling Long-term Motion Context via Memory Alignment Learning" (CVPR 2021 Oral)

Language: Python - Size: 19.5 KB - Last synced: about 1 year ago - Pushed: almost 3 years ago - Stars: 71 - Forks: 21

holmdk/Video-Prediction-using-PyTorch

Video Predicting using ConvLSTM and pytorch

Language: Python - Size: 2.11 MB - Last synced: about 1 year ago - Pushed: about 3 years ago - Stars: 78 - Forks: 27

vineeths96/Video-Frame-Prediction

In this repository, we focus on video frame prediction the task of predicting future frames given a set of past frames. We present an Adversarial Spatio-Temporal Convolutional LSTM architecture to predict the future frames of the Moving MNIST Dataset. We evaluate the model on long-term future frame prediction and its performance of the model on out-of-domain inputs by providing sequences on which the model was not trained.

Language: Python - Size: 70.8 MB - Last synced: about 1 year ago - Pushed: almost 3 years ago - Stars: 11 - Forks: 4

halixness/generative_timesformer_pytorch

Experimental fork of TimeSformer from Facebook AI to extend the attention-based model to video generation.

Language: Python - Size: 156 KB - Last synced: about 1 year ago - Pushed: about 3 years ago - Stars: 1 - Forks: 0

halixness/soa-video-prediction-21

Collection of High Performance Deep Learning Models for Video Prediction with experiments

Language: Python - Size: 226 KB - Last synced: about 1 year ago - Pushed: about 3 years ago - Stars: 2 - Forks: 2

I2-Multimedia-Lab/Dilated-CNN-based-deep-reference-picture-generation Fork of luka0714/OurProject

Dilated convolutional neural network-based deep reference picture generation for video compression (ICASSP 2022)

Size: 108 MB - Last synced: about 1 year ago - Pushed: about 2 years ago - Stars: 0 - Forks: 0

Xiaoyin96/SRIP19_SelfDriving

Multiple driving action prediction model using Faster-RCNN and object-centric network.

Language: Jupyter Notebook - Size: 29.8 MB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 7 - Forks: 3

halixness/Generative-TimeSformer-pytorch Fork of lucidrains/TimeSformer-pytorch

Experimental fork of TimeSformer from Facebook AI to extend the attention-based model to video generation.

Language: Python - Size: 176 KB - Last synced: about 1 year ago - Pushed: about 3 years ago - Stars: 1 - Forks: 1

KUIS-AI/slamp

Website for our ICCV 2021 paper "SLAMP: Stochastic Latent Appearance and Motion Prediction". Preprint: https://arxiv.org/abs/2108.02760

Language: HTML - Size: 25.9 MB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 2 - Forks: 0

AlexanderMelde/S-SPHAR-Dataset

Synthetically Generated Surveillance Perspective Human Action Recognition Dataset: 6901 Videos from 10 action classes, made by a 3D Simulation, all cropped spatio-temporally and filmed from a surveillance-camera like position.

Size: 1020 MB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 2 - Forks: 0

AlbertoCenzato/dnn_bouncing_balls

Language: Python - Size: 207 KB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 0 - Forks: 1

Related Keywords
video-prediction 55 deep-learning 22 pytorch 18 computer-vision 8 machine-learning 7 video 6 vae 5 video-generation 5 convlstm 4 stochastic 4 self-supervised-learning 4 artificial-intelligence 4 transformer 4 lstm 3 unsupervised-learning 3 weather-forecast 3 neural-networks 3 moving-mnist 3 dataset 3 attention 3 model-based-reinforcement-learning 3 world-models 3 research 3 cnn 2 surveillance-systems 2 frame-prediction 2 human-activity-recognition 2 object-detection 2 benchmark 2 planning 2 generative-adversarial-network 2 human-action-recognition 2 rnn 2 video-compression 2 predictive-learning 2 video-prediction-models 2 reinforcement-learning 2 action-recognition 2 cctv 2 cctv-detection 2 video-dataset 2 tensorflow 2 cvpr2023 2 image-classification 2 video-classification 2 transfer-learning 2 latent-variable-models 2 optical-flow 2 robotics 2 diffusion 2 iccv2021 2 generative-model 2 vit 2 timesformer 2 facebook 2 ai 2 spatio-temporal-modeling 2 dnn 1 transformers 1 object-centric-video-prediction 1 object-centric-learning 1 variational-autoencoder 1 vae-gan 1 gan 1 adversarial 1 vision-and-language 1 video-completion 1 iclr 1 temperature 1 satellite-imagery 1 precipitation 1 nowcasting 1 visual-planning 1 surveillance-perspective 1 generative 1 video-forecasting 1 self-driving-car 1 i3d 1 bdd-dataset 1 state-of-the-art 1 google 1 video-processing 1 pytorch-lightning 1 cvpr2021 1 transformer-architecture 1 encoder-decoder-architecture 1 conv-lstm 1 seq-to-seq 1 encoder-decoder 1 convgru 1 bouncing-mnist 1 readme 1 probability 1 overview 1 pinns 1 neural-network 1 mnist-dataset 1 icml-2020 1 deep-reinforcement-learning 1 predictive-modeling 1