A curated list of papers and resources linked to Action Anticipation and Early Action Recognition from videos.
If you find this list useful, please consider to give a star ⭐ !
Action Anticipation Papers
- Learning to Anticipate Egocentric Actions by Imagination - Y. Wu et al. - TIP, 2021.
 - Anticipative Video Transformer - Girdhar et al. - arXiv, 2021.
 
- Forecasting Human-Object Interaction: Joint Prediction of Motor Attention and Actions in First Person Video - M. Liu et al. - ECCV, 2020.
 - Rolling-Unrolling LSTMs for Action Anticipation from First-Person Video - A. Furnari, G. M. Farinella - PAMI, 2020.
 - Temporal Aggregate Representations for Long-Range Video Understanding - F. Sener et al. - ECCV, 2020.
 - TTPP: Temporal Transformer with Progressive Prediction for Efficient Action Anticipation - W. Wang et al. - arXiv, 2020.
 
- Leveraging the Present to Anticipate the Future in Videos - A. Miech et al. - CVPRW, 2019.
 - Predicting the Future: A Jointly Learnt Model for Action Anticipation - H. Gammulle et al. - ICCV, 2019.
 - Time-Conditioned Action Anticipation in One Shot - Q. Ke et al. - CVPR, 2019.
 - What Would You Expect? Anticipating Egocentric Actions With Rolling-Unrolling LSTMs and Modality Attention - A. Furnari and G. M. Farinella - ICCV, 2019.
 
- Action Anticipation By Predicting Future Dynamic Images - C. Rodriguez et al. - ECCVW, 2018.
 
- Encouraging LSTMs to Anticipate Actions Very Early - M. S. Aliakbarian et al. - ICCV, 2017.
 
Early Action Recognition Papers
- Rolling-Unrolling LSTMs for Action Anticipation from First-Person Video - Furnari et al - PAMI, 2020.
 
- What Would You Expect? Anticipating Egocentric Actions With Rolling-Unrolling LSTMs and Modality Attention - Furnari et al - ICCV, 2019.
 - Predicting the Future: A Jointly Learnt Model for Action Anticipation - Gammulle et al - ICCV, 2019.
 - Spatiotemporal Feature Residual Propagation for Action Prediction - Zhao et al - ICCV, 2019.
 - Relational Action Forecasting - Sun et al - CVPR, 2020.
 - Progressive Teacher-student Learning for Early Action Prediction - Wang et al - CVPR, 2019.
 - Action Anticipation with RBF Kernelized Feature Mapping RNN - Chen et al - ECCV, 2018.
 
- Part-Activated Deep Reinforcement Learning for Action Prediction - Chen et al - ECCV, 2018.
 - Temporal Relational Reasoning in Videos - Zhou et al - ECCV, 2018.
 - Human Action Recognition and Prediction: A Survey - Kong et al - arxiv, 2018.
 - SSNet: Scale Selection Network for Online 3D Action Prediction - Liu et al - CVPR, 2018.
 - Action Prediction from Videos via Memorizing Hard-to-Predict Samples - Kong et al - AAAI, 2018.
 - On Encoding Temporal Evolution for Real-time Action Prediction - Rezazadegan et al - arXiv, 2018.
 
- Predictive Learning: Using Future Representation Learning Variantial Autoencoder for Human Action Prediction - Runsheng et al - arXiv, 2017.
 - Encouraging LSTMs to Anticipate Actions Very Early - Aliakbarian et al - ICCV, 2017.
 - Online Real-time Multiple Spatiotemporal Action Localisation and Prediction - Singh et al - ICCV, 2017.
 - Visual Forecasting by Imitating Dynamics in Natural Sequences - *Zeng et al *- ICCV, 2017.
 - Binary Coding for Partial Action Analysis with Limited Observation Ratios - Qin et al - CVPR, 2017.
 - Deep Sequential Context Networks for Action Prediction - Kong et al - CVPR, 2017.
 - RED: Reinforced Encoder-Decoder Networks for Action Anticipation - Gao et al - BMVC, 2017.
 
- Anticipating Visual Representations from Unlabeled Video - Vondrick et al - CVPR, 2016.
 - Learning Activity Progression in LSTMs for Activity Detection and Early Detection - Ma et al - CVPR, 2016.
 - Deep Action- and Context-Aware Sequence Learning for Activity Recognition and Anticipation - Aliakbarian et al - arXiv, 2016.
 
- A hierarchical representation for future action prediction - Lan et al - ECCV, 2014.
 - A Discriminative Model with Multiple Temporal Scales for Action Prediction - Kong et al - ECCV, 2014.
 
- Human activity prediction: Early recognition of ongoing activities from streaming videos - Ryoo et al - ICCV, 2011.
 
Action Anticipation Datasets
Early Action Recognition Datasets
Competitions
Contributions are most welcome, if you have any suggestions and improvements, please create an issue or raise a pull request.
Note that:
- This list is not exhaustive.
 - The lists use alphabetical order for fairness.