Must Read Papers for Data Science, ML, and DL
Curated collection of Data Science, Machine Learning and Deep Learning papers, reviews and articles that are on must read list.โ
๐ READ THIS ๐โ
๐ Reading paper with heavy math is hard, it takes time and effort to understand, most of it is dedication and motivation to not quit, don't be discouraged, read once, read twice, read thrice,... until it clicks and blows you away.
๐ฅ - Read it first
๐ฅ - Read it second
๐ฅ - Read it third
Data Scienceโ
๐ Pre-processing & EDAโ
๐ฅ ๐Data preprocessing - Tidy data - by Hadley Wickham
๐ General DSโ
๐ฅ ๐ Statistical Modeling: The Two Cultures - by Leo Breiman
๐ฅ ๐ Frequentism and Bayesianism: A Python-driven Primer by Jake VanderPlas
Machine Learningโ
๐ฏ General MLโ
๐ฅ ๐ A Brief Introduction into Machine Learning - by Gunnar Ratsch
๐ฅ ๐ On Model Stability as a Function of Random Seed
๐ Outlier/Anomaly detectionโ
๐ฅ ๐ฐ Outlier Detection : A Survey
๐ Boostingโ
๐ฅ ๐ XGBoost: A Scalable Tree Boosting System
๐ฅ ๐ LightGBM: A Highly Efficient Gradient BoostingDecision Tree
๐ฅ ๐ AdaBoost and the Super Bowl of Classifiers - A Tutorial Introduction to Adaptive Boosting
๐ฅ ๐ Greedy Function Approximation: A Gradient Boosting Machine
:book: Unraveling Blackbox MLโ
๐ฅ ๐ Data Shapley: Equitable Valuation of Data for Machine Learning
โ๏ธ Dimensionality Reductionโ
๐ฅ ๐ A Tutorial on Principal Component Analysis
๐ฅ ๐ How to Use t-SNE Effectively
๐ฅ ๐ Visualizing Data using t-SNE
๐ Optimizationโ
๐ฅ ๐ A Tutorial on Bayesian Optimization
๐ฅ ๐ Taking the Human Out of the Loop: A review of Bayesian Optimization
Famous Blogsโ
๐ฑ ๐ฎ Recommendersโ
Surveysโ
๐ฅ ๐ A Survey of Collaborative Filtering Techniques
๐ฅ ๐ Collaborative Filtering Recommender Systems
๐ฅ ๐ Deep Learning Based Recommender System: A Survey and New Perspectives
๐ฅ ๐ ๐ค โญ Explainable Recommendation: A Survey and New Perspectives โญ
Case Studiesโ
๐ฅ ๐ The Netflix Recommender System: Algorithms, Business Value,and Innovation
- ๐ Netflix Medium Blog
๐ฅ ๐ Two Decades of Recommender Systems at Amazon.com
๐ฅ ๐ How Does Spotify Know You So Well?
๐ More In-Depth study, ๐ Recommender Systems Handbook
Famous Deep Learning Blogs ๐ค โ
๐ Stanford UFLDL Deep Learning Tutorial
๐ Distill.pub
๐ Colah's Blog
๐ Andrej Karpathy
๐ Zack Lipton
๐ Sebastian Ruder
๐ Jay Alammar
๐ Neural Networks and Deep Learning Neural Networksโ
โญ ๐ฅ ๐ฐ The Matrix Calculus You Need For Deep Learning - Terence Parr and Jeremy Howard โญ
๐ฅ ๐ฐ Deep learning -Yann LeCun, Yoshua Bengio & Geoffrey Hinton
๐ฅ ๐ Generalization in Deep Learning
๐ฅ ๐ Topology of Learning in Artificial Neural Networks
๐ฅ ๐ Dropout: A Simple Way to Prevent Neural Networks from Overfitting
๐ฅ ๐ Polynomial Regression As an Alternative to Neural Nets
๐ฅ ๐ The Neural Network Zoo
๐ฅ ๐ Image Completion with Deep Learning in TensorFlow
๐ฅ ๐ Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
๐ฅ ๐ A systematic study of the class imbalance problem in convolutional neural networks
๐ฅ ๐ All Neural Networks are Created Equal
๐ฅ ๐ Adam: A Method for Stochastic Optimization
๐ฅ ๐ AutoML: A Survey of the State-of-the-Art
๐ผ CNNsโ
๐ฅ ๐ Visualizing and Understanding Convolutional Networks -by Andrej Karpathy Justin Johnson Li Fei-Fei
๐ฅ ๐ Deep Residual Learning for Image Recognition
๐ฅ ๐AlexNet-ImageNet Classification with Deep Convolutional Neural Networks
๐ฅ ๐VGG Net-VERY DEEP CONVOLUTIONAL NETWORKS FOR LARGE-SCALE IMAGE RECOGNITION
๐ฅ ๐ A Mathematical Theory of Deep Convolutional Neural Networks for Feature Extraction
๐ฅ ๐ Large-scale Video Classification with Convolutional Neural Networks
๐ฅ ๐ Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering
โซ CapsNet ๐ฑโ
๐ฅ ๐ Dynamic Routing Between Capsules
-
Blog explaning, "What are CapsNet, or Capsule Networks?"
๐ ๐ฌ Image Captioningโ
๐ฅ ๐ Show and Tell: A Neural Image Caption Generator
๐ฅ ๐ Neural Machine Translation by Jointly Learning to Align and Translate
๐ฅ ๐ StyleNet: Generating Attractive Visual Captions with Styles
๐ฅ ๐ Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
๐ฅ ๐ Where to put the Image in an Image Caption Generator
๐ฅ ๐ Dank Learning: Generating Memes Using Deep Neural Networks
:car: ๐ถ Object Detection ๐ฆ ๐โ
๐ฅ ๐ResNet-Deep Residual Learning for Image Recognition
๐ฅ ๐ YOLO-You Only Look Once: Unified, Real-Time Object Detection
๐ฅ ๐ Microsoft COCO: Common Objects in Context
๐ฅ ๐ (R-CNN) Rich feature hierarchies for accurate object detection and semantic segmentation
๐ฅ ๐ Fast R-CNN
- ๐ป Papers with Code
๐ฅ ๐ Faster R-CNN
- ๐ป Papers with Code
๐ฅ ๐ Mask R-CNN
- ๐ป Papers with Code
:car: ๐ถ ๐ซ Pose Detection :runner: ๐โ
๐ฅ ๐ DensePose: Dense Human Pose Estimation In The Wild
- ๐ป Papers with Code
๐ฅ ๐ Parsing R-CNN for Instance-Level Human Analysis
- ๐ป Papers with Code
๐ก ๐ฃ Deep NLP ๐ฑ ๐ขโ
๐ฅ ๐ A Primer on Neural Network Models for Natural Language Processing
๐ฅ ๐ Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
๐ฅ ๐ On the Properties of Neural Machine Translation: EncoderโDecoder Approaches
๐ฅ ๐ LSTM: A Search Space Odyssey - by Klaus Greff et al.
๐ฅ