计算机视觉常见的五大任务：盘点影响计算机视觉Top100论文从ResNet到AlexNet

计算机视觉常见的五大任务：盘点影响计算机视觉Top100论文从ResNet到AlexNetImageNet分类经典论文今年2月，新智元曾经向大家介绍了近5年100篇被引用次数最多的深度学习论文，覆盖了优化/训练方法、无监督/生成模型、卷积网络模型和图像分割/目标检测等十大子领域。【进入新智元公众号，在对话框输入“论文100”下载这份经典资料】上述的深度学习被引用最多的100篇论文是Github上的一个开源项目，社区的成员都可以参与。在这个项目上，我们发现了另一个项目——Deep Vision，这是一个关于计算机视觉资源的项目，包含了近年来对该领域影响最大的论文、图书和博客等的汇总。其中在论文部分，作者也分为ImageNet 分类、物体检测、物体追踪、物体识别、图像与语言和图像生成等多个方向进行介绍。

1新智元编译

来源：github

编译整理： 新智元编辑部

【新智元导读】计算机视觉近年来获得了较大的发展，代表了深度学习最前沿的研究方向。本文梳理了2012到2017年计算机视觉领域的大事件：以论文和其他干货资源为主，并附上资源地址。囊括上百篇论文，分ImageNet 分类、物体检测、物体追踪、物体识别、图像与语言和图像生成等多个方向进行介绍。

今年2月，新智元曾经向大家介绍了近5年100篇被引用次数最多的深度学习论文，覆盖了优化/训练方法、无监督/生成模型、卷积网络模型和图像分割/目标检测等十大子领域。

【进入新智元公众号，在对话框输入“论文100”下载这份经典资料】

上述的深度学习被引用最多的100篇论文是Github上的一个开源项目，社区的成员都可以参与。在这个项目上，我们发现了另一个项目——Deep Vision，这是一个关于计算机视觉资源的项目，包含了近年来对该领域影响最大的论文、图书和博客等的汇总。其中在论文部分，作者也分为ImageNet 分类、物体检测、物体追踪、物体识别、图像与语言和图像生成等多个方向进行介绍。

经典论文

ImageNet分类

物体检测

物体跟踪

低级视觉

• 超分辨率

• 其他应用

边缘检测

语义分割

视觉注意力和显著性

物体识别

人体姿态估计

CNN原理和性质（Understanding CNN）

图像和语言

• 图像解说

• 视频解说

• 问答

图像生成

上面是根据这些论文、作者、机构的一些关键词制作的热图。

ImageNet分类

图片来源：AlexNet论文

• 微软ResNet

论文：用于图像识别的深度残差网络

作者：何恺明、张祥雨、任少卿和孙剑

• 微软PRelu（随机纠正线性单元/权重初始化）

论文：深入学习整流器：在ImageNet分类上超越人类水平

作者：何恺明、张祥雨、任少卿和孙剑

链接：https://arxiv.org/pdf/1502.01852.pdf

• 谷歌Batch Normalization

论文：批量归一化：通过减少内部协变量来加速深度网络训练

作者：Sergey Ioffe Christian Szegedy

链接：https://arxiv.org/pdf/1502.03167.pdf

• 谷歌GoogLeNet

论文：更深的卷积，CVPR 2015

作者：Christian Szegedy Wei Liu Yangqing Jia Pierre Sermanet Scott Reed Dragomir Anguelov Dumitru Erhan Vincent Vanhoucke Andrew Rabinovich

链接：https://arxiv.org/pdf/1409.4842.pdf

• 牛津VGG-Net

论文：大规模视觉识别中的极深卷积网络，ICLR 2015

作者：Karen Simonyan & Andrew Zisserman

链接：https://arxiv.org/pdf/1409.1556.pdf

• AlexNet

论文：使用深度卷积神经网络进行ImageNet分类

作者：Alex Krizhevsky Ilya Sutskever Geoffrey E. Hinton

物体检测

图片来源：Faster-RCNN 论文

• PVANET

论文：用于实时物体检测的深度轻量神经网络（PVANET：Deep but Lightweight Neural Networks for Real-time Object Detection）

作者：Kye-Hyeon Kim Sanghoon Hong Byungseok Roh Yeongjae Cheon Minje Park

链接：https://arxiv.org/pdf/1608.08021

• 纽约大学OverFeat

论文：使用卷积网络进行识别、定位和检测（OverFeat: Integrated Recognition Localization and Detection using Convolutional Networks），ICLR 2014

作者：Pierre Sermanet David Eigen Xiang Zhang Michael Mathieu Rob Fergus Yann LeCun

链接：https://arxiv.org/pdf/1312.6229.pdf

• 伯克利R-CNN

论文：精确物体检测和语义分割的丰富特征层次结构（Rich feature hierarchies for accurate object detection and semantic segmentation），CVPR 2014

作者：Ross Girshick Jeff Donahue Trevor Darrell Jitendra Malik

链接：http://www.cv-foundation.org/openaccess/content_CVPR_2014/papers/Girshick_Rich_Feature_Hierarchies_2014_CVPR_paper.pdf

• 微软SPP

论文：视觉识别深度卷积网络中的空间金字塔池化（Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition），ECCV 2014

作者：何恺明、张祥雨、任少卿和孙剑

链接：https://arxiv.org/pdf/1406.4729.pdf

• 微软Fast R-CNN

论文：Fast R-CNN

作者：Ross Girshick

链接：https://arxiv.org/pdf/1504.08083.pdf

• 微软Faster R-CNN

论文：使用RPN走向实时物体检测（Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks）

作者：任少卿、何恺明、Ross Girshick、孙剑

链接：https://arxiv.org/pdf/1506.01497.pdf

• 牛津大学R-CNN minus R

论文：R-CNN minus R

作者：Karel Lenc Andrea Vedaldi

链接：https://arxiv.org/pdf/1506.06981.pdf

• 端到端行人检测

论文：密集场景中端到端的行人检测（End-to-end People Detection in Crowded Scenes）

作者：Russell Stewart Mykhaylo Andriluka

链接：https://arxiv.org/pdf/1506.04878.pdf

• 实时物体检测

论文：你只看一次：统一实时物体检测（You Only Look Once: Unified Real-Time Object Detection）

作者：Joseph Redmon Santosh Divvala Ross Girshick Ali Farhadi

链接：https://arxiv.org/pdf/1506.02640.pdf

• Inside-Outside Net

论文：使用跳跃池化和RNN在场景中检测物体（Inside-Outside Net: Detecting Objects in Context with Skip Pooling and Recurrent Neural Networks）

作者：Sean Bell C. Lawrence Zitnick Kavita Bala Ross Girshick

链接：https://arxiv.org/abs/1512.04143.pdf

• R-FCN

论文：通过区域全卷积网络进行物体识别（R-FCN: Object Detection via Region-based Fully Convolutional Networks）

作者：代季峰，李益，何恺明，孙剑

链接：https://arxiv.org/abs/1605.06409

• SSD

论文：单次多框检测器（SSD: Single Shot MultiBox Detector）

作者：Wei Liu Dragomir Anguelov Dumitru Erhan Christian Szegedy Scott Reed Cheng-Yang Fu Alexander C. Berg

链接：https://arxiv.org/pdf/1512.02325v2.pdf

• 速度/精度权衡

论文：现代卷积物体检测器的速度/精度权衡（Speed/accuracy trade-offs for modern convolutional object detectors）

作者：Jonathan Huang Vivek Rathod Chen Sun Menglong Zhu Anoop Korattikara Alireza Fathi Ian Fischer Zbigniew Wojna Yang Song Sergio Guadarrama Kevin Murphy

链接：https://arxiv.org/pdf/1611.10012v1.pdf

物体跟踪

论文：用卷积神经网络通过学习可区分的显著性地图实现在线跟踪（Online Tracking by Learning Discriminative Saliency Map with Convolutional Neural Network）

作者：Seunghoon Hong Tackgeun You Suha Kwak Bohyung Han

地址：arXiv:1502.06796.

论文：DeepTrack：通过视觉跟踪的卷积神经网络学习辨别特征表征（DeepTrack: Learning Discriminative Feature Representations by Convolutional Neural Networks for Visual Tracking）

作者：Hanxi Li Yi Li and Fatih Porikli

发表： BMVC 2014.

论文：视觉跟踪中，学习深度紧凑图像表示（Learning a Deep Compact Image Representation for Visual Tracking）

作者：N Wang DY Yeung

发表：NIPS 2013.

论文：视觉跟踪的分层卷积特征（Hierarchical Convolutional Features for Visual Tracking）

作者：Chao Ma Jia-Bin Huang Xiaokang Yang and Ming-Hsuan Yang

发表： ICCV 2015

论文：完全卷积网络的视觉跟踪（Visual Tracking with fully Convolutional Networks）

作者：Lijun Wang Wanli Ouyang Xiaogang Wang and Huchuan Lu

发表：ICCV 2015

论文：学习多域卷积神经网络进行视觉跟踪

（Learning Multi-Domain Convolutional Neural Networks for Visual Tracking）

作者：Hyeonseob Namand Bohyung Han

对象识别（Object Recognition）

论文：卷积神经网络弱监督学习（Weakly-supervised learning with convolutional neural networks）

作者：Maxime Oquab，Leon Bottou，Ivan Laptev，Josef Sivic，CVPR，2015

链接：http://www.cv-foundation.org/openaccess/content_cvpr_2015/papers/Oquab_Is_Object_Localization_2015_CVPR_paper.pdf

FV-CNN

论文：深度滤波器组用于纹理识别和分割（Deep Filter Banks for Texture Recognition and Segmentation）

作者：Mircea Cimpoi Subhransu Maji Andrea Vedaldi CVPR 2015.

链接：http://www.cv-foundation.org/openaccess/content_cvpr_2015/papers/Cimpoi_Deep_Filter_Banks_2015_CVPR_paper.pdf

人体姿态估计（Human Pose Estimation）

论文：使用 Part Affinity Field的实时多人2D姿态估计（Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields）

作者：Zhe Cao Tomas Simon Shih-En Wei and Yaser Sheikh CVPR 2017.

论文：Deepcut：多人姿态估计的联合子集分割和标签（Deepcut: Joint subset partition and labeling for multi person pose estimation）

作者：Leonid Pishchulin Eldar Insafutdinov Siyu Tang Bjoern Andres Mykhaylo Andriluka Peter Gehler and Bernt Schiele CVPR 2016.

论文：Convolutional pose machines

作者：Shih-En Wei Varun Ramakrishna Takeo Kanade and Yaser Sheikh CVPR 2016.

论文：人体姿态估计的 Stacked hourglass networks（Stacked hourglass networks for human pose estimation）

作者：Alejandro Newell Kaiyu Yang and Jia Deng ECCV 2016.

论文：用于视频中人体姿态估计的Flowing convnets（Flowing convnets for human pose estimation in videos）

作者：Tomas Pfister James Charles and Andrew Zisserman ICCV 2015.

论文：卷积网络和人类姿态估计图模型的联合训练（Joint training of a convolutional network and a graphical model for human pose estimation）

作者：Jonathan J. Tompson Arjun Jain Yann LeCun Christoph Bregler NIPS 2014.

理解CNN

论文：通过测量同变性和等价性来理解图像表示(Understanding image representations by measuring their equivariance and equivalence)

作者：Karel Lenc Andrea Vedaldi CVPR 2015.

链接：http://www.cv-foundation.org/openaccess/content_cvpr_2015/papers/Lenc_Understanding_Image_Representations_2015_CVPR_paper.pdf

论文：深度神经网络容易被愚弄：无法识别的图像的高置信度预测（Deep Neural Networks are Easily Fooled:High Confidence Predictions for Unrecognizable Images）

作者：Anh Nguyen Jason Yosinski Jeff Clune CVPR 2015.

链接：http://www.cv-foundation.org/openaccess/content_cvpr_2015/papers/Nguyen_Deep_Neural_Networks_2015_CVPR_paper.pdf

论文：通过反演理解深度图像表示（Understanding Deep Image Representations by Inverting Them）

作者：Aravindh Mahendran Andrea Vedaldi CVPR 2015

链接：http://www.cv-foundation.org/openaccess/content_cvpr_2015/papers/Mahendran_Understanding_Deep_Image_2015_CVPR_paper.pdf

论文：深度场景CNN中的对象检测器（Object Detectors Emerge in Deep Scene CNNs）

作者：Bolei Zhou Aditya Khosla Agata Lapedriza Aude Oliva Antonio Torralba ICLR 2015.

论文：用卷积网络反演视觉表示（Inverting Visual Representations with Convolutional Networks）

作者：Alexey Dosovitskiy Thomas Brox arXiv 2015.

论文：可视化和理解卷积网络（Visualizing and Understanding Convolutional Networks）

作者：Matthrew Zeiler Rob Fergus ECCV 2014.

链接：https://www.cs.nyu.edu/~fergus/papers/zeilerECCV2014.pdf

图像与语言

图像说明（Image Captioning）

图：(from Andrej Karpathy Li Fei-Fei Deep Visual-Semantic Alignments for Generating Image Description CVPR 2015.)

UCLA / Baidu

用多模型循环神经网络解释图像（Explain Images with Multimodal Recurrent Neural Networks）

Junhua Mao Wei Xu Yi Yang Jiang Wang Alan L. Yuille arXiv:1410.1090

Toronto

使用多模型神经语言模型统一视觉语义嵌入（Unifying Visual-Semantic Embeddings with Multimodal Neural Language Models）

Ryan Kiros Ruslan Salakhutdinov Richard S. Zemel arXiv:1411.2539.

Berkeley

用于视觉识别和描述的长期循环卷积网络（Long-term Recurrent Convolutional Networks for Visual Recognition and Description）

Jeff Donahue Lisa Anne Hendricks Sergio Guadarrama Marcus Rohrbach Subhashini Venugopalan Kate Saenko Trevor Darrell arXiv:1411.4389.

Google

看图写字：神经图像说明生成器（Show and Tell: A Neural Image Caption Generator）

Oriol Vinyals Alexander Toshev Samy Bengio Dumitru Erhan arXiv:1411.4555.

Stanford

用于生成图像描述的深度视觉语义对齐（Deep Visual-Semantic Alignments for Generating Image Description）

Andrej Karpathy Li Fei-Fei CVPR 2015.

UML / UT

使用深度循环神经网络将视频转换为自然语言（Translating Videos to Natural Language Using Deep Recurrent Neural Networks）

Subhashini Venugopalan Huijuan Xu Jeff Donahue Marcus Rohrbach Raymond Mooney Kate Saenko NAACL-HLT 2015.

CMU / Microsoft

学习图像说明生成的循环视觉表示（Learning a Recurrent Visual Representation for Image Caption Generation）

Xinlei Chen C. Lawrence Zitnick arXiv:1411.5654.

Xinlei Chen C. Lawrence Zitnick Mind’s Eye: A Recurrent Visual Representation for Image Caption Generation CVPR 2015

http://www.cs.cmu.edu/~xinleic/papers/cvpr15_rnn.pdf

Microsoft

从图像说明到视觉概念（From Captions to Visual Concepts and Back）

Hao Fang Saurabh Gupta Forrest Iandola Rupesh Srivastava Li Deng Piotr Dollár Jianfeng Gao Xiaodong He Margaret Mitchell John C. Platt C. Lawrence Zitnick Geoffrey Zweig CVPR 2015.

Univ. Montreal / Univ. Toronto

Show Attend and Tell：视觉注意力与神经图像标题生成（Show Attend and Tell: Neural Image Caption Generation with Visual Attention）

Kelvin Xu Jimmy Lei Ba Ryan Kiros Kyunghyun Cho Aaron Courville Ruslan Salakhutdinov Richard S. Zemel Yoshua Bengio arXiv:1502.03044 / ICML 2015

http://www.cs.toronto.edu/~zemel/documents/captionAttn.pdf

Idiap / EPFL / Facebook

基于短语的图像说明（Phrase-based Image Captioning）

Remi Lebret Pedro O. Pinheiro Ronan Collobert arXiv:1502.03671 / ICML 2015

UCLA / Baidu

像孩子一样学习：从图像句子描述快速学习视觉的新概念（Learning like a Child: Fast Novel Visual Concept Learning from Sentence Descriptions of Images）

Junhua Mao Wei Xu Yi Yang Jiang Wang Zhiheng Huang Alan L. Yuille arXiv:1504.06692

MS Berkeley

探索图像说明的最近邻方法（ Exploring Nearest Neighbor Approaches for Image Captioning）

Jacob Devlin Saurabh Gupta Ross Girshick Margaret Mitchell C. Lawrence Zitnick arXiv:1505.04467

图像说明的语言模型（Language Models for Image Captioning: The Quirks and What Works）

Jacob Devlin Hao Cheng Hao Fang Saurabh Gupta Li Deng Xiaodong He Geoffrey Zweig Margaret Mitchell arXiv:1505.01809

阿德莱德

具有中间属性层的图像说明（ Image Captioning with an Intermediate Attributes Layer）

Qi Wu Chunhua Shen Anton van den Hengel Lingqiao Liu Anthony Dick arXiv:1506.01144

蒂尔堡

通过图片学习语言(Learning language through pictures)

Grzegorz Chrupala Akos Kadar Afra Alishahi arXiv:1506.03694

蒙特利尔大学

使用基于注意力的编码器-解码器网络描述多媒体内容（Describing Multimedia Content using Attention-based Encoder-Decoder Networks）

Kyunghyun Cho Aaron Courville Yoshua Bengio arXiv:1507.01053

康奈尔

图像表示和神经图像说明的新领域（Image Representations and New Domains in Neural Image Captioning）

Jack Hessel Nicolas Savva Michael J. Wilber arXiv:1508.02091

MS City Univ. of HongKong

Learning Query and Image Similarities with Ranking Canonical Correlation Analysis

Ting Yao Tao Mei and Chong-Wah Ngo ICCV 2015

视频字幕（Video Captioning）

伯克利

Jeff Donahue Lisa Anne Hendricks Sergio Guadarrama Marcus Rohrbach Subhashini Venugopalan Kate Saenko Trevor Darrell Long-term Recurrent Convolutional Networks for Visual Recognition and Description CVPR 2015.

犹他州/ UML / 伯克利

Subhashini Venugopalan Huijuan Xu Jeff Donahue Marcus Rohrbach Raymond Mooney Kate Saenko Translating Videos to Natural Language Using Deep Recurrent Neural Networks arXiv:1412.4729.

微软

Yingwei Pan Tao Mei Ting Yao Houqiang Li Yong Rui Joint Modeling Embedding and Translation to Bridge Video and Language arXiv:1505.01861.

犹他州/ UML / 伯克利

Subhashini Venugopalan Marcus Rohrbach Jeff Donahue Raymond Mooney Trevor Darrell Kate Saenko Sequence to Sequence--Video to Text arXiv:1505.00487.

蒙特利尔大学/ 舍布鲁克

Li Yao Atousa Torabi Kyunghyun Cho Nicolas Ballas Christopher Pal Hugo Larochelle Aaron Courville Describing Videos by Exploiting Temporal Structure arXiv:1502.08029

MPI / 伯克利

Anna Rohrbach Marcus Rohrbach Bernt Schiele The Long-Short Story of Movie Description arXiv:1506.01698

多伦多大学 / MIT

Yukun Zhu Ryan Kiros Richard Zemel Ruslan Salakhutdinov Raquel Urtasun Antonio Torralba Sanja Fidler Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Books arXiv:1506.06724

蒙特利尔大学

Kyunghyun Cho Aaron Courville Yoshua Bengio Describing Multimedia Content using Attention-based Encoder-Decoder Networks arXiv:1507.01053

TAU / 美国南加州大学

Dotan Kaufman Gil Levi Tal Hassner Lior Wolf Temporal Tessellation for Video Annotation and Summarization arXiv:1612.06950.

图像生成

卷积/循环网络

论文：Conditional Image Generation with PixelCNN Decoders”

作者：Aäron van den Oord Nal Kalchbrenner Oriol Vinyals Lasse Espeholt Alex Graves Koray Kavukcuoglu

论文：Learning to Generate Chairs with Convolutional Neural Networks

作者：Alexey Dosovitskiy Jost Tobias Springenberg Thomas Brox

发表：CVPR 2015.

论文：DRAW: A Recurrent Neural Network For Image Generation

作者：Karol Gregor Ivo Danihelka Alex Graves Danilo Jimenez Rezende Daan Wierstra

发表：ICML 2015.

对抗网络

论文：生成对抗网络（Generative Adversarial Networks）

作者：Ian J. Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville Yoshua Bengio

发表：NIPS 2014.

论文：使用对抗网络Laplacian Pyramid 的深度生成图像模型（Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks）

作者：Emily Denton Soumith Chintala Arthur Szlam Rob Fergus

发表：NIPS 2015.

论文：生成模型演讲概述 （A note on the evaluation of generative models）

作者：Lucas Theis Aäron van den Oord Matthias Bethge

发表：ICLR 2016.

论文：变分自动编码深度高斯过程（Variationally Auto-Encoded Deep Gaussian Processes）

作者：Zhenwen Dai Andreas Damianou Javier Gonzalez Neil Lawrence

发表：ICLR 2016.

论文：用注意力机制从字幕生成图像 （Generating Images from Captions with Attention）

作者：Elman Mansimov Emilio Parisotto Jimmy Ba Ruslan Salakhutdinov

发表： ICLR 2016

论文：分类生成对抗网络的无监督和半监督学习（Unsupervised and Semi-supervised Learning with Categorical Generative Adversarial Networks）

作者：Jost Tobias Springenberg

发表：ICLR 2016

论文：用一个对抗检测表征（Censoring Representations with an Adversary）

作者：Harrison Edwards Amos Storkey

发表：ICLR 2016

论文：虚拟对抗训练实现分布式顺滑 （Distributional Smoothing with Virtual Adversarial Training）

作者：Takeru Miyato Shin-ichi Maeda Masanori Koyama Ken Nakae Shin Ishii

发表：ICLR 2016

论文：自然图像流形上的生成视觉操作（Generative Visual Manipulation on the Natural Image Manifold）

作者：朱俊彦 Philipp Krahenbuhl Eli Shechtman and Alexei A. Efros

发表： ECCV 2016.

论文：深度卷积生成对抗网络的无监督表示学习（Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks）

作者：Alec Radford Luke Metz Soumith Chintala

发表： ICLR 2016

问题回答

图：(from Stanislaw Antol Aishwarya Agrawal Jiasen Lu Margaret Mitchell Dhruv Batra C. Lawrence Zitnick Devi Parikh VQA: Visual Question Answering CVPR 2015 SUNw:Scene Understanding workshop)

弗吉尼亚大学 / 微软研究院

论文：VQA: Visual Question Answering CVPR 2015 SUNw:Scene Understanding workshop.

作者：Stanislaw Antol Aishwarya Agrawal Jiasen Lu Margaret Mitchell Dhruv Batra C. Lawrence Zitnick Devi Parikh

MPI / 伯克利

论文：Ask Your Neurons: A Neural-based Approach to Answering Questions about Images

作者：Mateusz Malinowski Marcus Rohrbach Mario Fritz

发布 ： arXiv:1505.01121.

多伦多

论文： Image Question Answering: A Visual Semantic Embedding Model and a New Dataset

作者：Mengye Ren Ryan Kiros Richard Zemel

发表： arXiv:1505.02074 / ICML 2015 deep learning workshop.

百度/ 加州大学洛杉矶分校

作者：Hauyuan Gao Junhua Mao Jie Zhou Zhiheng Huang Lei Wang 徐伟

论文：Are You Talking to a Machine? Dataset and Methods for Multilingual Image Question Answering

发表： arXiv:1505.05612.

POSTECH（韩国）

论文：Image Question Answering using Convolutional Neural Network with Dynamic Parameter Prediction

作者：Hyeonwoo Noh Paul Hongsuck Seo and Bohyung Han

发表： arXiv:1511.05765

CMU / 微软研究院

论文：Stacked Attention Networks for Image Question Answering

作者：Yang Z. He X. Gao J. Deng L. & Smola A. (2015)

发表： arXiv:1511.02274.

MetaMind

论文：Dynamic Memory Networks for Visual and Textual Question Answering

作者：Xiong Caiming Stephen Merity and Richard Socher

发表： arXiv:1603.01417 (2016).

首尔国立大学 NAVER

论文：Multimodal Residual Learning for Visual QA

作者：Jin-Hwa Kim Sang-Woo Lee Dong-Hyun Kwak Min-Oh Heo Jeonghee Kim Jung-Woo Ha Byoung-Tak Zhang

发表：arXiv:1606:01455

UC Berkeley 索尼

论文：Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding

作者：Akira Fukui Dong Huk Park Daylen Yang Anna Rohrbach Trevor Darrell and Marcus Rohrbach

发表：arXiv:1606.01847

Postech

论文：Training Recurrent Answering Units with Joint Loss Minimization for VQA

作者：Hyeonwoo Noh and Bohyung Han

发表： arXiv:1606.03647

首尔国立大学 NAVER

论文： Hadamard Product for Low-rank Bilinear Pooling

作者：Jin-Hwa Kim Kyoung Woon On Jeonghee Kim Jung-Woo Ha Byoung-Tak Zhan

发表：arXiv:1610.04325.

视觉注意力和显著性

• Mr-CNN

  
  

论文：Predicting Eye Fixations using Convolutional Neural Networks

作者：Nian Liu Junwei Han Dingwen Zhang Shifeng Wen Tianming Liu

发表：CVPR 2015.




• 学习地标的连续搜索




作者：Learning a Sequential Search for Landmarks

论文：Saurabh Singh Derek Hoiem David Forsyth

发表：CVPR 2015.




• 视觉注意力机制实现多物体识别




论文：Multiple Object Recognition with Visual Attention

作者：Jimmy Lei Ba Volodymyr Mnih Koray Kavukcuoglu

发表：ICLR 2015.




• 视觉注意力机制的循环模型

作者：Volodymyr Mnih Nicolas Heess Alex Graves Koray Kavukcuoglu

论文：Recurrent Models of Visual Attention

发表：NIPS 2014.

低级视觉

超分辨率

• Iterative Image Reconstruction

• Sven Behnke: Learning Iterative Image Reconstruction. IJCAI 2001.

• Sven Behnke: Learning Iterative Image Reconstruction in the Neural Abstraction Pyramid. International Journal of Computational Intelligence and Applications vol. 1 no. 4 pp. 427-438 2001.

• Super-Resolution (SRCNN)

• Chao Dong Chen Change Loy Kaiming He Xiaoou Tang Learning a Deep Convolutional Network for Image Super-Resolution ECCV 2014.

• Chao Dong Chen Change Loy Kaiming He Xiaoou Tang Image Super-Resolution Using Deep Convolutional Networks arXiv:1501.00092.

• Very Deep Super-Resolution

• Jiwon Kim Jung Kwon Lee Kyoung Mu Lee Accurate Image Super-Resolution Using Very Deep Convolutional Networks arXiv:1511.04587 2015.

• Deeply-Recursive Convolutional Network

• Jiwon Kim Jung Kwon Lee Kyoung Mu Lee Deeply-Recursive Convolutional Network for Image Super-Resolution arXiv:1511.04491 2015.

• Casade-Sparse-Coding-Network

• Zhaowen Wang Ding Liu Wei Han Jianchao Yang and Thomas S. Huang Deep Networks for Image Super-Resolution with Sparse Prior. ICCV 2015.

• Perceptual Losses for Super-Resolution

• Justin Johnson Alexandre Alahi Li Fei-Fei Perceptual Losses for Real-Time Style Transfer and Super-Resolution arXiv:1603.08155 2016.

• SRGAN

• Christian Ledig Lucas Theis Ferenc Huszar Jose Caballero Andrew Cunningham Alejandro Acosta Andrew Aitken Alykhan Tejani Johannes Totz Zehan Wang Wenzhe Shi Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network arXiv:1609.04802v3 2016.

其他应用

• Optical Flow (FlowNet)

• Philipp Fischer Alexey Dosovitskiy Eddy Ilg Philip Häusser Caner Hazırbaş Vladimir Golkov Patrick van der Smagt Daniel Cremers Thomas Brox FlowNet: Learning Optical Flow with Convolutional Networks arXiv:1504.06852.

• Compression Artifacts Reduction

• Chao Dong Yubin Deng Chen Change Loy Xiaoou Tang Compression Artifacts Reduction by a Deep Convolutional Network arXiv:1504.06993.

• Blur Removal

• Christian J. Schuler Michael Hirsch Stefan Harmeling Bernhard Schölkopf Learning to Deblur arXiv:1406.7444

• Jian Sun Wenfei Cao Zongben Xu Jean Ponce Learning a Convolutional Neural Network for Non-uniform Motion Blur Removal CVPR 2015

• Image Deconvolution

• Li Xu Jimmy SJ. Ren Ce Liu Jiaya Jia Deep Convolutional Neural Network for Image Deconvolution NIPS 2014.

• Deep Edge-Aware Filter

• Li Xu Jimmy SJ. Ren Qiong Yan Renjie Liao Jiaya Jia Deep Edge-Aware Filters ICML 2015.

• Computing the Stereo Matching Cost with a Convolutional Neural Network

• Jure Žbontar Yann LeCun Computing the Stereo Matching Cost with a Convolutional Neural Network CVPR 2015.

• Colorful Image Colorization Richard Zhang Phillip Isola Alexei A. Efros ECCV 2016

• Feature Learning by Inpainting

• Deepak Pathak Philipp Krahenbuhl Jeff Donahue Trevor Darrell Alexei A. Efros Context Encoders: Feature Learning by Inpainting CVPR 2016

边缘检测

• Holistically-Nested Edge Detection

• Saining Xie Zhuowen Tu Holistically-Nested Edge Detection arXiv:1504.06375.

• DeepEdge

• Gedas Bertasius Jianbo Shi Lorenzo Torresani DeepEdge: A Multi-Scale Bifurcated Deep Network for Top-Down Contour Detection CVPR 2015.

• DeepContour

• Wei Shen Xinggang Wang Yan Wang Xiang Bai Zhijiang Zhang DeepContour: A Deep Convolutional Feature Learned by Positive-Sharing Loss for Contour Detection CVPR 2015.

语义分割

图片来源：BoxSup论文

• SEC: Seed Expand and Constrain

• Alexander Kolesnikov Christoph Lampert Seed Expand and Constrain: Three Principles for Weakly-Supervised Image Segmentation ECCV 2016.

• Adelaide

• Guosheng Lin Chunhua Shen Ian Reid Anton van dan Hengel Efficient piecewise training of deep structured models for semantic segmentation arXiv:1504.01013. (1st ranked in VOC2012)

• Guosheng Lin Chunhua Shen Ian Reid Anton van den Hengel Deeply Learning the Messages in Message Passing Inference arXiv:1508.02108. (4th ranked in VOC2012)

• Deep Parsing Network (DPN)

• Ziwei Liu Xiaoxiao Li Ping Luo Chen Change Loy Xiaoou Tang Semantic Image Segmentation via Deep Parsing Network arXiv:1509.02634 / ICCV 2015 (2nd ranked in VOC 2012)

• CentraleSuperBoundaries INRIA

• Iasonas Kokkinos Surpassing Humans in Boundary Detection using Deep Learning arXiv:1411.07386 (4th ranked in VOC 2012)

• BoxSup

• Jifeng Dai Kaiming He Jian Sun BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentation arXiv:1503.01640. (6th ranked in VOC2012)

• POSTECH

• Hyeonwoo Noh Seunghoon Hong Bohyung Han Learning Deconvolution Network for Semantic Segmentation arXiv:1505.04366. (7th ranked in VOC2012)

• Seunghoon Hong Hyeonwoo Noh Bohyung Han Decoupled Deep Neural Network for Semi-supervised Semantic Segmentation arXiv:1506.04924.

• Seunghoon Hong Junhyuk Oh Bohyung Han andHonglak Lee Learning Transferrable Knowledge for Semantic Segmentation with Deep Convolutional Neural Network arXiv:1512.07928

• Conditional Random Fields as Recurrent Neural Networks

• Shuai Zheng Sadeep Jayasumana Bernardino Romera-Paredes Vibhav Vineet Zhizhong Su Dalong Du Chang Huang Philip H. S. Torr Conditional Random Fields as Recurrent Neural Networks arXiv:1502.03240. (8th ranked in VOC2012)

• DeepLab

• Liang-Chieh Chen George Papandreou Kevin Murphy Alan L. Yuille Weakly-and semi-supervised learning of a DCNN for semantic image segmentation arXiv:1502.02734. (9th ranked in VOC2012)

• Zoom-out

• Mohammadreza Mostajabi Payman Yadollahpour Gregory Shakhnarovich Feedforward Semantic Segmentation With Zoom-Out Features CVPR 2015

• Joint Calibration

• Holger Caesar Jasper Uijlings Vittorio Ferrari Joint Calibration for Semantic Segmentation arXiv:1507.01581.

• Fully Convolutional Networks for Semantic Segmentation

• Jonathan Long Evan Shelhamer Trevor Darrell Fully Convolutional Networks for Semantic Segmentation CVPR 2015.

• Hypercolumn

• Bharath Hariharan Pablo Arbelaez Ross Girshick Jitendra Malik Hypercolumns for Object Segmentation and Fine-Grained Localization CVPR 2015.

• Deep Hierarchical Parsing

• Abhishek Sharma Oncel Tuzel David W. Jacobs Deep Hierarchical Parsing for Semantic Segmentation CVPR 2015.

• Learning Hierarchical Features for Scene Labeling

• Clement Farabet Camille Couprie Laurent Najman Yann LeCun Scene Parsing with Multiscale Feature Learning Purity Trees and Optimal Covers ICML 2012.

• Clement Farabet Camille Couprie Laurent Najman Yann LeCun Learning Hierarchical Features for Scene Labeling PAMI 2013.

• University of Cambridge

• Vijay Badrinarayanan Alex Kendall and Roberto Cipolla "SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation." arXiv preprint arXiv:1511.00561 2015.

• Alex Kendall Vijay Badrinarayanan and Roberto Cipolla "Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understanding." arXiv preprint arXiv:1511.02680 2015.

• Princeton

• Fisher Yu Vladlen Koltun "Multi-Scale Context Aggregation by Dilated Convolutions" ICLR 2016

• Univ. of Washington Allen AI

• Hamid Izadinia Fereshteh Sadeghi Santosh Kumar Divvala Yejin Choi Ali Farhadi "Segment-Phrase Table for Semantic Segmentation Visual Entailment and Paraphrasing" ICCV 2015

• INRIA

• Iasonas Kokkinos "Pusing the Boundaries of Boundary Detection Using deep Learning" ICLR 2016

• UCSB

• Niloufar Pourian S. Karthikeyan and B.S. Manjunath "Weakly supervised graph based semantic segmentation by learning communities of image-parts" ICCV 2015

其他资源

课程

•深度视觉

[斯坦福] CS231n: Convolutional Neural Networks for Visual Recognition

[香港中文大学] ELEG 5040: Advanced Topics in Signal Processing(Introduction to Deep Learning)

•更多深度课程推荐

[斯坦福] CS224d: Deep Learning for Natural Language Processing

[牛津 Deep Learning by Prof. Nando de Freitas

[纽约大学] Deep Learning by Prof. Yann LeCun

图书

免费在线图书

◦Deep Learning by Ian Goodfellow Yoshua Bengio and Aaron Courville

◦Neural Networks and Deep Learning by Michael Nielsen

◦Deep Learning Tutorial by LISA lab University of Montreal

视频

演讲

◦Deep Learning Self-Taught Learning and Unsupervised Feature Learning By Andrew Ng

◦Recent Developments in Deep Learning By Geoff Hinton

◦The Unreasonable Effectiveness of Deep Learning by Yann LeCun

◦Deep Learning of Representations by Yoshua bengio

软件

框架

•Tensorflow: An open source software library for numerical computation using data flow graph by Google [Web]

•Torch7: Deep learning library in Lua used by Facebook and Google Deepmind [Web]

◦Torch-based deep learning libraries: [torchnet]

•Caffe: Deep learning framework by the BVLC [Web]

•Theano: Mathematical library in Python maintained by LISA lab [Web]

◦Theano-based deep learning libraries: [Pylearn2] [Blocks] [Keras] [Lasagne]

•MatConvNet: CNNs for MATLAB [Web]

•MXNet: A flexible and efficient deep learning library for heterogeneous distributed systems with multi-language support [Web]

•Deepgaze: A computer vision library for human-computer interaction based on CNNs [Web]

应用

•对抗训练 Code and hyperparameters for the paper "Generative Adversarial Networks" [Web]

•理解与可视化 Source code for "Understanding Deep Image Representations by Inverting Them " CVPR 2015. [Web]

•词义分割 Source code for the paper "Rich feature hierarchies for accurate object detection and semantic segmentation " CVPR 2014. [Web] ； Source code for the paper "Fully Convolutional Networks for Semantic Segmentation " CVPR 2015. [Web]

•超分辨率 Image Super-Resolution for Anime-Style-Art [Web]

•边缘检测 Source code for the paper "DeepContour: A Deep Convolutional Feature Learned by Positive-Sharing Loss for Contour Detection " CVPR 2015. [Web]

；Source code for the paper "Holistically-Nested Edge Detection" ICCV 2015. [Web]

讲座

•[CVPR 2014] Tutorial on Deep Learning in Computer Vision

•[CVPR 2015] Applied Deep Learning for Computer Vision with Torch

博客

•Deep down the rabbit hole: CVPR 2015 and beyond@Tombone's Computer Vision Blog

•CVPR recap and where we're going@Zoya Bylinskii (MIT PhD Student)'s Blog

•Facebook's AI Painting@Wired

•Inceptionism: Going Deeper into Neural Networks@Google Research

•Implementing Neural networks

点击阅读原文可查看职位详情，期待你的加入~