Skip to content

Instantly share code, notes, and snippets.

@shagunsodhani
shagunsodhani / DCGAN.md
Created November 22, 2016 17:07
Notes for DCGAN paper

Deep Convolutional Generative Adversarial Nets

Introduction

  • The paper presents Deep Convolutional Generative Adversarial Nets (DCGAN) - a topologically constrained variant of conditional GAN.
  • Link to the paper

Benefits

  • Stable to train
@shagunsodhani
shagunsodhani / Generative Adversarial Nets.md
Created November 13, 2016 09:47
Summary of "Generative Adversarial Nets" paper

Generative Adversarial Nets

Introduction

  • The paper proposes an adversarial approach for estimating generative models where one model (generative model) tries to learn a data distribution and another model (discriminative model) tries to distinguish between samples from the generative model and original data distribution.
  • Link to the paper

Adversarial Net

  • Two models - Generative Model(G) and Discriminative Model(D)
@shagunsodhani
shagunsodhani / A Roadmap towards Machine Intelligence.md
Created November 6, 2016 19:09
Summary of "A Roadmap towards Machine Intelligence" paper

A Roadmap towards Machine Intelligence

Introduction

  • The paper presents some general characteristics that intelligent machines should possess and a roadmap to develop such intelligent machines in small, realistic steps.
  • Link to the paper

Ability to Communicate

  • The intelligent agents should be able to communicate with humans, preferably using language as the medium.
@shagunsodhani
shagunsodhani / SmartReply.md
Last active October 22, 2022 12:29
Notes for "Smart Reply: Automated Response Suggestion for Email" Paper

Smart Reply: Automated Response Suggestion for Email

Introduction

  • Proposes a novel, end-to-end architecture for generating short email responses.
  • Single most important benchmark of its success is that it is deployed in Inbox by Gmail and assists with around 10% of all mobile responses.
  • Link to the paper.

Challenges in deploying Smart Reply in a user-facing product

@shagunsodhani
shagunsodhani / entropy.py
Created October 26, 2016 11:01
Script to calculate entropy for any column in a file
# Script to calculate entropy for any column in a file.
from __future__ import print_function
import numpy as np
def entropy(file_path, sep, col_index, col_name):
'''Method to calculate entropy for any col_index
in a file where columns are seperated by sep'''
distribution = np.asarray(list(read_column(file_path, sep, col_index)))
@shagunsodhani
shagunsodhani / Convolutional Neural Network For Sentence Classification.md
Created October 23, 2016 16:00
Summary of paper "Convolutional Neural Network For Sentence Classification"

Convolutional Neural Network For Sentence Classification

Introduction

Architecture

@shagunsodhani
shagunsodhani / proposal-keras-dtdc.md
Last active October 22, 2016 12:17
Poposal for Keras talk at Delhi Twitter Developer Community Meetup

Topic

Introduction to Deep Learning with Keras

Description

Keras is a high-level neural networks library, written in Python and capable of running on top of either TensorFlow or Theano. It was developed with a focus on enabling fast experimentation. Being able to go from idea to result with the least possible delay is key to doing good research.

In the talk, I would introduce Keras and talk about how it can be used to accomplish workflows like image classfication and sequence modelling.

@shagunsodhani
shagunsodhani / Conditional Image Generation with PixelCNN Decoders.md
Created October 16, 2016 16:00
Summary of "Conditional Image Generation with PixelCNN Decoders" paper

Conditional Image Generation with PixelCNN Decoders

Introduction

  • The paper explores the domain of conditional image generation by adopting and improving PixelCNN architecture.
  • Link to the paper

Based on PixelRNN and PixelCNN

  • Models image pixel by pixel by decomposing the joint image distribution as a product of conditionals.
@shagunsodhani
shagunsodhani / PixelRNN.md
Created October 9, 2016 13:22
Summary of PixelRNN paper

Pixel Recurrent Neural Network

Introduction

  • Problem: Building an expressive, tractable and scalable image model which can be used in downstream tasks like image generation, reconstruction, compression etc.
  • Link to the paper

Model

  • Scan the image, one row at a time and one pixel at a time (within each row).
@shagunsodhani
shagunsodhani / Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps.md
Created October 2, 2016 12:52
Summary of "Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps" paper

Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps

Introduction

  • The paper presents gradient computation based techniques to visualise image classification models.
  • Link to the paper

Experimental Setup

  • Single deep convNet trained on ILSVRC-2013 dataset (1.2M training images and 1000 classes).