Introduction to Practical Neural Networks and Deep Learning (Part 1)

Share

Series Overview:  From the book introduction: "Neural networks and deep learning currently provides the best solutions to many problems in image recognition, speech recognition, and natural language processing."

This Part 1 and the planned Part 2 (winter or spring 2022, to be confirmed) series of courses will teach many of the core concepts behind neural networks and deep learning.

More from the book introduction:  "We'll learn the core principles behind neural networks and deep learning by attacking a concrete problem: the problem of teaching a computer to recognize handwritten digits. ...it can be solved pretty well using a simple neural network, with just a few tens of lines of code, and no special libraries."

"But you don't need to be a professional programmer."

The code provided is in Python, which even if you don't program in Python, should be easy to understand with just a little effort.

Benefits of attending the series:

* Learn the core principles behind neural network and deep learning.

* See a simple Python program that solves a concrete problem: teaching a computer to recognize a handwritten digit.

* Improve the result through incorporating more and more of core ideas about neural networks and deep learning.

* Understand the theory, with worked-out proofs of fundamental equations of backpropagation for those interested.

* Run straightforward Python demo code example.

The demo Python program (updated from version provided in the book) can be downloaded from the speaker's GitHub account. The demo program is run in a Docker container that runs on your Mac, Windows, or Linux personal computer; we plan to provide instructions on doing that in advance of the class.

(That would be one good reason to register early if you plan to attend, in order that you can receive the straightforward instructions and leave yourself with plenty of time to prepare the Git and Docker software that are widely used among software professionals.)

Decision to (Run/Cancel) Date for this course is Tuesday, June 15, 2021



  Date and Time

  Location

  Hosts

  Registration



  • Date: 19 Jun 2021
  • Time: 09:00 AM to 12:30 PM
  • All times are US/Eastern
  • Add_To_Calendar_icon Add Event to Calendar
If you are not a robot, please complete the ReCAPTCHA to display virtual attendance info.
  • A live, interactive webinar
  • Boston, Massachusetts
  • United States
  • ieeebostonsection@gmail.com

  • Starts 19 April 2021 12:03 PM
  • Ends 19 June 2021 08:15 AM
  • All times are US/Eastern
  • Admission fee ?


  Speakers

CL Kim

Topic:

Introduction to Practical Neural Networks and Deep Learning (Part I)

Biography:

CL Kim works in Software Engineering at CarGurus, Inc. He has graduate degrees in Business Administration and in Computer and Information Science from the University of Pennsylvania. He has previously taught for a few years the well-rated IEEE Boston Section class on introduction to the Android platform and API.

Address:United States





Agenda

Agenda:


Introduction to Practical Neural Networks and Deep Learning (Part 1)
Feedforward Neural Networks.
* Simple (Python) Network to classify a handwritten digit
* Learning with Gradient Descent
* How the backpropagation algorithm works
* Improving the way neural networks learn:
** Cross-entropy cost function
** Softmax activation function and log-likelihood cost function
** Rectified Linear Unit
** Overfitting and Regularization:
*** L2 regularization
*** Dropout
*** Artificially expanding data set
*** Hyper-parameters

Pre-requisites:
There is some heavier mathematics in proving the four fundamental equations behind backprogation, so a basic familiarity with multivariable calculus and linear algebra is expected, but nothing advanced is required. (The backpropagation equations can be also just accepted without bothering with the proofs since the provided python code for the simple network just makes use of the equations.)