Special Topics Course AI7100
Stochastic Algorithms for Nonconvex Optimization and Reinforcement Learning

The class will meet on Tuesdays and Wednesdays from 12:00 to 13:15, with some classes also on Fridays.
The classes will start on Tuesday, 20th August, and end on 22nd November.
The academic calendar of IIT Hyderabad, showing the holidays and the Semester Break, can be found here (see page 2):
Calendar

For those attending in person, the classroom is A-117.
Remote participants may use the Google Meet link shown below.

Students who register for credit are expected to carry out either some theoretical work or some numerical computations that illustrate some aspects of the theory covered here.
The last week will be devoted to presentations of projects by registered students.

Course Description

Some Links
Link to Google Classroom
Link to Google Meet
These links are accessible only those who have formally enrolled in the course via Google Classrooom.

Course Notes are updated frequently, so please check the date of the version you have with the date of the latest version)
Course Notes

Slides of Various Modules
Note: The modules correspond to various chapters in the course notes. There is no Module-1.

• Overview
• Module 2A
• Module 2B
• Module 2C
• Module 3A
• Module 3B
• Module 3C
• Module 4
• Module 5A
• Module 5B
• Module 5C
• Module 6

Python Codes and Data Files

• Hitting probabilities and Hitting times
• Hitting times
• Policy iteration
• Snakes and Ladders 1
• Snakes and Ladders 2