The current drive for energy-efficiency has made approximation a key concept in designing and implementing software in various areas, such as data analytics, mobile computing, multimedia processing, and engineering simulations. This course will focus on foundations and system-level techniques for processing for representing noise in program's data and reasoning about profitable tradeoffs between accuracy, reliability, and energy consumption. In addition to selected algorithmic-level approximations, we will study (i) programming languages that natively operate on probabilistic and/or uncertain data, (ii) compilers and programming systems that automatically approximate programs while verifying or testing the accuracy of optimized programs, and (iii) hardware devices that expose approximate components. In Spring 2022, our particular focus will be on the approximations and accuracy concerns of edge systems including machine learning components and techniques for checking correctness of randomized/probabilistic applications.
News 
-
2/1/2022: NEW: Homework #1 will be avaliable on Piazza today
-
2/1/2022: NEW: Submit Your Paper Choices by Next Tuesday: Link
-
1/20/2022: Lecture 2 available online.
-
1/18/2022: Lecture 1 available online.
-
1/17/2022: Access this document with Zoom info (requires Illinois credentials)
-
1/10/2022: The website is up!
Tuesday/Thursday
3:30-4:45pm
Siebel Center 0216
Instructor:
Sasa Misailovic
Assistant Professor
Computer Science, UIUC
4110 Siebel Center misailo@illinois.edu
Office Hours:
After class
Overview
This is a research-oriented course. It will include lectures, reading research papers, in-class discussions, and a final research project. In addition to in person lectures, we plan to use a combination of Zoom for some lectures and recording of asynchronous presentations, HotCRP for paper reviewing and discussion, and Piazza for announcements and Q&A. We will add the class-specific links soon.
We will compute the final grade using the following tentative table:
| Activity | Grade | Details |
|---|---|---|
| Reviews and Discussion | 20% |
|
| Presentation and Discussion Lead | 20% |
|
| Project | 50% |
| Homework | 10% (+ 10% XC) |
|
Tentative Schedule
We will first spend several weeks covering the key concepts of approximations in systems, accuracy management, and probabilistic programming. Then we will follow with studying recent research in approximation systems, systems and techniques for approximating deep learning, testing and analysis of approximate applications, probabilistic programming systems, and probabilistic techniques for system reliability.
Course Resources
Probabilistic Programming
Benchmark Suites:- ForestDB -- A database of generative models (typically written in Church)
- StanExamples -- a collection of diverse Stan models
- PROBPROG -- a conference on probabilistic progamming (videos included)
- probabilistic-programming.org -- a collection of various resources about probabilistic programming languages
- The Design and Implementation of Probabilistic Programming Languages (online book)
- Probfuzz -- A framework for testing probabilistic programming systems
- PSense -- A framework for symbolic sensitivity analysis of probabilistic programs
- PSI -- A symbolic solver for probabilistic programs
Approximate Computing
Benchmark Suites: Community: Dagstuhl Seminars: Tools: General Resources
Mental Health:
Diminished mental health, including significant stress, mood changes, excessive worry, substance/alcohol abuse, or problems with eating and/or sleeping can interfere with optimal academic performance, social development, and emotional wellbeing. The University of Illinois offers a variety of confidential services including individual and group counseling, crisis intervention, psychiatric services, and specialized screenings at no additional cost. If you or someone you know experiences any of the above mental health concerns, it is strongly encouraged to contact or visit any of the University’s resources provided below. Getting help is a smart and courageous thing to do -- for yourself and for those who care about you.
Counseling Center: 217-333-3704, 610 East John Street Champaign, IL 61820
McKinley Health Center:217-333-2700, 1109 South Lincoln Avenue, Urbana, Illinois 61801
Sexual Misconduct Reporting Obligation:
The University of Illinois is committed to combating sexual misconduct. Faculty and staff members are required to report any instances of sexual misconduct to the University’s Title IX Office. In turn, an individual with the Title IX Office will provide information about rights and options, including accommodations, support services, the campus disciplinary process, and law enforcement options.
A list of the designated University employees who, as counselors, confidential advisors, and medical professionals, do not have this reporting responsibility and can maintain confidentiality, can be found here: http://wecare.illinois.edu/resources/students/#confidential
Other information about resources and reporting is available here: wecare.illinois.edu.
Academic Integrity:
The University of Illinois at Urbana-Champaign Student Code should also be considered as a part of this syllabus. Students should pay particular attention to Article 1, Part 4: Academic Integrity. Read the Code at the following URL: http://studentcode.illinois.edu/.
Academic dishonesty may result in a failing grade. Every student is expected to review and abide by the Academic Integrity Policy: https://studentcode.illinois.edu/article1/part4/1-401/. Ignorance is not an excuse for any academic dishonesty. It is your responsibility to read this policy to avoid any misunderstanding. Do not hesitate to ask the instructor(s) if you are ever in doubt about what constitutes plagiarism, cheating, or any other breach of academic integrity.
Religious Observances:
Illinois law requires the University to reasonably accommodate its students' religious beliefs, observances, and practices in regard to admissions, class attendance, and the scheduling of examinations and work requirements. You should examine this syllabus at the beginning of the semester for potential conflicts between course deadlines and any of your religious observances. If a conflict exists, you should notify your instructor of the conflict and follow the procedure at https://odos.illinois.edu/community-of-care/resources/students/religious-observances/ to request appropriate accommodations. This should be done in the first two weeks of classes.
Disability-Related Accommodations:
To obtain disability-related academic adjustments and/or auxiliary aids, students with disabilities must contact the course instructor and the Disability Resources and Educational Services (DRES) as soon as possible. To contact DRES, you may visit 1207 S. Oak St., Champaign, call 333-4603, e-mail disability@illinois.edu or go to https://www.disability.illinois.edu. If you are concerned you have a disability-related condition that is impacting your academic progress, there are academic screening appointments available that can help diagnosis a previously undiagnosed disability. You may access these by visiting the DRES website and selecting “Request an Academic Screening” at the bottom of the page.
Family Educational Rights and Privacy Act (FERPA):
Any student who has suppressed their directory information pursuant to Family Educational Rights and Privacy Act (FERPA) should self-identify to the instructor to ensure protection of the privacy of their attendance in this course. See https://registrar.illinois.edu/academic-records/ferpa/ for more information on FERPA.