After successful completion of the course, students are able to solve first problems in the fields of in machine vision: basic computer vision methods, edge detection, region description, feature extraction, object tracking, depth image acquisition, methods of 2D and 3D object recognition, Gestalt theory, depth image processing, cognitive vision; Focus in robotics on cognitive robots, situated vision for robotics, and robot systems.

Emphasis is on the following topics in machine vision: basic computer vision methods, edge detection, region description, feature extraction, object tracking, depth image acquisition, methods of 2D and 3D object recognition, Gestalt theory, depth image processing, cognitive vision; Focus in robotics on cognitive robots, situated vision for robotics, and robot systems.

• Robots, robot tasks, cognitive robots, machine vision, vision applications; computer/machine/situated vision, and machine vision basics: camera, images, Filtering, SSD, Canny
• Machine_Vision_Features: Industrial/mobile/cognitive robotics, sensors used in robotics;
• Interest Points: Harris, DoG
• Object_Recognition_SIFT: Object recognition 2D: SIFT, SURF
• Geometry_Stereo: geometry, basic calibration, stereo vision, 3D_Camera_Systems: Other methods to obtain 3D images
• Attention_Ransac: attention, Ransac
• 3D_Vision_Methods: voxel grids, neighbours, integral images, surface normal, differential geometry, Gestalt, Clustering
• Object recognition in 3D: NARF, VFH, ESF, ..., examples, learning from CAD data
• Deep learning, concept, introduction, applications, object categorisation
• Open problems: human vision vs. robot vision, what works and open challenges

The contents of the course are presented in the form of oral presentations supported by digital slides. To apply the theoretic knowledge, students have to implement 6 programming exercises about topics discussed during the lecture. The exercises have to be done using Python with the popular libraries OpenCV, Open3D and NumPy. The submission and grading of the exercises is done via TUWEL.

Due to the current situation, the lecture will be given completely remotely in the winter term 2020. The lectures will be uploaded as videos. Additionally, there will be a biweekly livestream to introduce the new exercise and as an opportunity for students to ask questions. The dates for the livestream and more detailed information about the course are available in the TUWEL course.

Course Introduction 5th October 2020 10:00 - URL in TUWEL

Positive of all exercises followed by oral examination. Weight for final grade: Exercises 60%, Oral Examination 40%.

Due to the current situation, the oral exams will be conducted remotely using GoToMeeting until further notice.

Examination candidates will be assigned a time slot of 30 minutes. This slot will be sent out by mail after the end of the registration deadline. A webcam is needed for proof of identity. The public link of the exam will be shared in TISS. Candidates with time constraints or restrictions in terms of equipment should contact us before the exam. 

Knowledge of Python is recommended. Background in Robotics is helpful, e.g., 376.040 Fachvertiefung Bildverarbeitung und Robotik.