Course Code: ENG04
Term: October 2015
Start Date: Oct 19 2015
End Date: Dec 15 2015
Duration: 9 weeks
This course has ended
Robotic vision introduces you to the field of computer vision and the mathematics and algorithms that underpin it. You will learn how to interpret images to determine the color, size, shape and position of objects in the scene. We will work with you to build an intelligent vision system that can recognise objects of different colors and shapes. This course and the Introduction to robotics MOOC are based on a 13 week undergraduate course Introduction to robotics at the Queensland University of Technology (QUT).
By the end of this course you should be able to:
If you do the optional project you should also be able to:
If you have studied Introduction to robotics (MOOC) and completed the optional project you should also be able to:
It would be beneficial to have knowledge of basic programming either of MATLAB or another object-oriented programming language. MATLAB tutorials are available when you commence the course. You will also need to be familiar with some of the following areas of mathematics: vectors and spaces, matrices, and eigenvalues and eigenvectors. You can review these topics by visiting the Khan Academy using the links below.
Throughout the course you will have the opportunity to complete assessable quizzes and programming exercises. These will be automatically marked. The programming exercises will consist of several MATLAB tasks and will be based on the lecture content for that week.
If you complete the assessment successfully you will receive a certificate of participation. The certificate does not earn credit points towards a QUT qualification. The overall assessment is worth a total of 240 points (120 points for assessable quizzes and 120 points for MATLAB programming tasks). You need to achieve an overall score of 50% (120 points). The quizzes and programming tasks are weighted equally, so it does not matter how you make up your 120 points.
This optional project is a valuable opportunity to apply your knowledge as the course progresses. You will use MATLAB software to program a vision system that will find shapes and colors in an image. This is what equips a robot to navigate its way around its environment. If you have completed the optional project in Introduction to robotics (MOOC) and built a robot arm, you will be able to combine this with the vision system in an extension activity we do in the Final week after lectures end.
You can choose how you interact with this course. Following registration you can:
If you choose course options (a) and (c) you should plan to spend about 4–8 hours per week on this course. Depending on your level of skill with MATLAB and programming in general, your weekly studies might include:
If you plan to do the optional project you will need a webcam attached to the computer or a mobile phone and the ability to transfer images to the computer.
You will need the following software:
Access to the textbook written by Professor Peter Corke (2011), Robotics, Vision and Control: Fundamental Algorithms in MATLAB (Springer) is optional, but considered beneficial. The textbook is available for you to purchase at a significant discount. The course includes free extracts from the textbook for you to read online while studying with Peter.
The course content will be released weekly. Each week you will watch the videos for two lectures and check your understanding as you go by answering questions and doing exercises. After the two lectures you will complete an assessment quiz and an assessment programming exercise. Throughout the course you are encouraged to take part in the discussion forum. You can also choose to do the optional project.
Take the time to prepare before lectures commence. Familiarise yourself with the site, watch the required videos, introduce yourself with a post to the forum, join in the discussion, ensure you have everything you need and complete the recommended activities.
This week we will look at how robots sense the world around them. We will explore the sense of vision, what this means for robots and learn how to get an image into MATLAB where we can begin to process it. The skills you learn and the tools we use will be essential for the programming exercises and the project.
This week we discuss how to process images with simple arithmetic and logical operations to perform operations such as thresholding, green screening and change detection. Then we look at operations that allow us to blur or find edges within images, find distinctive patterns or select only objects of particular shapes.
This week we ask the question ‘How can a robot know what it is looking at?’ We will see how robots can extract simple meaning from an image, describing objects in terms of their size, shape and position. Then we look at color, its importance in image processing, and how we can describe and select objects based on their color.
So far we have assumed the existence of an image. This week we learn how images are formed by cameras. The first lecture presents a simple geometric approach to understanding this, while the second lecture uses homogeneous coordinates to express this process in terms of matrices and vectors which we can calculate easily using MATLAB.
This week we look at how humans perceive the three dimensional (3D) nature of the world using binocular vision, how stereo displays and TVs work, and how we can mimic this in a computer to extract a 3D model of the world from two images. Then we follow up on lecture 4 and discuss advanced image processing techniques for selecting shapes, rotating and scaling images, and finding dominant lines and points within an image.
In this final week we discuss the way that an image changes as the camera moves. Then we invert this and compute how the camera should move so that the image changes in the way we want, a technique commonly known as visual servoing.
Ensure you have completed and submitted all assessment quizzes and assessment programming exercises. If you have undertaken the project you can self-assess your robotic vision system. If you have a robot arm you can do the extension activity.
Check your email inbox and click on the email verification link we just sent you.
If it doesn’t reach your inbox in a few moments, it might be in your spam folder. Don’t forget to add our email address to your contacts if it did end up in spam! That’ll make sure it doesn’t happen again.
As soon as you’ve verified your email, you’ll be able to continue.