SENSING – Robust Vision (RV)

Program Leader: Michael Milford

Program Summary:Michael Milford Profile

Robust Vision (RV) is concerned with the front end of a robotic vision system, the sensors and the early algorithmic processing steps, with a focus on robustness to very low and changing lighting levels, viewpoint and weather conditions.

 

Program Description:

For robots, the process of vision starts with images acquired by cameras, but images are a complex (non-linear and non-invertible) function of many variables including: the 3D structure of the scene and the materials within it, the lighting, and the viewpoint of the camera. Vision outdoors is confounded by changes in appearance from day to night and wet to dry, by shadows, and by changes due to season where objects (e.g., trees) dramatically change appearance. A robot’s vision system must be able to understand its world in a robust way.

 

Current projects are concerned with:

  • Robustly recognizing places and objects despite challenging environmental conditions including darkness, weather, adverse atmospheric conditions and seasonal change.
  • Novel visual sensing for robotic operation in adverse conditions: new conventional low light cameras; light-field cameras, which have advantages for estimating depth, seeing through partial obscuration and in low light; hyperspectral cameras; and thermal camera.
  • Increasing the robustness of robot navigation using robust vision and semantic vision techniques.

 

Recent achievements include:

  • Semantic SLAM for scale correction demonstration with a mono camera.
  • Developed a 4×4 array camera for experiments with light-field imaging
  • Developed a mirror adaptor to convert a conventional camera to a light field camera (mirrorcam)
  • Demonstrated use of mirrorcam for robot arm guidance
  • Published an open source toolkit for light field imaging
  • Created a facility for very low-light robotic vision using an ISO 50,000 camera

 

Name Location Role
Zongyuan GeQUTPhD Candidate
Zhibin LiaoUniversity of AdelaidePhD Candidate
Zetao “Jason” ChenQUTPhD Candidate
Yuchao JiangUniversity of AdelaidePhD Candidate
Yi “Joey” ZhouANUPhD Candidate
Yasir LatifUniversity of AdelaideResearch Fellow
Yan ZouMonashPhD Candidate
Xiaoqin WangMonashPhD Candidate
Will ChamberlainQUTPhD Candidate
Viorela IlaANUResearch Fellow
Vincent LuiMonashPhD Candidate
Vijay KumarUniversity of AdelaideResearch Fellow
Trung Than PhamUniversity of AdelaideResearch Fellow
Tristan PerezQUTAssociate Investigator
Tracy KellyQUTFinance & Administration Officer
Tong ShenUniversity of AdelaidePhD Candidate
Tom DrummondMonash UniversityChief Investigator
Tim MacugaQUTCommunications and Media Officer
Thuy MaiUniversity of AdelaideNode Administration Officer
Thanuja DharmasiriMonashPhD Candidate
Tat-Jun ChinUniversity of AdelaideAssociate Investigator
Sue KeayQUTChief Operating Officer
Stephen GouldANUChief Investigator
Sourav GargQUTPhD Candidate
Sean McMahonQUTPhD Candidate
Sareh ShiraziQUTResearch Fellow
Sarah AllenQUTNode Administration Officer, PA to Centre Director Professor Peter Corke
Ruth SchulzQUTResearch Fellow
Ross CrawfordQUTAssociate Investigator
Rodrigo Santa CruzANUPhD Candidate
Rob MahonyANUChief Investigator
Richard HartleyANUChief Investigator
Riccardo SpicaANUPhD Candidate
Qinfeng ShiUniversity of AdelaideAssociate Investigator
Philip TorrOxfordPartner Investigator
Peter KujalaQUTPhD Candidates
Peter CorkeQUTCentre Director
Peter AndersonANUPhD Candidate
Paul NewmanOxfordPartner Investigator
Niko SuenderhaufQUTResearch Fellow
Mike BradyOxfordCentre Advisory Committee
Michelle SimmonsUNSWCentre Advisory Committee
Michael MilfordQUTChief Investigator
Matt DunbabinQUTAssociative Investigators
Markus EichQUTResearch Fellow
Marc PollefeysETH ZurichPartner Investigator
Mandyam SrinivasanUniversity of QueenslandCentre Advisory Committee
Luis Mejias AlvarezQUTAssociate Investigator
Lin WuUniversity of AdelaideResearch Fellow
Laurent KneipANUAssociative Investigators
Khurrum AftabMonash UniversityResearch Fellow
Kate AldridgeQUTCentre Administrative Coordinator
Juxi LeitnerQUTResearch Fellow
Juan AdarveANUPhD Candidate
Jonghyuk KimANUAssociate Investigator
Jonathan RobertsQUTChief Investigator
John SkinnerQUTPhD Candidate
Jochen TrumpfANUAssociate Investigator
Jeffrey DevarajQUTPhD Candidate
Jason FordQUTAssociate Investigator
Jae-Hak KimUniversity of AdelaideResearch Fellow
Inkyu SaQUTResearch Fellow
Ian ReidUniversity of AdelaideDeputy Director
Hui LiUniversity of AdelaidePhD Candidate
Hugh Durrant-WhyteUniversity of SydneyCentre Advisory Committee
Hongdong LiANUChief Investigator
Gustavo CarneiroUniversity of AdelaideChief Investigator
Guosheng LinUniversity of AdelaideResearch Fellow
Greg LeeQUTExternal Engagement Coordinator
Gordon WyethQUTChief Investigator
Frank DellaertOxfordPartner Investigator
Francois ChaumetteInriaPartner Investigator
Feras DayoubQUTResearch Fellow
Fatih PorikliANUAssociate Investigator
Fangyi ZhangQUTPhD Candidate
Fahimeh RezazadeganQUTPhD Candidate
Edison GuoANUPhD Candidate
Donald DansereauQUTResearch Fellow
Dinesh GamageMonashResearch Fellow
David SuterUniversity of AdelaideAssociate Investigator
David HallQUTPhD Candidate
David BallQUTResearch Fellow
Dan RichardsQUTPhD Candidates
Clinton FookesQUTAssociate Investigator
Chuong NguyenANUResearch Fellow
Chunhua ShenUniversity of AdelaideChief Investigator
Chris McCoolQUTResearch Fellow
Chris LehnertQUTResearch Fellow
Chris JefferyQUTPhD Candidate
Bohan ZhuangUniversity of AdelaidePhD Candidate
Ben UpcroftQUTChief Investigator
Ben TalbotQUTPhD Candidate
Ben MeyerMonashPhD Candidate
Ben HarwoodMonashPhD Candidate
Basura FernandoANUResearch Fellow
Anton Van Den HengelUniversity of AdelaideChief Investigator
Anthony DickUniversity of AdelaideAssociate Investigator
Anoop CherianANUResearch Fellow
Anjali JaiprakashQUTResearch Fellow
Andrew SpekMonashPhD Candidate
Andrew EnglishQUTPhD Candidate
Andrew DavisonImperial College LondonPartner Investigator
Andres Felipe Marmol VelezQUTPhD Candidate
Anders ErikssonQUTResearch Fellow
Alex ZelinskyDefence Science and Technology OrganisationCentre Advisory Committee
Ajay PandeyQUTResearch Fellow
Ahmet SekerciogluMonash UniversityAssociate Investigator
Adam TowQUTPhD Candidate
Adam JacobsonQUTPhD Candidate