SR3: Scene Understanding

UNDERSTANDING – Semantic Representations (SR) for Robotic Vision

Scene Understanding for Robotic Vision develops joint semantic, geometric and affordance representations of large-scale environments. The project will provide the semantic representations required for ACRV SLAM.

Initial work in this project aims to develop maps of the environment that are labelled semantically with a “standard” set of useful class labels. Work in VL1 is showing how such labels can be generated for single views, but here the aim is to ensure that such labels are consistent (and accurate) within the 3D structure of the scene.

We also aim to leverage prior information from scenes that can be learnt via CNNs. We will investigate how the information from 1000s or 1000000s of exemplars can be used to improve scene structure without imposing hard constraints such as manhattan world models. Subsequent work aims to develop representations that enable a scene to be decomposed into its constituent parts and thereby used for planning for robotic navigation or acquisition/manipulation. Representation of uncertainty is a key element here; this is well-understood in the context of geometry, but is a research question how to determine, represent and use uncertainty resulting from inference over semantic entities. SR3 will draw on advances in VL1 to bridge this gap. Later work aims to go beyond simple type labels to a deeper and more powerful set of labels such as affordances of objects.

Name Location Role
Zongyuan GeQUTPhD Candidate
Zhibin LiaoUniversity of AdelaidePhD Candidate
Zetao “Jason” ChenQUTPhD Candidate
Yuchao JiangUniversity of AdelaidePhD Candidate
Yi “Joey” ZhouANUPhD Candidate
Yasir LatifUniversity of AdelaideResearch Fellow
Yan ZouMonashPhD Candidate
Xiaoqin WangMonashPhD Candidate
Will ChamberlainQUTPhD Candidate
Viorela IlaANUResearch Fellow
Vincent LuiMonashPhD Candidate
Vijay KumarUniversity of AdelaideResearch Fellow
Trung Than PhamUniversity of AdelaideResearch Fellow
Tristan PerezQUTAssociate Investigator
Tracy KellyQUTFinance & Administration Officer
Tong ShenUniversity of AdelaidePhD Candidate
Tom DrummondMonash UniversityChief Investigator
Tim MacugaQUTCommunications and Media Officer
Thuy MaiUniversity of AdelaideNode Administration Officer
Thanuja DharmasiriMonashPhD Candidate
Tat-Jun ChinUniversity of AdelaideAssociate Investigator
Sue KeayQUTChief Operating Officer
Stephen GouldANUChief Investigator
Sourav GargQUTPhD Candidate
Sean McMahonQUTPhD Candidate
Sareh ShiraziQUTResearch Fellow
Sarah AllenQUTNode Administration Officer, PA to Centre Director Professor Peter Corke
Ruth SchulzQUTResearch Fellow
Ross CrawfordQUTAssociate Investigator
Rodrigo Santa CruzANUPhD Candidate
Rob MahonyANUChief Investigator
Richard HartleyANUChief Investigator
Riccardo SpicaANUPhD Candidate
Qinfeng ShiUniversity of AdelaideAssociate Investigator
Philip TorrOxfordPartner Investigator
Peter KujalaQUTPhD Candidates
Peter CorkeQUTCentre Director
Peter AndersonANUPhD Candidate
Paul NewmanOxfordPartner Investigator
Niko SuenderhaufQUTResearch Fellow
Mike BradyOxfordCentre Advisory Committee
Michelle SimmonsUNSWCentre Advisory Committee
Michael MilfordQUTChief Investigator
Matt DunbabinQUTAssociative Investigators
Markus EichQUTResearch Fellow
Marc PollefeysETH ZurichPartner Investigator
Mandyam SrinivasanUniversity of QueenslandCentre Advisory Committee
Luis Mejias AlvarezQUTAssociate Investigator
Lin WuUniversity of AdelaideResearch Fellow
Laurent KneipANUAssociative Investigators
Khurrum AftabMonash UniversityResearch Fellow
Kate AldridgeQUTCentre Administrative Coordinator
Juxi LeitnerQUTResearch Fellow
Juan AdarveANUPhD Candidate
Jonghyuk KimANUAssociate Investigator
Jonathan RobertsQUTChief Investigator
John SkinnerQUTPhD Candidate
Jochen TrumpfANUAssociate Investigator
Jeffrey DevarajQUTPhD Candidate
Jason FordQUTAssociate Investigator
Jae-Hak KimUniversity of AdelaideResearch Fellow
Inkyu SaQUTResearch Fellow
Ian ReidUniversity of AdelaideDeputy Director
Hui LiUniversity of AdelaidePhD Candidate
Hugh Durrant-WhyteUniversity of SydneyCentre Advisory Committee
Hongdong LiANUChief Investigator
Gustavo CarneiroUniversity of AdelaideChief Investigator
Guosheng LinUniversity of AdelaideResearch Fellow
Greg LeeQUTExternal Engagement Coordinator
Gordon WyethQUTChief Investigator
Frank DellaertOxfordPartner Investigator
Francois ChaumetteInriaPartner Investigator
Feras DayoubQUTResearch Fellow
Fatih PorikliANUAssociate Investigator
Fangyi ZhangQUTPhD Candidate
Fahimeh RezazadeganQUTPhD Candidate
Edison GuoANUPhD Candidate
Donald DansereauQUTResearch Fellow
Dinesh GamageMonashResearch Fellow
David SuterUniversity of AdelaideAssociate Investigator
David HallQUTPhD Candidate
David BallQUTResearch Fellow
Dan RichardsQUTPhD Candidates
Clinton FookesQUTAssociate Investigator
Chuong NguyenANUResearch Fellow
Chunhua ShenUniversity of AdelaideChief Investigator
Chris McCoolQUTResearch Fellow
Chris LehnertQUTResearch Fellow
Chris JefferyQUTPhD Candidate
Bohan ZhuangUniversity of AdelaidePhD Candidate
Ben UpcroftQUTChief Investigator
Ben TalbotQUTPhD Candidate
Ben MeyerMonashPhD Candidate
Ben HarwoodMonashPhD Candidate
Basura FernandoANUResearch Fellow
Anton Van Den HengelUniversity of AdelaideChief Investigator
Anthony DickUniversity of AdelaideAssociate Investigator
Anoop CherianANUResearch Fellow
Anjali JaiprakashQUTResearch Fellow
Andrew SpekMonashPhD Candidate
Andrew EnglishQUTPhD Candidate
Andrew DavisonImperial College LondonPartner Investigator
Andres Felipe Marmol VelezQUTPhD Candidate
Anders ErikssonQUTResearch Fellow
Alex ZelinskyDefence Science and Technology OrganisationCentre Advisory Committee
Ajay PandeyQUTResearch Fellow
Ahmet SekerciogluMonash UniversityAssociate Investigator
Adam TowQUTPhD Candidate
Adam JacobsonQUTPhD Candidate