ACTING – Vision & Action (VA)

Program Summary:

  • Hand-eye coordination for robotic grasping in novel environments

 

Program Description:

Vision control of robots for manipulating real objects, pushing the boundaries on speed, coordination & complexity.

 

The relationship between motion in the world and changes in images are at the heart of robotic vision. Vision is tightly coupled to action and provides rapid and continuous feedback for control. Action also directs the eye and is required to inform the task. Motion in an image reveals much more about the world, and how the robot is moving within the world, than the content of the image alone. Knowledge of how objects move enables prediction of their future location and where visual attention should be devoted.

Current projects are concerned with:
• using vision for complex manipulation of real-world objects, a trivial skill for humans but extremely challenging for robotics. Approaches include teaching a robot to learn the appropriate movement based directly on image information.
• super-human hand-eye coordination, pushing the boundaries on speed
Recent achievements include:
• Evaluation of deep learnt features from simulation to real environments
• A new approach to machine learning a control function from images to robot reaching action, trained using simulation
• 6th in Amazon Picking Challenge
• Sweet Pepper robot harvester
• Visual servoing to multimodal sensor targets for NASA
• Weed detection using deep learnt features for an integrated weed management autonomous system
• Visual human action recognition in the presence of camera ego-motion

Name Location Role
Zongyuan GeQUTPhD Candidate
Zhibin LiaoUniversity of AdelaidePhD Candidate
Zetao “Jason” ChenQUTPhD Candidate
Yuchao JiangUniversity of AdelaidePhD Candidate
Yi “Joey” ZhouANUPhD Candidate
Yasir LatifUniversity of AdelaideResearch Fellow
Yan ZouMonashPhD Candidate
Xiaoqin WangMonashPhD Candidate
Will ChamberlainQUTPhD Candidate
Viorela IlaANUResearch Fellow
Vincent LuiMonashPhD Candidate
Vijay KumarUniversity of AdelaideResearch Fellow
Trung Than PhamUniversity of AdelaideResearch Fellow
Tristan PerezQUTAssociate Investigator
Tracy KellyQUTFinance & Administration Officer
Tong ShenUniversity of AdelaidePhD Candidate
Tom DrummondMonash UniversityChief Investigator
Tim MacugaQUTCommunications and Media Officer
Thuy MaiUniversity of AdelaideNode Administration Officer
Thanuja DharmasiriMonashPhD Candidate
Tat-Jun ChinUniversity of AdelaideAssociate Investigator
Sue KeayQUTChief Operating Officer
Stephen GouldANUChief Investigator
Sourav GargQUTPhD Candidate
Sean McMahonQUTPhD Candidate
Sareh ShiraziQUTResearch Fellow
Sarah AllenQUTNode Administration Officer, PA to Centre Director Professor Peter Corke
Ruth SchulzQUTResearch Fellow
Ross CrawfordQUTAssociate Investigator
Rodrigo Santa CruzANUPhD Candidate
Rob MahonyANUChief Investigator
Richard HartleyANUChief Investigator
Riccardo SpicaANUPhD Candidate
Qinfeng ShiUniversity of AdelaideAssociate Investigator
Philip TorrOxfordPartner Investigator
Peter KujalaQUTPhD Candidates
Peter CorkeQUTCentre Director
Peter AndersonANUPhD Candidate
Paul NewmanOxfordPartner Investigator
Niko SuenderhaufQUTResearch Fellow
Mike BradyOxfordCentre Advisory Committee
Michelle SimmonsUNSWCentre Advisory Committee
Michael MilfordQUTChief Investigator
Matt DunbabinQUTAssociative Investigators
Markus EichQUTResearch Fellow
Marc PollefeysETH ZurichPartner Investigator
Mandyam SrinivasanUniversity of QueenslandCentre Advisory Committee
Luis Mejias AlvarezQUTAssociate Investigator
Lin WuUniversity of AdelaideResearch Fellow
Laurent KneipANUAssociative Investigators
Khurrum AftabMonash UniversityResearch Fellow
Kate AldridgeQUTCentre Administrative Coordinator
Juxi LeitnerQUTResearch Fellow
Juan AdarveANUPhD Candidate
Jonghyuk KimANUAssociate Investigator
Jonathan RobertsQUTChief Investigator
John SkinnerQUTPhD Candidate
Jochen TrumpfANUAssociate Investigator
Jeffrey DevarajQUTPhD Candidate
Jason FordQUTAssociate Investigator
Jae-Hak KimUniversity of AdelaideResearch Fellow
Inkyu SaQUTResearch Fellow
Ian ReidUniversity of AdelaideDeputy Director
Hui LiUniversity of AdelaidePhD Candidate
Hugh Durrant-WhyteUniversity of SydneyCentre Advisory Committee
Hongdong LiANUChief Investigator
Gustavo CarneiroUniversity of AdelaideChief Investigator
Guosheng LinUniversity of AdelaideResearch Fellow
Greg LeeQUTExternal Engagement Coordinator
Gordon WyethQUTChief Investigator
Frank DellaertOxfordPartner Investigator
Francois ChaumetteInriaPartner Investigator
Feras DayoubQUTResearch Fellow
Fatih PorikliANUAssociate Investigator
Fangyi ZhangQUTPhD Candidate
Fahimeh RezazadeganQUTPhD Candidate
Edison GuoANUPhD Candidate
Donald DansereauQUTResearch Fellow
Dinesh GamageMonashResearch Fellow
David SuterUniversity of AdelaideAssociate Investigator
David HallQUTPhD Candidate
David BallQUTResearch Fellow
Dan RichardsQUTPhD Candidates
Clinton FookesQUTAssociate Investigator
Chuong NguyenANUResearch Fellow
Chunhua ShenUniversity of AdelaideChief Investigator
Chris McCoolQUTResearch Fellow
Chris LehnertQUTResearch Fellow
Chris JefferyQUTPhD Candidate
Bohan ZhuangUniversity of AdelaidePhD Candidate
Ben UpcroftQUTChief Investigator
Ben TalbotQUTPhD Candidate
Ben MeyerMonashPhD Candidate
Ben HarwoodMonashPhD Candidate
Basura FernandoANUResearch Fellow
Anton Van Den HengelUniversity of AdelaideChief Investigator
Anthony DickUniversity of AdelaideAssociate Investigator
Anoop CherianANUResearch Fellow
Anjali JaiprakashQUTResearch Fellow
Andrew SpekMonashPhD Candidate
Andrew EnglishQUTPhD Candidate
Andrew DavisonImperial College LondonPartner Investigator
Andres Felipe Marmol VelezQUTPhD Candidate
Anders ErikssonQUTResearch Fellow
Alex ZelinskyDefence Science and Technology OrganisationCentre Advisory Committee
Ajay PandeyQUTResearch Fellow
Ahmet SekerciogluMonash UniversityAssociate Investigator
Adam TowQUTPhD Candidate
Adam JacobsonQUTPhD Candidate