Demos

Aerial Writing

A hybrid force and position Nonlinear Model-Predictive Controller (NMPC) for aerial manipulation showcased by a drone writing on a whiteboard [1].

Aggressive Drone Flight and Failure Recovery using NMPC

Nonlinear MPC with Motor Failure Identification and Recovery for Safe and Aggressive Multicopter Flight [2‌‌].

Drone Exploration

Fast Frontier-based Information-driven Autonomous Exploration with an MAV [3‌‌‌].

Adaptive-resolution Mapping

Adaptive-resolution octree-based volumetric SLAM [4‌‌‌‌].

MID-Fusion

https://www.youtube.com/watch?v=gturboNl9gg;feature=youtu.be

MID-Fusion: Octree-based Object-Level Multi-Instance Dynamic SLAM [5‌‌‌‌‌].

InteriorNet

https://www.youtube.com/watch?v=2OPE4KIE4dI;feature=youtu.be

InteriorNet: Mega-scale Multi-sensor Photo-realistic Indoor Scenes Dataset [6‌‌‌‌‌‌].

Downloads and further information at https://interiornet.org/ .

Fusion++

https://www.youtube.com/watch?v=2luKNC03x4k;feature=youtu.be

Fusion++: Volumetric Object-Level SLAM [7‌‌‌‌‌‌‌].

In collaboration with the Dyson Robotics Lab.

Fully Autonomous Multicopters

Fully autonomous MAV flight and landing on a moving target using visual-inertial estimation and model-predictive control [8‌‌‌‌‌‌‌‌].

In collaboration within Aerial Additive Manufacturing (the Aerial Robotics Lab)

Dense RGB-D-Inertial SLAM with Map Deformations

https://www.youtube.com/watch?v=-gUdQ0cxDh0;feature=youtu.be

Dense RGB-D-Inertial SLAM with Map Deformations [9‌‌‌‌‌‌‌‌‌].

In collaboration with the Dyson Robotics Lab.

SemanticFusion

https://www.youtube.com/watch?v=cGuoyNY54kU;feature=youtu.be

SemanticFusion: Dense 3D Semantic Mapping with Convolutional Neural Networks [10‌‌‌‌‌‌‌‌‌‌].

In collaboration with the Dyson Robotics Lab.

Monocular, Real-Time Surface Reconstruction

https://www.youtube.com/watch?v=UB_HDJU6LL4;feature=youtu.be

Monocular, Real-Time Surface Reconstruction using Dynamic Level of Detail [11‌‌‌‌‌‌‌‌‌‌‌].

In collaboration with the Dyson Robotics Lab.

ElasticFusion

https://www.youtube.com/watch?v=XySrhZpODYs;feature=youtu.be

ElasticFusion: Real-Time Dense SLAM and Light Source Estimation [12‌‌‌‌‌‌‌‌‌‌‌‌].

In collaboration with the Dyson Robotics Lab.

OKVIS: Open Keyframe-based Visual Inertial SLAM

 

Keyframe-Based Visual-Inertial Odometry Using Nonlinear Optimisation [13‌‌‌‌‌‌‌‌‌‌‌‌‌],[14‌‌‌‌‌‌‌‌‌‌‌‌‌‌]

Code available under BSD, see software.

BRISK

Binary Robust Invariant Scalable Keypoints [15‌‌‌‌‌‌‌‌‌‌‌‌‌‌‌]

Code available under BSD, see software.

Solar Aeroplane Operations

senseSoar solar aeroplane: first test flights.

 


[1] Dimos Tzoumanikas, Felix Graule, Qingyue Yan, Dhruv Shah, Marija Popovic, Stefan Leutenegger, Aerial Manipulation Using Hybrid Force andPosition NMPC Applied to Aerial Writing, Robotics: Science and Systems (RSS), 2020
[10‌‌‌‌‌‌‌‌‌‌] J McCormac, A Handa, A Davison, S Leutenegger, SemanticFusion: Dense 3D Semantic Mapping with Convolutional Neural Networks, 2016
[11‌‌‌‌‌‌‌‌‌‌‌] J Zienkiewicz, C Tsiotsios, AJ Davison, S Leutenegger, Monocular, Real-Time Surface Reconstruction using Dynamic Level of Detail, 2016
[12‌‌‌‌‌‌‌‌‌‌‌‌] T. Whelan, R. F. Salas-Moreno, B. Glocker, A. J. Davison, S. Leutenegger, ElasticFusion: Real-Time Dense SLAM and Light Source Estimation, Intl. J. of Robotics Research, IJRR, 2016
[13‌‌‌‌‌‌‌‌‌‌‌‌‌] Stefan Leutenegger, Paul Timothy Furgale, Vincent Rabaud, Margarita Chli, Kurt Konolige, Roland Siegwart, Keyframe-Based Visual-Inertial SLAM using Nonlinear Optimization., Robotics: Science and Systems, 2013
[14‌‌‌‌‌‌‌‌‌‌‌‌‌‌] Stefan Leutenegger, Simon Lynen, Michael Bosse, Roland Siegwart, Paul Furgale, Keyframe-based visual–inertial odometry using nonlinear optimization, The International Journal of Robotics Research, pp.0278364914554813, 2014
[15‌‌‌‌‌‌‌‌‌‌‌‌‌‌‌] Stefan Leutenegger, Margarita Chli, Roland Yves Siegwart, BRISK: Binary robust invariant scalable keypoints, Computer Vision (ICCV), 2011 IEEE International Conference on, pp.2548–2555, 2011
[2‌‌] Dimos Tzoumanikas, Qingyue Yan, Stefan Leutenegger, Nonlinear MPC with Motor Failure Identification and Recovery for Safe and Aggressive Multicopter Flight, 2020 International Conference on Robotics and Automation (ICRA), 2020
[3‌‌‌] Anna Dai, Sotiris Papatheodorou, Nils Funk, Dimos Tzoumanikas, Stefan Leutenegger, Fast Frontier-based Information-driven Autonomous Exploration with an MAV, 2020 International Conference on Robotics and Automation (ICRA), 2020
[5‌‌‌‌‌] Binbin Xu, Wenbin Li, Dimos Tzoumanikas, Michael Bloesch, Andrew Davison, Stefan Leutenegger, MID-Fusion: Octree-based Object-Level Multi-Instance Dynamic SLAM, arXiv preprint arXiv:1812.07976, 2018
[6‌‌‌‌‌‌] Wenbin Li, Sajad Saeedi, John McCormac, Ronald Clark, Dimos Tzoumanikas, Qing Ye, Yuzhong Huang, Rui Tang, Stefan Leutenegger, InteriorNet: Mega-scale Multi-sensor Photo-realistic Indoor Scenes Dataset, British Machine Vision Conference (BMVC), 2018
[7‌‌‌‌‌‌‌] John McCormac, Ronald Clark, Michael Bloesch, Andrew Davison, Stefan Leutenegger, Fusion++: Volumetric Object-Level SLAM, 2018
[8‌‌‌‌‌‌‌‌] Dimos Tzoumanikas, Wenbin Li, Marius Grimm, Ketao Zhang, Mirko Kovac, Stefan Leutenegger, Fully autonomous MAV flight and landing on a moving target using visual-inertial estimation and model-predictive control, Journal of Field Robotics, 2018
[9‌‌‌‌‌‌‌‌‌] Tristan Laidlow, Michael Bloesch, Wenbin Li, Stefan Leutenegger, Dense RGB-D-Inertial SLAM with Map Deformations, Intelligent Robots and Systems (IROS), 2017 IEEE/RSJ International Conference on, 2017