KeisukeTateno

Chair for Computer Aided Medical Procedures & Augmented Reality
Lehrstuhl für Informatikanwendungen in der Medizin & Augmented Reality

THIS WEBPAGE IS DEPRECATED - please visit our new website

Keisuke Tateno (立野 圭祐)

Me

Contact

Keisuke Tateno, M.Eng.

Email tateno@in.tum.de
Office tel +49 89 289 19435
room MI 03.13.035
Address Institut für Informatik I-16, Technische Universität München
Boltzmannstr. 3, 85748 Garching b. München, Germany
Groups Computer Vision

Short CV

  • Since January 2015: External doctoral student at CAMP, Computer Vision Team in cooperation with Canon Inc.
  • 2007-present: Engineer at Canon Inc., Tokyo, Japan.
  • 2005-2007: Master student in Systems and Information Engineering at University of Tsukuba, Tsukuba, Japan. Thesis: A Nested Marker for Augmented Reality.
  • 2001-2005: Bachelor student in Engineering systems at University of Tsukuba, Tsukuba, Japan. Thesis: Enhanced eyes for better gaze-awareness in collaborative mixed reality.

Research Interests

  • Simultaneous localization and mapping
  • 3D Scene Reconstruction & Segmentation
  • 3D Object Detection and Tracking
  • Robot Vision, Augmented Reality

Active research projects

Real-time Incremental Segmentation on Dense SLAM

Real-time Incremental Segmentation on Dense SLAM

Scientific Director: Dr. Federico Tombari

Contact Person(s): Keisuke Tateno Dr. Federico Tombari

Real-Time and Scalable Incremental Segmentation on Dense SLAM

This work proposes a real-time segmentation method for 3D point clouds obtained via Simultaneous Localization And Mapping (SLAM). The proposed method incrementally merges segments obtained from each input depth image in a unified global model using a SLAM framework. Differently from all other approaches, our method is able to yield segmentation of scenes reconstructed from multiple views in real-time, with a complexity that does not depend on the size of the global model.

When 2.5D is not enough: Simultaneous Reconstruction, Segmentation and Recognition on dense SLAM

While the main trend of 3D object recognition has been to infer object detection from single views of the scene --- i.e., 2.5D data --- this work explores the direction on performing object recognition on 3D data that is reconstructed from multiple viewpoints, under the conjecture that such data can improve the robustness of an object recognition system. To achieve this goal, we propose a framework which is able (i) to carry out incremental real-time segmentation of a 3D scene while being reconstructed via Simultaneous Localization And Mapping (SLAM), and (ii) to simultaneously and incrementally carry out 3D object recognition and pose estimation on the reconstructed and segmented 3D representations.

Large Scale and Long Standing Simultaneous Reconstruction and Segmentation

This work proposes a method to segment a 3D point cloud of a scene while simultaneously reconstructing it via Simultaneous Localization And Mapping (SLAM). The proposed method incrementally merges segments obtained from each input depth image in an unified global model leveraging the camera pose estimated via SLAM. Differently from other approaches, our method is able to yield segmentation of scenes reconstructed from multiple views in real-time and with a complexity that does not depend on the size of the global model. Moreover, we endow our system with two additional contributions: a loop closure approach and a failure recovery and re-localization approach, both specifically designed so to enforce global consistency between merged segments, thus making our system suitable for large scale and long standing reconstruction and segmentation.

CNN-SLAM: Real-time dense monocular SLAM with learned depth prediction

CNN-SLAM: Real-time dense monocular SLAM with learned depth prediction

Scientific Director: Dr. Federico Tombari

Contact Person(s): Keisuke Tateno Dr. Federico Tombari

CNN-SLAM: Real-time dense monocular SLAM with learned depth prediction

Given the recent advances in depth prediction from Convolutional Neural Networks (CNNs), this paper investigates how predicted depth maps from a deep neural network can be deployed for accurate and dense monocular reconstruction. We propose a method where CNN-predicted dense depth maps are naturally fused together with depth measurements obtained from direct monocular SLAM. Our fusion scheme privileges depth prediction in image locations where monocular SLAM approaches tend to fail, e.g. along low-textured regions, and vice-versa. We demonstrate the use of depth prediction for estimating the absolute scale of the reconstruction, hence overcoming one of the major limitations of monocular SLAM. Finally, we propose a framework to efficiently fuse semantic labels, obtained from a single frame, with dense SLAM, yielding semantically coherent scene reconstruction from a single view. Evaluation results on two benchmark datasets show the robustness and accuracy of our approach.

Publications

2021
S. Wu, J. Wald, K. Tateno, N. Navab, F. Tombari
SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequences
IEEE Computer Vision and Pattern Recognition (CVPR), June 2021. (bib)
2020
S. Wu, K. Tateno, N. Navab, F. Tombari
SCFusion: Real-time Incremental Scene Reconstruction with Semantic Completion
International Conference on 3D Vision 2020 (bib)
2019
H. Dhamo, K. Tateno, I. Laina, N. Navab, F. Tombari
Peeking Behind Objects: Layered Depth Prediction from a Single Image
Pattern Recognition Letters, Vol. 125, 2019 (bib)
2018
Y. Nakajima , K. Tateno, F. Tombari, H. Saito
Fast and Accurate Semantic Mapping through Geometric-based Incremental Segmentation
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain, October, 2018. (bib)
J. Wald, K. Tateno, J. Sturm, N. Navab, F. Tombari
Real-Time Fully Incremental Scene Understanding on Mobile Platforms
IEEE Robotics and Automation Letters (presented at IROS), Madrid, Spain, October 2018 (bib)
K. Tateno, N. Navab, F. Tombari
Distortion-Aware Convolutional Filters for Dense Prediction in Panoramic Images
15th European Conference on Computer Vision (ECCV), Munich, Germany, September, 2018. (bib)
2017
S.C. Lee, B. Fuerst, K. Tateno, A. Johnson, J. Fotouhi, G. Osgood, F. Tombari, N. Navab
Multi-modal Imaging, Model-based Tracking and Mixed Reality Visualisation for Orthopaedic Surgery
Healthcare Technology Letters Journal (IET HTL), September, 2017. This work won the outstanding paper award at AE-CAI 2017.
The final publication is available at http://digital-library.theiet.org/content/journals/10.1049/htl.2017.0066
(bib)
K. Tateno, F. Tombari, I. Laina, N. Navab
CNN-SLAM: Real-time dense monocular SLAM with learned depth prediction
IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Hawaii, USA, June, 2017.
The first two authors contribute equally to this paper.
(bib)
K. Tateno, F. Tombari, N. Navab
Large Scale and Long Standing Simultaneous Reconstruction and Segmentation
Computer Vision and Image Understanding (CVIU), Volume 157, Pages 138-150, April, 2017.
The final publication is available at http://www.sciencedirect.com/science/article/pii/S1077314216300662
(bib)
2016
C. Li , H. Xiao, K. Tateno, F. Tombari, N. Navab, G. D. Hager
Incremental Scene Understanding on Dense SLAM
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea, October, 2016. (bib)
K. Tateno, F. Tombari, N. Navab
When 2.5D is not enough: Simultaneous Reconstruction, Segmentation and Recognition on dense SLAM
IEEE International Conference on Robotics and Automation (ICRA), Stockholm, May 2016 (bib)
2015
K. Tateno, F. Tombari, N. Navab
Real-Time and Scalable Incremental Segmentation on Dense SLAM
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany, September 2015 (bib)

Software Download


UsersForm
Title: M.Sc.
Circumference of your head (in cm):  
Firstname: Keisuke
Middlename:  
Lastname: Tateno
Picture: tateno.jpg
Birthday:  
Nationality: Japan
Languages:  
Groups: Computer Vision
Expertise:  
Position: Scientific Staff
Status: Alumni
Emailbefore: tateno
Emailafter: in.tum.de
Room: MI 03.13.035
Telephone: +49 89 289 19435
Alumniactivity:  
Defensedate:  
Thesistitle:  
Alumnihomepage:  
Personalvideo01:  
Personalvideotext01:  
Personalvideopreview01:  
Personalvideo02:  
Personalvideotext02:  
Personalvideopreview02:  


Edit | Attach | Refresh | Diffs | More | Revision r1.24 - 07 Sep 2018 - 14:28 - DavidTan

Lehrstuhl für Computer Aided Medical Procedures & Augmented Reality    rss.gif