$whoami
Si-Yu Lu
PhD Candidate @ NTU
CMLab AIMM Group · National Taiwan University
Advised by Wen-Huang Cheng
PhD Candidate at National Taiwan University, researching 3D/4D Reconstruction, Visual Relocalization, and Geometric Foundation Models. My current research focus is on unified 4D continuous perception models.
$research_interests
3D Vision3D/4D ReconstructionGeometric Foundation ModelsVisual RelocalizationNeRF/3DGSWorld ModelPhysical AIGenerative ModelsAutonomous VehiclesAutonomous Mobile RobotEmbedded System
$education
Ph.D. (in progress)Sep 2022 - Now
National Taiwan University
Department of Computer Science and Information Engineering
Advisor: Wen-Huang Cheng
GPA: 4.20
Master of ScienceSep 2020 - Aug 2022
National Taiwan University of Science and Technology
Department of Electronic and Computer Engineering
Advisor: Yung-Yao Chen
Final GPA: 3.96
Bachelor of ScienceSep 2018 - Jun 2020
National Taiwan University of Science and Technology
Department of Electronic and Computer Engineering
Final GPA: 3.63
$publications
Training-Free Adaptation of Visual Geometry Foundation Models for Scene-Generalizable Localization
Under review at ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)
OVGGT: O(1) Constant-Cost Streaming Visual Geometry Transformer
Accepted to European Conference on Computer Vision (ECCV) · 2026
SeCo: Semantic-Guided Multimodal Color Splash Effects
ACM Transactions on Multimedia Computing, Communications and Applications (TOMM) · 2026
3D Multi-modal Object Detection Based on Cross-Attention Feature Fusion
International Conference on Robotics and Automation (ICRA) · 2025
Learning Based Heatmap Guided Model for Monocular Visual Odometry
IEEE Transactions on Instrumentation and Measurement (IEEE TIM) · 2025
Radiance Field-Based Pose Estimation via Decoupled Optimization Under Challenging Initial Conditions
Winter Conference on Applications of Computer Vision (WACV) · 2025
Eyeing3D: Perceiving 3D from 2D Images
IET International Conference on Engineering Technologies and Applications (ICETA) · 2023
Fast Learning-Based 3-D LiDAR Localization with Multiscale Feature Recursive Matching for Autonomous Driving
International Automatic Control Conference (CACS) · 2022
$awards
First Place, Graduate Student
National Chung Hsing University Competition on "AI Empowerment and Robotics in Smart Manufacturing Applications" · 2025
Best Paper Award, First Place
IET International Conference on Engineering Technologies and Applications · 2023
Best Popularity Award
Intel DevCup, "AI in Practice" track · 2022
Best Paper Award & Best Student Paper Award, Second Place
CACS International Automatic Control Conference · 2022
Certificate of Achievement
National Taiwan University of Science and Technology · 2020
Honorable Mention
AIGO Competition (Taiwan Industrial Development Administration) · 2020
National First Prize
Contemporary Undergraduate Mathematical Contest in Modeling · 2017
$experience
Research Assistant (Industry collaborations) · Kingston Technology Corp.
- AI-KM System Development and Validation (2025.06 - Present)
Research Assistant (Industry collaborations) · Industrial Technology Research Institute (ITRI)
- Solid-State LiDAR Perception and 3D Object Tracking (2024.12 - 2026.02)
- Bridge Inspection System (2025.02 - 2026.06)
Research Assistant (Projects) · National Science and Technology Council (NSTC)
- Collision-Avoidance Motion Planning for Multi-Human Multi-Robot Collaboration Based on Multimodal Perception and AI Path Generation (2025.06 - 2026.07)
- 5G-AI Human-Robot Collaboration Technology Applying High-Precision Full-Field Stereo Vision and Heterogeneous Sensor Fusion to Human Pose Prediction and Robotic Arm Path Planning (2023.06 - 2025.07)
$projects
OVGGT
A training-free framework enabling streaming 3D reconstruction from arbitrarily long video with constant memory and compute.
$services
Journal Reviewer
- IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
- IEEE Transactions on Consumer Electronics (TCE)
Conference Reviewer
- ACM Multimedia (ACM MM)
- IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
$certificates
JLPT N2 Certificate
Japanese-Language Proficiency Test · 2020
AHK Automation Engineer Assistant
German Industry and Commerce (AHK) · 2018