PhD Candidate @ NTU

Hi, I'm 嗨,这里是 嗨,這裏是 Si-Yu Lu

PhD Candidate at National Taiwan University, researching 研究方向: 研究方向: 3D Reconstruction, Geometric Foundation Models, and Visual Relocalization.

Si-Yu Lu

// About Me 关于我 關於我

I am currently pursuing my Ph.D. at CMLab AIMM Group, National Taiwan University, advised by Prof. Wen-Huang Cheng. I also work closely with Prof. Yung-Yao Chen at National Taiwan University of Science and Technology. My main research directions include 3D Reconstruction, Geometric Foundation Models, Visual Relocalization, Physical AI, and Generative Models. I also explore related areas such as Computer Vision (CV), Machine Learning (ML), Autonomous Vehicles (AV), Human-Computer Interaction (HCI), and Robotics/Automation. Please feel free to contact me if you are interested in my research or any of these topics.

我目前正于 CMLab AIMM Group, National Taiwan University 攻读博士学位,指导教授为 Wen-Huang Cheng. 同时,我也与 National Taiwan University of Science and Technology 的 Yung-Yao Chen 紧密合作。我的主要研究方向包括 三维重建, 几何基石模型/大模型, 视觉定位, 物理AI, 生成式模型. 同时我也探索相关领域,如计算机视觉 (CV)、机器学习 (ML)、自动驾驶 (AV)、人机交互 (HCI) 和机器人/自动化。如果您对我的研究或这些主题感兴趣,欢迎与我联系。

我目前正於 CMLab AIMM Group, National Taiwan University 攻讀博士學位,指導教授為 Wen-Huang Cheng. 同時,我也與 National Taiwan University of Science and Technology 的 Yung-Yao Chen 緊密合作。我的主要研究方向包括 三維重建, 幾何基石模型/大模型, 視覺定位, 物理AI, 生成式模型. 同時我也探索相關領域,如電腦視覺 (CV)、機器學習 (ML)、自動駕駛 (AV)、人機互動 (HCI) 和機器人/自動化。如果您對我的研究或這些主題感興趣,歡迎與我聯繫。

Research Interests 研究兴趣 研究興趣

3D Reconstruction Geometric Foundation Models Visual Relocalization Physical AI Generative Models Autonomous Vehicles Autonomous Mobile Robot
5+ Publications 发表 發表
10+ Reviews 审稿 審稿
2+ Projects 项目 專案
7+ Awards 奖项 獎項

// Publications 发表成果 發表成果

Selected research papers. 相关研究论文。 相關研究論文。

Radiance Field-Based Pose Estimation via Decoupled Optimization Under Challenging Initial Conditions

1st Author 第一作者 第一作者

Si-Yu Lu, Yung-Yao Chen, Yi-Tong Wu, Hsin-Chun Lin, Sin-Ye Jhong, Wen-Huang Cheng

Winter Conference on Applications of Computer Vision (WACV) · 2025

3D Multi-modal Object Detection Based on Cross-Attention Feature Fusion

Sin-Ye Jhong, Min-Hsuan Ho, Si-Yu Lu, Yung-Yao Chen*

International Conference on Robotics and Automation (ICRA) · 2025

Learning Based Heatmap Guided Model for Monocular Visual Odometry

Hsin-Chun Lin, Sin-Ye Jhong, Yu-Hsiu Lin, Jen-Kai Fang, Chi-An Chang, Si-Yu Lu, Yung-Yao Chen*

IEEE Transactions on Instrumentation and Measurement (IEEE TIM) · 2025

Eyeing3D: perceiving 3D from 2D images

Tai Peng, Kang-Yang Huang, Si-Yu Lu, Rou-An Chen, Jianlong Fu, Hong-Han Shuai, Wen-Huang Cheng

IET International Conference on Engineering Technologies and Applications (ICETA) · 2023

Fast Learning-Based 3-D Lidar Localization with Multiscale Feature Recursive Matching for Autonomous Driving

1st Author 第一作者 第一作者

Si-Yu Lu, Sin-Ye Jhong, Wei-Jia Cheng, Yung-Yao Chen*

International Automatic Control Conference (CACS) · 2022

// Projects 项目 專案

Projects and research implementations. 项目及研究实现 專案及研究實作

Active 进行中 進行中 Featured 精选 精選

[Test] 3D Gaussian Splatting Viewer

A real-time web-based viewer for 3D Gaussian Splatting scenes. Supports loading .ply files and provides interactive navigation with smooth rendering performance.

3D Reconstruction WebGL Gaussian Splatting

//Experience经历經歷

Work experience, internships, and industry-academia collaborations.工作经历、实习,以及产学合作等。工作經歷、實習,以及產學合作等。

Collaboration合作合作

GenAI PoC

Kingston Technology Corp.

2025-07 — Present至今至今

- Conducted a Proof of Concept (PoC) for an enterprise-grade Generative AI assistant, designed to streamline business operations and enhance workflow efficiency. - Analyzed validation datasets and performance metrics to assess model efficacy, while identifying strategic directions to optimize the AI’s generalization capabilities across diverse use cases.

GenAIKingstonPoC

//Services服务服務

Academic services and community contributions.学术服务与社群贡献。學術服務與社群貢獻。

Journal Reviewer (2025)

IEEE TPAMI, IEEE TCE

- IEEE Transactions on Pattern Analysis and Machine Intelligence - IEEE Transactions on Consumer Electronics

Conference Reviewer (2025)

ACM MM, WACV

- ACM Multimedia 2025 - IEEE/CVF Winter Conference on Applications of Computer Vision 2026

Journal Reviewer (2024)

IEEE TPAMI, IEEE TCE

- IEEE Transactions on Pattern Analysis and Machine Intelligence - IEEE Transactions on Consumer Electronics

Journal Reviewer (2024)

//Awards奖项獎項

Honors and recognition for research contributions.研究荣誉与奖项。研究榮譽與獎項。

First Place, Graduate Student

2025 National Chung Hsing University Competition on "AI Empowerment and Robotics in Smart Manufacturing Applications"

2025

First Place, Graduate Student

Best Paper Award, First Place

2023 lET International Conference on Engineering Technologies and Applications

2023

Best Paper Award, First Place

Best Paper Award & Best Student Paper Award, Second Place

2022 CACS International Automatic Control Conference

2022

Best Paper Award & Best Student Paper Award, Second Place

Best Popularity Award

Intel DevCup, “Al in Practice” track

2022

Best Popularity Award

//Certificates证书證照

Professional certifications, certificates, and courses.专业认证、证书,以及课程專業認證、證書,以及課程

JLPT N2 Certificate

Japanese-Language Proficiency Test

2020

JLPT N2 Certificate

AHK Automation Engineer Assistant

German Industry and Commerce (AHK)

2018

AHK Automation Engineer Assistant

Exchange Program Certificate

Landshut University of Applied Sciences

2017

Exchange Program Certificate