Bo-Ruei (Ray) Huang

I'm a senior undergrad double major in electrical engineering and computer science at National Taiwan University, advised by Shao-Hua Sun as part of NTU Robot Learning Lab.

Currently, I'm visiting MIT CSAIL as a visiting student, working with Jiayuan Mao, Xiaolin Fang, Leslie Pack Kaelbling, and Joshua B. Tenenbaum. I spent the summer of 2023 at Caltech GPS working with Yuk L. Yung.

Email (b09901171 [AT] ntu.edu.tw)  /  CV  /  Google Scholar  /  Twitter  /  GitHub  /  LinkedIn

profile photo

News

Research

The goal of my research is to make robots learn to help humans in their daily lives, especially in long-horizon and open-world tasks. I am interested in reinforcement learning, imitation learning, planning, and representation learning.

Pre-Prints

KALM Keypoint Abstraction using Large Models for Object-Relative Imitation Learning
Xiaolin Fang*, Bo-Ruei Huang*, Jiayuan Mao*, Jasmine Shone,
Joshua B. Tenenbaum, Tomás Lozano-Pérez, Leslie Pack Kaelbling (* equal contribution)

Under Review, 2024
project page / arXiv (comming soon)

KALM uses VLMs to automatically generate task-relevant keypoints for better generalization in robot manipulation tasks.

Publications

DIFO Diffusion Imitation from Observation
Bo-Ruei Huang, Chun-Kai Yang, Chun-Mao Lai, Dai-Jie Wu, Shao-Hua Sun
NeurIPS, 2024
project page / arXiv / bibtex

DIFO is a learning from demonstration algorithm that integrates diffusion models to model state transitions and provide robust rewards to improve policy learning without action labels.

OCO2 Improving XCO2 Precision in OCO-2/3 Retrievals through Machine Learning-Enabled Extraction of Volcanic Aerosol Information from L1B Spectra
Bo-Ruei Huang, Sihe Chen, Vijay Natraj, Zhao-Cheng Zeng, Yangcheng Luo, and Yuk L. Yung
AGU, 2023
poster / bibtex

An improved machine learning algorithm refines aerosol data from OCO satellite spectra to enhance CO2 retrieval accuracy and advance climate impact models of volcanic aerosols.


Template