Research Engineer Intern - Perception, E2E Autonomous Driving

We are seeking a highly motivated Research Intern to contribute to the development of next-generation end-to-end autonomous driving (E2E-AD) models inspired by recent advancements such as UniAD, VAD, and multi-task learning approaches. This internship provides a unique opportunity to work on unified, perception-to-planning architectures that integrate vision, sensor fusion, and control in a data-driven manner. The intern will work closely with researchers and engineers to develop models that enable self-driving vehicles to perceive, predict, and plan efficiently in real-world environments.

Responsibilities:

• Conduct research on end-to-end autonomous driving architectures, focusing on unified perception, prediction, and planning models.

• Implement and optimize multi-task learning approaches for driving tasks, including object detection, motion prediction, and trajectory planning.

• Work with sensor fusion techniques combining multi-modal inputs (e.g., camera, LiDAR, radar) to improve perception and decision-making.

• Develop spatio-temporal and motion planning transformers for holistic driving scene understanding

• Train, fine-tune, and evaluate models using large-scale autonomous driving datasets and internal Plus datasets

• Utilize simulators to test and validate models in diverse driving scenarios.

• Optimize real-time inference and deployment of driving models for efficient execution on edge devices.

• Contribute to research publications and open-source implementations of E2E-AD models.

Required Skills:

• Pursuing MS or PhD in CS, EE, mathematics, statistics or related field

• Thorough understanding of deep learning principles and familiarity with perception, prediction and planning models

• Proficiency in Python and deep learning frameworks such as PyTorch or TensorFlow.

• Experience with computer vision and sensor processing techniques.

• Strong analytical and problem-solving skills.

Preferred Skills:

• Past experiences in projects involving design, training or fine-tuning of various autonomous driving related models

• Familiarity with autonomous driving datasets (e.g., nuScenes, Waymo).

• Hands-on experience with simulators like CARLA, AirSim, or equivalent.

• Knowledge of robotics and motion planning algorithms is a plus.

• Publication record in relevant venues (CVPR, ICLR, ICCV, ECCV, NeurIPS, AAAI, SIGGRAPH)