By Josh Baxt
The Qualcomm Innovation Fellowship (QIF) recognizes creative Ph.D. students, providing them with funding, mentoring and other resources to pursue innovative research. This year, five UC San Diego Jacobs School of Engineering teams were awarded fellowships – four from Computer Science and Engineering (CSE) and one from Electrical and Computer Engineering (ECE).
“This is the most QIF awards UC San Diego has ever received in a single year,” said CSE Department Chair Sorin Lerner. “We are honored by Qualcomm’s commitment to our students and excited to watch them solve important and impactful research problems.”
Each team will receive $100,000 from Qualcomm to pursue cutting-edge research on autonomous vehicles, natural language processing and other areas.
“It is great to see the UC San Diego engineering graduate students thrive as participants in the Qualcomm Innovation Fellowship program,” said John Smee, Qualcomm’s vice president of Engineering. “Congratulations to all of the student finalists and winners this year.”
Team: Dominique Meyer (Ph.D. 2021) and Henry Zhang (Ph.D. 2024)
Advisors: CSE Professor Henrik Christensen, Director of the Contextual Robotics Institute; Professor Falko Kuester, Structural Engineering; Professor Todd Hylton, Mechanical and Aerospace Engineering and Executive Director of the Contextual Robotics Institute
Project: Spatiotemporal Fusion of Radar, Vision and LIDAR Data for Autonomous Driving
Autonomous vehicles use different sensor types to adapt to road conditions, traffic, weather and other hazards. The value of each sensor type shifts as circumstances change around the vehicles.
Multiple sensing technologies improve performance, but also pull heavily on the vehicle’s minimal processing power.
Building on work conducted at the Autonomous Vehicle Laboratory and DroneLab, Meyer and Zhang are developing a system that adjusts how sensor data is fused based on driving conditions to create a dynamic sensor fusion algorithm.
“The work on sensor fusion for autonomous driving vehicles the QIF fellows in my group are conducting is a rich data science problem of modeling sensors, fusion of information and generating actionable knowledge to operate in a dynamic and uncertain world,” said Christensen. “Qualcomm’s support for our students is invaluable for their studies, building direct links to real-world problems and helping them establish a broader world view.”
Team: Shuyang Li (Ph.D. 2022) and Bodhisattwa Prasad Majumder (Ph.D. 2022)
Advisor: CSE Associate Professor Julian McAuley
Project: Toward Personalized and Multimodal Conversational Recommender Systems
Working in the Julian McAuley lab, Li and Majumder have been investigating natural language processing to develop a conversational recommender system. The team was one of ten finalists in the Amazon Alexa Prize 2019-2020 for their efforts to build dialog systems that conduct engaging conversations with users.
Li’s research focuses on machine learning for text generation (recipes, news and dialog) and learning from unstructured fact collections. Majumder has designed more personalized and empathetic machine learning systems. He has published on language and dialog generation, common sense reasoning and information extraction.
“We believe this approach can be particularly impactful in a variety of user-facing applications, such as recommendation engines in product marketplaces, ad-targeting systems and customer support,” said McAuley. “For these applications, we must provide explanations that are interpretable by laypeople, and those explanations should be personalized to each individual user. Conversational frameworks increase accessibility, facilitate new forms of interaction and make recommender systems more empathetic.”
Team: Minghua Liu (Ph.D 2024) and Xiaoshuai Zhang (Ph.D. 2024)
Advisor: CSE Assistant Professor Hao Su
Project: Learning-Based 3D Mesh Reconstruction
3D reconstruction captures an object’s shape and appearance from sensor data, providing insights that cannot be easily gleaned from 2D observations.
3D data can be presented in several formats, such polygon meshes, which capture geometric shapes more efficiently, making them ideal for autonomous driving. While creating high-quality 3D meshes from point clouds is a prerequisite for many applications, current approaches can be problematic.
To overcome these limitations, the team is developing ways to better handle ambiguous structures, noise and incomplete data to create a system that supports robotics, autonomous driving, augmented reality and other applications.
Team: Sai Bi (Ph.D. 2021) and Zhengquin Li (Ph.D. 2021)
Advisors: CSE Assistant Professor Manmohan Chandraker and Professor Ravi Ramamoorthi
Project: Physically Motivated Deep Inverse Rendering from Sparse Inputs
Image formation is a complex process, in which lighting, materials and geometry interact to determine final appearance. Inverse rendering reconstructs a scene from a small set of images or sometimes a single image.
Current methods require expensive, carefully calibrated setups, or assume simplified physical models, reducing performance. Even deep learning methods have problems addressing limited data.
“The human eye is sensitive to all these details,” said Chandraker. “That’s why removing these artifacts is so important. For a true augmented reality experience, everything has to be just right.”
Bi and Li are developing inverse rendering networks that require only light-weight setups to handle complex visual effects, such as spatially varying lighting and global illumination. This work could potentially turn mobile phones into powerful augmented reality and 3D modeling devices.
Team: Casey Hardy (Ph.D. 2021) and Abdullah Abdulslam (Ph.D. 2021)
Advisors: ECE Assistant Professor Hanh-Phuc Le and Associate Professor Patrick Mercier
Project: Vertical Hybrid Power Delivery for High-Performance Processors and Digital Systems
As data processing requirements increase for mobile devices and autonomous vehicles, the industry needs higher performing processors. However, as performance increases, so do power demands.
Mobile devices must maximize battery life and minimize heat generation, limiting their performance. Autonomous vehicles rely on input/output (I/O) processor pins to handle large amounts of sensor data. However, a large number of pins are needed for power delivery. As a result, power demands can generate data processing bottlenecks. Hardy and Abdulslam are using a novel power converter architecture to operate at optimal efficiency while reducing power losses.
The team’s preliminary analysis shows this architecture can increase power delivery efficiency by up to 12 percent, as well as reducing heat generation and increasing I/O pin availability for laptops, smart phones and autonomous vehicles.
“We really appreciate Qualcomm (QTI) and the QIF program to support us on this project and the opportunity to work closely with QTI engineers to benefit from their immense mass-production experiences for the success of our project,” said Le. “With this support, we are excited to tackle one of the most urgent and challenging problems in modern high-performance computing systems, power delivery and management.”