index.html

---
layout: default
---
<div class="home">
  <!-- <h2>About</h2> -->
  <img src="{{ '/images/group2023.jpg' | relative_url }}" alt="RPL lab members"  style="width:100%; margin-bottom: 30px;" class="profile">
  <p>Welcome to the Robot Perception and Learning (RPL) Lab at the University of Texas at Austin! Our research focuses on two intimately connected research threads: <strong>Robotics</strong> and <strong>Embodied AI</strong>. We investigate the synergistic relations of perception and action in embodied agents and build algorithms and systems that give rise to <em>general-purpose robot autonomy</em>.</p>
  <p>In Robotics, we develop methods and principles that enable autonomous robots to reason about the real world through their senses, perform a wide range of tasks flexibly, and learn new tasks adaptively. To deploy generalist robots in the wild, we must deal with the variability and uncertainty of unstructured environments. We address this challenge by closing the perception-action loop using robot perception and learning techniques. In Embodied AI, we build computational frameworks of embodied agents. In these frameworks, perception arises from an embodied agent's active, situated, and skillful interactions in the open world, and its ability to make sense of the world through the lenses of perception, in turn, facilitates intelligent behaviors.</p>
  <p>Our work draws theories and methods from robotics, machine learning, and computer vision, along with inspirations from human cognition, neuroscience, and philosophy, to solve open problems at the forefront of Robotics and AI. We are always looking for talented members to <a href="opportunities/">join our group</a>.</p>
  <hr>
  <h4>Recent News</h4>
  <p>
    <ul>
      <li><p>We are thrilled to host <a href="https://2026.corl.org/">CoRL 2026</a> in Austin this November, with Yuke Zhu serving as General Chair. We look forward to welcoming you to Austin!</p></li>
      <li><p>We released a new talk, &quot;Building Generalist Humanoid Robots,&quot; highlighting our recent research on humanoid robots. Check out the <a href="{{ '/talks/building_generalist_humanoid_robots.pdf' | relative_url }}">slides</a> and <a href="https://www.youtube.com/watch?v=cNU_8t7i8Mk">video</a>.</p></li>
      <li><p>We have three papers accepted at <a href="https://2026.ieee-icra.org/">ICRA 2026</a> and three papers accepted at <a href="https://iclr.cc/Conferences/2026">ICLR 2026</a>.</p></li>
      <li><p>Yuke Zhu received the <a href="https://www.ieee-ras.org/awards-recognition/society-awards/early-academic-career-award-in-robotics-and-automation/">IEEE RAS Early Career Award</a> for his work on robot learning and open-source software.</p></li>
      <li><p>We released a new talk &quot;Data Pyramid and Data Flywheel for Robotic Foundation Models&quot; that summarizes our research vision and recent works. See the <a href="{{ '/talks/data_pyramid_and_data_flywheel_for_robotic_foundation_models.pdf' | relative_url }}">slides</a> and <a href="https://ai.princeton.edu/events/robotics-symposium-videos">video</a> here.</p></li>
      <!-- <li><p>Our lab has six papers accepted at <a href="https://2025.ieee-icra.org/">ICRA 2025</a>. See you there in Atlanta!</p></li> -->
      <!-- <li><p>We released <a href="https://robosuite.ai/">robosuite</a> v1.5, supporting diverse robot embodiments such as humanoids and better controller designs.</p></li> -->
      <!-- <li><p>Three papers are accepted at <a href="https://www.corl.org/">CoRL 2024</a>, including one oral presentation for <a href="https://ut-austin-rpl.github.io/OKAMI/">OKAMI</a>.</p></li> -->
      <!-- <li><p>We released <a href="https://robocasa.ai/">RoboCasa</a>, a large-scale simulation framework of everyday tasks for generalist robots.</p></li> -->
      <!-- <li><p>We have four papers accepted at <a href="https://2024.ieee-icra.org/">ICRA 2024</a> and four papers at <a href="https://roboticsconference.org/">RSS 2024</a>.</p></li> -->
      <!-- <li><p>Yuke gave an <a href="https://www.corl2023.org/speakers">early-career keynote talk</a> at <a href="https://www.corl2023.org/">CoRL'23</a> on November 8th. See <a href="talks/pathway_to_generalist_robots.pdf">slides</a> and <a href="https://youtu.be/hFPZSBnJeLc">video</a> here.</p></li> -->
      <!-- <li><p>We are co-organizing a <a href="https://www.corl2023.org/">CoRL'23</a> workshop on <a href="https://corl2023deployable.github.io/">Towards Reliable and Deployable Learning-Based Robotic Systems</a>.</p></li> -->
      <!-- <li><p>Our RSS paper <a href="https://ut-austin-rpl.github.io/sirius/">Sirius</a> is nominated as a Best Paper Award Finalist at <a href="https://roboticsconference.org/">RSS 2023</a>.</p></li> -->
      <!-- <li><p>Talk recordings of our <a href="https://sites.google.com/view/cvpr2023-3d-vision-robotics/">CVPR'23 workshop on 3D Vision and Robotics</a> are released on our <a href="https://www.youtube.com/playlist?list=PLdShcRn_apktZSvdvJaKvfnqnuxpE0pf5">YouTube channel</a>.</p></li> -->
      <!-- <li><p>Our lab has four papers accepted at <a href="https://www.icra2023.org">ICRA 2023</a>, <a href="https://roboticsconference.org/">RSS 2023</a> and <a href="https://icml.cc/">ICML 2023</a>.</p></li> -->
      <!-- <li><p>Our <a href="https://minedojo.org/">MineDojo</a> work received the Outstanding Paper Award at <a href="https://blog.neurips.cc/2022/11/21/announcing-the-neurips-2022-awards/">NeurIPS 2022</a>.</p></li> -->
      <!-- <li><p>We have two papers accepted at <a href="https://corl2022.org">CoRL 2022</a> and two at <a href="https://nips.cc">NeurIPS 2022</a>.</p></li> -->
      <!-- <li><p>We received a second <a href="https://www.amazon.science/research-awards/recipients/yuke-zhu-fall-2021">Amazon Research Award</a> on our 3D perception research.</p></li> -->
      <!-- <li><p>Our <a href="https://b0ku1.github.io/acid/">ACID</a> paper is nominated as a finalist for the Best Student Paper award at <a href="https://roboticsconference.org/">RSS 2022</a>.</p></li> -->
      <!-- <li><p>Our <a href="https://ut-austin-rpl.github.io/maple/">MAPLE</a> paper won the Outstanding Learning Paper award at <a href="https://www.icra2022.org/">ICRA 2022</a>.</p></li> -->
      <!-- <li><p>We had a great <a href="https://teros-texas.github.io/">Texas Regional Robotics Symposium</a> (TEROS). See you next year!</p></li> -->
      <!-- <li><p>Our lab has three papers accepted at <a href="https://cvpr2022.thecvf.com/">CVPR 2022</a>, including two oral presentations.</p></li> -->
      <!-- <li><p>We received the <a href="https://www.nsf.gov/awardsearch/showAward?AWD_ID=2145283">NSF CAREER award</a> to support our research on intelligent robot manipulation.</p></li> -->
      <!-- <li><p>Our lab has four papers accepted at <a href="https://www.icra2022.org">ICRA 2022</a> and <a href="https://www.ieee-ras.org/publications/ra-l">RA-L</a>.</p></li>
      <li><p>We released <a href="https://github.com/ARISE-Initiative/robosuite">robosuite v1.3</a> with new rendering tools and APIs to vision modalities.</p></li> -->
      <!-- <li><p>Our lab has two papers accepted at <a href="https://www.robot-learning.org/">CoRL 2021</a>, including one oral presentation.</p></li>
      <li>We released <a href="https://arise-initiative.github.io/robomimic-web/">robomimic</a>, an open-source framework for robot learning from demonstration.</p></li> -->
      <!-- <li>Talk recordings of our <a href="https://sites.google.com/view/cvpr2021-3d-vision-robotics">CVPR'21 workshop on 3D Vision and Robotics</a> are released on our <a href="https://www.youtube.com/playlist?list=PLdShcRn_apks7YWqxWJHWsbaOOfMaD3_6">YouTube channel</a>.</p></li>
      <li>We are organizing the <a href="https://rssvlrr.github.io/">Workshop on Visual Learning and Reasoning for Robotics</a> at RSS 2021.</p></li>
      <li><p>Our lab received <a href="https://www.amazon.science/research-awards">Amazon Research Award</a> for research on 3D perception for robot manipulation.</p></li> -->
      <!-- <li><p>We have two papers accepted at <a href="https://roboticsconference.org/">RSS 2021</a> and three papers at <a href="https://icml.cc/">ICML 2021</a>.</p></li> -->
      <!-- <li><p>Our work on <a href="https://roboturk.stanford.edu/multiarm">multi-arm manipulation</a> is nominated as finalist for Best Multi-robot Systems Paper.</p></li> -->
      <!-- <li><p>We have six papers accepted at <a href="http://www.icra2021.org/">ICRA 2021</a> and one paper accepted at <a href="https://iclr.cc/">ICLR 2021</a>.</p></li> -->
      <!-- <li>We released the <a href="https://github.com/ARISE-Initiative/robosuite/releases/tag/v1.2">v1.2 version</a> of <a href="https://robosuite.ai">robosuite</a> with new sensor APIs, randomization techniques for sim2real, enhanced controllers, and human demonstrations.</p></li> -->
      <!-- <li>We are organizing the <a href="https://eml-workshop.github.io/">Workshop on Embodied Multimodal Learning</a> at ICLR 2021 and the <a href="https://sites.google.com/view/cvpr2021-3d-vision-robotics/home">Workshop on 3D Vision & Robotics</a> at CVPR 2021. We invite contributions to these two workshops.</p></li> -->
      <!-- <li><p>We released <a href="https://robosuite.ai">robosuite</a> v1.0, a modular simulation framework and benchmark for robot learning.</p></li> -->
      <!-- <li><p>I will be serving as an Area Chair for <a href="https://www.robot-learning.org/">CoRL 2020</a>, <a href="http://cvpr2021.thecvf.com/">CVPR 2021</a>, and <a href="http://iccv2021.thecvf.com">ICCV 2021</a>.</p></li> -->
      <!-- <li><p>I gave a talk (<a href="https://www.youtube.com/watch?v=vxdxIBXC9x4">video</a>) at Samsung Forum on our latest research work on robot learning and perception.</p></li> -->
      <!-- <li><p>We are organizing a workshop on <a href="https://sites.google.com/view/rss20vlrrm">Visual Learning and Reasoning for Robotic Manipulation</a> (virtually) at <a href="https://roboticsconference.org/">RSS 2020</a>. We invite submissions of short papers and extended abstracts.</p></li> -->
      <!-- <li><p>I will be teaching a new version of <a href="https://www.cs.utexas.edu/~yukez/teaching/">CS391R: Robot Learning</a> in the fall semester.</p></li> -->
      <!-- <li><p><a href="http://ai.stanford.edu/blog/cavin/">New blog post</a> of our work on long-horizon planning for robot manipulation! We also released <a href="https://github.com/StanfordVL/robovat">RoboVat</a>, our robot learning framework that unifies simulation and robot control interfaces.</p></li> -->
    </ul>
  </p>
  <p>&nbsp;</p>
  </div>
</div>