Uploaded August 2021 | Updated September 2026, 1 day ago
Embodied AI Lecture Series @ PRIOR
Visit prior.allenai.org/lectures for the full list of our lectures
OpenBot: Turning Smartphones into Robots
Matthias Mueller • Intelligent Systems Lab at Intel • (7/23/21)
Current robots are either expensive or make significant compromises on sensory richness, computational power, and communication capabilities. We propose to leverage smartphones to equip robots with extensive sensor suites, powerful computational abilities, state-of-the-art communication channels, and access to a thriving software ecosystem. We design a small electric vehicle that costs $50 and serves as a robot body for standard Android smartphones. We develop a software stack that allows smartphones to use this body for mobile operation and demonstrate that the system is sufficiently powerful to support advanced robotics workloads such as person following and real-time autonomous navigation in unstructured environments. Controlled experiments demonstrate that the presented approach is robust across different smartphones and robot bodies.
Embodied AI Lecture Series @ PRIOR
Visit prior.allenai.org/lectures for the full list of our lectures
OpenBot: Turning Smartphones into Robots
Matthias Mueller • Intelligent Systems Lab at Intel • (7/23/21)
Current robots are either expensive or make significant compromises on sensory richness, computational power, and communication capabilities. We propose to leverage smartphones to equip robots with extensive sensor suites, powerful computational abilities, state-of-the-art communication channels, and access to a thriving software ecosystem. We design a small electric vehicle that costs $50 and serves as a robot body for standard Android smartphones. We develop a software stack that allows smartphones to use this body for mobile operation and demonstrate that the system is sufficiently powerful to support advanced robotics workloads such as person following and real-time autonomous navigation in unstructured environments. Controlled experiments demonstrate that the presented approach is robust across different smartphones and robot bodies.




![Language AI for RNA Virus and RNA Vaccine
Abstract:
Linguistics and biology are two sides of the same coin. This talk features several highly unexpected connections between them which yield efficient algorithms with substantial biological impacts. One such connection (Nature, 2023) is between messenger RNA (mRNA) vaccines and formal language theory. Although widely used in COVID, these vaccines still suffer from instability. But how to design more stable and efficient mRNAs? Here we show a surprising reduction of the mRNA design problem to the classical (1961) concept of “lattice parsing” in speech recognition, which enables efficient search in the exponentially large design space. Experiments on COVID and another virus show that our designs dramatically improves mRNA half-life, protein expression, and in vivo antibody response, compared to the standard method used by Pfizer and Moderna. Another connection (PNAS, 2021) is between COVID variants and multilingual parsing. Here we show that aligning and folding various coronavirus genomes (in order to find conserved structures for drug design) can be viewed as “synchronous parsing” for multiple languages. This enables efficient global prediction of COVID genome structure that matches experimental work.
[1] Nature paper: https://www.nature.com/articles/s41586-023-06127-z
[2] Nature news: https://www.nature.com/articles/d41586-023-01487-y (‘Remarkable’ AI tool designs mRNA vaccines that are more potent and stable)
[3] PNAS paper: https://www.pnas.org/doi/10.1073/pnas.2116269118
Bio:
Liang Huang (PhD, Penn, 2008) is a Professor of Computer Science at Oregon State University, and co-founder of Coderna.ai. Until recently, he was also a Distinguished Scientist at Baidu Research USA. He also worked at Google Research, USC, and City Univ. of New York. He was known for algorithms and theory in computational linguistics, where he received several best paper awards (ACL 2008 Best Paper Award, EMNLP 2016 Best Paper Honorable Mentions, NAACL 2022 Best Demo Paper Award) and delivered keynotes at ACL 2019 and CVPR 2021. But in recent years, he has shifted his attention to applying these natural language algorithms to computational biology, esp. RNA folding and RNA design, with the hope of fighting COVID. This line of linguistics-inspired biology work eventually led to PNAS (2021) and Nature (2023) papers, and is widely covered in the media. Language AI for RNA Virus and RNA Vaccine](https://i.ytimg.com/vi/B-fiTnUkq2A/mqdefault.jpg)





![From F to A on the N.Y. Regents Science Exams: An Overview of the Aristo Project | AI2
AI has achieved remarkable mastery over games such as Chess, Go, and Poker, and even Jeopardy!, but the rich variety of standardized exams has remained a landmark challenge. Even as recently as 2016, the best AI system could achieve merely 59.3% on an 8th Grade science exam.
This talk reports success on the Grade 8 New York Regents Science Exam, where for the first time a system scores more than 90% on the exams non-diagram, multiple choice (NDMC) questions. In addition, our Aristo system, building upon the success of recent language models, exceeded 83% on the corresponding Grade 12 Science Exam NDMC questions. The results, on unseen test questions, are robust across different test years and different variations of this kind of test. They demonstrate that modern Natural Language Processing (NLP) methods can result in mastery on this task. While not a full solution to general question-answering (the questions are limited to 8th Grade multiple-choice science) it represents a significant milestone for the field. [ Paper at AI Magazine 41 (4), Winter 2020, https://arxiv.org/pdf/1909.01958.pdf ] From F to A on the N.Y. Regents Science Exams: An Overview of the Aristo Project | AI2](https://i.ytimg.com/vi/CR3aICkhCJM/mqdefault.jpg)