P.A.R.T.S.: Transformer Neural Networks - From Language Models to Robotics
March 02, 2025 at 06:30 PM
to 08:30 PM
CNTRL-H PDX Hackerspace
Join us for another exciting session of Portland's longest-running robotics meetup! This month, we're thrilled to welcome Dr. Joe Cole, an honored member of our community, who will be presenting on the fascinating intersection of large language models and robotics.
Abstract
Large Language Models (LLMs) have revolutionized artificial intelligence, but how are they built from the ground up? In this talk, we will explore key excerpts from the first three chapters and Appendix A of "Build a Large Language Model (From Scratch)" by Sebastian Raschka, breaking down the fundamental components of LLMs.
Abstract
Large Language Models (LLMs) have revolutionized artificial intelligence, but how are they built from the ground up? In this talk, we will explore key excerpts from the first three chapters and Appendix A of "Build a Large Language Model (From Scratch)" by Sebastian Raschka, breaking down the fundamental components of LLMs.
Beyond the theoretical foundation, we will take a deep dive into how these transformer-based models can be applied to motion planning in robotics. By leveraging the pattern recognition and sequential reasoning capabilities of transformers, we can rethink traditional motion planning approaches—potentially moving beyond conventional pathfinding algorithms toward more adaptable and efficient solutions.
Attendees will gain an understanding of both the core principles behind LLMs and their emerging applications in robotics, paving the way for new perspectives on AI-driven decision-making in dynamic environments.
What You'll Learn
What You'll Learn
- The fundamental architecture of transformer neural networks
- How LLMs are built from the ground up
- Practical applications of transformer models in robotics
- New approaches to motion planning using AI
- The future of AI-driven decision-making in dynamic environments
Who Should Attend
This presentation is designed for robotics enthusiasts of all levels. Whether you're a professional engineer, a hobbyist, a student, or simply curious about the intersection of AI and robotics, you'll find valuable insights in this talk.
This presentation is designed for robotics enthusiasts of all levels. Whether you're a professional engineer, a hobbyist, a student, or simply curious about the intersection of AI and robotics, you'll find valuable insights in this talk.
About the Speaker
Dr. Joseph (Joe) Cole is a distinguished figure in the Portland robotics community and an honored member of P.A.R.T.S. With a Ph.D. in Applied Physics, Joe brings over 20 years of experience developing computer vision and machine learning algorithms.
Dr. Joseph (Joe) Cole is a distinguished figure in the Portland robotics community and an honored member of P.A.R.T.S. With a Ph.D. in Applied Physics, Joe brings over 20 years of experience developing computer vision and machine learning algorithms.
As the co-founder and Chief Technology Officer at Rose City Robotics, Joe is currently focused on building robots for disassembly of lithium-ion batteries. His extensive background includes work at Northrop Grumman, Applied Materials, and YorLabs, specializing in image processing and applied physics.
Joe has been a valued contributor to the Portland Area Robotics Society, regularly sharing his expertise through presentations and helping to bridge the gap between professional robotics development and our local community.
About P.A.R.T.S.
The Portland Area RoboTics Society (P.A.R.T.S.) is THE longest-running robotics meetup in Portland. We are an Oregon non-profit formed to help those interested in learning about and building robots. Our monthly meetings are open to the public and welcome everyone from professionals to amateurs, students to professors, engineers to artists.
P.A.R.T.S. members explore all aspects of robotics and work toward expanding communication between robot enthusiasts. We share ideas, experience, and enthusiasm for building robots in an informal and supportive environment.
The Portland Area RoboTics Society (P.A.R.T.S.) is THE longest-running robotics meetup in Portland. We are an Oregon non-profit formed to help those interested in learning about and building robots. Our monthly meetings are open to the public and welcome everyone from professionals to amateurs, students to professors, engineers to artists.
P.A.R.T.S. members explore all aspects of robotics and work toward expanding communication between robot enthusiasts. We share ideas, experience, and enthusiasm for building robots in an informal and supportive environment.
What to Bring
- Your curiosity and questions
- A robot (working or not) if you'd like to share or get help
- A notebook or laptop for capturing ideas
After the Presentation
As always, there will be time for Q&A and informal discussions after the presentation. This is your chance to connect with other robotics enthusiasts, share your projects, and get feedback from the community.
As always, there will be time for Q&A and informal discussions after the presentation. This is your chance to connect with other robotics enthusiasts, share your projects, and get feedback from the community.