BeingHumanhttp://www.magicalrobot.org/BeingHuman
Vytas SunSpiral's thoughts on the Art and Science of Being HumanTue, 16 Jan 2018 16:51:40 +0000en-UShourly1https://wordpress.org/?v=4.9.312937316Biomimetic Tensegrity Robots: snakes, quadrupeds, and humanoids!http://www.magicalrobot.org/BeingHuman/2017/12/biomimetic-tensegrity-robots-snakes-quadrupeds-and-humanoids
http://www.magicalrobot.org/BeingHuman/2017/12/biomimetic-tensegrity-robots-snakes-quadrupeds-and-humanoids#respondSun, 24 Dec 2017 05:02:26 +0000http://www.magicalrobot.org/BeingHuman/?p=320While many of the tensegrity robots we built over the years had strange shapes, like the spherical SUPERball, I always held a vision of making biomimetic robots which could move and walk like animals and humans — this should ultimately be possible given the assumption that tensegrity design principles are central to how our bodies are designed, but it is a big challenge and will ultimately involve a much more complex system than the simple rod and string models we are currently working with. Nonetheless, some progress was made over the years. Unlike the SUPERball project, this line of work was never properly funded, so it made progress as a variety of different students became interested in aspects of this topic and pushed it forward a few more steps. This post will attempt to summarize the many different threads in this multi-year effort and point to the papers we wrote for deeper reading on the topics.

Spines and Snakes
Most efforts to make walking robots have started by focusing on legs, usually bolting fancy legs to rigid boxes for torsos. This is, of course, a bit backwards from how nature designed walking animals. Spines were driving locomotion in fish long before legs came around, and it seems certain that legs evolved within the context of flexible dynamic spines driving the fundamental aspects of motion. Thus, I decided to start there and focus initially on tensegrity spines, and figuring out how they might be designed and move. Since I was not yet working with legs or arms, this meant that the first round of robots looked a lot like tensegrity snakes crawling across various terrains. I had the good fortune of working with Brian Mirletz for many years, a brilliant phd student (now graduated) who dived deep into creating tensegrity spine robots, building out the NASA Tensegrity Robotics Toolkit simulator to support the work, and developing complex machine learning tools to tune neuroscience inspired Central Pattern Generator (CPG) controllers to make these robots move over various terrains, and even move towards specific goal locations. If you want to learn all about this, read his thesis. Or, for fun inspiration, watch the video below showing a series of increasingly capable snake robots, which culminates in a version that developed a realistic slithering locomotion pattern based off the combination of its morphology and machine learning.

Central Pattern Generators (CPGs) for locomotion

Our early work in tensegrity locomotion focused heavily on neuroscience inspired CPG’s which are neural circuits that can generate a steady rhythm, even with no inputs. These neural networks are found in practically all vertebrate animals studied, including humans, and are closely related to the foundations of how we move. The key insight is that they enable a decentralized approach to generating coordinated locomotion through mechanisms of synchronization. It turns out that when a number of rhythmic systems interact with each other, they are able to naturally synchronize. This is a mathematical property, and we find it occurring all throughout nature — from how solar systems and galaxies end up with organized structure, to how some species of fireflies all blink in unison. (There is a great book on this!) The value of this is that you can have organized structure even without having a central authority or system creating that order. When you look at traditional robotics, their motion is usually controlled through a centralized algorithm which gets inputs from all aspects of the robot and calculates the optimal next motion for all the joints and motors. This does not scale well as you add more joints and complexity to the robot, and becomes practically impossible if the robots are flexible and soft. Biology appears to solve this by using the self coordinating capability of central pattern generators to ensure that all our muscles are working together to execute complex motions. Our brains thus have the simpler task of deciding on why and where to move, and can let the body (and the distributed CPG network in the spine) figure out the details. This approach to controlling motion was explored heavily by Brian Mirletz, and you can read more about it in his thesis or his many papers on the design and control of tensegrity spines and snakes:

Noting that the requirements of snake like locomotion are quite different from the needs of a spine for a quadruped or humanoid, Andrew (Drew) Sabelhaus took a different approach to studying tensegrity spines. Drew is a talented phd student at UC Berkeley, who was instrumental in the early design and construction of our first prototype of the SUPERball robot (see his Masters Thesis for more!). When turning their attention to spines, they decided to focus on a different form of control — instead of the CPG’s that we had studied in the past, Drew developed a formal approach bases on model predictive control. While it is computationally more challenging, the advantage of this approach is it allows for clear controllability of the spine and one can command it to follow specific motion trajectories. This differs from the CPG based controls which are computationally efficient and reactive, but are also harder to direct intentionally towards goals and specific behaviors (it is possible, as Brian showed, but it is harder to describe in a clear mathematical formulation). Drew published two papers on the design and control of ULTRA SPINE:

While currently unpublished, Drew has also been building hardware versions of the ULTRA SPINE, and working on incorporating it into a physical quadruped robot.

Vertebrae and Disks

Another student, Jennifer Case, came from a soft robotics lab. Her work was not exactly tensegrity focused, but explored another important aspect of designing robotic spines. She focused on the question of how one designs a spine with soft flexible disks between the vertebrae, and how one consequently controls the motion of the spine. The key goal of her work was to show that one could get more effective control of the spine, using fewer cables by spiraling the control cables around the spine, in a more biologically realistic manner. Most soft robot spines and tentacles focus control cables along linear paths on 3 different sides of the spine, which makes understanding the controls easier. Once you start spiraling and crossing the cables around, their effect becomes far more coupled and complicated, but it appears to have advantages. In Jennifer’s published works, she took the first steps along this path and made a planar spine where the cables crossed through the vertebrae, and was able to demonstrate improvements of the resulting system. Watch her future work!

Adding Legs to the Spine!
As hinted by Drew’s work, the next step after all the snake robot work was to add legs and create quadruped tensegrity robots! For this, I ended up working with Dawn Hustig-Schultz, a phd student at UC Santa Cruz, who picked up Brian’s work and started extending it. Her first step was to add some legs to one of the spine robots, for which she pulled inspiration from Tom Flemons’ “Big Puppy” designs. The initial designs were very compelling, showing a nice balance of flexible terrain adaptability and stability of form, and she named it MountainGoat. In the pictures you can see where we “dropped” MountainGoat onto a simulates surface of random blocks. It was able to naturally adapt with its compliant spine to complex terrain situations, such as having a front foot up on a block and the opposite back foot on a block. This adaptation happened passively, as an inherent property of the mechanism, and no active control was required. A traditional stiff robot would have been very challenged by this situation.

The next challenge was to get the robot to walk. For this we adapted the same Central Pattern Generator control scheme from the snake robots, and the machine learning used to tune the parameters. When we first started exploring how the robot would move, we found that there were many limitations to the original design — everything from the feet absorbing too much of the motion energy and not enabling good stepping, to the spine being too floppy — when the robot tried to pick up its leg what actually happened was that the shoulder dropped down and the foot never lifted. This gave us the insight that an important role of the spine and torso is to stabilize the hips and shoulders so that you can hold them in place while lifting a foot. This required adding spiral muscle lines to the torso to gain control of the hips and shoulders — and this is not really that surprising since we see similar spiral lines in the musculature of animals, and something that we also explored in Jennifer Case’s work discussed above.

One can read more about the details in the following two papers that Dawn wrote, and in her Masters Thesis.

Dawn Hustig-Schultz, Vytas SunSpiral, and Mircea Teodorescu, “Morphological Design for Controlled Tensegrity Quadruped Locomotion”, In the Proceedings of the International Conference on Intelligent Robots and Systems (IROS), Korea, October 2016. Download PDF.

A Different Design Strategy

Taking another design strategy, Lauren Sharo, a student from UCSD, built a number of tensegrity quadrupeds and bipeds based off of the workspace optimized joint developed by Jeff Friesen. Jeff had developed an optimization process to maximize the workspace and available actuation power for a high degree of freedom tetrahedral based tensegrity joint (details of this are in a paper currently under review). Lauren’s theory was that effective control of the quadruped would require the ability to apply actuation force in a wide range of vectors, depending on how the terrain interaction was affecting the distribution of forces into the robot. Given the underlying optimization of the joints she used, I was very excited about this direction. When we did drop tests of quadruped onto random block fields, it also showed very good properties of passive adaptation to random terrains. Sadly, the summer ended too soon, and no controllers were ever attached to these robots, so we were not able to explore how well they could move. Likewise, there was never a publication about the work, so these are the only images of them to have escaped the lab. As you can see from the photos, she also worked on making a basic two-legged humanoid like robot (though with no arms).

Arms and Shoulders

Having worked on spines, and legs, and even basic humanoids, the next obvious question is to explore how arms and shoulders might work in a tensegrity robot. Steve Lessard, an inspirational student from UCSC, took lead on this line of thinking. I was impressed by Steve’s ability to inspire many other students at UCSC to participate in his efforts and quest to understand tensegrity arms. For this work he studied a lot of anatomy and took significant inspiration from Graham Scarr’s book “Biotensegrity: The Structural Basis of Life.” With that background, he started designing a tensegrity elbow, and then developed shoulders, and finally combined them all together into a single integrated arm. The key is that he was always building both simulated arms and hardware versions which we could then control to move and do simple tasks. I was delighted to see this work mature over the years, because it gives a great starting point for how tensegrity robots could be designed and used to solve complex real-world manipulation tasks someday. There is still a long way to go, but the combination of natural compliance, high degrees of flexible adaptation, and the ability to control purposeful motion is pretty exciting. You can read more about his work in the series of papers he authored with the help of many other students.

One of the powerful things about tensegrity structures is that the structure itself is exactly in line with the lines of force in the structure, with the elements either being purely in tension (cables) or purely in compression (the rods). Thus, there is a very close coupling between the design of the structure (its “morphology”), and the control required to move it around. One of the things you can see from all the above work is that we were manually creating different physical designs for the robots, and then developing (manually or using machine learning) controllers to move the robots around. It was very clear from this experience that small changes in the physical structure could have huge impacts on how well the robot could ultimately move, even after using machine learning to find the “best” controller for it. Thus, it was my intention to extend our machine learning techniques to co-optimize both the physical morphology and the controller at the same time. This is a challenging endeavor, and becomes computationally quite difficult. Practically, our simulator was not setup for this, so we put significant effort into developing the ability to computationally define morphologies. While we got close, the ultimate goal of co-optimizing tensegrity brains and bodies together has not yet occurred (most of the tools are there in NTRT if someone wants to try). But, along the way I had the pleasure of working with Nick Cheney, who’s phd focused on exactly this question of co-optimizing morphology and control in soft robots. His work was never focused on tensegrity robots, but I learned a lot from collaborating with him in the last years of his thesis work. I highly recommend that anyone interested in this topic follow up on his research.

Nick Cheney, Josh Bongard, Vytas SunSpiral and Hod Lipson, “On the Difficulty of Co-Optimizing Morphology and Control in Evolved Virtual Creatures”, In The Proceedings of The 15th International Conference on the Synthesis and Simulation of Living Systems (ALife), Mexico, July 2016. Download PDF.

Conclusion

I’m delighted by all the progress that has been made on this front. I hope that future generations of tensegrity robotics researchers are inspired and explore these ideas further — we have explored many of the key elements required to start assembling fully biomimetic tensegrity robot. A key thing that stands out from this effort is recognizing that the design of a tensegrity robot that moves is very different from the design of a static tensegrity form that might look like a dog or person, but which has no capacity for actively controlled motion. To really mimic biological levels of motion, I think we ultimately need to imagine many tensegrity structures super-imposed on each other, each one representing an optimal balance of forces for a part of the possible range of motion. Thus, this would require thousands of actuators — which we see in our bodies if you realize that our muscle fibers are the actual basic unit of actuation, rather than the large muscle groups that we tend to think about. We are a long way from having a practical artificial muscle technology that is flexible and compact enough to mimic muscle fibers, but progress is being made. Perhaps when it happens, the ideas explored here can really come to fruition.

I also want to thank all the inspirational and talented students who shared this vision with me over the years, and who made this work possible. As you can tell by the many co-authors in the papers above, many many more folks contributed to these efforts than I have had room to name in this post. I learned so much from each of you, and could not have done it alone. Thank you.

]]>http://www.magicalrobot.org/BeingHuman/2017/12/biomimetic-tensegrity-robots-snakes-quadrupeds-and-humanoids/feed0320Introducing Jeff Friesen — Tensegrity Robot Designer Extraordinairehttp://www.magicalrobot.org/BeingHuman/2017/09/introducing-jeff-friesen-tensegrity-robot-designer-extraordinaire
http://www.magicalrobot.org/BeingHuman/2017/09/introducing-jeff-friesen-tensegrity-robot-designer-extraordinaire#respondMon, 04 Sep 2017 19:33:36 +0000http://www.magicalrobot.org/BeingHuman/?p=309I would like to take the opportunity to highlight the work of Jeff Friesen, one of the most talented robot designers I have had the pleasure to work with! He is a PhD student at UCSD in the Coordinated Robotics Lab, who has been working with our lab both as a summer student, and as a central part of our team for the last few years with the support of a NASA Space Technology Research Fellowships (NSTRF). Jeff is delightfully talented at mechatronic design and controls algorithms, and has built a number of very innovative tensegrity robots over the years. With his rapid iteration on building new robots, he has encountered and addressed a number of unique design challenges that are common to many tensegrity robots, and a number of his ideas have been integrated into our current SUPERball 2.0 robot designs (which he also participated in developing).

While some of Jeff’s most innovative and impactful work is waiting for publication, I would like to highlight one of the robots that Jeff developed over a couple years and through two design iterations,

Jeff Friesen’s Duct Climbing Tetrahedral Tensegrity (DuCTT) Robot

namely the Duct Climbing Tetrahedral Tensegrity (DuCTT) Robot. The intent of the robot was to develop a machine which could climb and maneuver through tight constrained spaces, such as ducts in buildings, or small tunnels or natural crevasses. The challenge is to be able to both lift and move in a vertical shaft, while also being able to turn corners. Because most duct systems (and all natural tunnels) have complex internal features, simply using wheels to roll along is not sufficient, but instead requires that the system be able to lift and place limbs of some sort. In attempting to address all these requirements with more traditional designs, past efforts have generally resulted in overly complex mechanisms which are too heavy or fragile for real use.

As is often the case, designing a robot with tensegrity principles in mind, Jeff was able to develop a simple and light weight solution which can climb and turn as required. The system is composed of 2 tetrahedral sections, connected by a network of cables, which enable the sections to inchworm up the shaft. In fact, there could be as many modules as needed, if a longer robot with different payloads or sensors was required. Each tetrahedron has a linear motor in one of the bars to control the width of the tetrahedron, allowing it to press and hold firmly against the shaft, or tuck in compactly to move around an obstacle. This next video shows DuCTT climbing up out of a vertical shaft.

Since it is a bit hard to see all the details of how the robot moves, the next animated video (based on the first generation robot) shows how the inchworm action occurs.

Finally, the following video shows DuCTT exercising its full range of motion, which shows how it could turn a corner within a duct system.

]]>http://www.magicalrobot.org/BeingHuman/2017/09/introducing-jeff-friesen-tensegrity-robot-designer-extraordinaire/feed0309Interviews, Media Coverage, and Deep Learninghttp://www.magicalrobot.org/BeingHuman/2017/08/recent-interviews-and-media-coverage
http://www.magicalrobot.org/BeingHuman/2017/08/recent-interviews-and-media-coverage#respondFri, 18 Aug 2017 05:26:06 +0000http://www.magicalrobot.org/BeingHuman/?p=302There has been some nice media coverage of our Tensegrity Robotics research “recently”. I’m a bit behind on updating this blog, so “recent” really means “in the last 6 months” or so.

Most exciting is an interview by Zygote Quarterly. This is a magazine dedicated to bio-inspired design, and the interview gives some nice insights into how I’ve found inspiration in fusing engineering and biological inspiration in developing the field of tensegrity robotics. And since it is a design magazine, its really pretty with some nice inspirational photos. Worth the read!

Next, back in January the BBC released a nice short video about our research. I always appreciate when someone does independent research and pulls together a story including prior videos and information we have released. It is so refreshing to see given how much of online media is slapped together with minimal effort and is often wildly inaccurate, especially around science topics. As usual, the BBC continues to maintain standards for real content. Thanks!

And, now to give this post some more fun technical content — back in May we presented a Tensegrity Deep Learning paper at the International Conference on Robotics and Automation (ICRA) that was developed jointing with our colleagues at UC Berkeley who led the algorithm development. In it we demonstrated the first example of learned continuous locomotion on the actual SUPERball robot. What is particularly amazing is that we were able to do all the training in simulation, and have the learned policy work directly on the real robot. This is unusual in the world of robotics, and I believe that it highlight the value of flexible, compliant robots like our tensegrity robot — the compliance that makes it resilient to unexpected contact also makes it robust to approximately tuned controllers. You can read the paper, find the code, and more on the project website.

Or just watch the video here:

]]>http://www.magicalrobot.org/BeingHuman/2017/08/recent-interviews-and-media-coverage/feed0302My 2016 NASA Ames Summer Series Presentation: SUPERball: A Biologically Inspired Robot for Planetary Explorationhttp://www.magicalrobot.org/BeingHuman/2017/01/my-2016-nasa-ames-summer-series-presentation-superball-a-biologically-inspired-robot-for-planetary-exploration
http://www.magicalrobot.org/BeingHuman/2017/01/my-2016-nasa-ames-summer-series-presentation-superball-a-biologically-inspired-robot-for-planetary-exploration#respondFri, 27 Jan 2017 06:38:50 +0000http://www.magicalrobot.org/BeingHuman/?p=295Back in June of 2016 I was very honored to be invited to present as part of the NASA Ames Summer Series. Each summer, the Office of the Chief Scientist at NASA Ames produces a lecture platform with leaders whose high achievements generate innovative discussion, as well as inspire and catalyze scientific progress. This year, the Summer Series consisted of 18 seminars by lecturers from NASA Ames Research Center, external NASA staff, as well as renowned colleagues who lectured on topics that span across multiple advanced subject areas including space technology and space exploration. It was an honor to be included in the lecture series!

Abstract:
Exploration and Innovation both require bold leaps into the unknown, beyond the boundaries of current knowledge and experience. Exploring the unknown frontiers of space requires resilient and adaptable robots capable of surviving the unexpected, qualities which humans excel at. Moving beyond the traditional designs for rigidly constructed fragile robots, Vytas draws inspiration from the flexible tensile network of muscle and tendons of our bodies to develop a new class of “Dynamic Tensegrity Robots.” His current project, SUPERball, is intended to survive high-speed landings without an airbag, and thus enable exploration of treacherous terrains where slipping and falling is an unavoidable possibility. These new robots break the rules of traditional robotics engineering, requiring innovation at all levels of mechanical design, actuation, sensing, and control strategies. Modern neuroscience provides insights into how decentralized rhythmic controllers can enable self-organizing control strategies for this new class of biologically inspired robot and provides insight into our core human qualities of thought, motion, inspiration, and our essential ability to see connections between people and ideas which is at the heart of innovation.

Biography:
Vytas SunSpiral is an entrepreneurial researcher moving fluidly between leading startups and building research labs to explore cutting edge robotic and AI technologies. He is a Fellow of the NASA Innovative Advanced Concepts (NIAC) program,, and currently leads the Dynamic Tensegrity Robotics Lab (DTRL) within the Intelligent Robotics Group at NASA Ames Research Center. His research spans a multi-disciplinary fusion of robotics, physiology, AI, mechatronics, and neuroscience, with the goal of understanding human intelligence via the foundational role that motion plays in our evolution. This quest led to a fundamental new approach to robotics that has the potential to reinvent how we explore the solar system. He is an author of ~50 journal and conference articles and was a contributing author of the 2013 Roadmap for US Robotics. Over the last 20 years he has also been the Founder, CTO, and Advisor to multiple startups, including Mobot, which sold the worlds first commercially available autonomous tour guide robots. Vytas holds a Masters in Computer Science and a BA in Symbolic Systems from Stanford University.

]]>http://www.magicalrobot.org/BeingHuman/2017/01/my-2016-nasa-ames-summer-series-presentation-superball-a-biologically-inspired-robot-for-planetary-exploration/feed0295New Video Highlighting Jonathan Bruce’s Researchhttp://www.magicalrobot.org/BeingHuman/2016/04/new-video-highlighting-uarc-collaboration
http://www.magicalrobot.org/BeingHuman/2016/04/new-video-highlighting-uarc-collaboration#respondTue, 12 Apr 2016 19:30:02 +0000http://www.magicalrobot.org/BeingHuman/?p=274Jonathan Bruce is a UC Santa Cruz PhD student who has been a central member of my lab for many years now. He has been instrumental to all of our successes, and is a gifted mechatronics engineer who is pushing the boundaries of tensegrity robotics design and control. The UARC program is a mechanism by which UC Santa Cruz and other UC campuses collaborate with NASA Ames, and they recently choose to highlight his innovative work and contribution to NASA’s research success. They sent a film crew to interview him and get context on our broader research project, including our collaboration with the BAIR and BEST labs at UC Berkeley. The resulting video is a *really* excellent overview of our research and well worth watching.

]]>http://www.magicalrobot.org/BeingHuman/2016/04/new-video-highlighting-uarc-collaboration/feed0274Related Projects by Collaboratorshttp://www.magicalrobot.org/BeingHuman/2016/01/related-projects-by-collaborators
http://www.magicalrobot.org/BeingHuman/2016/01/related-projects-by-collaborators#commentsWed, 06 Jan 2016 06:21:24 +0000http://www.magicalrobot.org/BeingHuman/?p=266Happy New Year!
I would like to take this opportunity to highlight the tensegrity robotics related work by some of our many inspired collaborators. First of all, I’m excited to introduce Dr. Julian Rimoli of Georgia Tech, who has developed some excellent new tools for analyzing the structural response of a tensegrity robot when it lands on another planet. The resulting video of its dynamics is excellent.

This is what Julian has to say about his work:

“Most approaches to modeling tensegrity structures assume their bars are rigid, and that they only experience pure axial loads. In addition, a common design constraint is assuming that the structure would fail if any of its members buckle. The first two assumptions break down under highly dynamic events such as impacts, and the third one is not necessarily true: slender bars can sustain a load after failure, and consequently stresses would redistribute without necessarily producing structural failure. This video shows an example of a light-weight tensegrity structure under a highly dynamic event. The model accounts for the body forces and associated bending on bars, and their buckling and post-buckling behavior. The ground is modeled as elastic with friction. For those interested, details of the model will be presented at SciTech in January 2016.”

Next, Julian made a great video from the perspective of a camera mounted at a centrally suspended payload during the same landing event as the video above. This shows what the point of view might be for navigation purposes if you gimbaled the camera to stay stable while the robot bounced and rolled. This is a 360 degree video, so you can use the arrows to change the direction that you are looking out from the robot.

Finally, another video of his shows how waves of landing forces might propagate in an interesting manner through the tensegrity robot, making it appear to “inch-worm” its way back up into the air. Once again, this shows how unique and surprising these structures can be!

Next I would like to share the work of a team led by Will Buchanan who built an amazing tensegrity art structure and took it out to the Burning Man festival, where folks could climb and play on it.

Finally, I would like to highlight some recent work by Ryan Adams, who has been an amazing contributor to the development of our open source physics based tensegrity robotics simulator (NTRT — the NASA Tensegrity Robotics Toolkit). Inspired by our use of coupled oscillators in the controls of tensegrity robots, he has been exploring the dynamics of fields of coupled oscillators. What is fascinating is how stable dynamic patterns readily emerge out of a randomly seeded field. This is not just the simple case of all the oscillators synchronizing with each other, but rather the emergence of stable repeating complex patterns, as shown in the video below.

I think that this is a very important line of research for the understanding of neuroscience and the fundamentals of how we control motion — where a coordinated set of actions must be generated by a very noisy and error prone computational system (our neurons). This ability to start with a random set of oscillators, and have it settle into a stable behavior is exactly what would enable the robust and reliable behavior of animals despite the noisy reality of our neurons. This is obviously just an early stage exploration of the key principles, and a long way from a full theory of neuroscience, but it is valuable to see the key properties at play.