Intrinsic – a business unit of Alphabet, the parent company of Google – has been exploring ways to bring the Intrinsic platform “closer together” with Robot Operating System (ROS).
From humble beginnings 17 years ago, ROS has grown to become the “backbone of all kinds of robotics products and projects around the world”, according to Intrinsic.
The open source community has long been at the edge of pushing for greater interoperability in robotics, with ROS playing a “critical role” in many of these advances.
At the recent ROSCon 2024 event in Odense, Denmark, Intrinsic showcased how ROS capabilities can be integrated with Flowstate, Intrinsic’s development environment, to unlock sophisticated, adaptive solutions for industry.
In collaboration with its innovation partner Comau, an industrial automation and robotics company, Intrinsic has made it possible to integrate existing ROS-based services with Flowstate without requiring modification to the original code for the first time.
This is achieved by developing a custom Flowstate skill, or software component, designed to directly interface with ROS 2 nodes developed by Comau.
Both companies’ teams have made it possible to use Comau’s MI.RA/Depalletizer skill within the Intrinsic developer ecosystem, in addition to leveraging skills that are included with Flowstate like collision avoidance or ensuring compatibility with different camera and robot brands.
This modular approach simplifies the adaptation process and offers a flexible, scalable solution for diverse automation needs. These benefits have been validated by the technical experts at Comau, who understand the in-depth challenges of industrial environments.
At a high level, this means Intrinsic is making “meaningful progress” in enhancing the its platform’s interoperability with commonly used development tools, empowering developers to create intelligent solutions needed by manufacturers.
Being able to combine ROS capabilities with Intrinsic capabilities like this in one developer environment gives solution builders new ways to develop intelligent solutions.
Flexible robotic depalletizing with AI-enabled vision systems
Billions of boxes are loaded and unloaded every year throughout the lifecycle of a product, from production to delivery. Getting the boxes off pallets is known as “depalletizing” and is traditionally done by a mix doing heavy lifting with limited help from robots.
Traditionally, robotics solutions here have been inflexible and hard programmed to only pick certain size boxes, from a certain position, in a certain way.
So while robotics has been used in logistics for this for many years, it’s still expensive, inflexible and difficult to manage in practice.
Automated depalletizing, the process of using robots to unload boxes from pallets, has typically struggled to handle diverse shapes, sizes, and positions.
Traditional robotic systems often require customized setups for specific pallet configurations, making it challenging to adapt to new or mixed packaging types without incurring costly reprogramming or hardware adjustments.
In partnership with Comau, and by leveraging ROS, Intrinsic has developed an adaptive solution that can help make depalletization “more flexible and efficient”.
The ability to determine the 3D positions of boxes on pallets relies on MI.RA — Machine Inspection Recognition Archetype, a family of flexible vision systems developed by Comau to enable quality inspection and robotic guidance tasks in smart and seamless ways.
Comau used ROS to build out their MI.RA algorithms since the modular design of ROS 2 Nodes provides an easy way to develop and debug specific tasks.
Then, utilizing both Flowstate and the ROS 2 SDKs, Intrinsic has created a skill that acquires sensor data from depth cameras and queries MI.RA with this data over ROS, to obtain 3D poses of boxes on the pallet.
Combined with other skills in its Flowstate catalog, Intrinsic is able to populate its simulated environment with box locations, and run automated grasping and motion planning to unload the boxes.
The ability to seamlessly combine ROS and Intrinsic skills this way enables the reuse and repurposing of valuable code, saves development time, and helps keep the developer’s focus on creatively solving the tasks.
Parameters for querying ROS can be adjusted conveniently from the Flowstate frontend, making it easy to tune MI.RA for any setup.
Additionally, Flowstate users now benefit from the rich tooling in the ROS ecosystem, including RViz, Rosbag, and ROS logs. These tools, when used alongside Flowstate, provide enhanced visualization and debugging workflows.
For example, during the development of the depalletizing solution, Intrinsic utilized RViz to visualize sensor data and internal states from the MI.RA algorithm in real time, ensuring precise box detection and picking.
With this latest collaboration, Comau has become Intrinsic’s first industry partner to help prove out not only an Intrinsic-to-ROS communication but also a workflow for future solutions.
Intrinsic says it is “excited” to build more and better ROS integrations that can bring “new opportunities to solution builders in industry”.
