Now Your Phone Can Become a Robot That Does the Boring Work
June 20, 2019 | Purdue UniversityEstimated reading time: 3 minutes
If any factory worker could program low-cost robots, then more factories could actually use robotics to increase worker productivity. This is because workers would be able to shift to taking on more varied and higher-level tasks, and factories could produce a greater variety of products.
Image Caption: A smartphone app allows a user to plan a task for a robot to perform. The robot carries out the task automatically once the phone is loaded onto its docking station. (Purdue University image/C Design Lab)
That’s the idea behind a prototype smartphone app Purdue University researchers have developed that allows a user to easily program any robot to perform a mundane activity, such as picking up parts from one area and delivering them to another.
The setup could also take care of household chores – no more plants dying because you forgot to water them.
Purdue researchers present their research on the embedded app, called VRa, on June 23 at DIS 2019 in San Diego. The platform is patented through the Purdue Research Foundation Office of Technology Commercialization, with plans to make it available for commercial use.
“Smaller companies can’t afford software programmers or expensive mobile robots,” said Karthik Ramani, Purdue’s Donald W. Feddersen Professor of Mechanical Engineering. “We’ve made it to where they can do the programming themselves, dramatically bringing down the costs of building and programming mobile robots,” he said.
Using augmented reality, the app allows the user to either walk out where the robot should go to perform its tasks, or draw out a workflow directly into real space. The app offers options for how those tasks can be performed, such as under a certain time limit, on repeat or after a machine has done its job.
After programming, the user drops the phone into a dock attached to the robot. While the phone needs to be familiar with the type of robot it’s “becoming” to perform tasks, the dock can be wirelessly connected to the robot’s basic controls and motor.
The phone is both the eyes and brain for the robot, controlling its navigation and tasks.
“As long as the phone is in the docking station, it is the robot,” Ramani said. “Whatever you move about and do is what the robot will do.”
To get the robot to execute a task that involves wirelessly interacting with another object or machine, the user simply scans the QR code of that object or machine while programming, effectively creating a network of so-called “Internet of Things.” Once docked, the phone (as the robot) uses information from the QR code to work with the objects.
The researchers demonstrated this with robots watering a plant, vacuuming and transporting objects. The user can also monitor the robot remotely through the app and make it start or stop a task, such as to go charge its battery or begin a 3D-printing job. The app provides an option to automatically record video when the phone is docked, so that the user can play it back and evaluate a workflow.
Ramani’s lab made it possible for the app to know how to navigate and interact with its environment according to what the user specifies through building upon so-called “simultaneous localization and mapping.” These types of algorithms are also used in self-driving cars and drones.
“We don’t undervalue the human. Our goal is for everyone to be able to program robots, and for humans and robots to collaborate with each other,” Ramani said.
Since creating the prototype, Ramani’s lab has been testing it in real factory settings to evaluate user-driven applications. Ultimately, the app is a step toward creating future “smart” factories, powered by artificial intelligence and augmented reality, that complement and increase worker productivity rather than replacing them, Ramani said.
The work aligns with Purdue's Giant Leaps celebration, acknowledging the university’s global advancements made in artificial intelligence as part of Purdue’s 150th anniversary. This is one of the four themes of the yearlong celebration’s Ideas Festival, designed to showcase Purdue as an intellectual center solving real-world issues.
A grant from the National Science Foundation’s Future of Work at the Human-Technology Frontier program is supporting the lab’s continued research in enabling humans to more easily create, program and collaborate with robots.
Suggested Items
The Right Approach: I Hear the Train A Comin'
04/25/2024 | Steve Williams -- Column: The Right ApproachTraining is often an afterthought in many organizations, and the longer a company has been in business, the more this seems to apply. Over the past couple of decades, it has been amazing to observe that the biggest offenders of this are the companies that overuse the sound bite, “Our most important assets are our people.” When you dig into the process and peel back the onion, their commitment to training is not commensurate with that statement.
US Department of Defense Selects Intel Foundry for Phase Three of RAMP-C
04/23/2024 | IntelThe U.S. Department of Defense (DoD) has awarded Intel Foundry Phase Three of its Rapid Assured Microelectronics Prototypes - Commercial (RAMP-C) program.
ViTrox Pioneering the Future of Smart Manufacturing at NEPCON China 2024
04/18/2024 | ViTroxViTrox, which aims to be the World’s Most Trusted Technology Company, is pleased to announce its participation in the NEPCON China 2024 at Booth #1H27 at Shanghai World Expo Exhibition & Convention Center from 24-26 April 2024.
Ansys Joins BAE Systems’ Mission Advantage Program to Advance Digital Engineering Across US Department of Defense
04/16/2024 | ANSYSAnsys announced it is working with BAE Systems, Inc., to accelerate the adoption of digital engineering and MBSE across the Department of Defense (DoD).
IMAPS & IPC to Host Onshoring Workshop
04/16/2024 | IPCThe International Microelectronics Assembly and Packaging Society (IMAPS) and IPC will host an Onshoring Workshop to discuss ongoing progress and forward-looking strategies to drive the Onshoring Advanced Packaging and Assembly, April 29 – May 1, 2024, in Arlington, Virginia.