With simple human-language instructions, Microsoft demonstrated that Open AI’s ChatGPT could convert them into code to facilitate communication between the machine and a user without special computer knowledge. In this experimental perspective, the chatbot was used to control a series of robotic tasks, including the inspection of a shelf by a drone.
Microsoft wanted to extend the capabilities of ChatGPT to robotics. Artificial Intelligence was thus able to produce code intended to take control of various robots, including a drone, thanks to extremely precise requests.
A team of researchers has made possible natural interactions between humans and robots, using ChatGPT, OpenAI’s artificial intelligence, which is currently making a lot of noise. The demonstration has been made that it is possible to control a drone in particular, without any particular knowledge of computer code.
Because ChatGPT is indeed able to generate code. However, here the challenge consisted in taking into account many parameters related to the flight of the drone, starting with the laws of physics and the various constraints related to the environment. The requests therefore had to contain a lot of precise information to lead to an exploitable code without risk for the device and everything around it.
Industrial robotics soon to be revolutionized by ChatGPT?
In the end, the drone was able to fly correctly, zigzag between several obstacles and even take a photo in flight, on request. These tests were carried out via the dedicated Microsoft AirSim platform. In addition to this drone, Microsoft has carried out other tests on various robots, again crowned with success.
Here’s how ChatGPT can help a user control a real drone with only language instructions. © Microsoft Autonomous Systems & Robotics Research
These are currently only experimental attempts, but the idea is to one day be able to control machines using natural language, while an Artificial Intelligence will take care of converting these requests into code. Thanks to ChatGPT (or another Artificial Intelligence), it will no longer be necessary tomorrow to be an expert in code to take control of a robot or a drone. More concretely, Microsoft has already integrated ChatGPT into its Bing search engine, while waiting to do the same with Outlook and its entire Office suite.
