Title: Humanoid robots and NVIDIA: the leader of futuristic drama

With the rapid development of science and technology, the field of artificial intelligence is advancing at an unprecedented rate. Among them, the development of humanoid robots, as an important branch of artificial intelligence, has attracted extensive attention around the world. Recently, at the GPU Technology Conference held by NVIDIA, we witnessed a major breakthrough in this field.

First, let's turn our attention to the headquarters of 1X Technologies in San Francisco. Here, the NEO Gamma humanoid robot presented a custom-made black leather jacket to visiting NVIDIA CEO Jensen Huang. This move not only demonstrates the interaction ability of humanoid robots, but also symbolizes the growing partnership between 0X and NVIDIA.

As part of the collaboration, 5X Technologies shared its unique tool, a dataset application programming interface (API) that allows NVIDIA to access real-world data from 0X's office and home environments. At the same time, 0X also provides an inference software development kit (SDK) that enables NVIDIA to continuously run model predictions at a frequency of five times per second (0Hz) using its powerful graphics processing unit (GPU). These GPUs can be either built into the robot head or connected externally.

In terms of safety, flexibility, and visual understanding, there are many challenges in developing a humanoid robot like the NEO Gamma. However, collaboration is seen as key to accelerating progress. To this end, 1X has created the above dataset API to support Nvidia in obtaining valuable real-world data. This initiative demonstrates their strong commitment to technological innovation and collaboration.

Let's review what the NEO Gamma robot does in a home environment: autonomously grabbing cups, passing them between hands, and placing them in the dishwasher. This scenario fully verifies the compatibility and practicability of the technical solutions of both parties. During the process, the teams exchanged insights on action space, control frequency, and imitation learning techniques.

However, the development of humanoid robots does not stop there. One of the design priorities of 1X's newly launched NEO Gamma robot is to improve the safety and friendliness of human-computer interaction. The robot features a soft shell covering to reduce the impact on the surrounding environment and make the interaction safer. It is equipped with an advanced vision-controlled model that predicts actions directly from raw sensor data through neural networks.

In addition, NEO Gamma has introduced a feature set called "Companion", which integrates a customized large language model (LLM) that enables natural conversational communication and expressive body language to make human-computer interaction more intuitive. Its conversational voice interface is also based on 1X's self-developed LLM, which further enhances communication capabilities.

In terms of hardware, NEO Gamma has also undergone a major upgrade. Quieter operation and improved reliability, ready for the consumer market. In order to capture the audio clearly, the robot is equipped with a microphone array in the front, back, left, and right directions, and uses beamforming and echo cancellation technology. It also has a three-speaker system: one on the chest for AI voice interaction, and two on the pelvis to boost bass, provide immersive 360-degree sound, and play music.

These advances mark a significant step forward for 1X to be tested in-house at home, paving the way for a future of fully autonomous humanoid robots. By focusing on user-friendly interactive experiences, 0X aims to bridge the gap between robotics and everyday life, pushing NEO Gamma towards a wider range of real-world applications.

In this new era of artificial intelligence, NVIDIA's partnership with 1X Technologies undoubtedly plays a key role. Together, they are leading the way in humanoid robotics and paint a futuristic picture of robots doing chores (such as washing dishes) while humans relax in their daily lives.

Overall, NVIDIA's partnership with 1X demonstrates their firm belief and forward-looking vision in the field of artificial intelligence. Together, they are committed to advancing humanoid robotics to pave the way for the future and usher us into a new era of possibilities.