Augmented Reality at Your Fingertips

Estimated reading time: 2 minutes

A flexible, carbon-based device that responds to humidity in two ways can sense 3D objects without touching them. The intuitive touch screens integral to smartphones caused a sensation when first released, and they remain popular for many consumer electronics. Now, a team from KAUST has found a way to take these input devices into three dimensions with a sensor that tracks the position and speed of human fingers in free space. 

Thin films made from carbon nanotubes or graphene oxides have electrical properties that are highly sensitive to humidity. Both substances absorb water molecules and transform them into charged hydronium ions (H3O+) that modify thin film conductivity in reversible, repeatable ways. They do this at faster speeds than traditional humidity sensors. The direction of conductivity change, however, depends on the nanomaterial—graphene oxide tends toward higher conductivity with H3O+additions, while nanotubes become more resistive. 

Dr. Yanlong Tai and Professor Gilles Lubineau realized that a combination of these tiny nanomaterials could be used to power a recognition system based on gestures rather than touch. “These 3D non-contact sensors,” explained Tai, “require generation of three different signals during a one-time measurement.” The duo envisioned that an appropriate mix of nanotubes and graphene oxides would give triple response patterns—positive-negative-negative, for example, to the natural humidity surrounding a fingertip. 

However, to achieve sufficient signal resolution to process a finger’s 3D position, they needed clearer insight into the contradictory response of nanotubes and graphene oxide to humidity. According to Lubineau, absorbed H3O+ ions induce mechanical stress inside the nanomaterials that alters the material’s bulk conductivity and the junction conductivity between individual nanoparticles. 

“Both films rely on the same two mechanisms, but the balance between them is totally different,” said Lubineau. “A key challenge was to be able to correctly separate the physics of each effect in the different microstructures.” 

By experimenting with sensors containing different microstructure layouts, the team deduced that a net model, where conductivity follows a grid-like system of intercrossed pathways, could explain the humidity-induced resistance of nanotube films. Graphene oxide, on the other hand, was best represented by an overlapping scale design that introduced favorable capacitive effects in the presence of H3O+.  

The researchers used this knowledge to fabricate a flexible, transparent device that measures the distance, speed and direction of a fingertip placed above it. This prototype also worked with vapor from human breath, and it is poised to make gesture sensing a part of digital input interfaces. 

“It’s usually hard to make non-contact sensors operate with different moisture levels,” said Lubineau. “Our findings here may promote their use in augmented reality setups.”