With iPhone X, Apple reinvents the camera. Again.

Each generation of iPhone has brought with it a camera more amazing than the last. As users ogled over higher resolution, bigger sensors and new computational features, few saw the device's evolution as more than just the making of a better camera.

But the iPhone X gives the camera a new job description — it's not just a photography specialist anymore. How iPhone cameras function in the future will have little to do with the photographic image. And the iPhone X previews the innovations to come.

Don't forget, the smartphone is more than a way to place and accept phone calls. So it makes sense that the iPhone's marquee feature does more than record your selfies.

The camera changes position on the iPhone X. It also has new tasks to perform.Photo: Apple

Tech-minded observers have recognized how Apple and app developers used software to expand the camera's role.

But the iPhone X is maybe the first iPhone to make it clear to everyone else that the camera serves multiple purposes. iPhone X camera: More than just pictures

It will still record amazing stills and videos. It will also provide personal security with 3D facial recognition, be an active player in monetary transactions and health care, and provide interactive entertainment through augmented reality.

The iPhone X's True Depth camera keeps an eye on you.Photo: Apple

With time, it will become a kind of mind reader. This is a camera that keeps its eye on you.

"It's probably not an exaggeration to say that," Michael Osakwe, a tech expert for NextAdvisor.com, a consumer information website that researches digital trends and reviews online services, told Cult of Mac. "Just like existing voice recognition systems are always listening for their hot word, Face ID will likely always be watching your gaze when it's awake."

The true potential of the iPhone X's camera is known only to Apple, Osakwe said. Yet its known superpowers seem both exciting and disconcerting.

True Depth camera system

This is not merely a selfie or FaceTime camera. The iPhone X's True Depth camera system bundles together two cameras (one infrared), sensors for light and proximity, a dot projector and a flood illuminator.

All work in concert with a neural engine to map the face so only the user can unlock the phone. Apple says its Face ID tech is smart enough to recognize hairstyle changes, aging and weight gain. And that it is more secure than Touch ID, which uses a fingerprint to identify the user.

Mashable discovered the Face ID feature can be tripped up by identical twins, but many who were able to get an early hands-on test found it to work just fine.

Much more than a selfie camera.Photo: Apple

Osakwe said the more dedicated neural processing done on your device, the greater security it provides. The data will be stored securely in the phone and not go to the cloud.

Yet he acknowledges "malicious actors" will try to crack Face ID.

"Anyone who can break Face ID or repurpose its hardware will have access to a wealth of data that no previous phone could provide," he said. "Of course, even with the degree of privacy that local neural processing can provide, the amount of data that Apple's True Depth camera can process might still be deeply off-putting for privacy-minded individuals."

Welcome to the future

But that's probably a small price to pay for getting a taste of the future. App developers will undoubtedly find innovative new uses for the front-facing camera.

A user may be able to navigate the iPhone without touch, instead using gestures to power a more intuitive experience. Facial recognition could also improve apps that aid in real-time health care.

"We could even see applications designed not simply to identify our feelings and intentions, like with Animoji, but react to them as well," Osakwe said.

A 'customized eye on the virtual'

Christopher Chesher, a senior lecturer in digital cultures at the University of Sydney in Australia, has studied and written about how the iPhone camera created seismic changes in the photo industry.

Apple consistently boosts camera operations through software innovation. And app developers continue to create new uses, like document scanning, for the camera and how it relates to the world, Chesher said.

In 2012, Cheser wrote a book chapter on how the iPhone reinvents the camera. Even five years ago, the iPhone camera could function as a digital input device. Placing the finger over the lens, the Instant Heart Rate app could recognize color changes in skin to determine the amount of oxygen in the blood.

"iPhone cameras increasingly perform as multimodal information sensors as much as creators of photographic images," Cheser told Cult of Mac. "The facial recognition feature on iPhone X adopts technologies associated with both surveillance and entertainment, to serve as a biometric security system, and a plaything for creating Animoji. In both cases, what is at stake is the user's subjectivity: securing a unique identity and providing a means of expressing the self."

So while the iPhone X camera will undoubtedly take stunning photos, it also offers a snapshot of the digital future.

"The rear-facing camera also operates as an input device that opens onto cybernetic information worlds," Cheser said. "It translates images into spatial models to generate augmented reality illusions. With Google Translate, it renders text in other languages as written English. With QR readers, it sources information and mediates transactions. With real-time feedback, the phone becomes a customized lens onto the virtual."

As with most Apple innovations, the iPhone X camera is just the beginning.

Source: With iPhone X, Apple reinvents the camera. Again.