A neural network camera without a matrix and a lens has been created. It’s kind of surreal

A video has gone viral on the network in which an unusual camera without lenses shoots using a neural network.The device was called Paragraphica.

The “Camera of the Future” was created by an engineer from Amsterdam.The camera does not have elements familiar to us, such as a photomatrix and a lens with lenses.Instead, a large “spider” is placed on the front part, and on the top of the device there are three knobs to adjust the result.

^{Photo: bjoernkarmann}

^{Photo: bjoernkarmann}

It works as follows.At the moment of taking a picture, the camera collects maximum information about the shooting location through open APIs – address, weather, time of day, nearby objects.Next, the device creates a text description, the so-called “promt” – it describes in detail everything that the user sees.After that, the neural network generates an image based on this “prompt” and a snapshot is obtained.

Raspberry Pi 4 computer is at the heart of the unusual “fotik”, and the case is printed on a 3D printer.The “snapshot” is generated using the Stable Diffusion neural network.Anyone can try online technology.

Earlier, we told how the neural network learned to help cats not get sick.