Glasses-free 3D display turns 2D video into 3D and tracks your eyes
A Japanese restaurant is testing a glasses-free 3D sign that converts ordinary video to 3D live and follows your eyes. It only works well for one viewer at a time.

Stand in front of the screen and a plate of osechi, the traditional Japanese New Year food, seems to float out toward you. No 3D glasses. Move left or right and the angle of the dish changes with you. The source video is ordinary 2D, and AI is converting it to 3D as it plays.
That is the glasses-free 3D display that SoftBank, SB Creative and the Japanese restaurant chain Tonden showed to the press on November 12 at a Tonden branch in Saitama. It is a trial of digital signage, the electronic menu boards and ads in shops. SoftBank says it is the first time it has tested this 3D display in Japan.
How does the glasses-free 3D display work?
Three technologies are involved. First, a lenticular lens: rows of thin, half-cylinder lenses that bend light so each eye gets a different image. Second, a depth estimation AI model that guesses how far away things in a video are and generates left-eye and right-eye images in real time. In a shot of cherry blossoms with Mount Fuji behind, it works out that the blossoms are in front and pushes them forward.
Third, AI eye tracking. A camera on the display finds the viewer's eyes and adjusts the picture to match, which keeps the 3D image sharp even if you are a little off-center.
SoftBank's Yuji Kumon said the main point is that video no longer has to be made specially for 3D displays. Existing 2D footage works as it is.
The catch: one viewer per screen
The eye tracking follows one person per display. With several people watching, not everyone sees 3D. A reporter watching a colleague from the side saw the image warp like a mirage at some angles. In a busy restaurant, how many customers can actually see the effect is an open question.
What happens next
The three companies want to know whether 3D grabs more attention than flat video and raises interest in the food. Visitors answer three yes-or-no questions with stickers on a board. At 3 p.m. on November 12, all stickers for "did the osechi look 3D" and "would you look at a 3D video in a shop" were positive. On "did your interest in osechi rise", most said yes, but a few said it had not changed.
SB Creative plans to build the conversion into BeyondCAST, its cloud service for managing video across many displays. Companies could then upload 2D clips and play them in 3D. SoftBank and SB Creative will weigh commercial launch after the final results.
Apps worth a look
Tap the right tiles, add them up, hit the target. Easy to learn, hard to master. Free, for all ages.
Talk to an AI conversation partner; every sentence comes back corrected and explained in your language. 9 languages, A1 to C2.
Open EDIFACT and X12 messages, see every segment explained, convert to JSON/XML, export PDF and Excel. Runs locally, no upload.
Pick who it is for, the occasion and their personality. The search engine reads product descriptions from local shops and ranks what fits. Free, no sign-up.
More from this day
See all →
Samsung Electronics union count hits seven as a new one files

KB Capital data breach exposes details of 1,811 people

Data center waste heat will warm a shrimp farm in Tokyo project

Onamae.com Desktop Cloud hack: GMO faces $200M-plus in claims
More in: Hardware
See all →
Fritzbox 5690 Pro: some units ship with half the memory

Fitbit Air won't sync with Google Health on iPhone: Error 16

Japan's PM names a tiger-striped LOVOT robot "Hanshin-kun"
