AdaptiVisor

Near-eye Display

Augmented Reality

Augmented Vision

AdaptiVisor: Assisting Eye Adaptation via Occlusive Optical See-Through Head-Mounted Displays

(Augmented Human 2017, Best Paper Award 3rd Place)




Abstract

Brightness adaptation is a fundamental ability in human visual system, and adjusts various levels of darkness and light. While this ability is continuously used, and it can mostly handle sudden lighting changes in the environment, the adaptation could still take several minutes. Moreover, during the adaptation, the color perception changes as well. This slow reactivity and perception change of the eyes could lead to mistakes for tasks performed in dazzling or temporally high-contrast environments such as when driving into the sun or during a welding process.

We present AdaptiVisor, a vision augmentation system that assists the brightness adaptation of the eye. Our system selectively modulates the intensity of the light coming into the eyes via occlusion-capable Optical See-Through Head-Mounted Displays (OST-HMD). An integrated camera captures highlights and brightness in the environment via high-dynamic range capture, and our display system selectively dims or enhances part of the field of views so that the user would not perceive rapid brightness changes. We build a proof-of-concept system to evaluate the feasibility of the adaptation assistance by combining a transmissive LCD panel and an OST-HMD, and test it with a user-perspective, view-point camera. The evaluation shows that the system decreases the overexposed area in a scene to 1/15th, and enhances the color by reducing the majorly underexposed area to half. We also include a preliminary user trial and it indicates that the system also works for real eyes for the HMD part and to some extent for the LCD.


日本語


AdaptiVisor: 遮蔽機能を備えた光学透過型ヘッドマウントディスプレイによる視覚の順応補助

「運転中にトンネルから出たとき、しばらく眼が眩む」「暗い部屋に入ったとき、目を暗闇に慣らす必要がある」といった例のように、眼に入る光の突然の変化に対する視覚の順応機能の遅れは常に発生し、しばしば大きな事故を引き起こす。視覚の順応機能を眼に入る光を直接変調することにより補助することを目的として、光学透過型ヘッドマウントディスプレイ(Optical See-Through Head-Mounted Display, OST-HMD)と透過型LCDを組み合わせた視覚拡張システム 「AdaptiVisor」 を提案した。
AdaptiVisorは、ハーフミラーを用いた同軸光学系により眼の位置と同じ位置にシーンカメラを設置することで、眼に入る映像と同じ映像を取得する。その後、カメラから得られた映像に基づき、眼に入る環境光の急激な変化を検出する。最後に、環境光のうち露光過多の領域は透過型LCDにより遮蔽し、露光不足の領域はOST-HMDにより強調する。
実験より、AdaptiVisorのシステムは眼に入る光を画素単位で適応的に調整することが可能であり、順応機能の補助に活用できることを確認した。



References

  • Yuichi Hiroi, Yuta Itoh, Takumi Hamasaki, Maki Sugimoto, “AdaptiVisor: assisting eye adaptation via occlusive optical see-through head-mounted displays”, 8th Augmented Human International Conference (AH 2017), pp.9.