Computer Vision (Nishino Lab)

Visual Information Processing, Computational Photography, and Visual Intelligence

In our laboratory, we study computer vision, the science aimed at establishing the theoretical foundation and practical implementation for granting computers the ability to see, whose findings also inform human vision studies. Armed with machine learning and optics, we aim to elevate computer vision to an intelligent perceptual modality for computers, instead of merely a means for efficient consumption of images and videos by humans.

Academic Staff

Ko Nishino

Ko NishinoProfessor (Graduate School of Informatics)

Research Interests

Visual information processing / Computer vision / Machine learning

Contacts

Research Bldg #9, South wing, Room S-303
TEL: +81-75-753-4891
https://vision.ist.i.kyoto-u.ac.jp/

Shohei Nobuhara

Shohei NobuharaAssociate Professor (Graduate School of Informatics)

Research Interests

Computer vision / 3D shape & motion estimation / 3D video

Contacts

Research Bldg #9, South wing, Room I-302
TEL: +81-75-753-5883
https://vision.ist.i.kyoto-u.ac.jp/~nob/

Introduction to R&D Topics

Perceiving People

Tracking People in Crowds
Tracking People in Crowds
The looks and actions of people embody their inner states including their thoughts and feelings, not merely their visual attributes such as gender and height. We, for instance, can easily identify the mood and intention of a person by just looking at them. In our lab, we have introduced how we can identify what are person is seeing and how a person would walk in a crowded scene. We plan to continue our work on understanding a person’s attention, intention, actions, and interactions from sight, towards realizing a rich symbiosis of artificial agents with computer vision and human beings.

Perceiving Things

Reflectance and Natural Illumination from a Single Image
Reflectance and Natural Illumination from a Single Image
We gauge a large amount of information by just looking at things and scenes around us. Instead of just recognizing the categories of objects in front of us, such as a road and a parked car, we immediately “see” information essential to interact with them such as the wetness of the road after rain and the difference in hardness between the metal body and plastic bumper of the car. Our lab has conducted seminal research on estimating rich object information from images, such as illumination, reflectance, geometry, and material. We plan to continue research on extracting such physical and semantic information from object and scene appearance.

Seeing Better

Shape from Water
Shape from Water
We use our two eyes to see our world in the visual spectrum, but computers need not be restricted to the same sensor limitations. In our lab, we conduct research on developing novel imaging systems that use computation as an integral part, referred to as computational photography, with the goal of capturing richer visual information to realize computational perception. Our recent work has focused on infrared imaging and subsurface light scattering modeling, leading to novel imaging systems for underwater real-time 3D sensing and transient imaging of subsurface scattering.