Multimodal Vision Research Laboratory


integral pixel cameras and differential image motion

Compressive-sensing cameras are an important new class of sensors that have different design constraints than standard cameras. Surprisingly, little work has explored the relationship between compressive-sensing measurements and differential image motion. We show that, given modest constraints on the measurements and image motions, we can omit the computationally expensive compressive-sensing reconstruction step and obtain more accurate motion estimates with much less computation time. We also formulate a compressive-sensing reconstruction problem that incorporates known image motion and show that this method outperforms the state-of-the-art in compressive-sensing video reconstruction.

Physical Camera

We added a tiling of lenticular arrays to the front of a standard video camera to create an imager with long, thin receptive fields. This is just one of many possible ways of constructing an integral pixel camera.

The physical camera with the tiling pattern of lenticular arrays mounted to the front.

The grid of lenticular arrays acts as a diffuser to cause pixels in the underlying camera to integrate larger regions of the view sphere.

Examples of receptive fields of pixels in the camera.


Press Coverage