Vision & Learning Projects

The goal of this effort is to develop statistical learning methods in the context of applications arising from visual media. Fundamental issues such as visual ambiguity and spatial distortion arise in the context of vision that must be accounted for while developing statistical learning methods. We are particularly interested in interactions that arise as a consequence of multiple views. These problems include zero shot learning and person re-identification.


Group Membership Prediction

Illustration of group membership prediction (GMP) in the visual recognition tasks of kinship verification and person re-identification. In kinship verification our task is to decide whether the facial images are from the same family. In person re-identification our task is to decide whether the four pedestrians are the same person. These images are borrowed from VIPeR dataset Family101 dataset.


Zero Shot Learning

In zero-shot learning we observe source and target domain data from a subset of classes. The goal during test-time is to accurately predict the class label of an unobserved class. Our method is based on viewing each source or target data as a mixture of seen class proportions and we postulate that the mixture patterns have to be similar if the two instances belong to the same unseen class.



 zs_retrievalThe graphical representation and retrieval of a “meeting” event.

Zero Shot Search & Retrieval

In the archival step, we take in incoming data, extract attributes and relationships and store them in hash tables. In the query creation step, a user utilizes our GUI to create a query graph that is used to extract the We then calculate the maximally discriminative spanning tree from the query graph, retrieve matches to it, and assemble them into ranked search results for the user

Anomalous Activity Detection