Facial Recognition for Retail

Customer

Customer is a big Australian Company that specializes on the variety of retail services for Retail Industry. The Customer created innovative services for various retail product groups (general merchandise, apparel, household appliances, grocery, consumer electronics, etc.). The Customer provides individual services to adapt its solutions to the needs of each client; its solutions are trading globally and are used by many customers all over the world from single store owners to huge multi-national retailers.

Challenge

The Customer decided to implement a solution for in-store service personalization and gathering customer metrics. The goal of the project was to recognize faces of the people entering stores and add information about them into the database for further analysis. As the same people enter the store again, their faces would be recognized based on the recorded data to enhance their customer experience and personalize service.

Solution

ScienceSoft divided the retail application development process into two main stages to enable:

  • Face image capture
  • Face recognition

Our specialists used the OpenCV library as a foundation platform to enable face image capturing and further improved its image capturing capabilities.

The second stage consisted of 3 parts:

  • Preprocessing with specifically processed input images to make customers' faces recognizable.
  • Calculating landmarks, i.e. some particular facial features.
  • Face recognition using calculated landmarks and special criteria.

During the work on this project the team investigated a set of algorithms and methods such as Harris corner detector, Flusser affine invariants, Hu invariants, Mahalanobis metric, SIFT (Scale-invariant feature transform), etc. This combination of algorithms allowed to implement the Customer's requirements and build the system that works with a high percentage of correct results.

Results

On time and on budget, the Customer received a solution that allowed to recognize store visitors using an innovative image recognition technology and tailor their in-store experience accordingly.

Technologies and Tools

.Net 2.0/3.5, C++, IPP, OpenCV library.