A night vision & face privacy protection application of OpenNCC

- Model-on-OpenNCC: face detection model, pixel substitution algorithm

- Hardware components: OpenNCC core board, IR LED kit

- Benefits: light pollution-free, face privacy safe

- Why this project?

By 2025, it is expected that there will be 1 billion cameras in the public and private fields. The edge-ai cameras with deep learning and visual analysis will also develop rapidly with the maturity of artificial intelligence technology and the improvement of computing power. At the same time, there will be a large number of application scenarios requiring privacy protection, such as:

• Privacy and identity protection in the public / private sphere
• Online protection of children (i.e. Blur the faces of minors when uploading photos)
• Hospital bed care for medical health
• Online fitness training guide
• Elderly care monitoring, fall detection alarm

Among them, in the field of medical treatment and nursing, cameras are often required to have good night vision ability, so that they can adapt to 24-hour coverage. Therefore, providing an edge AI face blurring night vision open camera that can meet privacy requirements can support developers of these scenarios to integrate their own applications.

Data security is being paid attention to by countries all over the world. More than 100 countries are actively dealing with data security issues and legislating for protection, such as:

• GDPR（Europe）
• Privacy Act 1988 (Australia)
• Personal Information Protection Act (Japan)
• Personal Data Protection Act (Singapore)
• The Cybersecurity Law of the People's Republic of China (China)

Vision is a kind of natural language. The face is our most personal feature of privacy. Protecting people's face information makes us more at ease and makes artificial intelligence better serve everyone in the field of vision.

How to implement a vision system with face privacy protection? We need to better understand the protection of face privacy from the composition of modern intelligent camera systems.

- How?

Generally speaking, a complete edge-ai camera is composed of a lens, photoelectric sensor, image processing chip, VPU/NPU processing unit, and some external interfaces. In daily applications, the camera will display photos and videos on the terminal computer, or transmit them to the cloud through the internet. 

From the above workflow, we can find the camera is the simplest place where the data can be desensitized directly. To develop a privacy protection camera with blurred human faces, first of all, we need it to have basic imaging functions and an open ability to allow developers to deploy and integrate algorithms.

Deploy Face blurring algorithm on Open Camera

OpenNCC(Open Neural Compute Camera) is an edge AI camera based on Intel Movidius VPU. It is compatible with the deployment of Intel OpenVINO, is also an open camera. There is a lot of source code for reference on GitHub so that developers can deploy different deep learning models to achieve differentiated functions and performance. This brings us a good development foundation for realizing such a human face blurring camera. We only need to care about the implementation and application of the algorithm, and we don't need to spend a lot of time on the optical and hardware design of the camera and the basic imaging of the camera.

From the perspective of embedded software, we need to complete the following steps to realize face blurring:

Deploy Face Detection Model on OpenNCC

Realize face detection on the Edge-AI camera, and also obtain the coordinates of the face.

OpenNCC camera supports OpenVINO. We select an object detection model from Intel's pre-trained model zoo of Intel OpenVINO Toolkit to implement face detection, of course, the model you trained yourself also could be used. To realize real-time privacy protection, we need to achieve a real-time face detection frame rate of 30 fps. Model training and clipping need to be...