Deeper Learning Makes Smart City Surveillance Even Smarter

April 22, 2019 Brandon Lewis

Security Camera Smart City

For smart city edge applications such as security surveillance, critical infrastructure monitoring, and traffic/transportation management, deep learning-based video systems deliver additional levels of critical detail compared to traditional computer vision.

In traffic management, for example, basic forms of computer vision may recognize the presence of vehicles, whereas a deep learning system can be trained to identify the number and types of vehicles, and even specific license plates (Figure 1). With this granular information, transit officials could reroute commercial vehicles during periods of high traffic congestion or track suspicious trucks hauling hazardous materials.

Deep learning-based vision systems
Figure 1. Deep learning-based vision systems can improve security and efficiency in smart cities. (Source: The University of Texas at Austin College of Natural Sciences)

In a deep learning-based vision system, most of the intelligence required for such applications can be located on or near the camera. Key parameters can be automatically identified and flagged by the AI software, which can trigger real-time alerts or responses.

But for these capabilities to be effective in a real-world smart-city setting, video surveillance systems must blend cutting-edge deep learning with industrial-grade durability. In practice, this means that neural network-based vision technology must integrate with legacy infrastructure that has been deployed for years or decades. This includes video cameras at the edge, which are often based on a diverse range of technologies.

But at the same time, newer intelligent video technology must be able to scale in both performance and capacity to maximize a city’s return on investment.

Transforming Smart City Surveillance with Deep Learning

Intelligent Security Systems (ISS) is a developer of turnkey video analytics, management, and network video recorder (NVR) solutions. Realizing the advantages of deep learning technology, the company developed the SecurOS video management system (VMS).

SecureOS is a cloud- or on-premises-based video analytics solution that supports AI algorithms for a range of smart city surveillance applications (Figure 2). The platform integrates with many legacy digital security and surveillance solutions, allowing city operators to scale capacity and performance as needs grow.

ISS SecurOS Enterprise
Figure 2. The SecurOS platform is an on-premises or cloud-based deep learning video management system. (Source: Dell EMC)

ISS supports a number of smart surveillance applications, including traffic management, pedestrian safety, and critical asset tracking for rail and mass transit systems. The SecurOS intelligent video analytics solution can be deployed for real-time or historical purposes. And it combines seamlessly with other platforms like intelligent transportation to maximize the benefits of deep learning.

But moving deep learning analytics to the edge of smart city surveillance systems is challenging. ISS had to ensure that neural network algorithms were also optimized to run on video camera endpoints. To do so, it leveraged the Intel® Distribution of the OpenVINO Toolkit to optimize deep learning performance across a range of camera architectures.

Taking Deep Learning to the Edge

The OpenVINO Toolkit is a suite of tools that accelerates development of convolutional neural networks (CNNs) and optimizes them for deployment across heterogeneous compute architectures (Figure 3). Surveillance engineers can therefore deploy deep learning algorithms across camera systems based on CPUs, integrated GPUs, FPGAs, or vision processing units (VPUs).

Intel Openvino Toolkit
Figure 3. The OpenVINO Toolkit optimizes deep learning models for a variety of compute architectures. (Source: Intel®)

The OpenVINO Toolkit is compatible with Intel® Vision Products dating back to 6th generation Intel® Core processors and the Intel Atom® E3900 series processors. As a result, deep learning-based vision performance can be deployed on a range of new and legacy smart city surveillance cameras.

For ISS, the OpenVINO Toolkit supports frameworks such as Caffe and TensorFlow that were already being used in the SecurOS portfolio. The company was therefore able to scale its existing deep learning technologies from server/cloud environments to surveillance camera endpoints without having to revamp deployed hardware infrastructure.

In addition to optimizing deep learning algorithms for diverse processor targets, the OpenVINO Toolkit supplies a number of pre-trained models and templated algorithms that helped ISS accelerate its offerings for specific use cases. These inferencing technologies include:

  • Vehicle Tracker, Counter, and Classifier—integrated into the SecurOS Traffic Monitoring—helps gather historical traffic statistics.
  • Pedestrian Tracker—integrated into the SecurOS Crossroad—assists with real-time detection of complex traffic violations.
  • License Plate Capturer— integrated into SecurOS Auto—enables a variety of parking management, traffic monitoring, law enforcement, and municipal services.

Thanks to enhancements delivered by the OpenVINO Toolkit, these applications also benefit from a significant performance boost compared to deep learning algorithms straight from a native development environment such as Caffe or OpenCV (Figure 4). SecurOS Auto, for example, can now capture license plate characters accurately on vehicles moving as fast as 155 miles per hour.

Performance Improvement Using OpenVINO Toolkit
Figure 4. The OpenVINO Toolkit delivers far superior performance on Intel® hardware. (Source: Intel®)

City Surveillance Gets Smarter, Faster, and More Flexible

The days of a police officer on every corner are long gone. Smart cities have deployed video surveillance technology for decades in an effort to improve safety, increase efficiency, and reduce costs.

Deep learning technology promises to amplify those benefits in more applications than ever before but requires some special considerations. Among these are cost, interoperability, and time to market.

Thanks to the Intel Distribution of OpenVINO Toolkit, smart city surveillance vendors like ISS are able to accelerate development and deployment of deep learning-based video analytics without having to redefine their infrastructure.

By optimizing neural network algorithms for a comprehensive range of vision processing hardware, the OpenVINO Toolkit is bringing deep learning to market quickly and cost-effectively today, while also providing an edge-to-cloud migration path for the vision intelligence technologies of the future.

About the Author

Brandon Lewis

Brandon is responsible for Embedded Computing Design’s IoT Design, Automotive Embedded Systems, Security by Design, and Industrial Embedded Systems brands, where he drives content strategy, positioning, and community engagement. He is also Embedded Computing Design’s IoT Insider columnist, and enjoys covering topics that range from development kits and tools to cyber security and technology business models. Brandon received a BA in English Literature from Arizona State University, where he graduated cum laude.

Follow on Twitter Follow on Linkedin More Content by Brandon Lewis
Previous Download
When Trash Misses the Bin
When Trash Misses the Bin

Next Article
Video Surveillance Secures the World Cup
Video Surveillance Secures the World Cup

Russian officials leveraged 9,000 cameras to monitor and secure more than 3 million attendees at the 2018 F...

×

First Name
Last Name
Your Company
Phone Number
Country/Region
By submitting a form on this site, you are confirming you are an adult 18 years or older and you agree to Intel and Intel® IoT Solutions Alliance members contacting you with marketing-related emails or by telephone. You may unsubscribe at any time. Intel's web sites and communications are subject to our Privacy Notice and Terms of Use.
I would like to be contacted by: - optional
Your contact request is submitted.
Error - something went wrong!
×

Get the latest updates on IoT for smart cities.

Country/Region
Subscribe To Intel Updates
Subscribe To Alliance Partner Updates
By submitting a form on this site, you are confirming you are an adult 18 years or older and you agree to Intel and Intel® IoT Solutions Alliance members contacting you with marketing-related emails or by telephone. You may unsubscribe at any time. Intel's web sites and communications are subject to our Privacy Notice and Terms of Use.
You are following this topic.
Error - something went wrong!