End-to-End video streaming solution with advanced AI/ML capabilities

SpartanShield Technologies partnered with InnoPhase IOT to bring Smart Home Matter software stack, AI/ML capabilities as well as Cloud agnostic Platform integration to industry’s leading wireless video solution. The system combines the InnoPhase IoT Talaria TWO™ ultra-low power Wi-Fi module and Ingenic’s T31 Video Processor with deep learning algorithms to create a cutting-edge solution.

SpartanShield Technologies provides for SpartanShield AI/ML Device Management Platform along with Android & IOS SDKs for mobile applications to support end-to-end video streaming from the Cameras to the Cloud. The cloud connected, battery-based video platform incorporates AI processing for new “Vision As a Sensor” applications, such as “smarter” security cameras, door locks, human monitors, access control and identity verification systems.

It allows to get to market quickier with application development kits that include hardware, software and design files to give your product design a head-start.

Camera devices are a first-class citizen for many vision application. Not only because it gives ears and eyes to your platform. Mainly due to SpartanShield ADMP is being developed with a vision of AIΩnization for any type of devices under its management. Device AIonization means adding AI/ML capabilities to any device type. Vision data and Camera itself are core component of AI/ML execution environments shifted from the Cloud to the Edge.

How to make the most from Cameras

In order to make Camera an organic part of Smart Home Platform, we use SpartanShield Video Platform that serves as a unification, orchestration and device management tool for integrating such device type. In addition, the following components should be deployed to the Camera device itself:

• USP Agent for managing Camera firmware updates( optional )
• MQTT Agent for Camera orchestration and lifecycle management

Camera platform integration looks as on the diagram below.

Mobile application SDKs for Android, iOS

SpartanShield Video Platform provides for SDKs to integrated Video streaming capabilities into mobile applications at Android, iOS environments.

Conclusion

SpartanShield end-to-end Video streaming solution is usefull for various vertical business applications.

Also, it’s time to think about how exactly your IOT devices are applicable for executing AI/ML computations locally as well as be an integral part of your Device Fleet AIΩnization.