Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save finddavesteele/ca523bf55ec673df078c1d845835e84c to your computer and use it in GitHub Desktop.
Save finddavesteele/ca523bf55ec673df078c1d845835e84c to your computer and use it in GitHub Desktop.
Getting Started with the NAVQ+ and Brinq Smart Camera Software Demo

Table of Contents

About the NAVQ+ and Brinq Smart Camera Software

The NAVQ+ Smart Camera is a turn-key platform for creating smart vision applications at the edge. It features a quad core NXP i.MX 8M Plus CPU with a 2.3 TOPS NPU and a 5MP OV5645 camera sensor all in a compact 80 x 90mm module. Installing the Brinq Smart Camera demo software transforms the NAVQ+ into a full-fledged smart camera system with web dashboard and analytics for boundary crossing, people counting, tracking, reidentification, motionless and loitering behaviour.

This is demo software and is limited in its features and capabilities. Additional analytics for people, vehicles, packages and inspection are available from Arcturus along with development services for specialized analytics and support. Refer to the contact section to reach out to us. We are here to help you deliver your ML and vision projects.

An additional tutorial on Brinq Smart Camera Analytics for NAVQ+ and a video demo has been created to illustrate features, operation and expected behaviour of the the analytics.

Brinq Smart Camera Software features

Web dashboard views

Live view

  • Live video stream
  • Visualization of detections in real-time
  • Visualization of analytics events in real-time
  • Time stamping
  • Real-time event notifications

Playback view

  • Playback of recorded video
  • Timeline view of events
  • Playback speed adjustments
  • Smart search by event class and time range
  • Event filtering by event class and time range

Statistics view

  • Visualize analytics events
  • Select time ranges and frequency
  • Visual CPU, storage and memory systems

Smart Vision Analytics

Boundary Crossing

  • Draw polygons to define boundary zones
  • Receive notifications when a person enters or exits a zone
  • Set schedules when the analytic notification runs
  • Count people in field of view or within zones

Loitering

  • Draw polygons to define loitering zones
  • Define the duration (loitering threshold) a person can remain in zone before triggering a notification
  • Set schedules when the analytic notification runs
  • Receive notifications when a loitering person is detected

Motionless

  • Draw polygons to define motionless detection zones
  • Define the duration and motion tracking tolerances to determine a person is motionless can remain in zone before triggering a notification
  • Set schedules when the analytic notification runs
  • Receive notifications when a motionless person is detected

Abandoned Package

  • Package and vehicle analytics are not available as part of the demo software.

Tracking / Reidentification

  • TBD

Configuration and Settings

  • Video source selection (camera, stream or file)
  • Advanced settings including detection confidence threshold
  • Analytics configuration including polygon zones, schedules and advanced features

Installing Smart Camera Software Demo on NAVQ+ Hardware

Refer to the Demo Installation Guide

Getting Started

NOTE: We highly recommend this demo be run using wired Ethernet connection between NAVQ+ and PC. Using Wi-Fi may cause synchronization, latency or jitter issues.

Logging into the Web Dashboard

  • Once you have installed the software by following the installation instructions the device will boot and begin to set up the demo. After the system boots and completes installation, you can access the Brinq Smart Camera Software Demo web dashboard.
  • The web dashboard can be accessed at the local address http://ip-address-of-imx8mpnavq.
  • The IP address can be obtained using the NAVQ+ serial connection and running the appropriate Linux shell command.

NOTE: logging into the web dashboard for the first time will take several seconds.

Getting Familiar with the System

Once you have logged into the web dashboard there are several important features and views.
image

Default System State

To help simplify the out-of-the-box experience the demo includes the following preconfigured settings:

  • Live camera enabled
  • Boundary Crossing analytic enabled with two zones (left / green) and (right / blue).
  • Boundary Crossing zones on the live view enabled
  • People Counting (based on boundary crossing zones) enabled
  • Motionless analytic with one zone configured (full screen) enabled
  • Loitering analytic with one zone configured (full screen) disabled

All of the above settings can be modified in the configuration panel.

ProTip: Only running analytics appear in Incidents Notification section below the Brinq logo.

Pre-loaded Test Video

A preloaded test video has been provided to help evaluate functionality using a controlled video source. The test video source can be selected in the configuration panel. To select the video source

  • Open configuration panel by clicking on gear icon in top right corner of web dashboard
  • Navigate to the Video Source tab in the configuration panel
  • Deselect the Erase Zones When Video Source Is Changed field image
  • Select "Test Source" from the Active Video Source Selection drop down
  • Apply changes image

Using the Pre-loaded Test Video to Validate Functionality

The test video features two athletes running on a track (one seems to be in slightly better shape - but ignore that). The video has been edited to provide sequences that can be used to test each of the analytics together or in isolation. The video contains annotations to help with testing Boundary Crossing, Motionless and Loitering behaviour. The preconfigured default state of the demo (as described above) will help illustrate the capabilities of the demo. The demo functions as follows:

Live View Workflow

In Live view when an event is detected by a Smart Analytic the event will be reported by:

  • A bounding box visualization and label in the live video
  • An incident notification reported under the corresponding analytic

To respond to the event:

  • Click on the Analytic drop down in the Incident Notifications to view the list of new events
  • Click on an event to open the playback view and view the event in the timeline
  • Click on Acknowledge All as a to clear all events To view the playback of the event

Playback View Workflow

In Playback view there several tools available. The features are described below. image

  • Timeline - annotated with event incidents
    • Use mouse zoom controls to zoom in/out and drag left/right
    • Click on any event to playback the video
    • Boundary Crossing event annotations inherit the zone colour configured in the analytic)
  • Scrubbing Controls
    • Play/pause, forward to next/previous event, back/forward 30 seconds
  • Playback Speed Control
    • Speed up or slow down playback video
  • Bookmark
    • Add a bookmark in the timeline
  • Event List
    • Filter by events by class
    • Select time in timeline
  • Smart Search
    • Filter events by class
    • Select time range

ProTip: Click on the Right Arrow above the incident notifications to expand the Incident Notification view and display a picture-in-picture live view.

Statistics View Workflow

The Statistics view provides a method to graphically visualize events and system performance over time. It features:

  • System Vitals

    • Current CPU, Memory and Disk Storage
  • Incidents (over time range)

    • Zone / Boundary Crossing
    • Loitering
    • Motionless
    • People traffic per minute
  • System Statistics (over time range)

    • CPU Load averages, Memory and Disk Storage
  • Time range and refresh frequency are configurable through the Grafana tool bar.

image

Contact and Additional Information

Brinq Smart Camera Software Demo on NAVQ+

Copyright 2023 - Arcturus Networks Inc. All Rights Reserved.

Licensing and customization available from Arcturus

Demo License and Terms

Refer to the Brinq Smart Camera Software Demo On NAVQ+ Hardware - License Terms (EULA)

Additional Resources

The follow resources and links available to support NAVQ+ development

Arcturus - Brinq Smart Camera Software

Emcraft Hardware

NXP Hardware

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment