DOCUMENTATION

Chooch Inference Engine Setup Guide

Chooch Inference Engine Setup Guide

Within the dashboard, this guide will walk you through the steps to set up an edge device running Chooch AI models for NVDIA GPU on new Chooch Inference. The guide will explain how to use the Chooch AI Vision Studio to create a device, then add camera streams and add AI models to the device. Finally, you will run a script that installs the AI models on the GPU hardware and access the Chooch Inference Engine to see the AI in action.

Please note you will need a free account on the Chooch AI Vision Studio. If you don’t yet have one, please sign up here. For the moment, you will also need an Enterprise account. Please request one here.

Hardware Requirements

GPU (7.1)

  • Compatible Graphics Card Platforms
    • T4, V100, A2, A10, A30, A100, RTX Ampere (Ax000/RTX30x0)
  • Compatible Operating Systems
    • Ubuntu 20.04
  • GCC
    • GCC 9.4.0
  • CUDA Release
    • CUDA 11.7.1
  • cuDNN Release
    • cuDNN 8.4.1.50+
  • TRT Release
    • TRT 8.4.1.5
  • Display Driver
    • R515.65.01
  • Memory
    • Min 32GB RAM
  • Disk
    • 256GB SSD Drive

CPU (7.0)

  • Compatible Processors
    • 8th to 10th generation Intel® Core™ > i7 (suggested i9)
    • 3rd generation Intel® Xeon® Scalable processors
  • Compatible Operating Systems
    • Ubuntu* 18.04.3 LTS and above (64 bit)
  • Memory

Jetson Orin (Coming Soon)

Installation Requirements

GPU(7.1) Setup Guide

Notes:

-An Internet connection is needed to perform many of the following steps
-Many of the following command lines will require your system’s root or super user password

Installation requirements for Ubuntu server – GPU:

If Ubuntu has not been installed, please use the following link. If Ubuntu has been previously installed, please skip to the next step.
https://releases.ubuntu.com/20.04/

Enter the following script to your terminal and follow the instructions:

This installation time may take approximately 60 minutes or more, based on your network upload speed.

#default GPU install (see below for other optional arguments)
#NOTE: API key MUST go after -k argument. Other optional argument appends to the end.

bash -c "$(curl http://get.chooch.ai/chooch-preinstall-v7)" -s -k  api_key

#NOTE: This command installs the necessary driver version and Nvidia Docker, deletes the oldest inference engine, and installs a new Chooch Inference Engine.
Optional arguments:

api_key: API Key provided by Chooch can be found at the bottom of your Chooch AI Vision Studio Homepage.

CPU(7.0) Setup Guide

Installation requirements for Ubuntu Server for CPU:

Please follow the docker installation instructions
https://docs.docker.com/engine/install/ubuntu/

Notes:

-An Internet connection is needed to perform many of the following steps
-Many of the following command lines will require your system’s root or super user password

 

Enter the following script to your terminal and follow the instructions:

This installation time may take approximately 60 minutes or more, based on your network upload speed.

#default CPU install (see below for other optional arguments)
#NOTE: api key MUST go after -k argument. Other optional argument append to the end

bash -c "$(curl http://get.chooch.ai/chooch-setup)" -s -c -k  api_key
Optional arguments:

-c: CPU install

-d <install_dir>: install directory (defaults to $HOME if not specified)

api_key: API Key provided by Chooch can be found at the bottom of your dashboard’s Homepage.

Jetson Orin Setup Guide (Coming Soon)

Chooch Inference Engine Service Installation:

  1. Log in to your Chooch AI Vision Studio account.
  2. Go to Devices
  3. Create a device
  4. Add a stream to your device
  5. Add Models to your Stream
  6. You can access your Chooch Inference Engine interface on your device from http://localhost:3000/. Copy & paste the Device ID of the device you want to connect. The Device list can be found under the Devices tab of your dashboard.
  7. Set a password to access the dashboard.
  8. You can access your Chooch Inference Engine interface on the device after installation, from http://localhost:3000/
  9. Now you can start using the system!
Some useful commands start,stop and restart the service on device.

Start

docker-compose start

Stop

docker-compose stop

Restart

docker-compose restart