IEI Technology Mustang-V100-MX8, User Manual

Page 1: ...e I User Manual MODEL Intel Vision Accelerator Design with Intel Movidius VPU Powered by Open Visual Inference Neural Network Optimization OpenVINO toolkit Rev 1 00 January 17 2019 Mustang V100 MX8 Mustang V100 MX8 CPU Ca ...

Page 2: ...Mustang V100 MX8 Page II Revision Date Version Changes January 17 2019 1 00 Initial release ...

Page 3: ...arising out of the use or inability to use the product or documentation even if advised of the possibility of such damages This document contains proprietary information protected by copyright All rights are reserved No part of this manual may be reproduced by any mechanical electronic or other means in any form without prior written permission of the manufacturer TRADEMARKS All registered tradema...

Page 4: ...jury Warnings should be taken seriously CAUTION Cautionary messages should be heeded to help reduce the chance of losing data or damaging the product NOTE These messages inform the reader of essential but non critical information These messages should be read carefully as any directions or instructions contained therein can help avoid making mistakes ...

Page 5: ...LATION LINUX 16 4 1 SYSTEM REQUIREMENTS 17 4 2 ONLINE INSTALLATION GUIDE 17 4 3 INSTALLATION STEP BY STEP 18 4 3 1 Install External Software Dependencies 18 4 3 2 Install the Intel Distribution of OpenVINO Toolkit Core Components 19 4 3 3 Set the Environment Variables 21 4 3 4 Configure the Model Optimizer 22 4 4 STEPS FOR INTEL VISION ACCELERATOR DESIGN WITH INTEL MOVIDIUS VPUS MUSTANG V100 MX8 D...

Page 6: ...nstall CMake 3 4 or higher 38 5 3 2 3 Install Python 3 6 5 39 5 3 3 Set the Environment Variables 41 5 3 4 Configure the Model Optimizer 41 5 3 4 1 Model Optimizer Configuration Steps 42 5 4 INSTALLATION STEPS FOR INTEL VISION ACCELERATOR DESIGN WITH INTEL MOVIDIUS VPUS MUSTANG V100 MX8 45 5 5 USE THE DEMO SCRIPTS TO VERIFY YOUR INSTALLATION 45 5 5 1 Run the Image Classification Demo 46 5 5 2 Run ...

Page 7: ... V100 MX8 2 Figure 1 2 Block Diagram 3 Figure 1 3 Dimensions mm 4 Figure 3 1 Remove One Blank Bracket 12 Figure 3 2 Change to Full height Bracket 13 Figure 3 3 Change to Full height Bracket 13 Figure 3 4 Power Connector Location 14 Figure 3 5 Assign a Card ID 14 ...

Page 8: ......

Page 9: ...Mustang V100 MX8 Page 1 Chapter 1 1 Introduction ...

Page 10: ...eillance retail and transportation With the advantage of power efficiency and high performance to dedicate DNN topologies it is perfect to be implemented in AI edge computing device to reduce total power usage providing longer duty time for the rechargeable edge computing equipment Open Visual Inference Neural Network Optimization OpenVINO toolkit is based on convolutional neural networks CNN the ...

Page 11: ...Active fan OpenVINO Toolkit AI edge computing ready device Eight Intel Movidius Myriad X chips can execute eight topologies simultaneously Low power consumption approximate 2 5W for each Intel Movidius Myriad X 12V external power Equipped with rotary switch and LED indicator for card number identification 1 3 Block Diagram Figure 1 2 shows the block diagram of the Mustang V100 MX8 Figure 1 2 Block...

Page 12: ...Mustang V100 MX8 Page 4 1 4 I O and Dimensions The I O interfaces and dimensions of the board are listed below Figure 1 3 Dimensions mm ...

Page 13: ... bit Physical PCIe Interface PCI Express x4 Compliant with PCI Express Specification v2 0 Indicator 7 segment LED display for card ID Fan Active fan External Power Connector 12 V external power Power Consumption 25 W Operating Temperature 5 C 60 C 41 F 140 F ambient temperature Operating Humidity 5 90 Dimensions WxHxD 169 54 mm x 80 05 mm x 23 16 mm Standard half height half length single width Ta...

Page 14: ...Mustang V100 MX8 Page 6 Chapter 2 2 Unpacking ...

Page 15: ...harge Self grounding Touch a grounded conductor every few minutes to discharge any excess static buildup Use an anti static pad When configuring any circuit board place it on an anti static mat Only handle the edges of the PCB Don t touch the surface of the motherboard Hold the motherboard by the edges when handling 2 2 Unpacking Precautions When the Mustang V100 MX8 is unpacked please do the foll...

Page 16: ...e IEI reseller or vendor the Mustang V100 MX8 was purchased from or contact an IEI sales representative directly by sending an email to sales ieiworld com The Mustang V100 MX8 is shipped with the following components Quantity Item and Part Number Image 1 Mustang V100 MX8 AI acceleration card 1 PCIe power adapter 1 Full height bracket 1 Quick Installation Guide ...

Page 17: ...Mustang V100 MX8 Page 9 Chapter 3 3 Hardware Installation ...

Page 18: ...istband can help to prevent ESD from damaging the board Self grounding Before handling the board touch any grounded conducting material During the time the board is handled frequently touch any conducting materials that are connected to the ground Use an anti static pad When configuring the Mustang V100 MX8 place it on an anti static pad This reduces the possibility of ESD damaging the Mustang V10...

Page 19: ... Electronic components are easily damaged by ESD Wearing an ESD cuff removes ESD from the body and helps prevent ESD damage Turn off system When installing the Mustang V100 MX8 make sure that the system to be connected is disconnected from all power supplies and that no electricity is being fed into the system Before and during the installation of the Mustang V100 MX8 DO NOT Remove any of the stic...

Page 20: ...stall the Mustang V100 MX8 or you risk damaging the system or experiencing electrical shock Step 2 Remove the cover from the chassis Step 3 Locate available PCIe slots and remove the blank brackets The Mustang V100 MX8 is compatible with PCIe x4 slots and only needs one PCIe slot for installation Remove a blank bracket panel on the back of the computer that aligns with the PCIe slot for installing...

Page 21: ...Change to Full height Bracket Step 5 Install and secure the Mustang V100 MX8 to the system Align the Mustang V100 MX8 to the PCIe slot Press down gently but firmly to seat the Mustang V100 MX8 correctly in the slot Install the bracket screw to secure the Mustang V100 MX8 to the system s chassis Low profile bracket Full height bracket Figure 3 3 Change to Full height Bracket ...

Page 22: ...er adapter to connect to the power connector of the Mustang V100 MX8 Figure 3 4 Power Connector Location Step 7 Assign a card ID to the Mustang V100 MX8 by adjusting the rotary switch The card ID number assigned here will be shown on the LED display of the card after power up NOTE The LED digit only displays 0 through 7 if switched to 8 the LED will display 0 if switched to F LED will display 7 Fi...

Page 23: ... 8 Repeat Step 3 Step 7 to install multiple Mustang V100 MX8 into the system if available Step 9 Re install the cover of the chassis Step 10 Reconnect any power cords and any network cables to the system Power up the system Step 0 ...

Page 24: ...Mustang V100 MX8 Page 16 Chapter 4 4 OpenVINO Toolkit Installation Linux ...

Page 25: ...enVINO Toolkit was pre installed in TANK 870AI 4 2 Online Installation Guide Go to https software intel com en us openvino toolkit Click Get Started then choose your configuration from Development Environment Installation Guides Videos Follow the instruction to complete the installation procedure ...

Page 26: ...image 4 15 0 38 generic apt get install linux headers 4 15 0 38 generic apt get install linux modules extra 4 15 0 38 generic apt get remove linux modules extra 4 15 0 38 generic 4 3 1 Install External Software Dependencies 1 Open the Terminal or your preferred console application and go to the directory in which you downloaded the Intel Distribution of OpenVINO toolkit This document assumes this ...

Page 27: ...toolkit core components Note The Model Optimizer has additional prerequisites that are addressed later in this document 4 3 2 Install the Intel Distribution of OpenVINO Toolkit Core Components If you have a previous version of the toolkit installed rename or delete two directories home user inference_engine_samples home user openvino_models To install the OpenVINO core components 1 Choose one of t...

Page 28: ...r_vision_sdk_ version For simplicity a symbolic link to the latest installation is also created opt intel computer_vision_sdk o If you used regular user privileges to run the installer it installs the Intel Distribution of OpenVINO toolkit in this directory home user intel computer_vision_sdk_ version For simplicity a symbolic link to the latest installation is also created home user intel compute...

Page 29: ...t section of the installation guide to set the environment variables You are in the same document The new window opens in case you ran the installation without first opening this installation guide The core components are installed Continue to the next section to set environment variables 4 3 3 Set the Environment Variables You must update several environment variables before you can compile and r...

Page 30: ...is section is required You must configure the Model Optimizer for at least one framework The Model Optimizer will fail if you do not complete the steps in this section The Model Optimizer is a key component of the Intel Distribution of OpenVINO toolkit You cannot do inference on your trained model without running the model through the Model Optimizer When you run a pre trained model through the Mo...

Page 31: ... for one framework at a time Choose the option that best suits your needs If you see error messages make sure you installed all dependencies Note If you did not install the Intel Distribution of OpenVINO toolkit to the default installation directory replace intel with the directory where you installed the software to Option 1 Configure the Model Optimizer for all supported frameworks at the same t...

Page 32: ...ration steps Continue to the next section 4 4 Steps for Intel Vision Accelerator Design with Intel Movidius VPUs Mustang V100 MX8 Driver Installation 1 Install dependencies sudo apt install libusb 1 0 0 libboost program options1 58 0 libboost thread1 58 0 libboost filesystem1 58 0 libssl1 0 0 libudev1 libjson c2 2 Add the current Linux user to the users group sudo usermod a G users whoami 3 Log ou...

Page 33: ...stall sudo cp av HDDL_INSTALL_DIR 97 myriad usbboot rules etc udev rules d sudo cp av HDDL_INSTALL_DIR etc sudo udevadm control reload rules sudo udevadm trigger sudo ldconfig Now the Mustang V100 MX8 drivers are installed 4 5 Use the Demo Scripts to Verify Your Installation Important This section is required In addition to confirming that your installation was successful the demo scripts perform ...

Page 34: ...cation demo 1 Set your environment variables source opt intel computer_vision_sdk bin setupvars sh 2 Modify sh content sudo gedit demo_squeezenet_download_convert_run sh Search MYRIAD and modify to HDDL then save 3 Assign Mustang V100 MX8 d HDDL and run demo demo_squeezenet_download_convert_run sh d HDDL 3 The Image Classification demo uses the Model Optimizer to convert a SqueezeNet model to bin ...

Page 35: ...uses car png in opt intel computer_vision_sdk deployment_tools demo to show an inference pipeline This demo uses three pre trained models The demo uses vehicle recognition in which vehicle attributes build on each other to narrow in on a specific attribute The demo works as follows 1 An object is identified as a vehicle 2 This identification is used as input to the next model which identifies spec...

Page 36: ...o o An image viewer window that displays a picture similar to the following 6 Close the image viewer screen to end the demo In this section you saw a preview of the Intel Distribution of OpenVINO toolkit capabilities You have completed all the required installation configuration and build steps to work with your trained models using the Mustang V100 MX8 ...

Page 37: ...Mustang V100 MX8 Page 29 Chapter 5 5 OpenVINO Toolkit Installation Windows 10 ...

Page 38: ...t was pre installed in TANK 870AI 5 2 Online Installation Guide Go to https software intel com en us openvino toolkit Click Get Started then choose your configuration from Development Environment Installation Guides Videos Follow the instruction to complete the installation procedure ...

Page 39: ... the latest version By default the file is saved to the Downloads directory as w_openvino_toolkit_p_ version exe 2 Go to the Downloads folder 3 Double click w_openvino_toolkit_p_ version exe A window opens to let you choose your installation directory and components The default installation directory is C Intel If you choose a different installation directory the installer will create the director...

Page 40: ... missing external dependencies you will see a warning screen Write down the dependencies you are missing You need to take no other action at this time After installing the Intel Distribution of OpenVINO toolkit core components you will be provided instructions to install the missing dependencies The screen example below indicates you are missing two dependencies ...

Page 41: ...d 9 Click Finish to close the installation wizard A new browser window opens to the next section of the installation guide to install the dependencies You are in the same document The new window opens in case you ran the installation without first opening this installation guide If the installation did not indicate you must install dependencies you can skip ahead to Configure the Model Optimizer ...

Page 42: ...udio C is required for building the Intel Deep Learning Deployment Toolkit samples and demonstration applications You can install the free Community version of Microsoft Visual Studio IMPORTANT The Microsoft Visual Studio dependency is a two part installation that consists of Microsoft Visual Studio 2017 or 2015 and the Microsoft Visual Studio Build Tools This guide includes steps for installing b...

Page 43: ... is saved in your Downloads folder 3 Double click the executable file to launch the Visual Studio Community 2017 installer 4 From the Workloads tab use the check boxes to select Universal Windows Platform development and Desktop development with C 5 Under the Individual components tab select MSBuild ...

Page 44: ...Mustang V100 MX8 Page 36 The Summary at the right side of the screen displays your installation selections 6 Make no other changes Click Next The installation begins and takes around 30 ...

Page 45: ...crosoft Visual Studio dependency You must complete this installation 1 Go to the Tools for Visual Studio 2017 section of the Microsoft Visual Studio Downloads page 2 Click the Download button next to Build tools for Visual Studio 2017 3 An executable file named vs_buildtools exe or similar is saved in your Downloads folder 4 Double click the file to install Build Tools for Visual Studio 2017 5 The...

Page 46: ...Install CMake 3 4 or higher These steps guide you through installing CMake 3 4 or higher which is required to build the Intel Distribution of OpenVINO toolkit samples 1 Go to the CMake download site 2 Under the heading Get the Software click the link for latest stable in the first paragraph Your screen displays Latest Release information 3 Scroll down to the line Windows win64 x64 Installer 4 Clic...

Page 47: ...CMake to the system PATH for all users 8 Click Next 9 Click Finish when the installation completes You have completed the CMake installation Next install Python 3 6 5 if the Intel Distribution of OpenVINO toolkit installation indicated you are missing the software 5 3 2 4 Install Python 3 6 5 Python 3 6 5 with pip is required to run the Model Optimizer Use these steps to install the correct versio...

Page 48: ...g V100 MX8 Page 40 2 Double click the file to launch the installation 3 Make sure the top of the screen shows Python 3 6 5 64 bit 4 IMPORTANT At the bottom of the install screen select Add Python 3 6 to PATH ...

Page 49: ...y The environment variables are set Continue to the next section to configure the Model Optimizer 5 3 4 Configure the Model Optimizer Important These steps are required You must configure the Model Optimizer for at least one framework The Model Optimizer will fail if you do not complete the steps in this section If you see an error indicating Python is not installed when you know you installed it ...

Page 50: ...f the supported frameworks at the same time or for individual frameworks If you want to manually configure the Model Optimizer instead of using scripts see the Using Manual Configuration Process section in the Model Optimizer Developer Guide For more information about the Model Optimizer see the Model Optimizer Developer Guide 5 3 4 1 Model Optimizer Configuration Steps You can configure the Model...

Page 51: ...OpenVINO toolkit that you installed cd C Intel computer_vision_sdk_ version deployment_tools model_ optimizer install_prerequisites 4 Run the following batch file to configure Model Optimizer for Caffe TensorFlow MXNet Kaldi and ONNX install_prerequisites bat Option 2 Configure the Model Optimizer for each framework separately 1 Go to the Model Optimizer prerequisites directory cd C Intel computer...

Page 52: ...ensorFlow install_prerequisites_tf bat o For MXNet install_prerequisites_mxnet bat o For ONNX install_prerequisites_onnx bat o For Kaldi install_prerequisites_kaldi bat The Model Optimizer is configured for one or more frameworks Success is indicated by a screen similar to this ...

Page 53: ...he directory in which the OpenVINO toolkit is installed 2 Right click on the Movidius_VSC_Device inf file and choose Install from the pop up menu 2 Install the SMBUS driver 1 Go to the INSTALL_DIR deployment_tools inference engine external hddl SMBusDriver directory where INSTALL_DIR is the directory in which the OpenVINO toolkit is installed 2 Right click on the hddlsmbus inf file and choose Inst...

Page 54: ...ctory other than C Intel update the directory with the location where you installed the software If you are migrating from the Intel Computer Vision SDK 2017 R3 Beta version to the Intel Distribution of OpenVINO toolkit read this information about porting your applications 1 Open a command prompt window 2 Go to the Inference Engine demo directory cd C Intel computer_vision_sdk_ version deployment_...

Page 55: ...r Guide 1 Run the Image Classification demo demo_squeezenet_download_convert_run bat 2 This demo uses the car png image located in the C Intel computer_vision_sdk_ version deployment_tools demo directory When the demo completes the label and confidence for the top 10 categories are displayed on your screen This demo is complete Leave the console open and continue to the next section to run the Inf...

Page 56: ...build on each other to narrow in on a specific attribute The demo works as follows 1 An object is identified as a vehicle 2 This identification is used as input to the next model which identifies specific vehicle attributes including the license plate 3 The attributes identified as the license plate are used as input to the third model which recognizes specific characters in the license plate For ...

Page 57: ...indow to end the demo In this section you saw a preview of the Intel Distribution of OpenVINO toolkit capabilities You have completed all the required installation configuration and build steps to work with your trained models using the Mustang V100 MX8 ...

Page 58: ...Mustang V100 MX8 Page 50 Appendix A A Regulatory Compliance ...

Page 59: ...rence that may cause undesired operation This equipment has been tested and found to comply with the limits for a Class A digital device pursuant to part 15 of the FCC Rules These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment This equipment generates uses and can radiate radio frequency energy and if not...

Page 60: ...Mustang V100 MX8 Page 52 B Product Disposal Appendix B ...

Page 61: ...fied as electronic device in terms of the European Directive 2012 19 EU WEEE and must not be disposed of as domestic garbage EU wide legislation as implemented in each Member State requires that waste electrical and electronic products carrying the mark left must be disposed of separately from normal household waste This includes monitors and electrical accessories such as signal cables or power c...

Page 62: ...Mustang V100 MX8 Page 54 Appendix C C Hazardous Materials Disclosure ...

Page 63: ... These components will be separately marked Please refer to the following table Part Name Toxic or Hazardous Substances and Elements Lead Pb Mercury Hg Cadmium Cd Hexavalent Chromium CR VI Polybrominated Biphenyls PBB Polybrominated Diphenyl Ethers PBDE Housing O O O O O O Display O O O O O O Printed Circuit Board O O O O O O Metal Fasteners O O O O O O Cable Assembly O O O O O O Fan Assembly O O ...

Page 64: ...管 这些元 件将会单独标示出来 部件名称 有毒有害物质或元素 铅 Pb 汞 Hg 镉 Cd 六价铬 CR VI 多溴联苯 PBB 多溴二苯 醚 PBDE 壳体 O O O O O O 显示 O O O O O O 印刷电路板 O O O O O O 金属螺帽 O O O O O O 电缆组装 O O O O O O 风扇组装 O O O O O O 电力供应组装 O O O O O O 电池 O O O O O O O 表示该有毒有害物质在该部件所有物质材料中的含量均在 SJ T 11363 2006 现由 GB T 26572 2011 取代 标准规定的限量要求以下 X 表示该有毒有害物质至少在该部件的某一均质材料中的含量超出 SJ T 11363 2006 现由 GB T 26572 2011 取代 标准规定的限量要求 ...