jonas@octo:~$ jonas@octo:~$ docker pull jonaswerner/movidius_nc2_with_openvino:2018.5.455 2018.5.455: Pulling from jonaswerner/movidius_nc2_with_openvino Digest: sha256:a07d16476ddb0cef5365647ab2c72c1ff1bd3467ce33c08f3609dfe52572fcfb Status: Image is up to date for jonaswerner/movidius_nc2_with_openvino:2018.5.455 jonas@octo:~$ jonas@octo:~$ jonas@octo:~$ sudo docker run -ti --privileged --net=host -v /dev:/dev jonaswerner/movidius_nc2_with_openvino:2018.5.455 [sudo] password for jonas: [setupvars.sh] OpenVINO environment initialized root@octo:/# root@octo:/# root@octo:/# cd /opt/intel/computer_vision_sdk/deployment_tools/demo/ root@octo:/opt/intel/computer_vision_sdk/deployment_tools/demo# root@octo:/opt/intel/computer_vision_sdk/deployment_tools/demo# ls -l total 1752 -rw-r--r-- 1 root root 2933 Feb 21 04:35 README.txt -rw-r--r-- 1 root root 310725 Feb 21 04:35 car.png -rw-r--r-- 1 root root 1432032 Feb 21 04:35 car_1.bmp -rwxr-xr-x 1 root root 6472 Feb 21 04:35 demo_security_barrier_camera.sh -rwxr-xr-x 1 root root 8605 Feb 21 04:35 demo_squeezenet_download_convert_run.sh -rw-r--r-- 1 root root 21675 Feb 21 04:35 squeezenet1.1.labels root@octo:/opt/intel/computer_vision_sdk/deployment_tools/demo# ./demo_squeezenet_download_convert_run.sh -d MYRIAD target = MYRIAD target_precision = FP16 ################################################### Downloading the Caffe model and the prototxt Installing dependencies Run sudo -E apt -y install build-essential python3-pip virtualenv cmake libcairo2-dev libpango1.0-dev libglib2.0-dev libgtk2.0-dev libswscale-dev libavcodec-dev libavformat-dev libgstreamer1.0-0 gstreamer1.0-plugins-base Get:1 http://security.ubuntu.com/ubuntu xenial-security InRelease [109 kB] Get:2 http://archive.ubuntu.com/ubuntu xenial InRelease [247 kB] Get:3 http://security.ubuntu.com/ubuntu xenial-security/main amd64 Packages [816 kB] Get:4 http://archive.ubuntu.com/ubuntu xenial-updates InRelease [109 kB] Get:5 http://archive.ubuntu.com/ubuntu xenial-backports InRelease [107 kB] Get:6 http://archive.ubuntu.com/ubuntu xenial/main amd64 Packages [1558 kB] Get:7 http://security.ubuntu.com/ubuntu xenial-security/restricted amd64 Packages [12.7 kB] Get:8 http://security.ubuntu.com/ubuntu xenial-security/universe amd64 Packages [551 kB] Get:9 http://security.ubuntu.com/ubuntu xenial-security/multiverse amd64 Packages [6121 B] Get:10 http://archive.ubuntu.com/ubuntu xenial/restricted amd64 Packages [14.1 kB] Get:11 http://archive.ubuntu.com/ubuntu xenial/universe amd64 Packages [9827 kB] Get:12 http://archive.ubuntu.com/ubuntu xenial/multiverse amd64 Packages [176 kB] Get:13 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 Packages [1211 kB] Get:14 http://archive.ubuntu.com/ubuntu xenial-updates/restricted amd64 Packages [13.1 kB] Get:15 http://archive.ubuntu.com/ubuntu xenial-updates/universe amd64 Packages [963 kB] Get:16 http://archive.ubuntu.com/ubuntu xenial-updates/multiverse amd64 Packages [19.1 kB] Get:17 http://archive.ubuntu.com/ubuntu xenial-backports/main amd64 Packages [7942 B] Get:18 http://archive.ubuntu.com/ubuntu xenial-backports/universe amd64 Packages [8532 B] Fetched 15.8 MB in 5s (2771 kB/s) Reading package lists... Done Building dependency tree Reading state information... Done 19 packages can be upgraded. Run 'apt list --upgradable' to see them. Reading package lists... Done Building dependency tree Reading state information... Done build-essential is already the newest version (12.1ubuntu2). libcairo2-dev is already the newest version (1.14.6-1). libpango1.0-dev is already the newest version (1.38.1-1). cmake is already the newest version (3.5.1-1ubuntu3). gstreamer1.0-plugins-base is already the newest version (1.8.3-1ubuntu0.2). libglib2.0-dev is already the newest version (2.48.2-0ubuntu4.1). libgstreamer1.0-0 is already the newest version (1.8.3-1~ubuntu0.1). libgtk2.0-dev is already the newest version (2.24.30-1ubuntu1.16.04.2). libavcodec-dev is already the newest version (7:2.8.15-0ubuntu0.16.04.1). libavformat-dev is already the newest version (7:2.8.15-0ubuntu0.16.04.1). libswscale-dev is already the newest version (7:2.8.15-0ubuntu0.16.04.1). python3-pip is already the newest version (8.1.1-2ubuntu0.4). The following additional packages will be installed: python3-virtualenv The following NEW packages will be installed: python3-virtualenv virtualenv 0 upgraded, 2 newly installed, 0 to remove and 19 not upgraded. Need to get 47.6 kB of archives. After this operation, 171 kB of additional disk space will be used. Get:1 http://archive.ubuntu.com/ubuntu xenial-updates/universe amd64 python3-virtualenv all 15.0.1+ds-3ubuntu1 [43.2 kB] Get:2 http://archive.ubuntu.com/ubuntu xenial-updates/universe amd64 virtualenv all 15.0.1+ds-3ubuntu1 [4342 B] Fetched 47.6 kB in 1s (32.1 kB/s) debconf: delaying package configuration, since apt-utils is not installed Selecting previously unselected package python3-virtualenv. (Reading database ... 24661 files and directories currently installed.) Preparing to unpack .../python3-virtualenv_15.0.1+ds-3ubuntu1_all.deb ... Unpacking python3-virtualenv (15.0.1+ds-3ubuntu1) ... Selecting previously unselected package virtualenv. Preparing to unpack .../virtualenv_15.0.1+ds-3ubuntu1_all.deb ... Unpacking virtualenv (15.0.1+ds-3ubuntu1) ... Processing triggers for man-db (2.7.5-1) ... Setting up python3-virtualenv (15.0.1+ds-3ubuntu1) ... Setting up virtualenv (15.0.1+ds-3ubuntu1) ... Reading package lists... Done Building dependency tree Reading state information... Done libpng12-dev is already the newest version (1.2.54-1ubuntu1.1). 0 upgraded, 0 newly installed, 0 to remove and 19 not upgraded. Collecting pyyaml Downloading https://files.pythonhosted.org/packages/9f/2c/9417b5c774792634834e730932745bc09a7d36754ca00acf1ccd1ac2594d/PyYAML-5.1.tar.gz (274kB) 100% |################################| 276kB 2.3MB/s Requirement already satisfied (use --upgrade to upgrade): requests in /usr/local/lib/python3.5/dist-packages Requirement already satisfied (use --upgrade to upgrade): urllib3<1.25,>=1.21.1 in /usr/local/lib/python3.5/dist-packages (from requests) Requirement already satisfied (use --upgrade to upgrade): certifi>=2017.4.17 in /usr/local/lib/python3.5/dist-packages (from requests) Requirement already satisfied (use --upgrade to upgrade): idna<2.9,>=2.5 in /usr/local/lib/python3.5/dist-packages (from requests) Requirement already satisfied (use --upgrade to upgrade): chardet<3.1.0,>=3.0.2 in /usr/local/lib/python3.5/dist-packages (from requests) Building wheels for collected packages: pyyaml Running setup.py bdist_wheel for pyyaml ... done Stored in directory: /root/.cache/pip/wheels/ad/56/bc/1522f864feb2a358ea6f1a92b4798d69ac783a28e80567a18b Successfully built pyyaml Installing collected packages: pyyaml Successfully installed pyyaml-5.1 You are using pip version 8.1.1, however version 19.0.3 is available. You should consider upgrading via the 'pip install --upgrade pip' command. Run /opt/intel//computer_vision_sdk_2018.5.455/deployment_tools/model_downloader/downloader.py --name squeezenet1.1 --output_dir /root/openvino_models/models/FP16 /opt/intel//computer_vision_sdk_2018.5.455/deployment_tools/model_downloader/downloader.py:146: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. c_new = yaml.load(stream) ###############|| Start downloading models ||############### ...100%, 9 KB, 57078 KB/s, 0 seconds passed ========= squeezenet1.1.prototxt ====> /root/openvino_models/models/FP16/classification/squeezenet/1.1/caffe/squeezenet1.1.prototxt ###############|| Start downloading weights ||############### ...100%, 4834 KB, 6670 KB/s, 0 seconds passed ========= squeezenet1.1.caffemodel ====> /root/openvino_models/models/FP16/classification/squeezenet/1.1/caffe/squeezenet1.1.caffemodel ###############|| Start downloading topologies in tarballs ||############### ###############|| Post processing ||############### ========= Changing input dimensions in squeezenet1.1.prototxt ========= ################################################### Install Model Optimizer dependencies Hit:1 http://security.ubuntu.com/ubuntu xenial-security InRelease Hit:2 http://archive.ubuntu.com/ubuntu xenial InRelease Hit:3 http://archive.ubuntu.com/ubuntu xenial-updates InRelease Hit:4 http://archive.ubuntu.com/ubuntu xenial-backports InRelease Reading package lists... Done Building dependency tree Reading state information... Done 19 packages can be upgraded. Run 'apt list --upgradable' to see them. Reading package lists... Done Building dependency tree Reading state information... Done python3-venv is already the newest version (3.5.1-3). libgfortran3 is already the newest version (5.4.0-6ubuntu1~16.04.11). python3-pip is already the newest version (8.1.1-2ubuntu0.4). 0 upgraded, 0 newly installed, 0 to remove and 19 not upgraded. Requirement already satisfied (use --upgrade to upgrade): networkx>=1.11 in /usr/local/lib/python3.5/dist-packages (from -r /opt/intel/computer_vision_sdk_2018.5.455/deployment_tools/model_optimizer/install_prerequisites/../requirements_caffe.txt (line 1)) Requirement already satisfied (use --upgrade to upgrade): numpy>=1.12.0 in /usr/local/lib/python3.5/dist-packages (from -r /opt/intel/computer_vision_sdk_2018.5.455/deployment_tools/model_optimizer/install_prerequisites/../requirements_caffe.txt (line 2)) Requirement already satisfied (use --upgrade to upgrade): protobuf==3.6.1 in /usr/local/lib/python3.5/dist-packages (from -r /opt/intel/computer_vision_sdk_2018.5.455/deployment_tools/model_optimizer/install_prerequisites/../requirements_caffe.txt (line 3)) Requirement already satisfied (use --upgrade to upgrade): decorator>=4.3.0 in /usr/local/lib/python3.5/dist-packages (from networkx>=1.11->-r /opt/intel/computer_vision_sdk_2018.5.455/deployment_tools/model_optimizer/install_prerequisites/../requirements_caffe.txt (line 1)) Requirement already satisfied (use --upgrade to upgrade): six>=1.9 in /usr/local/lib/python3.5/dist-packages (from protobuf==3.6.1->-r /opt/intel/computer_vision_sdk_2018.5.455/deployment_tools/model_optimizer/install_prerequisites/../requirements_caffe.txt (line 3)) Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python3/dist-packages (from protobuf==3.6.1->-r /opt/intel/computer_vision_sdk_2018.5.455/deployment_tools/model_optimizer/install_prerequisites/../requirements_caffe.txt (line 3)) You are using pip version 8.1.1, however version 19.0.3 is available. You should consider upgrading via the 'pip install --upgrade pip' command. [WARNING] All Model Optimizer dependencies are installed globally. [WARNING] If you want to keep Model Optimizer in separate sandbox [WARNING] run install_prerequisites.sh venv {caffe|tf|mxnet|kaldi|onnx} ################################################### Convert a model with Model Optimizer Run python3 /opt/intel//computer_vision_sdk_2018.5.455/deployment_tools/model_optimizer/mo.py --input_model /root/openvino_models/models/FP16/classification/squeezenet/1.1/caffe/squeezenet1.1.caffemodel /root/openvino_models/ir/FP16//classification/squeezenet/1.1/caffe --data_type FP16 Model Optimizer arguments: Common parameters: - Path to the Input Model: /root/openvino_models/models/FP16/classification/squeezenet/1.1/caffe/squeezenet1.1.caffemodel - Path for generated IR: /root/openvino_models/ir/FP16//classification/squeezenet/1.1/caffe - IR output name: squeezenet1.1 - Log level: ERROR - Batch: Not specified, inherited from the model - Input layers: Not specified, inherited from the model - Output layers: Not specified, inherited from the model - Input shapes: Not specified, inherited from the model - Mean values: Not specified - Scale values: Not specified - Scale factor: Not specified - Precision of IR: FP16 - Enable fusing: True - Enable grouped convolutions fusing: True - Move mean values to preprocess section: False - Reverse input channels: False Caffe specific parameters: - Enable resnet optimization: True - Path to the Input prototxt: /root/openvino_models/models/FP16/classification/squeezenet/1.1/caffe/squeezenet1.1.prototxt - Path to CustomLayersMapping.xml: Default - Path to a mean file: Not specified - Offsets for a mean file: Not specified Model Optimizer version: 1.5.12.49d067a0 [ SUCCESS ] Generated IR model. [ SUCCESS ] XML file: /root/openvino_models/ir/FP16//classification/squeezenet/1.1/caffe/squeezenet1.1.xml [ SUCCESS ] BIN file: /root/openvino_models/ir/FP16//classification/squeezenet/1.1/caffe/squeezenet1.1.bin [ SUCCESS ] Total execution time: 1.12 seconds. ################################################### Build Inference Engine samples -- The C compiler identification is GNU 5.4.0 -- The CXX compiler identification is GNU 5.4.0 -- Check for working C compiler: /usr/bin/cc -- Check for working C compiler: /usr/bin/cc -- works -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Detecting C compile features -- Detecting C compile features - done -- Check for working CXX compiler: /usr/bin/c++ -- Check for working CXX compiler: /usr/bin/c++ -- works -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Detecting CXX compile features -- Detecting CXX compile features - done -- /etc/*-release distrib: Ubuntu 16.04 -- Found InferenceEngine: /opt/intel/computer_vision_sdk_2018.5.455/deployment_tools/inference_engine/lib/ubuntu_16.04/intel64/libinference_engine.so (Required is at least version "1.5") -- Performing Test HAVE_CPUID_INFO -- Performing Test HAVE_CPUID_INFO - Success -- Host CPU features: -- 3DNOW not supported -- 3DNOWEXT not supported -- ABM not supported -- ADX supported -- AES supported -- AVX supported -- AVX2 supported -- AVX512CD not supported -- AVX512F not supported -- AVX512ER not supported -- AVX512PF not supported -- BMI1 supported -- BMI2 supported -- CLFSH supported -- CMPXCHG16B supported -- CX8 supported -- ERMS supported -- F16C supported -- FMA supported -- FSGSBASE supported -- FXSR supported -- HLE supported -- INVPCID supported -- LAHF supported -- LZCNT supported -- MMX supported -- MMXEXT not supported -- MONITOR supported -- MOVBE supported -- MSR supported -- OSXSAVE supported -- PCLMULQDQ supported -- POPCNT supported -- PREFETCHWT1 not supported -- RDRAND supported -- RDSEED supported -- RDTSCP supported -- RTM supported -- SEP supported -- SHA not supported -- SSE supported -- SSE2 supported -- SSE3 supported -- SSE4.1 supported -- SSE4.2 supported -- SSE4a not supported -- SSSE3 supported -- SYSCALL supported -- TBM not supported -- XOP not supported -- XSAVE supported -- OMP Release lib: /opt/intel/computer_vision_sdk_2018.5.455/deployment_tools/inference_engine/external/omp/lib/libiomp5.so -- OMP Debug lib: /opt/intel/computer_vision_sdk_2018.5.455/deployment_tools/inference_engine/external/omp/lib/libiomp5.so -- Looking for C++ include unistd.h -- Looking for C++ include unistd.h - found -- Looking for C++ include stdint.h -- Looking for C++ include stdint.h - found -- Looking for C++ include sys/types.h -- Looking for C++ include sys/types.h - found -- Looking for C++ include fnmatch.h -- Looking for C++ include fnmatch.h - found -- Looking for C++ include stddef.h -- Looking for C++ include stddef.h - found -- Check size of uint32_t -- Check size of uint32_t - done -- Looking for strtoll -- Looking for strtoll - found -- Configuring done -- Generating done -- Build files have been written to: /root/inference_engine_samples Scanning dependencies of target ie_cpu_extension Scanning dependencies of target format_reader Scanning dependencies of target gflags_nothreads_static [ 8%] Building CXX object thirdparty/gflags/CMakeFiles/gflags_nothreads_static.dir/src/gflags_reporting.cc.o [ 8%] Building CXX object thirdparty/gflags/CMakeFiles/gflags_nothreads_static.dir/src/gflags_completions.cc.o [ 8%] Building CXX object thirdparty/gflags/CMakeFiles/gflags_nothreads_static.dir/src/gflags.cc.o [ 8%] Building CXX object ie_cpu_extension/CMakeFiles/ie_cpu_extension.dir/ext_resample.cpp.o [ 12%] Building CXX object ie_cpu_extension/CMakeFiles/ie_cpu_extension.dir/ext_priorbox_clustered.cpp.o [ 16%] Building CXX object ie_cpu_extension/CMakeFiles/ie_cpu_extension.dir/ext_interp.cpp.o [ 20%] Building CXX object ie_cpu_extension/CMakeFiles/ie_cpu_extension.dir/ext_powerfile.cpp.o [ 20%] Building CXX object common/format_reader/CMakeFiles/format_reader.dir/bmp.cpp.o [ 24%] Building CXX object common/format_reader/CMakeFiles/format_reader.dir/format_reader.cpp.o [ 28%] Building CXX object common/format_reader/CMakeFiles/format_reader.dir/opencv_wraper.cpp.o [ 32%] Building CXX object common/format_reader/CMakeFiles/format_reader.dir/MnistUbyte.cpp.o [ 32%] Building CXX object ie_cpu_extension/CMakeFiles/ie_cpu_extension.dir/ext_simplernms.cpp.o [ 36%] Building CXX object ie_cpu_extension/CMakeFiles/ie_cpu_extension.dir/ext_pad.cpp.o [ 40%] Building CXX object ie_cpu_extension/CMakeFiles/ie_cpu_extension.dir/ext_gather.cpp.o [ 44%] Building CXX object ie_cpu_extension/CMakeFiles/ie_cpu_extension.dir/ext_list.cpp.o [ 44%] Building CXX object ie_cpu_extension/CMakeFiles/ie_cpu_extension.dir/ext_priorbox.cpp.o [ 48%] Building CXX object ie_cpu_extension/CMakeFiles/ie_cpu_extension.dir/ext_grn.cpp.o [ 52%] Linking CXX static library ../../intel64/Release/lib/libgflags_nothreads.a [ 52%] Built target gflags_nothreads_static [ 56%] Building CXX object ie_cpu_extension/CMakeFiles/ie_cpu_extension.dir/ext_ctc_greedy.cpp.o [ 56%] Linking CXX shared library ../../intel64/Release/lib/libformat_reader.so [ 56%] Built target format_reader [ 56%] Building CXX object ie_cpu_extension/CMakeFiles/ie_cpu_extension.dir/ext_reorg_yolo.cpp.o [ 60%] Building CXX object ie_cpu_extension/CMakeFiles/ie_cpu_extension.dir/ext_spatial_transformer.cpp.o [ 64%] Building CXX object ie_cpu_extension/CMakeFiles/ie_cpu_extension.dir/ext_proposal.cpp.o [ 68%] Building CXX object ie_cpu_extension/CMakeFiles/ie_cpu_extension.dir/ext_argmax.cpp.o [ 68%] Building CXX object ie_cpu_extension/CMakeFiles/ie_cpu_extension.dir/ext_psroi.cpp.o [ 72%] Building CXX object ie_cpu_extension/CMakeFiles/ie_cpu_extension.dir/ext_normalize.cpp.o [ 76%] Building CXX object ie_cpu_extension/CMakeFiles/ie_cpu_extension.dir/simple_copy.cpp.o [ 80%] Building CXX object ie_cpu_extension/CMakeFiles/ie_cpu_extension.dir/ext_detectionoutput.cpp.o [ 80%] Building CXX object ie_cpu_extension/CMakeFiles/ie_cpu_extension.dir/ext_mvn.cpp.o [ 84%] Building CXX object ie_cpu_extension/CMakeFiles/ie_cpu_extension.dir/ext_base.cpp.o [ 88%] Building CXX object ie_cpu_extension/CMakeFiles/ie_cpu_extension.dir/ext_region_yolo.cpp.o [ 92%] Linking CXX shared library ../intel64/Release/lib/libcpu_extension.so [ 92%] Built target ie_cpu_extension Scanning dependencies of target classification_sample [ 96%] Building CXX object classification_sample/CMakeFiles/classification_sample.dir/main.cpp.o [100%] Linking CXX executable ../intel64/Release/classification_sample [100%] Built target classification_sample ################################################### Run Inference Engine classification sample Run ./classification_sample -d MYRIAD -i /opt/intel/computer_vision_sdk/deployment_tools/demo/car.png -m /root/openvino_models/ir/FP16//classification/squeezenet/1.1/caffe/squeezenet1.1.xml [ INFO ] InferenceEngine: API version ............ 1.4 Build .................. 19154 [ INFO ] Parsing input parameters [ INFO ] Files were added: 1 [ INFO ] /opt/intel/computer_vision_sdk/deployment_tools/demo/car.png [ INFO ] Loading plugin API version ............ 1.5 Build .................. 19154 Description ....... myriadPlugin [ INFO ] Loading network files: /root/openvino_models/ir/FP16//classification/squeezenet/1.1/caffe/squeezenet1.1.xml /root/openvino_models/ir/FP16//classification/squeezenet/1.1/caffe/squeezenet1.1.bin [ INFO ] Preparing input blobs [ WARNING ] Image is resized from (787, 259) to (227, 227) [ INFO ] Batch size is 1 [ INFO ] Preparing output blobs [ INFO ] Loading model to the plugin [ INFO ] Starting inference (1 iterations) [ INFO ] Processing output blobs Top 10 results: Image /opt/intel/computer_vision_sdk/deployment_tools/demo/car.png 817 0.8295898 label sports car, sport car 511 0.0961304 label convertible 479 0.0439453 label car wheel 751 0.0101318 label racer, race car, racing car 436 0.0074234 label beach wagon, station wagon, wagon, estate car, beach waggon, station waggon, waggon 656 0.0042267 label minivan 586 0.0029869 label half track 717 0.0018148 label pickup, pickup truck 864 0.0013924 label tow truck, tow car, wrecker 581 0.0006595 label grille, radiator grille total inference time: 10.0843692 Average running time of one iteration: 10.0843692 ms Throughput: 99.1633664 FPS [ INFO ] Execution successful ################################################### Demo completed successfully. root@octo:/opt/intel/computer_vision_sdk/deployment_tools/demo# root@octo:/opt/intel/computer_vision_sdk/deployment_tools/demo# cd /opt/intel/computer_vision_sdk/deployment_tools/model_downloader root@octo:/opt/intel/computer_vision_sdk/deployment_tools/model_downloader# root@octo:/opt/intel/computer_vision_sdk/deployment_tools/model_downloader# root@octo:/opt/intel/computer_vision_sdk/deployment_tools/model_downloader# ./downloader.py --name alexnet ./downloader.py:146: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. c_new = yaml.load(stream) ###############|| Start downloading models ||############### ...100%, 3 KB, 11115 KB/s, 0 seconds passed ========= alexnet.prototxt ====> /opt/intel/computer_vision_sdk_2018.5.455/deployment_tools/model_downloader/classification/alexnet/caffe/alexnet.prototxt ###############|| Start downloading weights ||############### ...100%, 238146 KB, 5868 KB/s, 40 seconds passed ========= alexnet.caffemodel ====> /opt/intel/computer_vision_sdk_2018.5.455/deployment_tools/model_downloader/classification/alexnet/caffe/alexnet.caffemodel ###############|| Start downloading topologies in tarballs ||############### ###############|| Post processing ||############### ========= Changing input dimensions in alexnet.prototxt ========= root@octo:/opt/intel/computer_vision_sdk/deployment_tools/model_downloader# root@octo:/opt/intel/computer_vision_sdk/deployment_tools/model_downloader# root@octo:/opt/intel/computer_vision_sdk/deployment_tools/model_downloader# mkdir /opt/intel/computer_vision_sdk/deployment_tools/model_optimizer/alexnet root@octo:/opt/intel/computer_vision_sdk/deployment_tools/model_downloader# mkdir /opt/intel/computer_vision_sdk/deployment_tools/model_optimizer/alexnet/FP16 root@octo:/opt/intel/computer_vision_sdk/deployment_tools/model_downloader# mkdir /opt/intel/computer_vision_sdk/deployment_tools/model_optimizer/alexnet/FP32 root@octo:/opt/intel/computer_vision_sdk/deployment_tools/model_downloader# root@octo:/opt/intel/computer_vision_sdk/deployment_tools/model_downloader# cd /opt/intel/computer_vision_sdk/deployment_tools/model_optimizer root@octo:/opt/intel/computer_vision_sdk/deployment_tools/model_optimizer# root@octo:/opt/intel/computer_vision_sdk/deployment_tools/model_optimizer# ls -l total 80 drwxr-xr-x 4 root root 4096 Apr 16 07:48 alexnet drwxr-xr-x 1 root root 4096 Apr 16 07:45 extensions drwxr-xr-x 2 root root 4096 Feb 21 04:35 install_prerequisites drwxr-xr-x 1 root root 4096 Apr 16 07:45 mo -rwxr-xr-x 1 root root 994 Feb 21 04:35 mo.py -rwxr-xr-x 1 root root 927 Feb 21 04:35 mo_caffe.py -rwxr-xr-x 1 root root 927 Feb 21 04:35 mo_kaldi.py -rwxr-xr-x 1 root root 927 Feb 21 04:35 mo_mxnet.py -rwxr-xr-x 1 root root 924 Feb 21 04:35 mo_onnx.py -rwxr-xr-x 1 root root 918 Feb 21 04:35 mo_tf.py -rw-r--r-- 1 root root 96 Feb 21 04:35 requirements.txt -rw-r--r-- 1 root root 45 Feb 21 04:35 requirements_caffe.txt -rw-r--r-- 1 root root 29 Feb 21 04:35 requirements_kaldi.txt -rw-r--r-- 1 root root 50 Feb 21 04:35 requirements_mxnet.txt -rw-r--r-- 1 root root 41 Feb 21 04:35 requirements_onnx.txt -rw-r--r-- 1 root root 47 Feb 21 04:35 requirements_tf.txt drwxr-xr-x 3 root root 4096 Feb 21 04:35 tf_call_ie_layer -rw-r--r-- 1 root root 83 Feb 21 04:35 version.txt root@octo:/opt/intel/computer_vision_sdk/deployment_tools/model_optimizer# ./mo.py --data_type=FP16 --input_model ../model_downloader/classification/alexnet/caffe/alexnet.caffemodel -o ./alexnet/FP16/ Model Optimizer arguments: Common parameters: - Path to the Input Model: /opt/intel/computer_vision_sdk_2018.5.455/deployment_tools/model_optimizer/../model_downloader/classification/alexnet/caffe/alexnet.caffemodel - Path for generated IR: /opt/intel/computer_vision_sdk_2018.5.455/deployment_tools/model_optimizer/./alexnet/FP16/ - IR output name: alexnet - Log level: ERROR - Batch: Not specified, inherited from the model - Input layers: Not specified, inherited from the model - Output layers: Not specified, inherited from the model - Input shapes: Not specified, inherited from the model - Mean values: Not specified - Scale values: Not specified - Scale factor: Not specified - Precision of IR: FP16 - Enable fusing: True - Enable grouped convolutions fusing: True - Move mean values to preprocess section: False - Reverse input channels: False Caffe specific parameters: - Enable resnet optimization: True - Path to the Input prototxt: /opt/intel/computer_vision_sdk_2018.5.455/deployment_tools/model_optimizer/../model_downloader/classification/alexnet/caffe/alexnet.prototxt - Path to CustomLayersMapping.xml: Default - Path to a mean file: Not specified - Offsets for a mean file: Not specified Model Optimizer version: 1.5.12.49d067a0 [ SUCCESS ] Generated IR model. [ SUCCESS ] XML file: /opt/intel/computer_vision_sdk_2018.5.455/deployment_tools/model_optimizer/./alexnet/FP16/alexnet.xml [ SUCCESS ] BIN file: /opt/intel/computer_vision_sdk_2018.5.455/deployment_tools/model_optimizer/./alexnet/FP16/alexnet.bin [ SUCCESS ] Total execution time: 11.29 seconds. root@octo:/opt/intel/computer_vision_sdk/deployment_tools/model_optimizer# ./mo.py --data_type=FP32 --input_model ../model_downloader/classification/alexnet/caffe/alexnet.caffemodel -o ./alexnet/FP32/ Model Optimizer arguments: Common parameters: - Path to the Input Model: /opt/intel/computer_vision_sdk_2018.5.455/deployment_tools/model_optimizer/../model_downloader/classification/alexnet/caffe/alexnet.caffemodel - Path for generated IR: /opt/intel/computer_vision_sdk_2018.5.455/deployment_tools/model_optimizer/./alexnet/FP32/ - IR output name: alexnet - Log level: ERROR - Batch: Not specified, inherited from the model - Input layers: Not specified, inherited from the model - Output layers: Not specified, inherited from the model - Input shapes: Not specified, inherited from the model - Mean values: Not specified - Scale values: Not specified - Scale factor: Not specified - Precision of IR: FP32 - Enable fusing: True - Enable grouped convolutions fusing: True - Move mean values to preprocess section: False - Reverse input channels: False Caffe specific parameters: - Enable resnet optimization: True - Path to the Input prototxt: /opt/intel/computer_vision_sdk_2018.5.455/deployment_tools/model_optimizer/../model_downloader/classification/alexnet/caffe/alexnet.prototxt - Path to CustomLayersMapping.xml: Default - Path to a mean file: Not specified - Offsets for a mean file: Not specified Model Optimizer version: 1.5.12.49d067a0 [ SUCCESS ] Generated IR model. [ SUCCESS ] XML file: /opt/intel/computer_vision_sdk_2018.5.455/deployment_tools/model_optimizer/./alexnet/FP32/alexnet.xml [ SUCCESS ] BIN file: /opt/intel/computer_vision_sdk_2018.5.455/deployment_tools/model_optimizer/./alexnet/FP32/alexnet.bin [ SUCCESS ] Total execution time: 11.28 seconds. root@octo:/opt/intel/computer_vision_sdk/deployment_tools/model_optimizer# root@octo:/opt/intel/computer_vision_sdk/deployment_tools/model_optimizer# root@octo:/opt/intel/computer_vision_sdk/deployment_tools/model_optimizer# cd ~/inference_engine_samples/benchmark_app/ root@octo:~/inference_engine_samples/benchmark_app# root@octo:~/inference_engine_samples/benchmark_app# make [ 12%] Built target format_reader [ 83%] Built target ie_cpu_extension [ 95%] Built target gflags_nothreads_static Scanning dependencies of target benchmark_app [ 95%] Building CXX object benchmark_app/CMakeFiles/benchmark_app.dir/main.cpp.o [100%] Linking CXX executable ../intel64/Release/benchmark_app [100%] Built target benchmark_app root@octo:~/inference_engine_samples/benchmark_app# root@octo:~/inference_engine_samples/benchmark_app# root@octo:~/inference_engine_samples/benchmark_app# cd ~/inference_engine_samples/intel64/Release/ root@octo:~/inference_engine_samples/intel64/Release# root@octo:~/inference_engine_samples/intel64/Release# ls -l total 728 -rwxr-xr-x 1 root root 349512 Apr 16 07:49 benchmark_app -rwxr-xr-x 1 root root 385464 Apr 16 07:45 classification_sample drwxr-xr-x 2 root root 4096 Apr 16 07:45 lib root@octo:~/inference_engine_samples/intel64/Release# ./benchmark_app -d MYRIAD -i /opt/intel/computer_vision_sdk/deployment_tools/demo/car.png -m /opt/intel/computer_vision_sdk/deployment_tools/model_optimizer/alexnet/FP16/alexnet.xml [ INFO ] InferenceEngine: API version ............ 1.4 Build .................. 19154 [ INFO ] Parsing input parameters [ INFO ] Files were added: 1 [ INFO ] /opt/intel/computer_vision_sdk/deployment_tools/demo/car.png [ INFO ] Loading plugin [ INFO ] API version ............ 1.5 Build .................. 19154 Description ....... myriadPlugin [ INFO ] Loading network files [ INFO ] Network batch size: 1, precision: FP32 [ INFO ] Preparing output blobs [ INFO ] Loading model to the plugin Opening device #0 I: [ncAPI] [ 26869] ncDeviceSetOption:2358 Set watchdog interval to: 1000 I: [ncAPI] [ 26869] ncDeviceOpen:806 ncDeviceOpen() XLinkBootRemote is running ... I: [ncAPI] [ 29111] ncDeviceOpen:821 ncDeviceOpen() XLinkBootRemote returned success X_LINK_SUCCESS I: [xLink] [ 29111] eventSchedulerRun:569 Scheduler thread started I: [xLink] [ 29111] eventReader:239 eventReader started I: [ncAPI] [ 29112] ncDeviceOpen:875 XLinkConnect done - link Id 1 I: [ncAPI] [ 29112] ncDeviceOpen:888 Booted 1.1-ma2480 -> VSC I: [ncAPI] [ 30114] getDevAttributes:433 Device attributes I: [ncAPI] [ 30114] getDevAttributes:435 Device FW version: 444c4454.2480.0.0 I: [ncAPI] [ 30114] getDevAttributes:436 Maximum graphs: 10 I: [ncAPI] [ 30114] getDevAttributes:437 Maximum fifos: 20 I: [ncAPI] [ 30114] getDevAttributes:438 Maximum graph option class: 1 I: [ncAPI] [ 30114] getDevAttributes:439 Maximum device option class: 2 I: [ncAPI] [ 30114] getDevAttributes:440 Device memory capacity: 521407664 Device #0 MYRIAD-X allocated [VPU] GraphTransformer : blobSize=122109204 I: [ncAPI] [ 30751] ncGraphAllocate:1333 Starting Graph allocation sequence I: [ncAPI] [ 31506] ncGraphAllocate:1401 Sent graph I: [ncAPI] [ 31539] ncGraphAllocate:1509 Graph allocation completed successfully I: [ncAPI] [ 31539] ncFifoCreate:2504 Init fifo I: [ncAPI] [ 31539] ncFifoAllocate:2692 Creating fifo I: [ncAPI] [ 31542] ncFifoCreate:2504 Init fifo I: [ncAPI] [ 31542] ncFifoAllocate:2692 Creating fifo [ INFO ] Input dimensions (NCHW): 1 3 227 227 [ WARNING ] Image is resized from (787, 259) to (227, 227) [ INFO ] Input dimensions (NCHW): 1 3 227 227 [ WARNING ] Image is resized from (787, 259) to (227, 227) [ INFO ] Start inference asynchronously (60000 ms duration, 2 inference requests in parallel) I: [ncAPI] [ 31559] ncGraphQueueInference:3425 trigger start I: [ncAPI] [ 31560] ncGraphQueueInference:3551 trigger end I: [ncAPI] [ 31584] ncGraphQueueInference:3425 trigger start I: [ncAPI] [ 31586] ncGraphQueueInference:3551 trigger end ..... SHORTENED FOR BREVITY ..... I: [ncAPI] [ 91581] ncGraphQueueInference:3425 trigger start I: [ncAPI] [ 91583] ncGraphQueueInference:3551 trigger end [ INFO ] Throughput: 58.4078 FPS I: [ncAPI] [ 91627] ncDeviceClose:1086 closing device... I: [ncAPI] [ 92096] ncDeviceDestroy:1226 Destroying Device root@octo:~/inference_engine_samples/intel64/Release# root@octo:~/inference_engine_samples/intel64/Release# root@octo:~/inference_engine_samples/intel64/Release# ./benchmark_app -d CPU -i /opt/intel/computer_vision_sdk/deployment_tools/demo/car.png -m /opt/intel/computer_vision_sdk/deployment_tools/model_optimizer/alexnet/FP32/alexnet.xml [ INFO ] InferenceEngine: API version ............ 1.4 Build .................. 19154 [ INFO ] Parsing input parameters [ INFO ] Files were added: 1 [ INFO ] /opt/intel/computer_vision_sdk/deployment_tools/demo/car.png [ INFO ] Loading plugin [ INFO ] API version ............ 1.5 Build .................. lnx_20181004 Description ....... MKLDNNPlugin [ INFO ] Loading network files [ INFO ] Network batch size: 1, precision: FP32 [ INFO ] Preparing output blobs [ INFO ] Loading model to the plugin [ INFO ] Input dimensions (NCHW): 1 3 227 227 [ WARNING ] Image is resized from (787, 259) to (227, 227) [ INFO ] Input dimensions (NCHW): 1 3 227 227 [ WARNING ] Image is resized from (787, 259) to (227, 227) [ INFO ] Start inference asynchronously (60000 ms duration, 2 inference requests in parallel) [ INFO ] Throughput: 71.4526 FPS root@octo:~/inference_engine_samples/intel64/Release#