Build OpenCV with CUDA Support for Jetson 

Hi, Your channel is an exceptional resource for anyone interested in Jetson platform. The contents are well-presented, concise, and easy to follow, making it an excellent resource for beginners and experts alike. Your channel is an excellent resource for researchers like myself. Overall, I highly recommend this channel to anyone interested in Jetson platform. The content is high-quality, informative, making it an excellent resource for anyone looking to improve their skills in this area.

It is a great pleasure and distinction to be a subscriber of your great channel. I am here probably from the beginning, You are always so consistent and precise. Your content is grateful and sufficiently helps to manage the highly library-dependent SW stack up on the Jetson boards. Great, you discuss often and deeply investigate the latest "technology" from the industry. I wish you good luck. Have a nice day.

This is really amazing. For so long I have wanted to know how to do this. Thanks for posting.

#TIL: Upgrading from the stock CUDA library broke a lot of stuff. I have an Orin AGX dev kit. The stock image had CUDA 11.4.315 on it, (jetpack 5.1.2). I manually updated it to CUDA 12.2. After doing that, I got all kinds of compilation errors, trying to build opencv 4.5.4 AND 4.8.0. There was no way to downgrade that I was able to find. I wound up flashing the system and starting fresh. At least my notes on how to set up a new system are getting better! Thanks for the awesome video!

Thank you so much. Great work! Without you, I cannot go forward in Jetson Cuda

Thank you! Works flawlessly for version 4.8.1. Took around 3 hours to install on my Xavier NX Nvidia Dev Kit. However, I also installed ROS Noetic before thus also has a pre-installed opencv version 4.2.0 (no cuda) from ROS. I just need to point my python path to the opencv version 4.8.1 instead of 4.2.0 version.

Thank you very much! I would recommend saving the build to another drive and copying it when you need to reinstall the operating system.

Awesome, thanks! Worked for Jetson AGX Orin

Super helpful! Short. Rational. To the point. Bless you!

Great content as always. Descriptive, informative, helpful. Keep up the great content.

Hi, I can't find the "build_opencv" folder in the "tmp" directory. I am using a Jetson Nano 4GB, and I followed your steps. Where can I find this folder?

It works for me on my Jetson Orin, save my day, Thanks!!!

Thanks for the great video tutorial on installing OpenCV with CUDA support. I was able to successfully install OpenCV 4.5.4 on my Jetson Nano, with only the CUDA Arch BIN modules for 5.3 architecture. But testing didn't go well. You mention that I should ensure I download the correct version of OpenCV_Zoo for testing, but I only see one repository. When I try to run the demo.py from that one I am getting --> AttributeError: module 'cv2.dnn. has no attribute 'DNN_BACKEND_TIMVX'. It looks like this version wanted to run on OpenCV 4.8.0, so it may just be the wrong version of OpenCV_Zoo, but I don't see where to get any other one. Thoughts?

Hello. I installed opencv 4.7.0 version on jetson nano with cuda. When I check in jtop, I can see that it says "opencv:4.7.0 with CUDA:YES". When I check it with python codes and terminl commands, I see CUDA is usable. However, when I want to detect objects with the yolov4-tiny model, I get an average of 2 fps. What's the problem? Can you help?

Hi... i'm using Jetson Nano with Jetpack 4.6.1, Python 3.6.9 and OpenCV 4.1.1 pre-loaded. When i use jtop to view CuDNN, it seem like my CuDNN is 8.2. The problem is why my build is getting failed using the mdegans script? Is it anything wrong i did?

I wonder it works the same with jetson orin nano I've done installing opencv 4.10 for it but when I tried to do the demo in -bt 1 mode it keeps changing to cpu mode.....

Hello there are some issue with my system after installation there is one file should be present inside tmp which build opencv .but in my its not there, any solution?

How where you able to screen record this footage with such a high frame rate? I'm currently using VNC to remote into my Jetson Nano, but I have a massive amount of lag by just navigating the desktop alone. The framerate while using VNC is worse if I run a simple script/code to check if my RPI V2 cameras are functional

Hi! Thanks for video. I used your repo to build opencv 4.6.0 on my jetson nano. It worker fine but it turned out that new version installed for python2 only and python3 still uses 4.1.1 version. The olny thing I changed in file were CUDA_ARCH_BIN and CUDNN_VERSION. What did i do wrong? Thank you.

Hello, I want to run OpenCV compiled with CUDA on Jetson TX2. What should I do? can you help me?

I love watching your videos, they are so informational and compact, im a recent engineer graduate in IoT, and my graduation project was using Jetson nano for occupancy analytics, i have been thinking how can i use this for my advantage while looking for a job and can i start a business using jetson cards for security ? thank you for the videos and have a nice day.

Does this make any difference if I am on Arch Bin 8.7? Just following the video, this might be answered later.

HI Jim, txs for this excellent update of your previous video on the topic.... a couple of clarification if possible: you mention 4.5.4 release but at the beginning of the script it is stated 4.4... how and why did you pick that release?

hello, thank you for your videos, i liked and subscribed! Is there a reason why one would want to install other NVIDIA GPU architectures on one device? for example i have a jetson orin nano developer kit, would i even be able to use other architectures on this device? thank you for your time

Another excellent video. Could you please share how did you update the Python version? is this a Jetson Nano, or an Jenson Orin Nano? what Jetpack version are you using? Thanks!

thank you! Thanks to this, CUDA works perfectly. But since installing CUDA, I have a problem with my RAM increasing more and more. For example, it increases by 0.1G every 2 hours. There is an issue where jetson xaiver quits when all memory is used. Do you know the solution?

Question, after you build openCV and new libraries/headers are put in standard ppaces, what happens with previous so/h files? I noticed the old version came from a debian package called libopencv-dev version 4.1.1-2 and they are still lingering around Do you remove this package so the compiler doesnt link with them?😊

I followed all your steps with my Jetson Nano 4GB to build OpenCV 4.8.0. I checked in Jtop, and it was recognizing "OpenCV: 4.8.0 with CUDA: YES." However, when I executed "print(cv2.getBuildInformation())", it showed OpenCV 4.1.1:General configuration for OpenCV 4.1.1 | Version control: 4.1.1-2-gd5a58aa75. What is the problrm?

Thank you for that. I am trying to run a custom model and torch.cuda.is_available() always returns false, any idea on how to compile pytorch with cuda support please ? Thanks

Thank you very much for your video! I've followed it perfectly and I'm getting everything right in jtop as well as when checking importing cv in python. I'm making a custom library to use in the gstreamer plugin nvivafilter to do image remapping operations and undo distortion using cv::cuda::GpuMat and cv::cuda::remap among others. The problem is that when running my gstreamer pipeline: terminate called after throwing an instance of 'cv::Exception'. what(): OpenCV(4.5.4) /home/ubuntu/build_opencv/opencv/opencv/modules/core/include/opencv2/core/private.cuda.hpp:106: error: (-216:No CUDA support) The library is compiled without CUDA support in function 'throw_no_cuda'. Do you know what could be the cause? I would appreciate any help on the subject!

Hı I have jetson orin nano and ı try to use csı camera named ımx219 but when I run opencv code it doesn't work. Then I checked GStreamer enable status on opencv it tell me GStreamer=NO how can I fix that problem.

Cannot run the opencv zoo model with 4.5.4 version installed... the notebook requires the 4.7, should I try upgrading?

how did you set deafualt python ans python 3.8

Hy, actually I'm using orin nano 8gb. I have an issue building Opencv. I want to change cap_v4l.cpp inside opencv/modules/videoio/src in line 1001 in 4.5.4 version. The select () timeout warning is the one i need to change. I used tv.tv_sec = 0 so that select() won't wait for anything. But after i build it, in /tmp/Opencv i see it is not taking any changes that was made during build time. It is using default things itself. I'm actually downloading opencv and opencv-contrib and then making the changes and updating the path inside build_opencv. sh in ---- git clone line. Please help me 🙏

I upgraded OpenCV on python3 to 4.5.4 and left python2 on 4.1.1. I understand I could have used my default OpenCV installation but wanted to match yours for the sake of the tutorial. Before I was getting stuck around 20% but I'm now a couple hours in around 50% so I have confidence it will work or at least successfully compile (Jetson Nano 4gb). When I use JTOP, I still see OpenCV 4.1.1 even after upgrading to 4.5.4. Do you know how to direct JTOP to python3 or could there be a different reason for showing the wrong version? Regardless, I appreciate the video. I targeted python3 and OpenCV 4.5.4 in the script, so I am hopeful I will be in good shape so long as I use python3. EDIT: After the compilation was completed, the version in JTOP updated and says CUDA is enabled. However when I run cv2.getBuildInformation() with python3 I get the same as before building, I do not see CUDA/CUDNN references.

CUDA is so CUTE ahhhh 😊

Thanks so much!! How should I proceed if I wish to install openCV with cuda a virtual environment? Any ideas?

I tried building the same Opencv with cuda support for Ubuntu 18.04. The cmake would always state that Cuda was enabled but when I started up my conda env Cuda support was never enabled. I am gonna give this method a try later.

First of all, thank you so much for the video, I have a jetson xavier nx (P3518) and i just follow exactly the same procedure and the end it didn't work, neither in jtop or with cv2.getBuildInfomation() i get something about CUDA. Help 😢

Hello ! Thank you for this tutorial ! I have one question: since I often work with different projects I like to work with archiconda/miniconda virtual environments to try different installations with many dependencies. Is it possible to install opencv this way by activating first a virtual environment? I want to have opencv with CUDA enabled within a specific environment and then install other libraries such as tensorflow, numpy, etc, untill all works together finely. Does this work this way or is it supposed to install everything on the system?

Hi If I check Jtop my opencv version is 4.1.1 I am using an nvdia xavier nx. I ran the the script but used version 4.1.1 for some reason CUDA is not installed when I check jtop. Any idead what I did wrong? Thanks for the great videos!

Thank you so much for your knowledge. Could you make a video to build YOLOv3 on Orin running with C script? Iam struggle with library dependency on that.

Hi Do you know how to erase emmc data from the jetson nano emmc module?

OpenCV gets installed to Python 2.7 but I cannot use it from Python 3.8 version. What am I doing wrong?

Hi, Thanks for the resource! I have one question, my jetson xavier nx builds openCV successfully, but it's weird that I can not find any build_opencv file in /tmp/ when I search in my jetson xavier. But if I check the build infromation with python3, it shows that build_opencv file exists in /tmp/.

@JetsonHacks Thank you! We all know that jetson devices have so-called unified memory. I am wondering how this concept translates into the Open CV framework with cuda support. One of the main functions in open cv with cuda is gpu_frame = cv2.cuda_GpuMat() and gpu_frame.upload(frame). Am I duplicating here the array? Is there a way to let open cv/ cuda know, that the data is already available for the GPU? I know that for pycuda on jetson devices handles this automatically. However I was not able to find information on that for open cv with cuda.

The cuda build worked on my new Orin Nano, JTOP is saying OpenCV 4.5.4 CUDA: YES ... now I need to learn how to enable cuda for opencv. do you have any recomindations, Jim?

Hi I am using ubuntu version 20.04 , iam running one opencv object detection application its taking load on cpu When I check the status using jtop its showing opencv with Cuda status is yes If I run Import cv2 Print(cv2.cuda.getCudadevicecount()) Its giving 0 as output Please suggest me how to solve this issue And run my application using gpu

Hey sir, could you please share the modified YuNet code, interfaced for USB Camera?

Anyone knows if exists a "ready made - image file, with cuda support, for Jetson Nano 2gb " to download? - since on that device, compiling would take 8 - 12 hours. - rather, would like to download a all ready compiled image, "with all the bells and whistles"..

YES!

I was following your tutorial on how to build OpenCV with CUDA support. I am running on a Jetson Orin AGX. I followed your directions as closely as possible twice however I am getting the following errors while compiling cuda_compile_1_generated_gpu_mat.cu.o, it is complaining that in texture.hpp(61): error: texture is not a template typedef texture TexRef Because I am only planning to run on arch 8.6, I only added that arch to the cmake flag and selected cuDNN 8.6 Any suggestions? Thanks! Jim

Thank you for your video. I was able to build opencv 4.5.4 on my Jetson Orin Nano. When I tried to modify the face_detection_yunet code following your instructions I got the following error: cv2.error: OpenCV(4.8.0) /io/opencv/modules/dnn/src/onnx/onnx_importer.cpp:279: error: (-210:Unsupported format or combination of formats) Failed to parse ONNX model: face_detection_yunet_2023mar.onnx in function 'ONNXImporter' I;m not sure why this is occurring, but searching on the internet, suggests that this might be a path problem. Any ideas?

I couldn't find "opencv_zoo" on your repos. Is it available???

You are my favorite.

Hi, I have a nvidia jetson nano by your video im trying to build opencv cuda but when it comes to %24 i got an error which is Cmake error at cuda_compile_1_generated_cpu_mat.cu.o.RELEASE.cmake:221 , how can i fix that problem please help me

Great stuff!

Great content!!

hello i followed everything it worked i installed opencv 4.1.1 it shows cuda support but its only when i use python not python3 what is the solution plz

Any body compile opencv with libnvjpeg? I try accelerate decode jpeg decompression use nvjpeg on jetson nano.

Hi, My Nvidia jetson nx developer kit specifications are: platform: machine: aarch64 system: Linux Distribution: Ubuntu 18.04 Bionic Beaver Release:4.9.299-tegra python:3.6.9 Libraries CUDA: 10.2.300 cuDNN:8.2.1.32 TensorRT:8.2.1.8 VPI:1.2.3 vulkan:1.2.70 opencv:4.7.0-dev-with CUDA: NO Hardware: Model:NVIDIA JETSON XAVIER NX DEVELOPER KIT SoCL:tegra194 CUDA ARCH BIN: 7.2 L4T:32.7.3 jetpack:4.6.3 I followed the above tutorial and checked the jtop the cuda is still NO How to make it yes

Hi i have used all your steps , and i am able to successful build opencv , but when i am doing python3 , import cv2 , it saying that (tf2) dhanvi@ubuntu:~$ python3 Python 3.8.18 (default, Sep 11 2023, 13:19:25) [GCC 11.2.0] :: Anaconda, Inc. on linux Type "help", "copyright", "credits" or "license" for more information. >>> import cv2 Traceback (most recent call last): File "", line 1, in ModuleNotFoundError: No module named 'cv2'

Before anyone else wastes their time this does not work on jetson orin nano

I attempted to install OpenCV 4.5.0, jetpack 4.6 and 7GB swap on my Jetson Nano 4GB and received this error message: [ 26%] Building nvcc fatal : Unsupported gpu architecture 'compute_87' CMake Error at cuda_compile_1_generated_gpu_mat.cu.o.RELEASE.cmake:221 (message): Error generating /tmp/build_opencv/opencv/build/modules/core/CMakeFiles/cuda_compile_1.dir/src/cuda/./cuda_compile_1_generated_gpu_mat.cu.o modules/core/CMakeFiles/opencv_core.dir/build.make:63: recipe for target 'modules/core/CMakeFiles/cuda_compile_1.dir/src/cuda/cuda_compile_1_generated_gpu_mat.cu.o' failed make[2]: *** [modules/core/CMakeFiles/cuda_compile_1.dir/src/cuda/cuda_compile_1_generated_gpu_mat.cu.o] Error 1 CMakeFiles/Makefile2:2981: recipe for target 'modules/core/CMakeFiles/opencv_core.dir/all' failed make[1]: *** [modules/core/CMakeFiles/opencv_core.dir/all] Error 2 Makefile:162: recipe for target 'all' failed make: *** [all] Error 2 Do you wish to remove temporary build files in /tmp/build_opencv ? (Doing so may make running tests on the build later impossible) Y/N y rm: cannot remove '/tmp/build_opencv/opencv/build/CMakeFiles/Progress/23': Permission denied

Great videos and content, thank you :) I have an issue using the Orin Nano dev kit. I've followed the steps, modified mdegans script to only build for arch_bin 8.7 with CUDNN version 8.6, as I understand is correct for 4.5.4 (took about 55 mins). The symptom I have is the same as @nickbeser5187.... error: OpenCV(4.8.0) /io/opencv/modules/dnn/src/onnx/onnx_importer.cpp:279: error: (-210:Unsupported format or combination of formats) Failed to parse I've worked my way through the script and don't see anything wrong, any thoughts?