Тёмный

Jetson Nano B01 - Dual RPi Cameras + how to get faster frame rates 

JetsonHacks
Подписаться 36 тыс.
Просмотров 41 тыс.
50% 1

Опубликовано:

 

16 сен 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 100   
@jadoo16815125390625
@jadoo16815125390625 4 года назад
Thank you for the long form video, walking through the code and explaining the caveats so clearly. We have missed you. Hopefully there will be more content coming our way soon. Cheers and stay safe.
@JetsonHacks
@JetsonHacks 4 года назад
This is a little departure, I usually try to keep the videos around 10 minutes. I'm glad you enjoyed this format. Thanks for watching!
@paulmcwhorter
@paulmcwhorter 4 года назад
Really nice work. Thank you for the teaching.
@JetsonHacks
@JetsonHacks 4 года назад
You are very welcome, and thank you for the kind words. Thanks for watching!
@shankarhariharank7837
@shankarhariharank7837 4 года назад
After a long time , Wow ... Your GTC digital speech was amazing 👏
@JetsonHacks
@JetsonHacks 4 года назад
Thank you for the kind words. That speech was a lot of work, I'm glad some one watched it. Thanks for watching!
@puptentacle9648
@puptentacle9648 3 года назад
Brilliant video. New to the Nano. Gleaned ALOT from the vid. Never thought to thread the camera capture, was a "I could have had a V8." moment. Project I'm working on mandates high frame rates, now I got a clue. Big thanks.
@JetsonHacks
@JetsonHacks 3 года назад
Thank you for the kind words. Threading is usually the first trick to use on smaller machines if available. The goal is to try to take advantage of as much of the machine resources as possible. The smaller the machine, the more you have to know to make it performant. Thanks for watching!
@puptentacle9648
@puptentacle9648 3 года назад
@@JetsonHacks Yeah, concur regarding the need to get closer to the hardware & do a little "bit twiddling". I'm an "old school" coder. Cut my teeth on Univac main frames in the 70's-80's, transitioned to the 8086, 6800, & 68000 families in the late 80's, quite coding professionally in the middle to late 90's. Worked w/ the Nestor NI1000, back in the day (1,024 neurons in silicon) . My forte, language wise, was machine language, assembly (on several chips sets), C, C++, Ada, & several high level languages so Python is new to me, it being a relatively new OO language. So your "tutorials" are beneficial in multiple arenas. My dev machine is a HP DL580 (40 cores/80 threads, 1Tb memory, 4x 1080Ti's, etc.), am amazed @ just how much AI @ the edge can do (RPi 4 + NCS, Nano, AGX). Ever done anything combining the Nano + NCS (OpenCV + OpenVINO + CuDNN)? Think it would be interesting to encapsulate NLP "at the edge" versus the Alexa/Wolfram Alpha client server style implementation. Anyway, keep up the good teaching/experimentation, I'll be watching. What's the best way to subsidize your endeavors here on RU-vid, et al.? Feel the least I can do is throw you some pizza $$$. :)
@TymexComputing
@TymexComputing 4 года назад
I didnt order the Jetson Nano last year :) - but i came back to Your channel to check up if there's something new coming out :) - Thank You for a new video :)
@JetsonHacks
@JetsonHacks 4 года назад
You are welcome, and thanks for watching!
@isbestlizard
@isbestlizard 4 года назад
THIS IS AWESOME! thank you for this primer, next i need to feed each frame into a real time SLAM algorithm and build a volumetric representation of the space around the drone so it can A* path hmm
@JetsonHacks
@JetsonHacks 4 года назад
Thank you for the kind words, and thanks for watching!
@Wolkenkeller
@Wolkenkeller 3 года назад
Thanks for your videos. I've learned so much by it.
@JetsonHacks
@JetsonHacks 3 года назад
You are welcome, and thanks for watching!
@girayyillikci3188
@girayyillikci3188 4 года назад
where have you been? I am glad to see you best :)
@JetsonHacks
@JetsonHacks 4 года назад
I have been hiding in a room in my mind. Thank you for the concern, and thanks for watching!
@gohjiayi5521
@gohjiayi5521 4 года назад
Really helpful! Managed to up the FPS finally thank you.
@JetsonHacks
@JetsonHacks 4 года назад
You're welcome! Thanks for watching!
@AndresLeonSalas
@AndresLeonSalas 2 года назад
Thanks a lot Jim! Awesome as always
@JetsonHacks
@JetsonHacks 2 года назад
You are welcome. Thank you for the kind words, and thanks for watching!
@alexandremarcondes5612
@alexandremarcondes5612 4 года назад
Thank you so much, your video gave me a great support!
@JetsonHacks
@JetsonHacks 4 года назад
You are welcome, and thanks for watching!
@user-bs9kr3cu9n
@user-bs9kr3cu9n 3 года назад
Imo, firstly it's better to check if everything is ok with cameras using ls /dev/video* You can see 2 cameras with video0 and video1 names, means both must visible as devices. otherwise gst gives errors, wich are difficult to understand. Also dual camera sample didn't work for me with sensor_mode parameter, I've commented them out, then it was ok.
@JetsonHacks
@JetsonHacks 3 года назад
Thanks for the advice, and thanks for watching!
@OVISION-KBS
@OVISION-KBS 4 года назад
Thank you for such a great educational video!:)
@JetsonHacks
@JetsonHacks 4 года назад
I'm glad you found it useful. Thanks for watching!
@jorgemiar
@jorgemiar 4 года назад
Hope you can get your hands on a Jetson Xavier NX when it's available! 😃
@JetsonHacks
@JetsonHacks 4 года назад
I hope so too! Thanks for watching!
@masseteilchen3000
@masseteilchen3000 4 года назад
Awesome! Can you do some object detection benchmarks next? :)
@JetsonHacks
@JetsonHacks 4 года назад
Thank you for the kind words, and thanks for watching!
@Merceiz
@Merceiz 3 года назад
I am currently working on a project using an inland camera and when I try to test the camera this error shows up: "Error generated. /dvs/git/dirty/git-master_linux/multimedia/nvgstreamer/gst-nvarguscamera/gstnvarguscamerasrc.cpp, execute:557 No cameras available" can anyone help?
@JetsonHacks
@JetsonHacks 3 года назад
This example is for CSI cameras. I do not know what an inland camera actually might be.
@juanpalaciosvargas7329
@juanpalaciosvargas7329 2 года назад
I love your video. Could you make a video in which you use 02 CSI cameras and 02 Webcams? Thanks in advance.
@JetsonHacks
@JetsonHacks 2 года назад
Thank you for the kind words. Thank you for the suggestion, and thanks for watching!
@RakshithPrakash
@RakshithPrakash 4 года назад
Awesome, my board has 2 CSI slots too,so does this mean we use these cheap pi cameras and create depth maps?
@JetsonHacks
@JetsonHacks 4 года назад
There are tradeoffs. Typically stereo cameras have global shutter and hardware sync which using two RPi cameras do not offer. The results won't be perfect, but you should be able to play around with the concept. Thanks for watching!
@fvw94
@fvw94 4 года назад
Yeeee you are alive
@JetsonHacks
@JetsonHacks 4 года назад
If you call this living ;) Thanks for watching!
@xacompany
@xacompany 4 года назад
I´ve purchased the IMX219-83 Stereo Camera from Waveshare but for some reason the tests don´t work... I would love to make that one work.
@JetsonHacks
@JetsonHacks 4 года назад
I am not familiar with that product. Please ask your question on the official NVIDIA Jetson Nano forum. Thanks for watching!
@kadirkutlu7072
@kadirkutlu7072 3 года назад
Hi! I purchased the cam too. For stereo vision with Jetson Nano, could you help me? I have tried to solve the connection between the cam and Jetson Nano.
@egeerdem8272
@egeerdem8272 2 года назад
i am currently using it, it works the same maybe try changing CSI settings to IMX219 from jetson-io (ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-eImDQ0PVu2Y.html around 9-min guy uses the same program to configure pwm pins)
@잘풀리는집-z2m
@잘풀리는집-z2m 2 года назад
hello. I am a student studying Jetson Nano and opencv for the first time. Because I use a translator, the writing may not be smooth. I want to save the video output from the code you uploaded as an mp4 file, but the VideoWriter function doesn't seem to work. Do you have any code to solve this? I've searched many examples, but haven't found a solution yet. Thank you for good material.
@JetsonHacks
@JetsonHacks 2 года назад
You are welcome. I do not have any code to share about video writing. You may ask on the official NVIDIA Jetson Nano forum, where a large group of developers and NVIDIA engineers share their experience. Good luck on your project!
@kannanbalu7163
@kannanbalu7163 3 года назад
Hello Jim, i took a tutorial on your videos and did everything. But some point i got stuck with the syncing of two cameras in instrumened folder. I got an error like this: python -u "/home/jetson/Documents/3D_workspace/CSI-Camera/instrumented/dual_camera_fps.py" Traceback (most recent call last): File "/home/jetson/Documents/3D_workspace/CSI-Camera/instrumented/dual_camera_fps.py", line 16, in from csi_camera import CSI_Camera File "/home/jetson/Documents/3D_workspace/CSI-Camera/instrumented/csi_camera.py", line 14, in class RepeatTimer(threading.Timer): TypeError: Error when calling the metaclass bases function() argument 1 must be code, not str Can you let me know what the error is.. Thanks in advance.
@gggggrrrr1
@gggggrrrr1 3 года назад
when i lunch th dual_camera_fps.py i have this message : Traceback (most recent call last): File "csi_camera.py", line 14, in class RepeatTimer(threading.Timer): TypeError: Error when calling the metaclass bases function() argument 1 must be code, not str
@mostafamohsen250
@mostafamohsen250 4 года назад
Hi (i'm new to embedded AI), would the xavier nx be able to take advantage of the 60 fps? also unrelated; for Jetpack 4.4 does opencv come with Cuda support? I cannot tell from the build info. Thanks so much for all your helpful videos!!!!!
@AlexanderParphenuyk
@AlexanderParphenuyk 3 года назад
Great manual, thank you. But could you cover case when second camera not in device tree. And how to fix that issue.
@JetsonHacks
@JetsonHacks 3 года назад
I do not know what that means.
@raiden7502
@raiden7502 4 года назад
Hi ... thanks for the wonderful tutorials .. by the way, i just would like to know if you had experienced connecting flir lepton breakout board on jetson nano?
@JetsonHacks
@JetsonHacks 4 года назад
You are welcome. I have not used the Fair Lepton boards on the Nano. Thanks for watching!
@liamhan8145
@liamhan8145 4 года назад
Thank you for the video! I realized that the video output is much smoother with lower fps (e.g. 30) but there's so much lag for higher fps (e.g. 120). This seems counterintuitive to me... Shouldn't the video output have a faster/smoother output with higher fps?
@JetsonHacks
@JetsonHacks 4 года назад
Not sure why you think that. You have to move 4x the pixels, and most monitors don't refresh that quickly (many are 30Hz to 60Hz).
@angelleal3005
@angelleal3005 4 года назад
Great video as always! I want to ask, How far can it detect objects from ?
@JetsonHacks
@JetsonHacks 4 года назад
Not sure
@vitalyrudenya5554
@vitalyrudenya5554 2 года назад
You have to use YOLO sample
@jbcons9643
@jbcons9643 2 года назад
Hi, I could only get a hold on a jetson nano A02 here in our country.. Is it possible to use 2 usb cameras in a stereo setup for depth estimation using A02?
@JetsonHacks
@JetsonHacks 2 года назад
I haven't tried it, but it should be possible. I would try two USB 2.0 cameras.
@jbcons9643
@jbcons9643 2 года назад
@@JetsonHacks thanks a lot for your suggestion, I've learned a lot from your contents, keep it up!
@_kanavbatra
@_kanavbatra 4 года назад
Are there any differences in the board size between a02 and b01 ? Board screw holes etc? Tried finding the cad files for both, but didn't see them (still looking btw) :)
@isbestlizard
@isbestlizard 4 года назад
Why not do a while loop around the cv2.waitKey checking the internal clock until 1000/fps has elapsed since you last presented a frame, and sleep for like, 1ms so it sleeps for exactly the right amount of time to match the frame rate?
@JetsonHacks
@JetsonHacks 4 года назад
Sounds like a nice extension!
@nithinrpathiwada9304
@nithinrpathiwada9304 3 года назад
hello Jim, does the 2 GB version work well with 2 cameras simultaneously without any problem?
@JetsonHacks
@JetsonHacks 3 года назад
The Jetson Nano 2GB only has one CSI camera port.
@nithinrpathiwada9304
@nithinrpathiwada9304 3 года назад
@@JetsonHacks thanks for the info.
@Diamond_Hanz
@Diamond_Hanz 4 года назад
Yey
@JetsonHacks
@JetsonHacks 4 года назад
Yey times two. Thanks for watching!
@shrijank522
@shrijank522 4 года назад
Hi, Is there any way to turn off the CSI without turning off the jetson board. and then turn the CSI ON when required?
@JetsonHacks
@JetsonHacks 4 года назад
I do not know what "turn off CSI" means. You should ask this question on the official NVIDIA Jetson Nano forum. Thanks for watching!
@kankanasarkar7439
@kankanasarkar7439 3 года назад
Hello, Can you please tell what is the maximum fps that can be achievable using Jetson nano and RPi camera(dual as well as single)? In general a RP camera specfi max is written as 120/90fps but I guess using OpenCV or bash command we can achieve higher. here using dual camera along with Jetson nano what's the max FRAME PER SEC limit is possible?
@JetsonHacks
@JetsonHacks 3 года назад
Please ask your question on the official NVIDIA jetson Nano forum, where a large group of developers and NVIDIA engineers share their experience. Good luck on your project!
@mostafamohsen4552
@mostafamohsen4552 4 года назад
Hello, when I display the camera feed from my raspberry pi, i get some weird white dots that appear all over the screen. They seem to be permanent and not moving. Additionally, the image quality seems to be much worse than what your are getting out of your cameras. I tried buying the rpi camera from different suppliers, even from the one linked in your video description. Three different cameras in total, they ALL have this same issue and its very frustrating. Would you happen to know why or have any advice? Thanks!
@JetsonHacks
@JetsonHacks 4 года назад
I do not have any experience with your issue. Please ask this question on the official NVIDIA Jetson Nano forum, where a large group of developers and NVIDIA engineers share their experience.
@boredom1000
@boredom1000 4 года назад
Do you know the specific model of you nano? Mine only has 1 CSI connector.
@JetsonHacks
@JetsonHacks 4 года назад
Jetson Nano B01 Development Kit. The earlier version with one CSI connector (A02) can be seen here: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-dHvb225Pw1s.html
@rickhunt3183
@rickhunt3183 3 года назад
You make it look so easy, but it's really not, at least for me. Looks like I'm going to have to devote a lot more time to this. There must be a way to do facial recognition from off axis. There's always a way to do something that seems imposible. I like that the fire extinguisher is always in frame. You should plug in your guitar and crank out some power cords at the end of some of your videos. I like saying rock on dude, instead of stay safe. I say that all the time.
@puffvayne
@puffvayne Год назад
what's the benefit for installing two camera?
@JetsonHacks
@JetsonHacks Год назад
Depends on the application. On a moving robot, you can aim the cameras in different directions, one being a front view, the second being a rear view. Same thing with side views. You can angle the cameras slightly from each other, giving you a wider field of view. You can point the cameras in the same direction a known distance apart and use the pair as a stereo camera. Using trigonometry, the stereo camera can estimate the depth of a given object from the cameras. On an inspection line, you can monitor two different areas on the line at once. Thanks for watching!
@abdobell
@abdobell 3 года назад
Which version of opencv are you using
@JetsonHacks
@JetsonHacks 3 года назад
In the video, as stated in the JetsonHacksNano article in the description and referenced Github repository: OpenCV 4.1.1 Thanks for watching!
@pinakibhattacharyya8936
@pinakibhattacharyya8936 4 года назад
Hi there, wonderful video.. I have tried everything you said but still getting errors after running the Python code in visual studio.. not sure why.. I have installed everything, cython, numpy
@JetsonHacks
@JetsonHacks 4 года назад
I don't know what "getting errors" means.
@pinakibhattacharyya8936
@pinakibhattacharyya8936 4 года назад
@@JetsonHackswhen running the Python codes like face detect, simple camera scripts, it's throwing number of errors and I can't see the camera window. No matter what I do. Not sure if I am missing any plugins or software . I did whatever you have mentioned in your video
@howeiliang6941
@howeiliang6941 4 года назад
Hi! Jetson nano B01 different with nano developer kit?
@JetsonHacks
@JetsonHacks 4 года назад
The Jetson Nano B01 is the development kit, second revision. Thanks for watching!
@AndyKong51
@AndyKong51 3 года назад
It is sad that Jetson does not support v1.3 rpi camera. :
@loaialoamro8199
@loaialoamro8199 4 года назад
Thank you for this video can you please provide the download like for the python-ide used
@JetsonHacks
@JetsonHacks 4 года назад
ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-2sHQBTtDz6c.html
@ycdcherokee
@ycdcherokee 3 года назад
i am here to watch a tutorial but i watched too many advertisements. thanks.
@bartvanmieghem4751
@bartvanmieghem4751 4 года назад
Hi Jim, very nice video again! From my understanding this software synchronisation of the cameras is not perfect but close to perfect, right? Also shown in this video from Arducam: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-MbLOcaAJ7Ug.html Do you have an idea what the lag is (in ms, ns) between the cameras? Would the only option be to use global shutter and harware sync to get them perfect? Did you try to save the recorded frames (as idividual images) on the SD card or on a SSD and what would be the achievable frame rate in that case? I'm asking because I need to do postprocessing on the images and my script is so computational heavy that I cannot do it within the acquisition loop. Thanks Bart
@JetsonHacks
@JetsonHacks 4 года назад
In the video referenced, they use a global shutter and external trigger for the cameras. This is effectively a synchronized stereo image capture. It requires a different camera sensor, driver for the camera sensor, and external hardware trigger board. You describe a project which is beyond the scope of a quick answer. There should be enough information in this video to get you started in in the search to answer your questions. Thanks for watching!
@pascalfust1035
@pascalfust1035 4 года назад
Hi Bart, thanks for that question - I am also wondering about the maximum number of stored (HD) images per second, as my requirements look similar to yours.... BTW, I´m currently working on that issue on a StereoPi, which resulted in around 1 fps, however with some long waits of several seconds after 10 images or so. So in continuous burst mode not at 1 fps
@melvinsajith4448
@melvinsajith4448 3 года назад
can jetson B01 run jetpack 4.3
@JetsonHacks
@JetsonHacks 3 года назад
The demonstration was shown on Jetpack 4.3. Thanks for watching!
@OEFarredondo
@OEFarredondo 4 года назад
Hi!!!
@JetsonHacks
@JetsonHacks 4 года назад
Right back at you!
@bennysvideostore
@bennysvideostore Год назад
Very nice video. Do you know if RAW10 or RAW12 recording is possible?
@JetsonHacks
@JetsonHacks Год назад
Thank you for the kind words. I believe it is possible, but is highly dependent on which camera you are using. Thanks for watching!
Далее
USB Cameras - NVIDIA Jetson
23:54
Просмотров 27 тыс.
World’s Tallest Man VS Shortest Woman!
15:07
Просмотров 18 млн
Семья с двойным дном. Рассказ
2:45:06
Explore the JetPack 4.2 Samples on the NVIDIA Jetsons
12:17
JETSON NANO + INTEL WIFI
8:51
Просмотров 107 тыс.
Jetson Orin Nano - 75x Faster Than A Raspberry Pi
11:45
Jetbot Neural Network Based Collision Avoidance
7:50
My First Jetson Nano Object Detection Inference Server
14:24
Jetson Nano + RealSense T265 Tracking Camera
7:41
Просмотров 65 тыс.
World’s Tallest Man VS Shortest Woman!
15:07
Просмотров 18 млн