Raspberry Pi 4 + Intel's RealSense D435 Depth Camera Step-By-Step Installation

Подписаться 29 тыс.

Просмотров 55 тыс.

50% 1

• Your support helps me post videos more frequently:
/ acrobotic
www.paypal.me/acrobotic
buymeacoff.ee/acrobotic
BTC: 1ZpLvgETofMuzCaKoq5XJZKSwe5UNkwLM
==========
• Find me on:
/ acrobotic
/ acrobotic
/ acrobotic
==========
• My shops:
acrobotic.com/shop
amazon.com/shops/acrobotic
==========
• Description:
This tutorial is part of a series where the goal is to build a Raspberry Pi-powered, small-scale driverless car based on Computer Vision and Reinforcement Learning. It is based on the Open Source, community-backed project: Donkey Car (www.donkeycar.com/)
In this video I go over the steps for getting the Intel RealSense D435 Depth Camera working with a Raspberry Pi 4. Starting with a newly flashed image of Raspbian OS, I follow all the necessary steps for configuring Raspbian, and installing the software to get the device working.
==========
• Related vids:
Set up the linux-based Raspbian Operating System: • Raspberry Pi 4 as a Li...
Set up Raspbian for access without a keyboard, monitor, and even a Wi-Fi connection: • Raspberry Pi 4 SSH Set... (complete) • Raspberry Pi 4 Headles... (summary)
==========
• Project parts:
Intel RealSense D435 Camera:
amzn.to/2SxXJhM
Raspberry Pi Robocar Kit (unassembled):
amzn.to/3b4f6xN (affiliate)
Raspberry Pi Robocar Kit (assembled, pre-programmed):
acrobotic.com/products/robocar
==========
• Tutorials:
The steps are outlined in the Wiki for my Raspberry Pi Demos repository:
github.com/acrobotic/Ai_Demos...
==========
• Music:
Epidemic Sound (epidemicsound.com). Standard RU-vid License.
==========
#RaspberryPi #Robotics #Tutorial

Наука

Опубликовано:

6 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 94

@mongolz1000 3 года назад

Mate, your channel is extremely underrated

@JayrMagave 3 года назад

I think this channel is on par and superior to many channels about electronics. Kudos for the author.

@ssembeds522 3 года назад

Thank you very much. you save me a lot of time. the process goes very smooth.

@marrysky678 2 года назад

Thank you for this video! it's very helpful.

@jasontassell 2 месяца назад

Thank you for making this video. Still really helpful, despite a few things being different since it was first published.

@wangdony3405 29 дней назад

what are things that are different, my python setup wont work.

@rezabasiri 3 года назад

Very good! thanks

@asdfds6752 4 года назад

Great job! Really impressive! How much different would it be with a d435i and with Jetson Nano? Do you have any ideas? It is ridiculously messy to work with these camera. Don't really get why!

@tuviejapendeja2624 3 года назад

Vamos ahi !! Un servidor desde España!

@datasith 3 года назад

Un gran saludo, gracias por el aguante!

@EDGARDOUX1701 4 года назад

Esta GENIAL!! Gracias y un fuerte abrazo Argento!!

@datasith 4 года назад

Gracias capo, un gran saludo y felicidades for el cambio de nombre de usuario (es joda!) :)

@varshaarun9388 3 года назад

You are AMAZING! Thank you for simplifying the process!! I’m getting an error that says GLSL not supported. Any leads on how to go on out it further will be greatly appreciated! Thanks in advance!

@PhG1961 4 года назад

Nice video, quite an achievement !

@datasith 4 года назад

ha! thanks philip. now the real fun begins with some computer vision applications :)

@PhG1961 4 года назад

@@datasith Indeed. Build a robot and use the vision system together with that.

@datasith 4 года назад

@@PhG1961 yup, yup! it'll take some time, but the plan is to mount it on my little robocar. i'm soooo looking forward to it!

@grokwhy 3 года назад

Thank you for the video and the Wiki post. I now have the D415 up and running on the Pi 4.

@pisoiorfan 3 года назад

Hi what frame rate did you get? thanks

@grokwhy 3 года назад

@@pisoiorfan On a Raspberry Pi 4 8G using a D415 at 1280x720 in the Realsense viewer 2D I'm getting 29 hardware FPS

@pisoiorfan 3 года назад

@@grokwhy Thank you. Does the lag is annoying/noticeable?

@laxmanbal4740 3 года назад

hi i am also trying to connect my d415 with Rasperry pi. But i am having hard time to get it running. can you please help me or give me your email? or can you emailed me at laxmankumarbal58@gmail.com

@quentinjames981 3 года назад

What are the limitations of running RealSense/OpenCV on a Raspberry Pi 4? I've seen some really poor frame rates (less than 5) on i5 8GB systems, so I'm curious to see how this video's setup performs.

@ivankay639 3 года назад

how do you apply the swapfile? how do you save that file after you changed to 2048? ctrl+o does not seem to work, nor ctr+x

@maxmustermann5777 2 года назад

Hey, my fonts are missing when I open the realsense-viewer through Vnc Viewer

@LucaAlfredoSanzio 3 года назад

Thank you for this video!. Did you measure somehow the frame rate depending on camera resolution settings? Can the resolution be downgraded to QVGA for achieving higher speeds?

@grokwhy 3 года назад

In the viewer, which is just a pretty interface to what you can do in code, you can set the resolution and the frame rate.

@socialtech3509 3 года назад

Can we use this for interactive floor mapping?

@romiolover6852 4 года назад

nice project

@datasith 4 года назад

thanks

@crunchbubba 5 месяцев назад

the Ai_Demos_RPi repository on the video footer does not exist? what it the link for the "demos for the raspberry Pi wiki" mentioned at 0:34?

@snouzz-gaming917 Год назад

hi, can some help me to do some thing: i wonna do real time scan of object, so you get xy ply pictures and algorithm must put it in one 3d modell together, i cant do it.. it works with 2 ply files but not so well.... Pls help so we can meet us in discord or so...

@pisoiorfan 3 года назад

Thanks. Still for whatever reason the make install does not copy wrappers/python/pyrealsense2/__init__.py into wherever destination folder pyrealsense2.cpython-37m-arm-linux-gnueabihf.so goes. And it was a bit of pain to figure that out :) PS also on a 4Gbyte Pi4 compiling full throttle works fine. It saves a lot of time. $ make -j4

@mermichael9108 2 года назад

how do I find the 12 digit device_id of the intel realsensecamera?

@amir3515 2 года назад

would this work with a 16gb sd card? Update: You can install the SDK and be able to successfully install librealsense and run realsense-viewer but you will be at 100% usage and will have no free space to add the python wrapper or anything else. Can confirm that you will need a 32GB sd card

@hariharanraghavan7567 2 года назад

Hi @ACROBOTIC, Why does my comment gets removed? I was seeking for help to understand the problem during the installation procedure

@NitinRNtini Год назад

My Intel RealSense D415 camera is working on my Raspberry pi 4, 4gb model, but the video feed is very slow and laggy. Anyone know how to fix?

@vegasofficial2431 Год назад

The Tbb link is no longer working. Please suggest an alternative.

@mahdi6569 6 месяцев назад

Hi The GitHub page is not accessable, is there alternative page or way to use that data??

@qzorn4440 Год назад

Do you have a video doing this project with an Orange Pi 5? 😎 Thank you.

@srijansingh9663 2 года назад

Will this work with a ReasSense D415?

@ar1675 2 года назад

Is this tutorial the same for the D455 camera? I got a problem while installing the py realsense wrapper.. it says there are some libaries missing while linking. I am using a d455 camera. Do you know this problem?

@user-uc3ng5nw4i Год назад

ตอนนี้แก้ปัญหาได้หรือยัง

@user-rg2dn1ns1h 4 месяца назад

It doesn’t work when I reboot the raspberry pi. I have to unplug and replug

@wen-yuchien2088 4 года назад

Good video! What's the frame rate of the depth image could achieve? (848*480)

@damonhtoo 4 года назад

I'm interested in frame rates too. I think it heavily depends on ROI you define but I need at least 30 fps.

@anatolemombrun9250 2 года назад

Hey! Thanks for your amazing tutorial. So far i've got everything done on my pi4 (running on ubuntu mate) except for the last part where i can't activate the openGL driver : it says that driver and kernel are not present on the system. Do you have any idea what may cause this ? If i dont succeed i guess i'll try to do the same on your linux distribution

@odysseusthephilosopher6993 Год назад

Hi Bro. Im trying on ubuntu mate but i get errors. Can you recommend me what distro did you use? Thanks!

@giuseppepuglisi9852 3 года назад

I must to install OpenCL, how can I do it?

@rukey3001 4 года назад

Great.. I was waiting this for a long long time... What python libraries are you gonna use ? Open3D?

@datasith 4 года назад

Glad to hear, Shan! For now just OpenCV in addition to the standard pyrealsense2. I haven't gotten the chance to use Open3D so you're right, this might be a perfect opportunity to do so. Thanks for the suggestion!

@rukey3001 4 года назад

ACROBOTIC great. Thanks. Can’t wait for next video..

@p._7555 3 года назад

Nice ! Why the Argentina futbol Tshirt?

@harrisonlong644 3 года назад

are there other viewers for intel realsene or is this the only one? i would love to have a camera, raspberry pi and a small screen to measure depths, however i dont need the viewer gui, is it possible to just have the raw depth video feed displayed on screen or must you use the realsense viewer ??

@camdennagg6419 2 года назад

yes it is possible to get the raw depth

@asdfds6752 4 года назад

Hi, I followed your tutorial step by step on my raspberry pi4. I can see the camera frames in the realsense-viewer, very fine! But when I try running the python examples in the wrapper/python directory I get an error message like: File "opencv_viewer_example.py", line 13, in pipeline = rs.pipeline() AttributeError: module 'pyrealsense2' has no attribute 'pipeline' I can run "import pyrealsense2 as pr", but it seems nothing is really working. Is there something I am missing? Please let me know and thanks again for your amazing work!

@user-pk8po2hp2t 4 года назад

I got this error too.....Do you fix it?

@superzaaclub 3 года назад

I got the same problem. The fix is copy ~/librealsense/wrappers/python/pyrealsense2/__init__.py into pyrealsense2 install folder where all the .so files are. in my case it is at /usr/lib/python3/dist-packages/pyrealsense2

@stevedsouza842 3 года назад

Are you able to use the same steps for the L515 Intel RealSense Camera?

@amir3515 2 года назад

yes I can confirm these steps worked for the L515

@NSAwatchesME 3 года назад

have you tried the latest real sense? and they do lidar too l515

@datasith 3 года назад

For now, I've only tried the D435, but as the communication protocols are similar, the Python code *should* work with the rest of the line. At the very least, you can see if the devices are recognized by the realsense-viewer, and then take it from there. HTH!

@PremSai2244 3 года назад

Could not initialize offscreen context! GLFW Driver Error: GLX: GLX version 1.3 is required cant run realsense-viewer suggest a solution, please

@varshaarun9388 3 года назад

Same problem! Were you able to find a solution?

@PremSai2244 3 года назад

@@varshaarun9388 hey. This has been months ago. I think I had a GitHub issue raised on the same. As far as I remember this issue is due to vnc viewer. If you connect monitor to the screen it will show the realsense-viewer. Vnc viewer uses virtual tech to simulate monitor to operating system. Only way to solve this is to update glx drivers on raspi. Eventually we shifted to Jetson platform and couldn't reproduce the problem. Will update you with the issue link if we find it.

@varshaarun9388 3 года назад

@@PremSai2244 Thanks for the reply. But I dont use VNC server. I have a monitor connected but I was still getting this driver issue.

@PremSai2244 3 года назад

@@varshaarun9388 then it must be other way round. Try with vnc viewer and without monitor.

@DeltaWhiskey89 Год назад

@@PremSai2244 this is the fix. Unfortunately, the viewer only appears to display correctly if you are VNC without a screen plugged into the pi. Anyone figure out a fix to view with an onboard screen?

@Oscar-db8mp 3 года назад

Is there a new setup or should I still just be using the same setup for my Pi 4?

@datasith 3 года назад

Did you read the title?

@Oscar-db8mp 3 года назад

ACROBOTIC sorry about that.

@datasith 3 года назад

@@Oscar-db8mp no worries, I was going through a whole lot of comments and answered in a hurry. Let me know if you run into any trouble getting it to work!

@zariframzan7777 4 года назад

can i followe this steps for raspberry pi 3b+ ??

@datasith 4 года назад

You can, one limitation is on the USB speed. Notice that I connected the camera to USB 3 ports. Intel announced a while back support for USB 2 (which are the only option on a Raspberry Pi 3B+): www.intelrealsense.com/usb2-support-for-intel-realsense-technology/ But, you'll have to trade off the smaller bandwidth for image quality. HTH!

@NSAwatchesME 3 года назад

to use realsense on something like nanopi4 or rock pi 4c or tinker edge r is there specific Linux I need? can use same code?

@datasith 3 года назад

It depends on the system's architecture of the other boards. Since the libraries have been compiled for the SoC on the Pi, you'll need to recompile the source code for other ones. If it's the same architecture (e.g., armv7) then it shouldn't be too bad. Best of luck!

@NSAwatchesME 3 года назад

@@datasith it looks like there is very limited compatibility with any dev board and even the more popular odroid has issues dev.intelrealsense.com/docs/odroid thats a shame

@datasith 3 года назад

@@NSAwatchesME thanks for sharing, and yup, that'd be what i expected. if you find an x86 dev board that works for you (assuming power consumption isn't an issue) then that's an alternative as well.

@sanjiblamichhane 2 года назад

Good video should not have fast forwarded video unnecessarily. Cant read cli commands

@grokwhy 3 года назад

While the Realsense Viewer worked fine, I discovered the python examples didn't. So I went back to study over the instructions, and see this line cmake .. -DBUILD_PYTHON_BINDINGS=bool:true -DPYTHON_EXECUTABLE=$(which python3) I'm assuming now, I should have replaced (which python3) with something. After some Google searching, I found an example something like this cmake .. -DBUILD_PYTHON_BINDINGS=bool:true -DPYTHON_EXECUTABLE=/usr/bin/python3.7 Is this correct? I rebuilding now, but this takes hours. Thanks!

@grokwhy 3 года назад

Well, no change >>> import pyrealsense2 as rs >>> pipeline = rs.pipeline() ... module 'pyrealsense2' has no attribute 'pipeline'

@grokwhy 3 года назад

Well, I went back and looked at the video and you are using DPYTHON_EXECUTABLE=$(which python3), so that must be correct syntax. Must be some other issue.

@grokwhy 3 года назад

The answer was already posted by Pankrit Kritkiattisak below The fix is copy ~/librealsense/wrappers/python/pyrealsense2/__init__.py into pyrealsense2 install folder where all the .so files are. in my case it is at /usr/lib/python3/dist-packages/pyrealsense2

@VVaxman 4 года назад

Do you think this would work with the intel RealSense d415?

@datasith 4 года назад

Yup, the same library works for all RealSense devices. On the Python side you might need to make a few adjustments depending on the actual model, but the included examples are a good starting point for that. HTH!

@VVaxman 4 года назад

@@datasith Thanks a lot for the answer, i have not been able to import the correct pyrealsense module, what import have you been having success with? realsense-viewer works fine, but the Thonny IDE doesn't find the module pyrealsense2 nor does it find the pyrealsense module, do you have any idea as to why?

@VVaxman 4 года назад

It worked if i ran the program through the commandline with python3 *insert programname*.py

@andreacecchetto5748 4 года назад

ACROBOTIC So also for T265?

@yaltipolous Год назад

Receiving this error during the librealsense build process /home/yalt/librealsense/src/libusb/libusb.h:10:82: error: extended character ‘ is not valid in an identifier 10 | /usr/include/libusb-1.0/libusb.h:736:4: warning: ISO C++ forbids zero-size array ▒▒▒dev_capability_data’ [-Wpedantic] Any idea what the source of this could be?

@raenaurdturpin6262 3 года назад

Hello - Everything went smoothly until I executed the following: "cmake .. -DBUILD_EXAMPLES=true -DCMAKE_BUILD_TYPE=Release -DFORCE_LIBUVC=true" Info: REALSENSE_VERSION_STRING=2.45.0 -- Performing Test COMPILER_SUPPORTS_CXX11 -- Performing Test COMPILER_SUPPORTS_CXX11 - Success -- Performing Test COMPILER_SUPPORTS_CXX0X -- Performing Test COMPILER_SUPPORTS_CXX0X - Success -- Setting Unix configurations -- Building libcurl enabled CMake Error at /usr/share/cmake-3.16/Modules/FindPackageHandleStandardArgs.cmake:146 (message): Could NOT find OpenSSL, try to set the path to OpenSSL root folder in the system variable OPENSSL_ROOT_DIR (missing: OPENSSL_CRYPTO_LIBRARY OPENSSL_INCLUDE_DIR) Can you provide some guidance or updates?

@maxmustermann5777 2 года назад

I fixed it by installnig libssl

@DeltaWhiskey89 Год назад

Below is the solution that worked for me: sudo apt-get update sudo apt-get upgrade sudo apt-get install libssl-dev

@g0oberdm417 4 года назад

when enabling permissions at 3.11, what would you do differently on a d435i (different port name I assume)

@datasith 4 года назад

So I can't test it since I don't have a D435i, but I'm 99% confident that the same command works. The udev rules are part of the `librealsense` library, and they enable USB communication for all "RealSense" devices. So try these same commands, and they should work!