ROS and OpenCv for beginners | Blob Tracking and Ball Chasing with Raspberry Pi

Подписаться 26 тыс.

Просмотров 77 тыс.

50% 1

** Visit my brand new portal at tiziano-school.thinkific.com/ where you can find this ROS series as a FREE course **
ROS and OpenCV can work together for accomplishing incredible tasks. In this tutorial for beginners we are going to use the Rover's camera for detecting and tracking a blue golf ball.
We will develop multiple nodes, each responsible of one particular task:
- capturing and streaming the camera
- detecting the ball
- calculating control actions to track the ball
- controlling the rover to follow the ball
We will be building up on everything we have learned in the previous tutorials: you can find the complete playlist right here: • What is ROS (Robot Ope...
*** Find the code: github.com/tizianofiorenzani/...
*** Build and setup the robot: • ROS and Raspberry Pi f...
*** Simple Ball Tracking example from Pyimagesearch: www.pyimagesearch.com/2015/09...
*** imutils library for image processing: github.com/jrosebr1/imutils
*** Simple blob detect
** Example from Satya Mallick: www.learnopencv.com/blob-dete...
** Docs on opencv.org: docs.opencv.org/3.4/d0/d7a/cl...
******** STORE
teespring.com/stores/geekmeup
- Raspberry Pi 4 (4 GB RAM): amzn.to/36GqwXf
- Raspberry Pi 4 (2 GB RAM): amzn.to/2Aj7Pg3
- Wide angle camera: amzn.to/2Pwc6P7
******** Find me on Facebook
/ tizianotutorials
******** Find me on Linkedin
/ tiziano-fiorenzani
******** Find me on Twitter
/ tfiorenzani
** Go to my channel: goo.gl/BjLGnS
** Check out my latest video: goo.gl/ZhcNi4
** Check out my most popular video: goo.gl/5KMJnU
#ros #opencv #blobtracking

Наука

Опубликовано:

26 окт 2019

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 50

@prandtlmayer 4 года назад

Edit the source, add your blob tracking algorithm and I will test it!

@empty0303 4 года назад

This is awesome, thanks for sharing :)

@sammflynn6751 4 года назад

Thanks a lot for such awesome contents

@seifddinejlassi2059 4 года назад

really awesome. Thanks a lot!!!

@MrWachowsky 4 года назад

Tactical comment for greater exposure. Thanks for the video!

@shashwatpandey5165 4 года назад

You are best!

@carterwang4940 2 года назад

thank your share. perfect!

@PFstoker 2 года назад

Thank you for your tutorial ! I was able to modify on some points it to control my Burger Turtlebot !

@sudiptobasak7419 4 года назад

Sir,Please upload a video with path planning and obstacle avoiding using lidar sensor.

@IT-sq5rj 4 года назад

I'm gunna get it, I'm gunna get it!!!

@Frankx520 4 года назад

I am trying to get it !!!!!

@waiyulai5392 4 года назад

Any chance that you might review Jetson Nano?

@bushramemon178 4 года назад

Hi,could you guide me what changes do I required for person tracking and chasing.

@IT-sq5rj 4 года назад

Have you thought about a numer plate reader for open cv??

@chenhanbo3006 4 года назад

Hi Tiziano, thanks for your share. If I would like to design a drone to autonomously tracking the ball like the car in the video, how can I design the controller's part? Can you give me some advices or do you have any recommend docs?

@prandtlmayer 4 года назад

There are a few examples, for example there is a follow red ball project on Ardupilot

@owenplanchart 3 года назад

great tutorial as always, do you think it would be possible to run Aruco marker tracking and blob tracking on the same raspberry Pi?

@prandtlmayer 3 года назад

Give it a shot, otherwise the beauty of Ros is that you can distribute the computing among multiple boards

@abaskamal8599 4 года назад

Wow

@lucasreybraga9754 3 года назад

Hi Tiziano , your tutorials are really useful, but I have a question, python could be use only with the cv2 library without the cv_bridge for ROS applications? I don't understand well what is doing in the program the function of the cv_bridge, if you could explain that to me I would be so pleaseful. Thanks

@prandtlmayer 3 года назад

That is simply a bridge between OpenCV and ROS. It translates input/outputs into publish/subscribe

@rasesh_pradhan 4 года назад

Sir i am trying RPLiDER a1 and want to add this to my drone but i get many failure can you help me i want to try your PI and ultrasonic obstacle avoidance and opencv all your projects to my autonomous drone plz sir help me

@sarahchen8692 3 года назад

Great tutorial, but do you have any gazebo simulation scenarios with blob detection and turtlebot follow?

@prandtlmayer 3 года назад

I am going to focus on gazebo and ros in the incoming months

@sonnchenundhomie 4 года назад

@Tiziano Fiorenzani Thanks! Right now I'm trying to apply my own HSV filter for a yellow object, because I don't have a blue ball ;) Which code do i have to edit? Is it the blue_min and blue_max in the blob_detector.py node?

@prandtlmayer 4 года назад

I show a script that you can use to tune the HSV filter

@sonnchenundhomie 4 года назад

@@prandtlmayer thanks a lot!! my camera can now detect my ball :) now i have to edit the dk_llc node, because i don't have an adafruit control board, but a L298 H motor bridge. Any tips on that?

@Frankx520 4 года назад

@@sonnchenundhomie Hi, any luck with L298 H motor bridge

@sonnchenundhomie 4 года назад

Is it possible that instead of the keyboard node, the /dk_llc_3 node subscribes to a topic published by the three ultrasonic sensors? So that while tracking the blob, the car also avoids obstacles? If its possible, how to do that?

@prandtlmayer 4 года назад

My software only purpose is to provide an example and. Make the main loop subscribe also to ultrasonic and then create a repulsing vector that you sum to the commanded one

@falin9557 3 года назад

I want to make a bird tracker camera, to record brids flying in slow motion using a secondary camera and a pan-tilt system. I know some arduino, PLC programming (including artificial vision using CheckOptic, so I know some concepts) and some other languages like java script, php... just basic stuffs. This tutorial seems too hard for me. Do you know how can I better understand how to make this project? It might help me with mine

@prandtlmayer 3 года назад

This tutorial is not made for your purpose, only to show how to interface Ros and opencv. Anyhow, first focus on the recognition and tracking algorithm. You need a beefy board for that, something optimized for running neural networks

@PIYUSHTAILORstillalive 4 года назад

After watching video- I realised that how simple can life be

@ptptp7826 2 года назад

I cant find the pkg for raspicam_node, isn't it included in the repo? Or is it?

@prandtlmayer 2 года назад

It is not, you install it as a Ros package

@imamsriraharjo267 3 года назад

thanks for your video. if using usb webcam with video1 not video0, How?

@prandtlmayer 3 года назад

I do not know, maybe it does not have the drivers? Anyway I with the wrong webcam, performance might be very slow

@imamsriraharjo267 3 года назад

@@prandtlmayer dk_llc_3-3 process has died __name:=dk_llc_3 __log:= ((my file)) whats wrong??

@elmichellangelo 2 года назад

Damn I though that ball was levitating.

@ayashkantavtar3335 4 года назад

I m getting no transform between frames/ map and scanmatcher_frame available after 20.004533 seconds of waiting..This warning only prints once..can I get some help??

@prandtlmayer 4 года назад

that happened to me only when I played data back from a rosbag because I forgot to set the simulation time. Could be related to the time, but I am not sure

@aminfirdaus3279 2 года назад

hi sir, i want to build this kind of project but the objective is to follow human, can i use this code and where the part that i need to change?? thamk you

@prandtlmayer 2 года назад

Well, first you need to detect humans, then you publish the position in a topic and from there it should be the same