Тёмный

Demo of vehicle tracking and speed estimation at the 2nd AI City Challenge Workshop in CVPR 2018 

Dr. Tangerine
Подписаться 770
Просмотров 141 тыс.
50% 1

In this demo video, the estimated speed of each vehicle is shown in miles/hour.
Our team from the University of Washington is the winner of Track 1 (Traffic Flow Analysis) at the 2nd AI City Challenge Workshop in CVPR 2018.
Our source code is available at the following link:
github.com/zhengthomastang/20...
The datasets for the 2nd AI City Challenge (2018) are no longer available to the public. However, you may still access the datasets of the 3rd AI City Challenge (2019), or participate in the latest 4th AI City Challenge in CVPR 2020. They provided a new city-scale dataset for multi-camera vehicle tracking as well as image-based re-identification. They also had a new dataset for traffic anomaly detection. The scale of the datasets and the number of vehicles that are being used for evaluation are both unprecedented.
The website of the AI City Challenges is at www.aicitychallenge.org/. Please forward your inquiry to aicitychallenges@gmail.com.

Опубликовано:

 

8 апр 2018

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 113   
@calebjuma7648
@calebjuma7648 5 лет назад
good work Zheng Tang. quite an inspiration
@MeshalAlshaye
@MeshalAlshaye 5 лет назад
Great job Thomas!
@user-vm9gx4so4x
@user-vm9gx4so4x 4 года назад
ага александар
@admirebetera3760
@admirebetera3760 4 года назад
Very impressive!
@lihaiyu2719
@lihaiyu2719 6 лет назад
Amazing!
@mickeyvobros2184
@mickeyvobros2184 4 года назад
Awesome work @Zheng Tang & co. - Very impressive. Am I correct in thinking this software could run a count on any piece of recorded video? And do you have the ability to export a final breakdown of the the various counts? Our local BIA is debating installing a bike lane / we're currently just using the pneumatic hoses for counts, would love something a little more reliable / detailed like this -
@mr.hashford713
@mr.hashford713 3 года назад
insane, dude
@debasisharout8353
@debasisharout8353 3 года назад
Thanks 🙏
@zikasit9691
@zikasit9691 4 года назад
Hi @Zheng Tang thank you for making this project opensource , i have a question aboutrun , how can i put the input video? , and its possible to allow camera ip With RSTP protocol ? thank in advance
@DrTangerineAI
@DrTangerineAI 4 года назад
You can follow the guideline in our GitHub repo: github.com/zhengthomastang/2018AICity_TeamUW
@SouvikBagchi
@SouvikBagchi 5 лет назад
Hi This is great work ! One question - How are you comparing your predicted speeds to the actual speeds ? Is there a dataset for that or are you just predicting speeds with your algo since the data is not available ?
@DrTangerineAI
@DrTangerineAI 4 года назад
@@SouvikBagchi There is no public benchmark with fixed camera view available now. However, you can experiment with autonomous driving datasets that have moving camera views.
@coolamigo00
@coolamigo00 5 лет назад
Hi! kindly let me know of the frame rate your algorithm is capable of running at. Can it handle occlusions? Can it be used to handle multiple cars.
@shehzadarshad2000
@shehzadarshad2000 4 года назад
Nice video and nice project . Do you have source code to detect Number plates?
@MANOJBABU36
@MANOJBABU36 6 лет назад
Your work is really amazing. Can i know on what hardware did u run this.please let me know.
@MANOJBABU36
@MANOJBABU36 5 лет назад
Zheng Tang appreciate for your reply
@qqaadir
@qqaadir 4 года назад
@Zheng Tang, Could you please let me know about the data collection? What camera was used? Also could you please suggest a camera for night-time data collection ?
@talhayousuf4599
@talhayousuf4599 3 года назад
Did you get the answer or any solution to the problem of collecting dataset?
@qqaadir
@qqaadir 3 года назад
@@talhayousuf4599 I need on-road data and not from a height, so I used an ordinary dash cam fitted on car's dashboard.
@jadavpur4
@jadavpur4 3 года назад
Hi... Thank you for the tutorial.. It's impressive. I have one question. Can we make the animation of moving objects a function of time? the program will run and continuous animation will run??? Thank you
@DrTangerineAI
@DrTangerineAI 3 года назад
You can find our GitHub repo here: github.com/zhengthomastang/2018AICity_TeamUW. The input is the original video and the output includes the coordinates of bounding boxes at each time index. The animation can be produced online or offline, which is just for visualization purpose.
@bolzanoitaly8360
@bolzanoitaly8360 2 года назад
where is the tutorial ? He is very greedy, just showing video is not a great fun. May be this video belongs to someone else. I disliked this video completely. I am sorry.
@jays7603
@jays7603 2 года назад
@@bolzanoitaly8360 wtf bro do you want a massage too while going ?
@DataFromSky
@DataFromSky 3 года назад
Cool video. Nice colors! Is there some reason each car has a different color? Thanks!
@DrTangerineAI
@DrTangerineAI 3 года назад
The colors are just to indicate different vehicle identities.
@DataFromSky
@DataFromSky 3 года назад
@@DrTangerineAI Interesting! It is good way to separate them. We use colors of trajectories to indicate the category of the vehicle detected.
@feyzadogan2388
@feyzadogan2388 4 года назад
Hi Zheng Tang, thank you for sharing the code . I am using faster cnn and i do not know how to give an id to object do you have any opinion? Best
@feyzadogan2388
@feyzadogan2388 4 года назад
@@DrTangerineAI thank you for your reply. I looked your github repository but I don't understand clearly .Can you briefly explain it ?
@killerofothers
@killerofothers 4 года назад
how to determine the position of each object identified in the video in the output like this bus: 89% , Position : (0.032253, 0.110209), Height and Width : 0.063911, 0.072384
@zikasit9691
@zikasit9691 4 года назад
Hi Sir ,I see your publication at CVPR 2018 , do you integrat ALPR in your source code?
@maloukemallouke9735
@maloukemallouke9735 4 года назад
Hello, Dr. Tang can I ask you if you used a GPU for the training model? If yes, which one Thank you.
@DrTangerineAI
@DrTangerineAI 4 года назад
If I remember correctly, we used a 1080 Ti for training at that time. There have been a lot of new versions now.
@hrishikeshthakurdesai9095
@hrishikeshthakurdesai9095 5 лет назад
Hello Zheng, Can you please help me to with steps with how I can run your code to see the output of track 1. I have seen six packages in the code but not understanding the Main file to be executed. Can you please write one "readme" file for steps of execution. It would be very useful. You have done a great work !!
@hrishikeshthakurdesai9095
@hrishikeshthakurdesai9095 5 лет назад
Thanks a lot for quick reply..I will try it and let you know
@arpitj07_
@arpitj07_ 4 года назад
Hey, great work. was this done on real time or prerecorded video? Can we implement in python too? what all things are needed?
@DrTangerineAI
@DrTangerineAI 4 года назад
Here is the GitHub repo: github.com/zhengthomastang/2018AICity_TeamUW. It is an offline method. Since the code is broken down into multiple parts, it is hard for us to measure the runtime.
@ishanis6561
@ishanis6561 3 года назад
Nice implementation.. Do you have similar source with Python and Tensorflow? like resnet or with efficient net
@DrTangerineAI
@DrTangerineAI 3 года назад
Sorry but we only have the C++ version available.
@bendahouwael1176
@bendahouwael1176 3 года назад
@@DrTangerineAI can you please send me the C++ version i didn't find it anywhere thanks !
@DrTangerineAI
@DrTangerineAI 3 года назад
@@bendahouwael1176 github.com/zhengthomastang/2018AICity_TeamUW
@alexandrepolastri1118
@alexandrepolastri1118 4 года назад
How do I get a copy of your program, Demo of vehicle tracking and speed estimation at the 2nd AI City Challenge Workshop in CVPR 2018
@lowqchannel
@lowqchannel 4 года назад
is the vehicle and speed detection in real time. what hardware was used to accelerate the process
@DrTangerineAI
@DrTangerineAI 4 года назад
Our method is offline. We used NVIDIA GPU for object detection.
@talhayousuf4599
@talhayousuf4599 4 года назад
That is wonderful. I want to read your paper. Can i read it?
@etc_a_12_aishwaryajadhav76
@etc_a_12_aishwaryajadhav76 3 года назад
What you used for recording video
@hendrafauzi2761
@hendrafauzi2761 4 года назад
you have this video sample?
@Kiran-zd7ks
@Kiran-zd7ks 4 года назад
Hii I know about this project.ill do image annotation, lanes and bounding boxes, how to do this project on online.
@AI_CANISTER
@AI_CANISTER 3 года назад
please someone should tell me how to get those flying lines....
@germancruz6618
@germancruz6618 2 года назад
I hope in the future you can make a tutorial explaining the code. it would be fantastic
@DrTangerineAI
@DrTangerineAI 2 года назад
Please check the repo at github.com/zhengthomastang/2018AICity_TeamUW.
@zainulabdeen906
@zainulabdeen906 Год назад
Me need this software
@atheeral3
@atheeral3 Месяц назад
How can I find a ready-made template so I can count the number of people for my project? in the Roboflow???
@_javierrojas
@_javierrojas 2 года назад
I would like to know if you could share the original video where to perform the test?
@_javierrojas
@_javierrojas 2 года назад
I already saw the note in your repository, thank you very much for the note.
@shoaibsattar4301
@shoaibsattar4301 5 лет назад
can I get the paper or source code for the winner of this challenge?
@Juanp082413
@Juanp082413 4 года назад
Hello man, I m looking for this projects, I need to count vehicles, motorcycles and persons for my projetcs job. Tell me if can We talk
@karthikgovindappa
@karthikgovindappa 6 лет назад
Could more information be given how the speed is calculated ?
@karthikgovindappa
@karthikgovindappa 6 лет назад
Zheng Tang thanks
@wiemrachman4788
@wiemrachman4788 5 лет назад
@@DrTangerineAI Could i possible get the the dataset from you ? many thanks
@cjjx1488
@cjjx1488 4 года назад
You used a high spec desktop in those experiments, I was wondering if the track 1 experiments could be done on a mid-low spec machine, I want to try it since I work in a traficc monitoring enterprise and have access to street videos.
@cjjx1488
@cjjx1488 4 года назад
@@DrTangerineAI Thomas thank u for the answer but I have another doubt, do I need Cuda for this project? because I have an AMD GPU so no cuda for me.
@zakariaharakat7759
@zakariaharakat7759 4 года назад
@zheng do you have the some code developed with python
@zakariaharakat7759
@zakariaharakat7759 4 года назад
@@DrTangerineAI I'm developer python , i have big problems C++ : when i run this command g++ main.cpp i find this issues : /usr/bin/ld: /tmp/ccoPmRqH.o: in function `cv::String::String(char const*)': main.cpp:(.text._ZN2cv6StringC2EPKc[_ZN2cv6StringC5EPKc]+0x4d): undefined reference to `cv::String::allocate(unsigned long)' /usr/bin/ld: /tmp/ccoPmRqH.o: in function `cv::String::~String()': main.cpp:(.text._ZN2cv6StringD2Ev[_ZN2cv6StringD5Ev]+0x14): undefined reference to `cv::String::deallocate()' /usr/bin/ld: /tmp/ccoPmRqH.o: in function `cv::Mat::~Mat()': main.cpp:(.text._ZN2cv3MatD2Ev[_ZN2cv3MatD5Ev]+0x39): undefined reference to `cv::fastFree(void*)' /usr/bin/ld: /tmp/ccoPmRqH.o: in function `cv::Mat::create(int, int, int)': main.cpp:(.text._ZN2cv3Mat6createEiii[_ZN2cv3Mat6createEiii]+0x9d): undefined reference to `cv::Mat::create(int, int const*, int)' /usr/bin/ld: /tmp/ccoPmRqH.o: in function `cv::Mat::release()': main.cpp:(.text._ZN2cv3Mat7releaseEv[_ZN2cv3Mat7releaseEv]+0x4b): undefined reference to `cv::Mat::deallocate()' /usr/bin/ld: /tmp/ccoPmRqH.o: in function `cv::Mat::operator=(cv::Mat&&)': main.cpp:(.text._ZN2cv3MataSEOS0_[_ZN2cv3MataSEOS0_]+0xe7): undefined reference to `cv::fastFree(void*)' collect2: error: ld returned 1 exit status please help me
@zikasit9691
@zikasit9691 4 года назад
Hi @ZhengTang , tell me which lines in your code , you put ""the line direction in the rear of vehicle "" thanks
@zikasit9691
@zikasit9691 4 года назад
Hello @Zheng i mean after bounding box of vehicle how can you draw directions of vehicle with colors .
@zakariaharakat7759
@zakariaharakat7759 4 года назад
@@DrTangerineAI please could you please take a look in this project , i want to draw directions of vehicle with colors like your project , github.com/JdeRobot/traffic-monitor
@zakariaharakat7759
@zakariaharakat7759 4 года назад
@@DrTangerineAI please i need your help . jut 5 min of your time
@zakariaharakat7759
@zakariaharakat7759 4 года назад
@@DrTangerineAI please check issues
@zakariaharakat7759
@zakariaharakat7759 4 года назад
Sir please see this code i tried since 2 weeks to draw directions of vehicle with colors with function cv::line , unfortunately i haven't succeed , could you please give me 5 min .
@thomasluk4319
@thomasluk4319 2 года назад
How can you compensate the image distortion due to the perspective view? Simply finding the change of pixel could not actual calculating the vehicle speed. I have worked a project about intersection collision prediction system, a method called "Distance map" is generated with big data and DL, to add a weighting to each pixel on the captured view, this project won an award from Geneva inventions Bronze Medal.
@DrTangerineAI
@DrTangerineAI 2 года назад
Congratulations on the medal! For camera undistortion, I simply applied cv.undistort(): docs.opencv.org/4.x/dc/dbb/tutorial_py_calibration.html
@thomasluk4319
@thomasluk4319 2 года назад
@@DrTangerineAI ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-mHkz8yT_vxY.html Thanks. This video shows the concept what I have applied to my project for actually detect the vehicle speed
@lowqchannel
@lowqchannel 4 года назад
any paper on this program i can refer? i want to learn how this works
@DrTangerineAI
@DrTangerineAI 4 года назад
openaccess.thecvf.com/content_cvpr_2018_workshops/w3/html/Tang_Single-Camera_and_Inter-Camera_CVPR_2018_paper.html
@wildheart25c
@wildheart25c 3 года назад
Accoding to your description, we are to our inquiries to aicity but i hope you won't mind answering this question: I'm working on a project and I would like to track vehicles. If I contact aicity and ask them for access, will they give it to me or do i have to participate in the 2021 challenge first? Don't mean to repeat the question but you said we can still access 2019 datasets. Where? Can you please provide the link? As for your source code, thank you for sharing. Is there a document I can sign for you if and when I use your code? In your GitHub link, you asked us to site your paper. Is there something more official I can do for you? And would it be possible to contact you here again for inquiries about your code? Thank you again.
@DrTangerineAI
@DrTangerineAI 3 года назад
Our demonstrated experiments were conducted on the 2018 version of the AI City Challenge data sets. From what I learned, NVIDIA cannot release the 2018 version any more. However, the 2021 version is currently available, which is an expanded set of the 2020 version and 2019 version. They now have a much larger city-scale data set along with better annotations. Hope it will still help your research. Please email to Prof. Jenq-Neng Hwang (hwang@uw.edu) if you want to use the code for commercial purpose. For paper citation, you may ignore it if you are not publishing a conference/journal paper. For other technical questions, please add them to the Issues of our GitHub repo, so that other people can see our answers as well. Thanks.
@wildheart25c
@wildheart25c 3 года назад
@@DrTangerineAI Thank you for the prompt response. I understand that 2018 is no longer available but I wanted to know if all i had to do to get access to those datasets is to literally request it from them by email instead of having to participate ie datasets are only available to participants. I'll look at your code and post in the ISSUES section just like you asked if I run into anything. Thank you again for responding and for the email.
@Covid-bv4hp
@Covid-bv4hp 3 года назад
Shoutout to the chad going 69.420 on the highway
@paulvanderhaegen761
@paulvanderhaegen761 3 года назад
and now Big-brother is really watching you hahaha.
@Zhak7
@Zhak7 3 года назад
LOL
@hab_punch
@hab_punch Год назад
So smooth... Can you tell me FPS ?
@DrTangerineAI
@DrTangerineAI Год назад
We demonstrated on a Jetson device in nearly real time (10 FPS).
@bluestarelduzb1681
@bluestarelduzb1681 3 года назад
what is your accurancyin total?
@GULTOM.
@GULTOM. Год назад
Apa nama dan Spec alat ini, saya mau beli, terimakasih
@gauravzende9718
@gauravzende9718 5 лет назад
this code is not working. how to make it worked
@wupeng8888
@wupeng8888 5 лет назад
Is it real time ?
@zakariaharakat7759
@zakariaharakat7759 4 года назад
HI Zheng Tang when i run the folder of speed_detection it give me : Error: camera parameters not loaded ,
@zakariaharakat7759
@zakariaharakat7759 4 года назад
@@DrTangerineAI i try to generate parametre of camera , its give me this message : ""Reprojection error is small enough. Stop generation"". please i need your help
@zakariaharakat7759
@zakariaharakat7759 4 года назад
@@DrTangerineAI thank you so much
@zakariaharakat7759
@zakariaharakat7759 4 года назад
@@DrTangerineAI please can you do a video for explain that , it does not work for me
@DrTangerineAI
@DrTangerineAI 4 года назад
Sorry for the late response. You have to execute the code in order, since the output of a module can be the input of another module.
@DrTangerineAI
@DrTangerineAI 4 года назад
@@zakariaharakat7759 This is the expected message as the objective error is small enough. The generation stops, and you can collect the output results.
@WiseWeeabo
@WiseWeeabo 4 года назад
Try speeding and getting away with it now LMAO...
@DaShonuff
@DaShonuff 4 года назад
These are not approximate just estimates. You could beat that in court. I think this project is to determine the flow of traffic.
@ashimkarki1321
@ashimkarki1321 2 года назад
whats is the algorithm to estimate speed...please help me sir?
@DrTangerineAI
@DrTangerineAI 2 года назад
You can check our GitHub repo here: github.com/zhengthomastang/2018AICity_TeamUW
@amquangphuoc5377
@amquangphuoc5377 3 года назад
How about source code c# with yolo?
@DrTangerineAI
@DrTangerineAI 3 года назад
We used YOLO for detection of objects in each frame. But the tracking part was implemented separately.
@shopisold9322
@shopisold9322 3 года назад
do you have the code version python ??
@DrTangerineAI
@DrTangerineAI 3 года назад
Sorry. Our code was developed in C++: github.com/zhengthomastang/2018AICity_TeamUW
@faridasyraf
@faridasyraf 5 лет назад
Hi, can you share me the code of MATLAB. I need this code for my final year project. Thanks
@bluestarelduzb1681
@bluestarelduzb1681 3 года назад
have you checked your result?
@DrTangerineAI
@DrTangerineAI 3 года назад
Yes. You can find the results in our paper: openaccess.thecvf.com/content_cvpr_2018_workshops/w3/html/Tang_Single-Camera_and_Inter-Camera_CVPR_2018_paper.html
@elbaz_afandy
@elbaz_afandy 2 года назад
how can i do the same job with yolov5 , please help
@DrTangerineAI
@DrTangerineAI 2 года назад
Please check the repo at github.com/zhengthomastang/2018AICity_TeamUW. You may change the YOLOv3 component with YOLOv5.
@elbaz_afandy
@elbaz_afandy 2 года назад
@@DrTangerineAI ،i am sorry, but the code is written in c, i don't know c language, is there away that i can find one written with python
@DrTangerineAI
@DrTangerineAI 2 года назад
@@elbaz_afandy I may release a Python version in the future. Will keep you updated.
@elbaz_afandy
@elbaz_afandy 2 года назад
@@DrTangerineAI thank you very much,
@user-kj6nm6zr3o
@user-kj6nm6zr3o 6 лет назад
hahah
Далее
Accurate Speed Measurement from Uncalibrated Camera
1:42
Despicable Me Fart Blaster
00:51
Просмотров 9 млн
I Made a Self Driving FPV RC Car
7:55
Просмотров 309 тыс.
500 MPH on highway (simulated)
3:20
Просмотров 12 тыс.
SPEED CAMERAS - Road Safety or Cash Cows?
6:53
Просмотров 159 тыс.
Vehicles speed calculation with real-time YOLO v4
1:01