An Inside Look at Computer Vision and Radar — Video Demo
Hello everyone, I recently completed a video demonstration using some new tools I recently acquired. I purchased an NVIDIA Jetson Nano, added a 4K MIPI camera, and set up a few Github projects that allow me to run a Convolutional Neural Network (CNN) program and perform real-time Object Detection and Classification similar to how some ADAS equipped vehicles are operating today. The other tool I acquired is a TI radar demo board that allows one to create visuals in order to see what the radar sensor sees. These experiments are strictly non-scientific and really just some experimentation and as I learn more I plan to share.
I talked with my colleagues over at AESwave to help me with the radar board acquisition, so if you like what you see please let them know.
Wow Scott, very cool, and crazy at the same time. AI / neural networks are fascinating. Thanks for showing us.
Nice demonstration and explanation Scott! Thanks for taking the time and expense to put this together.
Scott very interesting....some good examples...nice job
Scott very interesting thank you for putting this together and sharing it!!!
Hi Scott: Interesting presentation, thanks for sharing. I've got a question though. Is there a reason that you didn't make this a DN presentation (or a shared credit)? It seems like it could be a potential piece of viral guerrilla marketing. Guido
Hi Guido, This was my first round of experimentation with these tools. Once I‘m able to master some of this tech further, my plan is to assemble some more content and distribute as DN branded material.
Wow, im very interested in having a look at this , today
This is really cool, the first thing that came to my mind was the Terminator, how they showed us in the movie what it was seeing detecting objects and not knowing back then when the first movie came out thinking it was all fiction ,that it would become a reality today for vehicles.
Very interesting, thanks Scott. How long did it take you to put this together ? I just spent some time reading up on, NVIDIA Jetson Nano, Convolutional Neural Network and Real-Time Object Detection and Classification then it hit me, all this because folks can't seem to pay attention and drive, almost unbelievable... Do me a favor on the next video, put the clown on the bicycle :O)
Hi Hollis, Time element - many hours over months researching etc. Video shoot, 2 hrs, editing, 2-3 hrs. Can I borrow your clown to bike adapter? ;) Thanks for the feedback!
Thank you for this visual. Very interesting.
Hi Scott, That's pretty impressive. I can't wait until they can identify a Bozo from a mile away however. Thanks for putting that together!
I’m sure that we’ve both seen our share of “Bozo’s” behind the wheel, perhaps we’ll see a level of machine learning to help these smart cars avoid those drivers!
Very cool Scott, Thank you for the demo.
Hi Scott, What I find the most intriguing is the object and probability. My question to you is that video that we are seeing coming directly from the camera or is that the CNN communicating back and forth between the processor and the camera? Also, what make, model and year are we looking at? What version is the front camera? Are you going to be looking at LIDAR and compare it to Radar? If you…
Hi Steve, The video feed is piped to the program and it is performing the inferencing and producing the data overlays AFAIK. This isn’t a specific make or model but it’s widely used technology similar to what Tesla and others do on their vehicles but is not limited to those channels. Think about the Nest/Ring camera systems are running. I would certainly love to check out other tech like LIDAR…
Hi Scott, Great video!! Is the TI mmwave Demo Visualizer an out of the box system or a custom API? How did you get started building your radar project?
From Scott's post I searched these items. I'm not sure if they're exactly what he used, but it gives some insight. [NVIDIA Jetson Nano] developer.nvidia.com/embedded/jetso… [Convolutional Neural Network (CNN) and perform real-time Object Detection and Classification] ieeexplore.ieee.org/document/87233… [TI radar demo…
Hi Hollis, Thank you for the product links and the link to the iee paper on CNN. I am interested in building a project with the TI AWR1642 automotive radar evaluation module. Will also have a look at the NVIDIA AI developer kit.
Hi Anthony, Hollis shared the right links. TI offers the code for free from their website.