Robot Gift Guide 2022(spectrum.ieee.org) |
Robot Gift Guide 2022(spectrum.ieee.org) |
Background is that I'm a software engineer.
It runs on open source software OpenCat and can integrate with Pi or ROS.
Here's the review by MagPi in its Nov 2022 issue: https://images.ctfassets.net/2lpsze4g694w/2A12bpCahduZNgNQZv...
It supports ROS2, is relatively cheap and easy to her started with. You can layer build your own systems.
PS: If you can afford to spend like $5000 and want a quadraped like Spot, you can get one from Unitree. If you are looking for manipulators, you can get one from Elephant robotics for less than $1000. If you are looking for a more useful manipulator, I love Franka panda but it's like 20,000 USD.
Although it's a robot, there's not much you can do with your code right now since the Skills SDK access has been heavily restricted.
Their tech blows my mind. They do all the navigation and motion planning based on just RGB cameras, running multiple neural networks in parallel on board the drone. All the depth estimation, including small obstacles likes leaves and power cables, they are doing it all onboard. I don't think anyone in industry come close to that.
I so regret missing interning with them when they were starting to grow in 2018 - they came to my University for recruiting and I was just starting my PhD and decided to not look for internships.
Check NVidia. I believe Jetson Nano can do stereo matching from multiple camera pairs in real time. From here one step to 3d points cloud. New Orin will have like 10x performance. Coming in January. So, it's within the reach. I'm thinking, have big stupid drones collecting the dust...
The closest thing I’ve seen is Roborocks Socket API.
There's this https://github.com/Sollimann/CleanIt for iRobot or 'Valetudo' for Xiaomi, which may be at the very least hackable, if not have good APIs.
And there are of course projects to build your own https://github.com/awesome-vacuum/awesome-vacuum
Cool open-source hardware projects in awesome-vacuum though. I'd love to abstract away atleast the hardware vacuum parts if possible.
I collected info about the various protocols and interfacing options in 2013, in the course of making a Racket package for the Roomba and Create. https://www.neilvandyke.org/racket/roomba/
Tbh most people use it only for learning ROS. I know you can learn ROS using Gazebo similations but real robot feels better and many universities use such hardware for reaching ROS and robotics basics in intro to robotics classes.
A more useful, affordable "robot" I can think of is Crazyflie nano drone. It has an amazing ecosystem of extensions around it and you can do as high level or low level as you want to. You can develop and tune your own sensor fusion and state estimation algorithms, control algorithms, etc.
My comment was about people using neural network models for everything needed to fly a drone. I've seen models fail badly in ground based robots. They are flying a drone that's running so many models to be able to track, detect, localize, plan and fly. It's insane.
Jetson Nano can do stereo matching, and perhaps one can manage to even run multiple neural networks at the same time in inference mode. Getting it into production on real world systems is a whole different story. I can't imagine how Skydio manages to produce such robust and consistent outputs. I mean it kinda makes sense why Skydio is the first and the only company so far who's able to do it effectively - Adam's (CEO) been working on it for like more than 10 years now and his PhD thesis at MIT is awesome!
I work on drones for research. I do RL. No one in academia can build something so robust. You seem to think that flying drones autonomously in the real world is same as running an RL simulation. Good luck trying to build it for a 1000$ lol. Sure, go ahead and try your open source project. Good luck to you!
I strongly suggest you to do some reading before talking about things you clearly don't know anything about.
https://support.skydio.com/hc/en-us/articles/5338292379803-C...
The funny thing, I may try it. I'm more interested in 360 degree 3d scanner. But having that it's easy to put it on drone. I have a bunch of them, so it will be almost free.