Hi all,
I've been working on a Lego 51515 robot that uses computer vision to detect an object and then pick it up. Here is a video:
The robot works as follows:
1) Objects are detected by a free TensorFlow Android App, available on Google Play (ArdObjectTracker)
2) The detection data is sent from the mobile via Bluetooth Classic and picked up on the Arduino board by an HC-05 module
3) The object detection data is then processed and converted to robot movement instructions which are then sent to the Lego hub via the BluetoothLE module (HM-10)
4) Finally, the Lego hub (running a Python program) receives the instructions via a BluetoothLE notification and then moves to pick up the object
I have shared the code and more details on this Github page:
https://github.com/osullivp/Lego51515BLEArduinoTensorFlow
Hope you all find this helpful!
Regards,
Paul.