Discussion

(RoboVac) Building a home robot to autonomously clean our house

isoprophlex: Cool project! That validation loss curve screams train set memorization without generalization ability.Too little train data, and/or data of insufficient quality. Maybe let the robot run autonomously with an (expensive) VLM operating it to bootstrap a larger train dataset without needing to annotate it yourself.Or maybe the problem itself is poorly specified, or intractable with your chosen network architecture. But if you see that a vision llm can pilot the bot, at least you know you have a fighting chance.

amelius: The trick is to make a robot that has a Lidar and a camera, then train a model that can replace the Lidar.(Lidar can of course also be echolocation).