DiffVL: Scaling Up Soft Body Manipulation using Vision-Language Driven Differentiable Physics

This paper is how to use both vision and language information help to solve soft body manipulation tasks. Also, we introduce non-expert into setting up dataset by UI-system and large language model. Paper site

Download paper here