SUPR
Soft Fixture Simulation
Dnr:

NAISS 2024/5-401

Type:

NAISS Medium Compute

Principal Investigator:

Florian Pokorny

Affiliation:

Kungliga Tekniska högskolan

Start Date:

2024-08-30

End Date:

2025-03-01

Primary Classification:

10207: Computer Vision and Robotics (Autonomous Systems)

Secondary Classification:

10201: Computer Sciences

Tertiary Classification:

10299: Other Computer and Information Science

Allocation

Abstract

The European Commission project SoftEnable extends the concept of rigid body caging to soft, deformable objects, integrating both extrinsic and intrinsic constraints to create robust manipulation primitives capable of handling perturbations effectively. The project is a part of SoftEnable and focuses on designing tools or robot end-effectors using iterative bilevel optimization. A Bayesian optimization framework proposes candidate designs in the outer loop, and the Berzelius computing resources are used to train an image-based RL agent to learn manipulation policies to evaluate these designs. The reinforcement learning agent processes RGB images of manipulated rigid/deformable objects as observations and outputs corresponding tool/gripper actions. Our novel approach involves designing for robust manipulation (e.g., pushing, scooping) of deformable objects, using manipulation robustness metrics as rewards in the training process.