Soft robotics with a focus on sensing.
- Sochaki, G., Iida, F. and Hughes, J. (2021) ‘Compliant Sensorized Testing Device to Provide a Model-Based Estimation of the Cooking Time of Vegetables’, 16th International Conference on Intelligent Autonomous Systems, doi:10.17863/CAM.66275.
- Sochacki, G., Hughes, J., Hauser, S., and Iida, F. (2021) ‘Closed-Loop Robotic Cooking of Scrambled Eggs with a Salinity-based ‘Taste’ Sensor’, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 594-600, doi:10.1109/IROS51168.2021.9636750.
- Sochacki, G., Hughes, J., and Iida, F. (2022) ‘Sensorized Compliant Robot Gripper for Estimating the Cooking Time of Boil-Cooked Vegetables’, Intelligent Autonomous Systems 16 (IAS 2021), doi:10.1007/978-3-030-95892-3_17.
- Sochacki, G., Abdulali, A., and Iida, F. (2022) ‘Mastication-Enhanced Taste-Based Classification of Multi-Ingredient Dishes for Robotic Cooking’, Frontiers in Robotics and AI-Bio-Inspired Robotics, doi:10.3389/frobt.2022.886074.
- Lincoln Conference on Intelligent Robots and Systems 2020: Residual Physics for Grasp Failure Prediction.
- International Workshop on Embedded Intelligence 2021: Touch, smell, taste and sound sensing in robotic kitchen.
- 16th International Conference on Intelligent Autonomous Systems (IAS-16) 2021: Sensorized Compliant Robot Gripper for Estimating the Cooking Time of Boil-Cooked Vegetables.
- AgriFoRwArdS CDT Annual Conference 2021: Closed Loop Action for Robotic Chef Implementation.
- International Conference on Intelligent Robots and Systems 2021: Closed-Loop Robotic Cooking of Scrambled Eggs with a Salinity-based ‘Taste’ Sensor.
Other Activities and Outputs
- Co-Chaired a breakout session at the International Workshop on Embedded Intelligence 2021
- Designed the robotic kits used for the AgriFoRwArdS Summer School 2021, and provided technical support
- Guest on BBC Radio Berkshire
- Took part in the AgriFoRwArdS Summer School 2021 resulting in co-authored presentation, presented at the AgriFoRwArdS CDT Annual Conference 2021: Visual Serving for Human Tracking and Counting (in collaboration with Jack Foster, Samuel Wandai Kihara, Kirsten Ayris, Thomas Slattery).
- Member of the discussion panel for Tony Pridmore’s Keynote presentation at the AgriFoRwArdS CDT Annual Conference 2021, ‘Plant Phenotyping: Getting to the root of the problem’.
Residual Physics for Grasp Failure Prediction
Prediction of grasping success is not a solved problem, with current research focusing on the grasp stability during lifting an object, which is much less then human intuition can do. Human intuition can assess the extent of possible movements, that can be done without losing a grasp of an object. The project attempts to produce an algorithm, which can analyze trajectory plans for a robotic arm and decide if the grasp would remain stable, based on tactile information, series of waypoints, and estimates of object mass and inertia. The chosen approach is to use residual physics, where a coarse physical model is complemented by residua l computed by a neural network. The project hopes to enable choosing optimal paths and maximum speeds for not optimal grasps.
Low-Cost Dextrous Robots for Food and Tool Handling
While the conventional robots are very successful in well-structures and predicable tasks and environments such as automobile assembling factories, they still underperform in unstructured and/or less-predictable tasks such as food preparation, cooking and associated tasks in domestic kitchens. To tackle these challenges, this project aims to develop soft robot manipulators that can perform some of these tasks to help simplify complex operations in kitchens in ordinary houses, possibly in cooperation with human users.
One of the main research drivers of this project is the use of sensorised soft robotic grippers that are able to handle variations of objects such as fruits, vegetables, plates, cooking tools etc. (water taps and dish washers) based on the guidance provided by computer vision. There are four main technological challenges in this domain as follows. First the closed-loop control of soft gripper interacting with a large variety of objects is a fundamental challenge. The use of mechanically adaptable structures needs to be utilised for grasping of a large variety of uncertain objects, while sensoring such systems needs a well-thought integration of soft tactile sensors into advanced feedback control processes, including the strategies to make the entire hardware setup reliable and economical. Second, the use of machine learning for visual recognition of variations of household objects is still a significant challenge particularly in unstructured environment and task, such as cleaning of dishes. And third, the interactions with human users in such an advanced platform are unsolved. What is the framework of human interfaces for complex robots for easy programming and teaching? How can humans give feedback to learning cooking robots? What is the framework of health and safety for such advanced robotic systems in household? The fourth is to address technological challenges allowing cost reduction in order to make robotic solutions more affordable and accessible. By developing this cutting-edge robotics platform in household, we will explore these fundamental questions in this project. The outcome of this project is also contributing to the automation of complex food manipulation tasks in the Agri-Food industry at large.