Learning objectives

On successful completion of the module, students should be able to:

  • Be able to formulate a short term research question, plan a methodology that involves making a robotic test bed, conduct experiments, analyse evidence, and make conclusions.
  • Apply robotics system design methods to develop an experimental prototype.
  • Select and utilize appropriate software in the programming and demonstration of a robotic system.
  • Be able to report test results in a structured manner (conference paper format).

Introduction

The service robotics industry is growing at around 15% now. However, there are many challenges to be solved to make them safer and efficient. In this regard, Design Engineers will come in handy if they know how to formulate clear questions about service robots and test them in a methodical way. These questions can span many aspects of a robot from mechanisms, user interaction, control systems and their interfaces, to machine intelligence. The most important challenge is to be able to design an experiment to quantify the factors that will add most value to a robot in a given user context.

In this module, students will come up with a user case for a robotic solution, develop a hypothesis about the effect of a design criterion on the user experience, develop the robotic solution (experimental set up), test, obtain measurements, analyse data, and write a report in a conference paper format (6-8 pages). This covers a training needed to complete the full cycle of a methodical study in a short span of 12 weeks to produce a scientific report with evidence and interpretations for management decisions.

More details

Background

A 2013 report by McKinsey [1] estimated that advanced robotics could generate a potential economic impact of USD1.7-4.5 trillion by 2025. It mentions that “These advanced robots have greater mobility, dexterity, flexibility, and adaptability, as well as the ability to learn from and interact with humans. In advanced economies, some workers might find new job opportunities in developing, maintaining, or working with robots”. The users of these future robotic co-workers will be diverse in terms of gender and culture. Therefore, it is pertinent to develop a robotics module that accounts for the diversity of users in the design process. Therefore, we will choose several domains of human-robot interaction that allow us to raise questions about how diversity of robot users and designers should be integrated into the design process of robots.

[1] McKinsey global report 2013: Disruptive technologies

Suggested projects

The following suggested project scopes can be used to discuss further to identify a specific question you want to address for 12 weeks. You can discuss with the module leaders Thrishantha Nanayakkara, Petar Kormushev, and Nicolas Rojas to identify a refined research question to investigate deeper or you can propose a new project. You can do a project in a team of up to 3 members. You will work in the robotics research labs in the basement of the Dyson Building to conduct experiments. You will also get the support of the research teams in the robotics labs.

The role of morphological features of the fingertip in efficient touch sensation (Supervised by Professor Thrishantha Nanayakkara): Have you ever wondered why we have nails and particular shapes of bones in the fingers? Well there can be multiple purposes. We have questioned whether they have a role in simplifying the neural computation needed to separate touch sensations from different objects. In this project, you will do a simple FEM simulation with and without a nail and a distal palange bone in the fingertip to see how stress concentrations develop in the soft fingertip tissue for different tactile interaction scenarios. Then you will fabricate soft fingertips using silicone rubber with and without the above morphological features to conduct experiments. You will simulate biological mechanoreceptors using 3 Hall Effect sensors mounted around a permament magnet. The 3 data streams will be analysed using wavelet decomposition and eigen vector analysis to quantify the relative contributions from each morphological feature to improve the accuracy for distinguishing one object from another. You will use standard lab equipment and collaborate with a PhD student or a postdoc in the lab.

Haptic feedback from an endoscopic capsule (supervised by Professor Thrishantha Nanayakkara/Yukun Ge): Endoscopic capsulaes are used to take images inside the intestine to detect tissue anomalies such as bowel cancer. However, existing camera capsules can just move forward. We have tested an origami inspired soft capsule that can change its shape to go both ways to take more data from a suspected site in the intestine. The aim of this project is to design a soft tactile sensor for the capsule so that it can sense changes in mechanical properties in the intestine due to early development of tumors before visual symptoms appear from inside. You will collaborate with Yukun Ge, who is a former IDE student and a PhD candidate.

Goat hoof inspired shoe sole (supervised by Professor Thrishantha Nanayakkara): It will be very useful to have a slip resistant shoe for elderly people to go outdoors without worrying about slipping and falling. Our recent experiments to understand how the mountain goat hoofs reduce slip led to the discovery that the stiffness of certain joints play a key role in slip resistance. The hoof can passively deform and vibrate to reduce slip when the key joints in the hoof are in a certain range of stiffness. In this project, you will use biological inspirations and recent robotic findings to design and test a shoe sole printed using a multimaterial 3D printer or made by depositing soft silicon rubber layers. The experiment will involve directional slip resistance characteristics and comparisons between at least 2 designs. You will use already available laboratory equipment like an XY table and a 6 axis force torque sensor to conduct experiments.

A robotic knee joint for efficient locomotion (Supervised by Professor Thrishantha Nanayakkara/Fulin Li): Recent work suggest that the cam profile of the human knee joint provides a joint angle dependent damping profile that make biped walking very efficient. The work is extended in a European Union funded project called Natural Intelligence. In this project, you will develop a new soft damper mounted inside a four-bar linkage mechanism to approximate the cam profile of a knee joint and test how the robot feels collision forces with and without the damper. The insights will be useful not only to design efficient robotic walkers, but also to design wearable exo-knee kits to assist elderly people to enjoy outdoors with ease. You will collaborate with a PhD student and a postdoc in the Natural Intelligence project.

Bioinspired whisker for mobile robots (Supervised by Professor Thrishantha Nanayakkara): Neuromorphic hardware enables fast and power-efficient neural network-based artificial intelligence, which is well suited for autonomous robots to perform a wide range of sophisticated tasks in complex, unknown environments. We argue that inspiration from animal whiskers is a promising alternative to classic methods in robotics for the artificial intelligence needed for the autonomy of small, mobile robots.We have designed and constructed a whisker sensor for mobile robots' terrain classification and navigation. The aim of this project is to investigate how stiffness control of the tapered whisker can be used as a control parameter to improve its identification performance. This research would enable the mobile robots to capture information across a broad frequency spectrum for environment perception.The mobile robot could also active control the whisker vibration to do objects inspection in narrow space just like the rats rapid ‘whisking’ of all vibrissae. You will use standard lab equipment and collaborate with Zhenhua Yu, a PhD student in the Morph Lab.

Natural Terrain Locomotion (Supervised by Professor Thrishantha Nanayakkara/Barry Mulvey): Mobile robots are good at navigating on even and structured ground, like in factories and warehouses. However, unstructured environments (such as natural terrains) are more challenging, and wheeled robots can struggle when trying to navigate outdoors. There is significant opportunity to design a new structure (in place of the traditional tyre wheel) for use in these environments. Inspiration can be drawn from continuous tracks, whegs (wheel-legs), omnidirectional wheels, mecanum wheels, variable stiffness wheels, and others. The goal for this project is to develop novel wheel designs and test them against existing structures in natural environments. Experience with mechanics, CAD modelling, and 3D printing is preferable for this project.

 

 
 




Suggested reading
For recent publications in the three groups involved, please visit Morphlab, REDS lab, and Robot Intelligence Lab.
 
In addition, the following publications give a good idea about human robot interaction experimental methods:

  1. Fong, T., Nourbakhsh, I., & Dautenhahn, K. (2003). A survey of socially interactive robots. Robotics and autonomous systems42(3-4), 143-166. PDF
  2. Lee, H. R., Sung, J., Šabanović, S., & Han, J. (2012, September). Cultural design of domestic robots: A study of user expectations in Korea and the United States. In 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication (pp. 803-808). IEEE. PDF
  3. Lee, H. R., & Sabanović, S. (2014, March). Culturally variable preferences for robot design and use in South Korea, Turkey, and the United States. In Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction (pp. 17-24). ACM. PDF
  4. Carpenter, J., Davis, J. M., Erwin-Stewart, N., Lee, T. R., Bransford, J. D., & Vye, N. (2009). Gender representation and humanoid robots designed for domestic use. International Journal of Social Robotics1(3), 261. PDF
  5. Mumm, J., & Mutlu, B. (2011, March). Human-robot proxemics: physical and psychological distancing in human-robot interaction. In Proceedings of the 6th international conference on Human-robot interaction (pp. 331-338). ACM. PDF
  6. Libin, A. V., & Libin, E. V. (2004). Person-robot interactions from the robopsychologists’ point of view: The robotic psychology and robotherapy approach. Proceedings of the IEEE92(11), 1789-1803. PDF
  7. Blake, M. K., & Hanson, S. (2005). Rethinking innovation: context and gender. Environment and planning A37(4), 681-701. PDF
Assessment

Deliverables and assessment

Learning outcomes

On successful completion of the module, students should be able to:

  • Apply robotics system design methods and biological principles to the development and construction of a novel intelligent robotic system.
  • Select and utilize appropriate software in the programming and demonstration of a robotic system.
  • Select and utilize appropriate fabrications techniques to develop and build a small robot that includes integrated electrical and mechanical components.
  • Discuss the opportunities and limitations of current robotics technologies.
  • Demonstrate an understanding of the potential scope of application for robotic systems.

Assessment-1

Technical presentation on Thursday 12th December 2024 from 9am - 12 noon

Percentage of marks: 25%

Duration for each presentation: The viva will be 15 mins per project in total (doesn't depend on the number of team members). Please plan to present within 10 mins and leave 5 mins for discussion.

Please structure your 10 minute presentation as follows:

1. Clearly articulate your problem statement/research question highlighting its significance  (1st slide).

2. Mention a couple of key background work citing the references in the bottom of your slide. Use this to highlight the novelty of your project (2nd slide).

3. Clearly describe your methods. Here, use photos of the experimental setup and run a video of the experiment while talking. Mention the kind of sensors you used, data collection methods, frame rates/sampling frequency, any calibration methods, etc, to establish the validity of data (3rd /4th slides)

4. Start results by showing some raw data. Use these to make a curious observation and to raise the next level of questioning (5th slide)

5. Show the analysis to answer the question raised based on the raw data. (6th slide)

6. You can raise more questions and show deeper analysis  (7th slide)

7. Make a clear conclusion about the research question you raised in the first slide based on evidence above (8th slide)

8. Now reflect on the limitations of the conclusion given possible limitations in methods, analysis, and data, and suggest future directions (9th slide)

9. Mention what broad insights you gained from this project in terms of Design Engineering thinking, what you would do differently if you were to do it again. Here you can show any attempts that didn't work out (10th slide)

It is recommended to spend 1-minute per slide.

Assessment panel: Three staff members including Thrishantha Nanayakkara will independently award marks for the clarity of each of the following objectives

Objectives:

  1. To show what research question was addressed in the short project showing why it is important.
  2. To show what methods were used to address/investigate the question.
  3. To show what results were obtained and what can be concluded.
  4. To show how these insights can be useful to future robot design approaches.

Nature of feedback: Oral feedback at the end of each presentation

Grade descriptor:

Assessment criteria Pass (D grade) Excellent (A grade)
Research question Broad outline available. A very clear question is articulated with clear evidence of why it is timely and important.
Methods Broad description is available throughout the presentation. Clear analytical and/or experimental methods are shown with clear evidence like figures.
Results Some qualitative and/or quantitative results are available. Insights not readily available in raw data have been derived through analysis.
Insights Student can answer questions about deeper insights. Student presents deeper insights based on own analysis and evidence. Student can relate findings to other work in the field.

Assessment-2

Technical report due on Thursday 12th December 2024 by 4pm.

Percentage of marks: 75%

Length of report: 6-8 page technical report in IEEE conference paper format (2 column, Arial 11 font)

Assessment panel: At least two staff members (Thrishantha Nanayakkara, Petar Kormushev, Nicolas Rojas) will independently award marks for each report for the clarity of each of the following objectives

Nature of feedback: A collated document of independent written feedback in the format of a technical paper review

Objectives:

  1. To write an abstract showing what research question was addressed in the short project mentioning why it is important.
  2. To write an introduction outlining related work identifying a need to do the chosen project.
  3. To write a methods section showing what research methods were used to address/investigate the question.
  4. To write a results section showing experimental and/or analytical results.
  5. To write a conclusion section clearly articulating what can be concluded from the results.
  6. To write a discussion section showing insights that can be useful to future robot design approaches.

Grade descriptor:

Assessment criteria Pass (D grade) Excellent (A grade)
Abstract Broad outline of the work done is available. A very clear question is articulated highlighting why it is important to address it. The abstract clearly mentions the conclusion with summary findings.
Introduction Gives a broad outline to the project with at least 5 citations to relevant literature. A thorough discussion is done on the background literature citing more than 6 related papers. The introduction identifies an open challenge and outlines how the rest of the report is organized.
Methods Broad description of analytical and/or experimental methods is available. Clear analytical and/or experimental methods are shown with clear evidence like photos, diagrams, tables, and figures.
Results Some qualitative and/or quantitative results are available. Insights not readily available in raw data have been derived through analysis. Plots are clearly presented with labelled axes. Tables are informative and structured. Figure and table captions are concise and self-explanatory.
Conclusion A broad conclusion is available. A clear and concise conclusion is available based on evidence.
Discussions Student discusses broad insights, limitations, and opportunities for improvement. Student presents deeper insights based on own analysis and evidence. Student can relate findings to other work in the field.
Weekly schedule

Each project will be discussed in a weekly meeting during the time tabled slot. This will be the opportunity to discuss how to solve problems, related theory and techniques, related work done by others, report or paper writing, practicing presentations, troubleshooting, and any other project related topics. The first 3-weeks will be used to discuss some related research publications listed above, to refine a research question to be investigated, and to plan the resources and methods. The last 2-weeks will be spent on polishing the demonstration and the report.

Week-1: Introduction, outline learning outcomes, and lab visit in the basement of the Dyson Building. Then students go out and prepare draft project proposals consisting of a) Objective, b) Methods, c) Expected outcomes, and d) Gantt chart (maximum 3 pages). We encourage to make groups of 2 students each.

Week-2: Students submit project proposals. Meet and discuss to help sharpen the research questions and methods (0.5 hr of brief, 1 hr of discussion about possible research questions). Use this discussion to come up with a detailed experimentation plan and schedule. If there are collaborating PhD students involved, discuss their availability to do experiments.

 Week-3 – Week-10: The first hour will be spent on theory discussions. Last year I taught

  • different methods for noise filtering in experimental data, such as Wavelet decomposition, Savitsky-Golay filters, Kalman Filters, smoothing.
  • Simscape multibody dynamics modeling with cad models.
  • different robot design paradigms such as bio-inspiration, situated design, and concepts like embodied intelligence.
  • this year, I plan to discuss AI concepts like Bayesian inferencing, neural networks, and fuzzy inferencing.

The above theory discussion will be followed by a 2-hour lab session where I meet you individually while working on your projects to address ongoing problems. It used to be in the basement robotics lab area. Due to a change in department lab management policy, this year, you will do your projects in the ACE workshop. I have reseved 2 hour slots every week (also seen in your calendars).

12th December, 2024: Student groups do technical presentations (9am - 12 noon). These are 15 min conference style talks followed by a 10 min viva. A panel will give marks (25% of final grade).

By 4pm on 12th December 2024: Students submit a 6-page IEEE conference paper style report with a title, abstract, introduction, methods, results, discussion, and conclusions (75% of the final grade).

Resources

You will conduct experiments in the ACE workshop. I have also bought Arduino boards, wires, and some other consumables for each group. You can plan to order consumable items upto £200 per group.

Contact the PI

Professor Thrishantha Nanayakkara
RCS1 M229, Dyson Building
25 Exhibition Road
South Kensington, SW7 2DB

Email: t.nanayakkara@imperial.ac.uk