Reciprocal Human Machine Learning (RHML) is an interdisciplinary approach to designing human-AI interaction systems.[1] RHML aims to enable continual learning between humans and machine learning models by having them learn from each other. This approach keeps the human expert "in the loop" to oversee and enhance machine learning performance and simultaneously support the human expert continue learning.
Background
RHML emerged in the context of the rise of big data analytics and artificial intelligence for intelligent tasks like sense-making and decision-making.[2] As machine learning advanced to take on more roles, researchers realized fully autonomous systems had limitations and needed human guidance.[3][4][5][6]
RHML extends the concept of human-in-the-loop systems by promoting reciprocal learning. Humans learn from their interactions with machine learning models, staying up-to-date on evolving technology.[7] The models also learn from human feedback and oversight. This amplification of learning on both sides is a key focus of RHML.
The approach draws on theories of learning in dyads from education and psychology. It also builds on human-computer interaction and human-centered design principles. Implementing RHML requires developing specialized tools and interfaces tailored to the application[8]
Applications
RHML has been explored across diverse domains including:
Cybersecurity - Software to enable reciprocal learning between experts and AI models for social media threat detection.[8]
Organizational decision-making - RHML to structure collaboration between humans and AI systems.[9]
Workplace training - Using RHML for workers to learn from AI technologies on the job.[10]
Open science - Using human and AI collaboration to promote open science.[5]
RHML maintains human oversight and control over AI systems, while enabling cutting-edge machine learning performance. This collaborative approach highlights the importance of keeping the human expert involved in the loop.
^So, Chaehan (2020). "Human-in-the-Loop Design Cycles – A Process Framework that Integrates Design Sprints, Agile Processes, and Machine Learning with Humans". In Degen, Helmut; Reinerman-Jones, Lauren (eds.). Artificial Intelligence in HCI. Lecture Notes in Computer Science. Vol. 12217. Cham: Springer International Publishing. pp. 136–145. arXiv:2003.05268. doi:10.1007/978-3-030-50334-5_9. ISBN978-3-030-50334-5. S2CID212657395.