Researchers at EKFZ for Digital Health, TU Dresden analyze LLM risks in medicine in Dresden; Call for centralized AI Security Operations Centers.
Researchers at EKFZ for Digital Health, TU Dresden analyze LLM risks in medicine in Dresden; Call for centralized AI Security Operations Centers. Large Language Models in Medicine: New Review Analyzes Risks and Strategies for Safe Use in Clinical Practice Large Language Models in Medicine: New Review Analyzes Risks and Strategies for Safe Use in Clinical Practice A conversation taking place in a clinic. Large language models (LLMs), including the models behind ChatGPT and Claude as well as numerous other systems developed specifically for medical applications, are increasingly used in clinical workflows. They support medical documentation, summarize knowledge, and assist with clinical decision-making. However, their adoption is outpacing the development of systems for oversight and safety. An interdisciplinary team of researchers at the Else Kröner Fresenius Center (EKFZ) for Digital Health at TUD Dresden University of Technology and University Hospital Dresden, together with national and international colleagues, has systematically analyzed the risks associated with LLM use in medicine. The review, published in Nature, brings together evidence from medical AI, cybersecurity, regulatory science, ethics and behavioral psychology and outlines strategies for trustworthy and responsible use of artificial intelligence (AI) in clinical practice. ...