.Attributes Medicine, Published online: 26 July 2024 doi:10.1038/ s41591-024-03181-6Although big language models (LLMs) present commitment in regulated setups, a study currently subjects their limitations in real-world professional uses and points the technique towards sturdy evaluation as well as benchmarking prior to clinical make use of.