Testing LLMs on superconductivity research questions
March 16, 2026
Subhashini Venugopalan, Research Scientist, and Eun-ah Kim, Visiting Scientist, Google Research
Can LLMs become expert-level research partners in modern physics? Using high-temperature superconductivity as a case study, physicists tested six LLMs with challenging questions and graded the responses.
Quick links
Artificial intellige...
This study presents a rigorous attempt to assess whether LLMs can serve as reliable partners in specialized scientific research, using high-temperature superconductivity as a test case. The strongest version of this narrative is that curated, quality-controlled data sources significantly improve LLM performance in complex domains, while open-web models struggle with accuracy and balance. The research acknowledges the potential of AI to accelerate scientific discovery but also highlights critical...
