SteelAgent: An LLM-Orchestrated System for Physics-Informed Steel Property Prediction and Generalization Auditing
SteelAgent: An LLM-Orchestrated System for Physics-Informed Steel Property Prediction and Generalization Auditing
Aleksandr Volkov, Roman Sultimov, Mikhail Kuzin, Yury Maximov
Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence
Demo Track. Pages 8547-8550.
https://doi.org/10.24963/ijcai.2026/1000
Machine learning models for steel property prediction routinely report high-quality metrics with R² > 0.85, yet these results rely on random splits that allow similar grades in both train and test sets. We present SteelAgent, an interactive system that exposes a critical generalization gap: the same models drop from R² > 0.85 to R² = 0.11 on unseen steel families, revealing more than 7 times higher quality degradation. Similarly, conformal prediction coverage degrades from 91% to 38% under distribution shift induced by holding out substantial data sources. SteelAgent combines physics-informed features grounded in classical metallurgy and interpretable models with conformal uncertainty quantification, and an LLM orchestrator that coordinates six domain-specific tools. The system supports property prediction with specification compliance checking, competitive steel comparison, and cost-aware inverse alloy design over 3,741 heat treatment records spanning 1,234 grades. All predictions are traceable through explicit tool calls, ensuring that all physical quantities are computed, not generated. We made the code and data freely accessible to the community.
Keywords:
AI: Agent-based and Multi-agent Systems
AI: Knowledge Representation and Reasoning
AI: Natural Language Processing
AI: Multidisciplinary Topics and Applications
