Toward generalizable unified modeling language automation: a dual case study on class and use case diagram generation

Abstract

Manual generation of unified modeling language (UML) diagrams creates bottlenecks in agile development due to inconsistency and labor intensity. While large language models (LLMs) offer generative capabilities, existing solutions suffer from data scarcity and inadequate evaluation tools. To address this, we present a dual-LLM pipeline integrating lightweight specification generation with reasoning-oriented code synthesis. Uniquely, this framework employs a weighted multimodal validation module utilizing diverse vision-language models (VLMs) to assess diagrammatic fidelity. We further address the data shortage by releasing benchmark datasets comprising 5,000 class and 3,000 use case diagrams. Empirical results demonstrate a 95.8% rendering success rate for class diagrams and strong semantic alignment for use case models. By mitigating structural and behavioral reasoning conflicts, this research provides a replicable architecture and rigorous assessment methodology, establishing a robust foundation for scalable, artificial intelligence-driven automation in software engineering.