Götz, Markus, Baghban, Hojjat, Dazzi, Patrizio and Rana, Omer  ORCID: https://orcid.org/0000-0003-3597-2646
2026.
LEMON: LLM-enabled monitoring for microservices orchestration.
IEEE Transactions on Services Computing
10.1109/tsc.2026.3679374
|
Preview |
PDF
- Accepted Post-Print Version
Available under License Creative Commons Attribution. Download (4MB) | Preview |
Abstract
The complexity of modern microservice architectures has surpassed the capabilities of traditional orchestration tools, which rely on static, manual workflows. This limits scalability and adaptability, especially to dynamic workloads. This paper argues for a paradigm shift towards self-managing, intent-driven microservices orchestration systems, where human operators express high-level goals in natural language. As a foundational step towards this vision of autonomous orchestration agents, we introduce LEMON: a new architecture that leverages Large Language Models (LLMs) for intelligent microservice monitoring. We also propose a comprehensive classification to structure this emerging field. Our evaluation demonstrates that fine-tuning Small Language Models (SLMs) for intent classification significantly enhances accuracy while ensuring the model's output is reliably structured for automation. Furthermore, our analysis of the trade-offs between model size, precision, and latency provides a practical guide for deploying these systems. We foresee this monitoring capability as the critical ”sense” component toward autonomous microservices orchestration loops. By diagnosing performance bottlenecks from natural language queries, LEMON enables future systems to automatically suggest and execute solutions. This work lays the groundwork for truly self-managing, intent-driven systems.
| Item Type: | Article |
|---|---|
| Date Type: | Published Online |
| Status: | Published |
| Schools: | Schools > Computer Science & Informatics |
| Additional Information: | RRS policy applied |
| Publisher: | Institute of Electrical and Electronics Engineers |
| ISSN: | 1939-1374 |
| Date of First Compliant Deposit: | 7 April 2026 |
| Last Modified: | 05 Aug 2026 01:00 |
| URI: | https://orca.cardiff.ac.uk/id/eprint/186219 |
Actions (repository staff only)
 |
Edit Item |
Dimensions
Dimensions