Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

Knowledge grafting: A mechanism for optimizing AI model deployment in resource-constrained environments

Almurshed, Osama, Kaushal, Ashish, Muftah, Asmail, Auluck, Nitin and Rana, Omer ORCID: https://orcid.org/0000-0003-3597-2646 2025. Knowledge grafting: A mechanism for optimizing AI model deployment in resource-constrained environments. [Online]. arXiv: Cornell University. Available at: https://doi.org/10.48550/arXiv.2507.19261

Full text not available from this repository.

Abstract

The increasing adoption of Artificial Intelligence (AI) has led to larger, more complex models with numerous parameters that require substantial computing power -- resources often unavailable in many real-world application scenarios. Our paper addresses this challenge by introducing knowledge grafting, a novel mechanism that optimizes AI models for resource-constrained environments by transferring selected features (the scion) from a large donor model to a smaller rootstock model. The approach achieves an 88.54% reduction in model size (from 64.39 MB to 7.38 MB), while improving generalization capability of the model. Our new rootstock model achieves 89.97% validation accuracy (vs. donor's 87.47%), maintains lower validation loss (0.2976 vs. 0.5068), and performs exceptionally well on unseen test data with 90.45% accuracy. It addresses the typical size vs performance trade-off, and enables deployment of AI frameworks on resource-constrained devices with enhanced performance. We have tested our approach on an agricultural weed detection scenario, however, it can be extended across various edge computing scenarios, potentially accelerating AI adoption in areas with limited hardware/software support -- by mirroring in a similar manner the horticultural grafting enables productive cultivation in challenging agri-based environments.

Item Type: Website Content
Date Type: Published Online
Status: Published
Schools: Schools > Computer Science & Informatics
Publisher: Cornell University
Last Modified: 04 Aug 2025 11:00
URI: https://orca.cardiff.ac.uk/id/eprint/180213

Actions (repository staff only)

Edit Item Edit Item