Journal article · 2026 · Open access
FedTuneFM: Federated Fine-Tuning of Foundation Models for Mobile Edge Computing via Adaptive Compression and Attention Alignment
IEEE Transactions on Mobile Computing, 25(11), 21884–21900 · Published 5 August 2026 · DOI 10.1109/tmc.2026.3720660
In brief
“FedTuneFM: Federated Fine-Tuning of Foundation Models for Mobile Edge Computing via Adaptive Compression and Attention Alignment” is a 2026 journal article by Yalan Jiang and Bin Song, published in IEEE Transactions on Mobile Computing. OpenAlex counts 0 citations as of 19 November 2026. It is open access under a CC BY licence: the full text is free to read at IEEE Transactions on Mobile Computing.
- Citations
- 0
- References
- 36
- Authors
- 2
Abstract
Federated Learning (FL) has emerged as a promising paradigm for fine-tuning large-scale Foundation Models (FMs) in distributed environments while preserving data privacy. However, efficiently adapting FMs in FL remains challenging, especially in mobile edge computing scenarios where devices are resource-constrained and heterogeneous. Existing federated compression–distillation methods often rely on fixed proxy structures and focus mainly on knowledge transfer between the full FM and a single sub-FM. These designs may leave intermediate layers insufficiently updated, accumulate model mismatch, and overlook cross-layer dependencies, thereby weakening knowledge transfer and model performance. To address these limitations, we propose FedTuneFM, an efficient federated fine-tuning framework that jointly optimizes the sub-FM structure, the round-wise update set, and consistency across heterogeneous sub-FMs. FedTuneFM consists of two core modules: the FM-to-sub-FM mapping module and the sub-FM optimization module. The mapping module employs a multi-level compression strategy that selectively retains critical parameters to reduce communication cost. Furthermore, an adaptive block update mechanism selects and updates the most informative blocks in each round. The optimization module aligns attention matrices between the full FM and each sub-FM, as well as across heterogeneous sub-FMs, to improve knowledge transfer and aggregation stability. Experiments on six benchmark datasets, including four text datasets and two vision datasets, demonstrate that FedTuneFM achieves a favorable accuracy–efficiency trade-off in heterogeneous and resource-constrained environments while substantially reducing computational and communication costs.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Jiang, Y., & Song, B. (2026). FedTuneFM: Federated Fine-Tuning of Foundation Models for Mobile Edge Computing via Adaptive Compression and Attention Alignment. IEEE Transactions on Mobile Computing, 25(11), 21884–21900. https://doi.org/10.1109/tmc.2026.3720660
MLA 9
Jiang, Yalan, and Bin Song. “FedTuneFM: Federated Fine-Tuning of Foundation Models for Mobile Edge Computing via Adaptive Compression and Attention Alignment.” IEEE Transactions on Mobile Computing, vol. 25, no. 11, 2026, pp. 21884–21900. https://doi.org/10.1109/tmc.2026.3720660.
Chicago
Jiang, Yalan and Bin Song. 2026. “FedTuneFM: Federated Fine-Tuning of Foundation Models for Mobile Edge Computing via Adaptive Compression and Attention Alignment.” IEEE Transactions on Mobile Computing 25 (11): 21884–21900. https://doi.org/10.1109/tmc.2026.3720660.
Harvard
Jiang, Y. and Song, B. (2026) ‘FedTuneFM: Federated Fine-Tuning of Foundation Models for Mobile Edge Computing via Adaptive Compression and Attention Alignment’, IEEE Transactions on Mobile Computing, 25(11), pp. 21884–21900. doi:10.1109/tmc.2026.3720660.
IEEE
Y. Jiang and B. Song, “FedTuneFM: Federated Fine-Tuning of Foundation Models for Mobile Edge Computing via Adaptive Compression and Attention Alignment,” IEEE Transactions on Mobile Computing, vol. 25, no. 11, pp. 21884–21900, 2026, doi: 10.1109/tmc.2026.3720660.
BibTeX
@article{jiang2026fedtunefm,
title = {{FedTuneFM: Federated Fine-Tuning of Foundation Models for Mobile Edge Computing via Adaptive Compression and Attention Alignment}},
author = {Jiang, Yalan and Song, Bin},
journal = {IEEE Transactions on Mobile Computing},
year = {2026},
volume = {25},
number = {11},
pages = {21884--21900},
doi = {10.1109/tmc.2026.3720660},
url = {https://doi.org/10.1109/tmc.2026.3720660}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- federated fine-tuning
- foundation models
- mobile edge computing
- model compression
- attention alignment
- knowledge distillation
- heterogeneous devices
- communication efficiency
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Jiang, Y., & Song, B. (2026). FedTuneFM: Federated Fine-Tuning of Foundation Models for Mobile Edge Computing via Adaptive Compression and Attention Alignment. IEEE Transactions on Mobile Computing, 25(11), 21884–21900. https://doi.org/10.1109/tmc.2026.3720660
How many times has this paper been cited?
0 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at IEEE Transactions on Mobile Computing: sign in and open the full text from this page.
Who wrote this paper?
Yalan Jiang, Bin Song.
What is the DOI of this paper?
10.1109/tmc.2026.3720660, permanently at https://doi.org/10.1109/tmc.2026.3720660. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.