SplitFed-MobileFormer with Privacy-Constrained Token Compression for Data-Driven Visual Perception in Heterogeneous Edge Camera Networks

Authors

  • Zbigniew Kaczan Faculty of Information and Communication Technology, West Pomeranian University of Technology in Szczecin, Szczecin, 70-310, Poland

DOI:

https://doi.org/10.64972/dea.2022.v1i2.4216d:81-93

Keywords:

Edge Camera Network; Privacy-Preserving Visual Perception; SplitFed Learning; MobileFormer

Abstract

 In smart cities, edge camera networks are typically used for traffic monitoring, factory inspections, and community and school security. However, centralized visual analysis has a high transmission cost and may contain sensitive information. A SplitFed-MobileFormer model for privacy-preserving visual perception in edge camera networks is presented in this study. The three are a lightweight MobileFormer backbone, federated aggregation, and split learning. For collaborative semantic learning, camera nodes only provide compact intermediate tokens while retaining the raw pictures and shallow representations. To lower the danger of feature inversion without sacrificing recognition speed, use a privacy-constrained optimization goal and a communication-aware feature compression approach. In comparison to a traditional split-learning baseline, experiments in a distributed multi-camera visual perception scenario demonstrate that the suggested model achieves 94.6% accuracy, 93.8% macro-F1, 21.7 ms average edge inference latency, and a 46.2% reduction in transmitted feature volume. The results show that SplitFed-MobileFormer can accomplish real-time, privacy-preserving visual intelligence on heterogeneous edge devices.

Downloads

Published

2022-08-07

How to Cite

Kaczan, Z. (2022). SplitFed-MobileFormer with Privacy-Constrained Token Compression for Data-Driven Visual Perception in Heterogeneous Edge Camera Networks. Data Engineering and Applications, 1(2), 6d:81–93. https://doi.org/10.64972/dea.2022.v1i2.4216d:81-93

Issue

Section

Articles