Publications

Papers and preprints

Partitioning neural networks and LLMs for the edge, operating systems for NPU-equipped microcontrollers, and software-defined tactical networks. Most of the work is with Prof. Iordanis Koutsopoulos at AUEB.

12 publications 11 as first author 200 citations 5 h-index 4 i10-index Google Scholar, October 2026
2026
IEEE SPAWC 2026Workshop paper

HeadSplit: Attention Head Partitioning and Inter-Layer Speculation for Distributed Inference at the Edge

Dimitrios Kafetzis, Iordanis Koutsopoulos

A small LLM still exceeds one edge device's memory, and layer-wise splits leave all but one device idle at any moment. HeadSplit schedules each layer's attention heads across devices so attention runs in parallel everywhere, and forwards a speculative intermediate output to the next layer before the FFN finishes, filling the idle interval it creates.

arXivPreprint

SynapticOS: An Inference-First Runtime Architecture for Neural Processing Units on Resource-Constrained Microcontrollers

Dimitrios Kafetzis

Production combinations of Zephyr or FreeRTOS with TensorFlow Lite Micro treat inference as an application library, leaving memory fragmentation, accelerator-state hygiene and model-lifecycle guards to the application developer. This paper presents the Phase 1 architecture of SynapticOS, which makes them operating-system concerns.

arXivPreprint

Inference Pipelines as Operating-System Objects: Priority Scheduling and Constant-Footprint Streaming for Microcontroller Neural Inference

Dimitrios Kafetzis

Pre-processing, accelerator invocation and post-processing are usually re-implemented per project around a library call. The Phase 2 inference engine of SynapticOS makes the pipeline an OS object with priority scheduling and streaming at a constant memory footprint.

arXivPreprint

Cross-Core Inference Offload as an Operating-System Service on Dual-Core Microcontrollers

Dimitrios Kafetzis

On NXP's MCXN947 the second Cortex-M33 core has no FPU, DSP extension, TrustZone or MPU. The Phase 3 dual-core architecture of SynapticOS treats that asymmetry as a design input: the AI runtime lives on the capable core, and the application core reaches inference only through a message-based OS service.

2025
IEEE MeditCom 2025

Video Quality Monitoring for Remote Autonomous Vehicle Control

Dimitrios Kafetzis, Nikos Fotiou, Savvas Argyropoulos, Jad Nasreddine, Iordanis Koutsopoulos

A blueprint for an integrated video-quality monitoring system for remote autonomous vehicle operation over 4G/5G: onboard data collection, video capture and compression, streaming to edge servers, AI model deployment and proactive decisions on predicted quality. Twenty LSTM, GRU and Transformer variants are benchmarked against DNN and linear baselines on a hybrid field-trial and synthetic dataset, with onboard and edge inference compared.

IEEE/IFIP WiOpt 2025

Large Language Model Partitioning for Low-Latency Inference at the Edge

Dimitrios Kafetzis, Ramin Khalili, Iordanis Koutsopoulos

Decoder-only LLMs generate one token at a time while their key-value caches grow. The paper places attention heads, projections and FFN blocks across edge devices and re-plans as the cache expands, minimising per-token latency under each device's memory limit.

2024
ACM MobiHoc 2024Demo

An Experimental Platform for AI Model Partitioning on Resource-constrained Devices

Dimitrios Kafetzis, Iordanis Koutsopoulos

A WiFi network of Raspberry Pi 4 devices for partitioned inference experiments, from simple and deep neural networks to Transformer architectures, measuring performance and resource usage per device.

EuCNC & 6G Summit 2024

DNN Partitioning and Inference Task Offloading in 6G Resource-Constrained Networks

Dimitrios Kafetzis, Iordanis Koutsopoulos

Each resource-constrained device runs the first layers of its DNN locally and offloads the rest to a base station, where the tasks of different devices couple through scheduling. The paper formulates partitioning for minimum total delay and for fair, balanced delays across devices, and proposes a greedy heuristic for each.

2023
IEEE MILCOM 2023

Revisiting the OLSRv2 Protocol Optimization in SDN-enabled Tactical MANETs

Ioannis Fourfouris, Merkouris Karaliopoulos, Dimitrios Kafetzis, Georgios Vardoulias, Apostolos Georgiadis, Spyridon Vassilaras, Iordanis Koutsopoulos

A data-driven way to configure OLSRv2 in tactical MANETs. Machine-learning models trained on a CORE/EMANE measurement dataset predict protocol responsiveness and overhead for each topology and configuration, and the global view that SDN adds to the MANET is what makes applying the best configuration practical.

European Wireless 2023

Joint Controller Placement and Intrusion Detection System Enablement in Software Defined Mobile Ad Hoc Networks

Dimitrios Kafetzis, Iordanis Koutsopoulos

Where to place the SDN controller and a limited number of IDS modules in a software-defined MANET so that attack traffic paths are covered and mitigation delay stays low. A greedy heuristic and a simulated-annealing algorithm, validated in a custom Python simulator against all-nodes and random IDS placements.

2022
IEEE AccessSurvey · 146 citations

Software-Defined Networking Meets Software-Defined Radio in Mobile ad hoc Networks: State of the Art and Future Directions

Dimitrios Kafetzis, Spyridon Vassilaras, Georgios Vardoulias, Iordanis Koutsopoulos

A survey of how SDN and SDR can coexist and cooperate in MANETs: architectures, cross-layer design and optimisation, and the open problems for tactical and civilian deployments.

2020
IEEE ICUAS 2020

UAV-assisted Aerial Survey of Railways using Deep Learning

Dimitrios Kafetzis, Ioannis Fourfouris, Savvas Argyropoulos, Iordanis Koutsopoulos

A proof of concept for UAV-assisted vegetation and obstacle detection on railways: a new manually annotated dataset built from public clips and own recordings, a deep-learning detection pipeline evaluated per class, and tests on the NVIDIA Jetson Nano as the on-board computer.

People

Co-authors

  • Iordanis Koutsopoulos
  • Spyridon Vassilaras
  • Georgios Vardoulias
  • Savvas Argyropoulos
  • Merkourios Karaliopoulos
  • Ramin Khalili
  • Ioannis Fourfouris
  • Nikos Fotiou
  • Jad Nasreddine
  • Apostolos Georgiadis