Arian Morteza

Arian Morteza

Posts by Category

Research

Paper Summary: Whittle Index Scheduling for Age of Information in IoT Networks

1 minute read

Published:

This post summarizes our paper published at IEEE SmartIOT 2025:

A Novel Whittle Index-Based Scheduling for Age of Information Minimization in IoT Networks

Motivation

In IoT networks, keeping information fresh matters. A sensor reading that is 10 seconds old may be useless for real-time control. Age of Information (AoI) captures this freshness — it measures the time elapsed since the last successful update from a source.

The challenge: with many sensors and limited transmission slots, which sensors should you update at each time step to keep the overall network as fresh as possible?

Our Approach

We modeled this as a Restless Multi-Armed Bandit (RMAB) problem, where each sensor is an “arm” with an evolving AoI state. We derived a Whittle index policy — a lightweight, scalable scheduling rule that assigns a priority score to each sensor based on its current AoI.

Key contributions:

  • Proved the indexability of the AoI bandit problem under our model
  • Derived a closed-form Whittle index for efficient computation
  • Demonstrated near-optimal performance through simulations

Results

Our Whittle index policy significantly outperformed baseline round-robin scheduling and came close to the optimal policy computed by dynamic programming — at a fraction of the computational cost.

Full paper: IEEE SmartIOT 2025

This post is part of the Research series — plain-language summaries of my published work.

Tutorials

What is the Whittle Index? A Plain-Language Introduction

1 minute read

Published:

The Whittle index is a powerful tool for solving scheduling problems where you have limited resources and many competing tasks — each with its own urgency and behavior over time.

The Problem

Imagine you have a network of IoT sensors, and you can only query a few of them at each time step. Each sensor has a state (e.g., how fresh its data is), and that state evolves over time whether or not you pay attention to it. You want to maximize the quality of information you collect. Which sensors do you query?

This is the Restless Multi-Armed Bandit (RMAB) problem — “restless” because the arms (sensors) keep changing state even when not selected.

Why It’s Hard

The RMAB is PSPACE-hard in general. An exact solution requires tracking the joint state of all arms, which grows exponentially. For real systems with hundreds of sensors, this is completely intractable.

The Whittle Index Approach

Peter Whittle (1988) proposed a clever relaxation: instead of solving the joint problem, assign a scalar index to each arm based on its current state. At each time step, simply activate the arms with the highest indices.

The index for an arm in state $s$ is defined as the subsidy $\lambda$ at which the decision-maker is indifferent between activating and not activating that arm. Intuitively, a higher index means the arm is more “urgent” right now.

Why It Works Well in Practice

  • It reduces an exponential problem to computing one number per arm
  • It is provably optimal in certain asymptotic regimes
  • Empirically, it performs close to optimal even in finite settings

My Work

My doctoral research applied Whittle index scheduling to Age of Information (AoI) minimization in IoT networks — optimizing how fresh the information is across a fleet of sensors under transmission constraints. Our results were published at IEEE SmartIOT 2025.

This post is part of the Tutorials series — breaking down research concepts for a broad audience.