Improved UCB-based Energy-Efficient Channel Selection in Hybrid-Band Wireless Communication

Sherief Hashima, Mostafa M. Fouda, Zubair Md Fadlullah, Ehab Mahmoud Mohamed, Kohei Hatano

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

While hybrid-band wireless systems recently gained prominence to achieve high capacity, selecting the best channel in these systems in real-time is still a formidable research challenge that requires further investigations. In this paper, we address this challenge in terms of an optimization problem, which is reformu-lated as a stochastic multi-armed bandit (MAB). Then, we introduce online learning-based solutions to solve the MAB problem for the multi-band/channel selection (MBS). Improved variants of the upper confidence bound (UCB) scheme are investigated and modified to be energy-aware. Hence, we propose Energy-Aware Randomized UCB-MBS (EA-RUCB-MBS) and Energy-Aware Kullback-Leibler UCB-MBS (EA-KLUCB-MBS) methods, which demonstrate near-optimal results. Also, EA-KLUCB-MBS exhibits the fastest convergence, while the convergence of EA-RUCB-MBS is similar to that of the original UCB. Based on extensive simulation results, we evaluate the performance of our proposed algorithms against benchmark MBS schemes including UCB and Thompson sampling (TS).

Original languageEnglish
Title of host publication2021 IEEE Global Communications Conference, GLOBECOM 2021 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728181042
DOIs
Publication statusPublished - 2021
Event2021 IEEE Global Communications Conference, GLOBECOM 2021 - Madrid, Spain
Duration: Dec 7 2021Dec 11 2021

Publication series

Name2021 IEEE Global Communications Conference, GLOBECOM 2021 - Proceedings

Conference

Conference2021 IEEE Global Communications Conference, GLOBECOM 2021
Country/TerritorySpain
CityMadrid
Period12/7/2112/11/21

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computer Networks and Communications
  • Computer Science Applications
  • Hardware and Architecture
  • Information Systems and Management
  • Safety, Risk, Reliability and Quality
  • Health Informatics

Fingerprint

Dive into the research topics of 'Improved UCB-based Energy-Efficient Channel Selection in Hybrid-Band Wireless Communication'. Together they form a unique fingerprint.

Cite this