Multiagent multi-armed bandit techniques for millimeter wave concurrent beamforming

Sherief Hashima, Kohei Hatano, Hani Kasban, Mohamed Rihan, Ehab Mahmoud Mohamed

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper leverages multiagent multi-armed bandit (MA-MAB) schemes to handle efficiently the millimeter wave (mmWave) concurrent transmission problem. MA-MAB selects the beams with the maximum long-term reward, mostly data rate, from the concurrent links. The mmWave access points (APs) are the agents of the bandit game, while the arms are the existing beam directions. Towards that, MA-KLUCB and MA-EXP3 are proposed and tested via applying them within each AP in a selfish concurrent beamforming scenario. It turns out that the proposed algorithms provide near-optimal performances as compared to the exhaustive search of all concurrent beams' combinations. Also, they demonstrate reasonable fast convergence rates too.

Original languageEnglish
Title of host publicationProceedings of the 8th International Japan-Africa Conference on Electronics, Communications and Computations, JAC-ECC 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages56-59
Number of pages4
ISBN (Electronic)9780738143187
DOIs
Publication statusPublished - Dec 14 2020
Event8th International Japan-Africa Conference on Electronics, Communications and Computations, JAC-ECC 2020 - Virtual, Alexandria, Egypt
Duration: Dec 14 2020Dec 15 2020

Publication series

NameProceedings of the 8th International Japan-Africa Conference on Electronics, Communications and Computations, JAC-ECC 2020

Conference

Conference8th International Japan-Africa Conference on Electronics, Communications and Computations, JAC-ECC 2020
CountryEgypt
CityVirtual, Alexandria
Period12/14/2012/15/20

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Computer Science Applications
  • Health Informatics
  • Instrumentation

Fingerprint Dive into the research topics of 'Multiagent multi-armed bandit techniques for millimeter wave concurrent beamforming'. Together they form a unique fingerprint.

Cite this