Research Article Open Access

A Q-Routing Protocol Using Self-Aware Approach for Mobile Ad hoc Networks

Amal Alharbi1, Abdullah Al-Dhalaan1 and Miznah Al-Rodhaan1
  • 1 Department of Computer Science, College of Information Sciences, King Saud University, Riyadh, Saudi Arabia

Abstract

Mobile Ad hoc Networks (MANET) are self-organized networks that are characterized by dynamic topologies in time and space. This creates an instable environment, where classical routing approaches cannot achieve high performance. Thus, adaptive routing is necessary to handle the challenges in MANETs. Furthermore, it is necessary for nodes to be self-aware i.e., able to discover neighbors, links and paths when needed. This paper proposes a new adaptive Mobile Ad hoc Networks (MANET) routing algorithm to find and maintain paths that provide the needed Quality of Service (QoS) for network traffic using a low-complexity bio-inspired learning paradigm. It combines the self-aware approach in Cognitive Packets Network (CPN) with a Q-routing inspired path selection mechanism. CPN is a distributed adaptive routing protocol that uses three types of packets: Smart Packets for route discovery, Data Packets for carrying data payload and Acknowledgments to bring back feedback information for the Reinforcement Learning reward function. The research defines a Q-routing reward function as a combination of high stability and low delay path criteria to discover long-lived routes without disrupting the overall delay. The algorithm uses Acknowledgment-based feedback for Q-routing to make routing decisions that adapt on line to network changes allowing nodes to learn efficient routing policies. Simulation Results show how the reward function handles the network changing topology to select paths that improve QoS delivered.

American Journal of Applied Sciences
Volume 12 No. 12, 2015, 1014-1022

DOI: https://doi.org/10.3844/ajassp.2015.1014.1022

Submitted On: 2 March 2015 Published On: 7 December 2015

How to Cite: Alharbi, A., Al-Dhalaan, A. & Al-Rodhaan, M. (2015). A Q-Routing Protocol Using Self-Aware Approach for Mobile Ad hoc Networks. American Journal of Applied Sciences, 12(12), 1014-1022. https://doi.org/10.3844/ajassp.2015.1014.1022

  • 2,121 Views
  • 1,657 Downloads
  • 0 Citations

Download

Keywords

  • Cognitive Packet Network (CPN)
  • Mobile Ad hoc Network (MANET)
  • Q-Routing
  • Reinforcement Learning (RL)
  • Self-Aware Networks (SAN)