ISSN: 3048-6815

Adaptive Neuro-Fuzzy Inference System with Reinforcement Learning for Enhanced Dynamic Resource Allocation in Cloud Computing Environments

Abstract

Cloud computing environments demand efficient and dynamic resource allocation strategies to meet fluctuating user demands and optimize resource utilization. This paper proposes an Adaptive Neuro-Fuzzy Inference System (ANFIS) integrated with Reinforcement Learning (RL), specifically Q-learning, for enhanced dynamic resource allocation in cloud environments. The proposed system, ANFIS-RL, leverages the learning capabilities of RL to adapt the fuzzy rules of ANFIS, enabling it to dynamically adjust resource allocation policies based on real-time system performance and changing workload patterns. We detail the architecture of ANFIS-RL, the Q-learning algorithm implementation, and the experimental setup used to evaluate its performance. The results demonstrate that ANFIS-RL significantly outperforms traditional rule-based fuzzy systems and standard Q-learning approaches in terms of resource utilization, response time, and overall system efficiency. This hybrid approach offers a robust and adaptive solution for managing the complexities of resource allocation in dynamic cloud environments.

References

  1. Beloglazov, A., & Buyya, R. (2012). Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers. Concurrency and Computation: Practice and Experience, 24(13), 1397-1420.
  2. Tesfatsion, A., & Wolter, K. (2014). Fuzzy logic based dynamic resource provisioning for cloud computing. Future Generation Computer Systems, 37, 137-148.
  3. Calheiros, R. N., Ranjan, R., De Rose, C. A. F., & Buyya, R. (2011). WorkflowSim: A toolkit for modeling and simulation of scientific workflows in Cloud computing environments. Concurrency and Computation: Practice and Experience, 23(11), 1095-1124.
  4. Mao, H., Alizadeh, M., Menache, I., & Katabi, D. (2016). Resource management with deep reinforcement learning. Proceedings of the 13th USENIX conference on Networked Systems Design and Implementation (NSDI), 261-274.
  5. Verma, A., & Kaushal, T. (2015). A reinforcement learning approach for dynamic vm placement in cloud data centers. Proceedings of the 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), 695-704.
  6. Niyato, D., Hossain, E., & Han, Z. (2016). Dynamic resource allocation in cloud federations: A game-theoretic approach. IEEE Transactions on Cloud Computing, 4(1), 113-127.
  7. Dastjerdi, A. V., & Buyya, R. (2016). Fog computing: Helping mobile internet of things applications. IEEE Computer, 49(5), 61-69.
  8. Arabnejad, H., & Barbosa, J. G. (2017). Adaptive neuro-fuzzy inference system for resource utilization prediction in cloud computing environments. Journal of Network and Computer Applications, 89, 1-11.
  9. Samimi, P., Moser, A., & Dustdar, S. (2018). Genetic algorithm-based fuzzy logic controller for dynamic resource provisioning in cloud environments. Future Generation Computer Systems, 87, 1-13.
  10. Li, W., Zhu, J., & Zhang, X. (2020). Actor-critic reinforcement learning for dynamic resource allocation in edge computing. IEEE Internet of Things Journal, 7(5), 4235-4245.
  11. Jang, J. S. R. (1993). ANFIS: adaptive-network-based fuzzy inference system. IEEE Transactions on Systems, Man, and Cybernetics, 23(3), 665-685.
  12. Sutton, R. S., & Barto, A. G. (2018). Reinforcement learning: An introduction. MIT press.
  13. Wolpert, D. H. (1996). The lack of a priori distinctions between learning algorithms. Neural Computation, 8(7), 1341-1390.
  14. Haykin, S. (2009). Neural networks and learning machines. Pearson Education.
  15. Mitchell, T. M. (1997). Machine learning*. McGraw-Hill.
Download PDF

How to Cite

Aditi Singh , (2025-05-02 11:54:23.554). Adaptive Neuro-Fuzzy Inference System with Reinforcement Learning for Enhanced Dynamic Resource Allocation in Cloud Computing Environments. JANOLI International Journal of Artificial Intelligence and its Applications, Volume EOCMPeqBj5R9ZDur0Rlk, Issue 4.