ISSN: 3048-6815

Adaptive Neuro-Fuzzy Inference System with Reinforcement Learning for Enhanced Dynamic Resource Allocation in Cloud Computing Environments (P1-P1)

Abstract

Cloud computing environments demand efficient and dynamic resource allocation strategies to meet fluctuating user demands and optimize resource utilization. This paper proposes an Adaptive Neuro-Fuzzy Inference System (ANFIS) integrated with Reinforcement Learning (RL), specifically Q-learning, for enhanced dynamic resource allocation in cloud environments. The proposed system, ANFIS-RL, leverages the learning capabilities of RL to adapt the fuzzy rules of ANFIS, enabling it to dynamically adjust resource allocation policies based on real-time system performance and changing workload patterns. We detail the architecture of ANFIS-RL, the Q-learning algorithm implementation, and the experimental setup used to evaluate its performance. The results demonstrate that ANFIS-RL significantly outperforms traditional rule-based fuzzy systems and standard Q-learning approaches in terms of resource utilization, response time, and overall system efficiency. This hybrid approach offers a robust and adaptive solution for managing the complexities of resource allocation in dynamic cloud environments.

References

  1. Beloglazov, A., & Buyya, R. (2012). Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers. Concurrency and Computation: Practice and Experience, 24(13), 1397-1420.
  2. Tesfatsion, A., & Wolter, K. (2014). Fuzzy logic based dynamic resource provisioning for cloud computing. Future Generation Computer Systems, 37, 137-148.
  3. Calheiros, R. N., Ranjan, R., De Rose, C. A. F., & Buyya, R. (2011). WorkflowSim: A toolkit for modeling and simulation of scientific workflows in Cloud computing environments. Concurrency and Computation: Practice and Experience, 23(11), 1095-1124.
  4. Mao, H., Alizadeh, M., Menache, I., & Katabi, D. (2016). Resource management with deep reinforcement learning. Proceedings of the 13th USENIX conference on Networked Systems Design and Implementation (NSDI), 261-274.
  5. Verma, A., & Kaushal, T. (2015). A reinforcement learning approach for dynamic vm placement in cloud data centers. Proceedings of the 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), 695-704.
  6. Niyato, D., Hossain, E., & Han, Z. (2016). Dynamic resource allocation in cloud federations: A game-theoretic approach. IEEE Transactions on Cloud Computing, 4(1), 113-127.
  7. Dastjerdi, A. V., & Buyya, R. (2016). Fog computing: Helping mobile internet of things applications. IEEE Computer, 49(5), 61-69.
  8. Arabnejad, H., & Barbosa, J. G. (2017). Adaptive neuro-fuzzy inference system for resource utilization prediction in cloud computing environments. Journal of Network and Computer Applications, 89, 1-11.
  9. Samimi, P., Moser, A., & Dustdar, S. (2018). Genetic algorithm-based fuzzy logic controller for dynamic resource provisioning in cloud environments. Future Generation Computer Systems, 87, 1-13.
  10. Li, W., Zhu, J., & Zhang, X. (2020). Actor-critic reinforcement learning for dynamic resource allocation in edge computing. IEEE Internet of Things Journal, 7(5), 4235-4245.
  11. Jang, J. S. R. (1993). ANFIS: adaptive-network-based fuzzy inference system. IEEE Transactions on Systems, Man, and Cybernetics, 23(3), 665-685.
  12. Sutton, R. S., & Barto, A. G. (2018). Reinforcement learning: An introduction. MIT press.
  13. Wolpert, D. H. (1996). The lack of a priori distinctions between learning algorithms. Neural Computation, 8(7), 1341-1390.
  14. Haykin, S. (2009). Neural networks and learning machines. Pearson Education.
  15. Mitchell, T. M. (1997). Machine learning*. McGraw-Hill.
Download PDF

How to Cite

Aditi Singh , (2025/5/2). Adaptive Neuro-Fuzzy Inference System with Reinforcement Learning for Enhanced Dynamic Resource Allocation in Cloud Computing Environments. JANOLI International Journal of Artificial Intelligence and its Applications, Volume EOCMPeqBj5R9ZDur0Rlk, Issue 4.