Adaptive Security Solutions for NOMA Networks: The Role of DDPG and RIS-Equipped UAVs

Syed Zain  Ul Abideen; Abdul  Wahid; Mian Muhammad  Kamal

doi:10.31258/ijeepse.7.3.158-174

Syed Zain Ul Abideen College of Computer Science and Technology, Qingdao University, Qingdao 266071, China
Abdul Wahid College of Computer Science and Technology, Qingdao University, Qingdao 266071, China
Mian Muhammad Kamal School of Electronic Science and Engineering, Southeast University, Nanjing, China

DOI: https://doi.org/10.31258/ijeepse.7.3.158-174

Abstract viewed: 125 times

pdf downloaded: 37 times

Keywords: non-orthogonal multiple access, reconfigurable intelligent surface, unmanned aerial vehicles, deep reinforcement learning, deep deterministic policy gradient, Physical layer security.

Abstract

In this work, we apply the Deep Deterministic Policy Gradient (DDPG) technique to improve the security of a non-orthogonal multiple access (NOMA) downlink network by enabling use of a reconfigurable intelligent surface (RIS) equipped unmanned aerial vehicles (UAV). Our main objective is to prevent eavesdroppers from accessing the network while preserving seamless communication for authorized users. The system is made up of a UAV integrated with an RIS which is essential for optimizing signal paths, and a Base Station. Our work aims to maximize secrecy rates for all users under possible eavesdropping scenarios by dynamically adjusting the RIS’s phase shifts and power allocations. This method not only shows how flexible and successful the DDPG algorithm is at protecting wireless communications when used in conjunction with an RIS but it also highlights how much the algorithm has advanced secure communication systems.

References

J. Li, S. Xu, J. Liu, Y. Cao, and W. Gao, “Reconfigurable Intelligent Surface Enhanced Secure Aerial-Ground Communication,” IEEE Transactions on Communications, vol. 69, no. 9, pp. 6185–6197, Jun. 2021.

V. N. Vo, C. So-In, H. Tran, D.-D. Tran, and T. P. Huu, “Performance Analysis of an Energy-Harvesting IoT System Using a UAV Friendly Jammer and NOMA Under Cooperative Attack,” IEEE Access, vol. 8, pp. 221986–222000, Dec. 2020.

A. S. Abdalla, T. F. Rahman, and V. Marojevic, “UAVs with reconfigurable intelligent surfaces: Applications, challenges, and opportunities,” arXiv preprint arXiv:2012.04775, 2020.

W. U. Khan, A. Mahmood, C. K. Sheemar, E. Lagunas, S. Chatzinotas, and B. Ottersten, “Reconfigurable Intelligent Surfaces for 6G Non-Terrestrial Networks: Assisting Connectivity from the Sky,” IEEE Internet of Things Magazine, vol. 7, no. 1, pp. 34–39, Jan. 2024.

T. Alladi, Naren, G. Bansal, V. Chamola, and M. Guizani, “Secauthuav: A novel authentication scheme for uav-ground station and uav-uav communication,” IEEE Transactions on Vehicular Technology, vol. 69, no. 12, pp. 15068–15077, Oct. 2020.

S. Jiao, X. Xie, and Z. Ding, “Deep reinforcement learning based optimization for irs based uav-noma downlink networks,” arXiv preprint arXiv:2106.09616, 2021.

J. Yao and J. Xu, “Joint 3D Maneuver and Power Adaptation for Secure UAV Communication With CoMP Reception,” IEEE Transactions on Wireless Communications, vol. 19, no. 10, pp. 6992–7006, Jul. 2020.

M. Najafi, V. Jamali, R. Schober, and H. V. Poor, “Physics-Based Modeling and Scalable Optimization of Large Intelligent Reflecting Surfaces,” IEEE Transactions on Communications, vol. 69, no. 4, pp. 2673–2691, Dec. 2021.

F. Zhou, Z. Li, J. Cheng, Q. Li, and J. Si, “Robust AN-Aided Beamforming and Power Splitting Design for Secure MISO Cognitive Radio With SWIPT,” IEEE Transactions on Wireless Communications, vol. 16, no. 4, pp. 2450–2464, Mar. 2017.

X. Zhang, X. Zhou, and M. R. McKay, “Enhancing Secrecy with Multi-Antenna Transmission in Wireless Ad Hoc Networks,” IEEE Transactions on Information Forensics and Security, vol. 8, no. 11, pp. 1802–1814, Aug. 2013.

Y. Liu, X. Liu, X. Mu, T. Hou, J. Xu, M. Di Renzo, and N. Al-Dhahir, “Reconfigurable Intelligent Surfaces: Principles and Opportunities,” IEEE Communications Surveys Tutorials, vol. 23, no. 3, pp. 1546–1577, May 2021.

X. Sun, D. W. K. Ng, Z. Ding, Y. Xu, and Z. Zhong, “Physical layer security in uav systems: Challenges and opportunities,” IEEE Wireless Communications, vol. 26, no. 5, pp. 40–47, Oct. 2019.

Z. Zhang, C. Zhang, C. Jiang, F. Jia, J. Ge, and F. Gong, “Improving physical layer security for reconfigurable intelligent surface aided NOMA 6G networks,” IEEE Transactions on Vehicular Technology, vol. 70, no. 5, pp. 4451–4463, Mar. 2021.

C. Huang, G. C. Alexandropoulos, A. Zappone, C. Yuen, and M. Debbah, “Deep Learning for UL/DL Channel Calibration in Generic Massive MIMO Systems,” in ICC 2019 - 2019 IEEE International Conference on Communications (ICC), Shanghai, China, Jul. 2019, pp. 1–6.

T. Wang, F. Fang, and Z. Ding, “An SCA and Relaxation Based Energy Efficiency Optimization for Multi-User RIS-Assisted NOMA Networks,” IEEE Transactions on Vehicular Technology, vol. 71, no. 6, pp. 6843–6847, Mar. 2022.

J. Chen, L. Guo, J. Jia, J. Shang, and X. Wang, “Resource Allocation for IRS Assisted SGF NOMA Transmission: A MADRL Approach,” IEEE Journal on Selected Areas in Communications, vol. 40, no. 4, pp. 1302–1316, 2022.

J. Chen, Y. Xie, X. Mu, J. Jia, Y. Liu, and X. Wang, “Energy Efficient Resource Allocation for IRS Assisted CoMP Systems,” IEEE Transactions on Wireless Communications, vol. 21, no. 7, pp. 5688–5702, Jan. 2022.

J. Chen, Z. Ma, Y. Zou, J. Jia, and X. Wang, “DRL-based Energy Efficient Resource Allocation for STAR-RIS Assisted Coordinated Multi-Cell Networks,” in GLOBECOM 2022 - 2022 IEEE Global Communications Conference, Jan. 2022, pp. 4232–4237.

X. Mu, Y. Liu, L. Guo, J. Lin, and H. V. Poor, “Intelligent Reflecting Surface Enhanced Multi-UAV NOMA Networks,” IEEE Journal on Selected Areas in Communications, vol. 39, no. 10, pp. 3051–3066, Jun. 2021.

J. Zhao, Y. Zhu, X. Mu, K. Cai, Y. Liu, and L. Hanzo, “Simultaneously Transmitting and Reflecting Reconfigurable Intelligent Surface (STAR-RIS) Assisted UAV Communications,” IEEE Journal on Selected Areas in Communications, vol. 40, no. 10, pp. 3041–3056, Aug. 2022.

Z. Tang, T. Hou, Y. Liu, J. Zhang, and C. Zhong, “A Novel Design of RIS for Enhancing the Physical Layer Security for RIS-Aided NOMA Networks,” IEEE Wireless Communications Letters, vol. 10, no. 11, pp. 2398–2401, Aug. 2021.

M. Cui, G. Zhang, and R. Zhang, “Secure Wireless Communication via Intelligent Reflecting Surface,” IEEE Wireless Communications Letters, vol. 8, no. 5, pp. 1410–1414, May 2019.

X. Yu, D. Xu, Y. Sun, D. W. K. Ng, and R. Schober, “Robust and Secure Wireless Communications via Intelligent Reflecting Surfaces,” IEEE Journal on Selected Areas in Communications, vol. 38, no. 11, pp. 2637–2652, Jul. 2020.

Y. Han, N. Li, Y. Liu, T. Zhang, and X. Tao, “Artificial Noise Aided Secure NOMA Communications in STAR-RIS Networks,” IEEE Wireless Communications Letters, vol. 11, no. 6, pp. 1191–1195, Mar. 2022.

H. Long, M. Chen, Z. Yang, Z. Li, B. Wang, X. Yun, and M. ShikhBahaei, “Joint Trajectory and Passive Beamforming Design for Secure UAV Networks with RIS,” in 2020 IEEE Globecom Workshops (GC Wkshps), Mar. 2020, pp. 1–6.

D. Wang, Y. Zhao, Y. Lou, L. Pang, Y. He, and D. Zhang, “Secure NOMA Based RIS-UAV Networks: Passive Beamforming and Location Optimization,” in GLOBECOM 2022 - 2022 IEEE Global Communications Conference, Rio de Janeiro, Brazil, Jan. 2022, pp. 3168–3173.

L. Li, Q. Cheng, X. Tang, T. Bai, W. Chen, Z. Ding, and Z. Han, “Resource Allocation for NOMA-MEC Systems in Ultra-Dense Networks: A Learning Aided Mean-Field Game Approach,” IEEE Transactions on Wireless Communications, vol. 20, no. 3, pp. 1487–1500, Nov. 2021.

D. Silver, G. Lever, N. Heess, T. Degris, D. Wierstra, and M. Riedmiller, “Deterministic policy gradient algorithms,” in International Conference on Machine Learning. PMLR, 2014, pp. 387–395.

S. Zhang and R. S. Sutton, “A deeper look at experience replay,” arXiv preprint arXiv:1712.01275, 2017.

H. Peng and X. S. Shen, “DDPG-based Resource Management for MEC/UAV-Assisted Vehicular Networks,” in 2020 IEEE 92nd Vehicular Technology Conference (VTC2020-Fall), Victoria, BC, Canada, Feb. 2020, pp. 1–6.