Q-learning based resource management in 5G networks with CO-existence of human and machine type communications /
Amaal Samir Abdelhameed
Q-learning based resource management in 5G networks with CO-existence of human and machine type communications / ادارة الموارد فى شبكات الجيل الخامس القائمة على التعلم الذاتى فى وجود اتصالات الانسان و الاله Amaal Samir Abdelhameed ; Supervised Khaled M. Fouad - Cairo : Amaal Samir Abdelhameed , 2021 - 87 P. : charts ; 30cm
Thesis (Ph.D.) - Cairo University - Faculty of Engineering - Department of Electronics and Communications
The 4th generation (4G) wireless systems and beyond are used to support both Human to Human (H2H) and Machine to Machine (M2M) communications. Since M2M communication is expected to be massive and the characteristics of M2M traffic is different compared to H2H network traffic in both data packets size and transmission time, the LTE-Advanced system must evolve to face this new type of users. In LTE-A, M2M communication devices share the same random access channel (RACH) with the H2H communication devices, consequently the RACH has become a new bottleneck in the LTE-A system. In order to solve this problem, we propose a new random access channel scheme based on Q-learning approach to reduce the congestion problem.The scheme adaptively divides the available preambles between both M2M and H2H devices in a way that provides an acceptable service for the H2H devices and maximizes the number of active M2M devices.The results indicate that the proposed approach provides high random access channel success probability for both M2M and H2H devices even with the huge number of M2M devices with 95% and with 50% raise over the other systems not use the Q-learning.In the second part of the thesis, we study the heterogeneous networks with two layers; Macro-cell and Pico-cell with the co-existence of both H2H and M2M communications
Congestion Control Q-learning Random Access Channel (RACH)
Q-learning based resource management in 5G networks with CO-existence of human and machine type communications / ادارة الموارد فى شبكات الجيل الخامس القائمة على التعلم الذاتى فى وجود اتصالات الانسان و الاله Amaal Samir Abdelhameed ; Supervised Khaled M. Fouad - Cairo : Amaal Samir Abdelhameed , 2021 - 87 P. : charts ; 30cm
Thesis (Ph.D.) - Cairo University - Faculty of Engineering - Department of Electronics and Communications
The 4th generation (4G) wireless systems and beyond are used to support both Human to Human (H2H) and Machine to Machine (M2M) communications. Since M2M communication is expected to be massive and the characteristics of M2M traffic is different compared to H2H network traffic in both data packets size and transmission time, the LTE-Advanced system must evolve to face this new type of users. In LTE-A, M2M communication devices share the same random access channel (RACH) with the H2H communication devices, consequently the RACH has become a new bottleneck in the LTE-A system. In order to solve this problem, we propose a new random access channel scheme based on Q-learning approach to reduce the congestion problem.The scheme adaptively divides the available preambles between both M2M and H2H devices in a way that provides an acceptable service for the H2H devices and maximizes the number of active M2M devices.The results indicate that the proposed approach provides high random access channel success probability for both M2M and H2H devices even with the huge number of M2M devices with 95% and with 50% raise over the other systems not use the Q-learning.In the second part of the thesis, we study the heterogeneous networks with two layers; Macro-cell and Pico-cell with the co-existence of both H2H and M2M communications
Congestion Control Q-learning Random Access Channel (RACH)