Transmission Power Level
4.5.6 VoLTE Latency
10% 20% 30% 40% 50% 60% 70% 80% 90%
20 40 60 80 100 120 140
ABS Proportion
Over−the−air Delay (ms)
ABS
MTS
Figure 4.23: The over-the-air delay of the ABS scheme and the proposed ap-proaches.
In this section, we study VoLTE traffic latency of ABS and MTS. The sim-ulation settings are according to the work in [103], and the load of macrocells is about 275 VoLTE users based on the same work. We set the number of VoLTE users to 250 in a macrocell, and assume that there is no limit on the number of physical downlink control channel (PDCCH) available. We study the over-the-air transmission delay, and it is unacceptable while the delay is more than 50 ms.
Fig. 4.23shows the delay time versus proportion of ABSs. We find that delay time increased dramatically while ABS proportion gets higher. This is because that the higher ABS proportion, the less subframes MBSs can use. It leads to that UEs need to wait a lot of subframes to transmit a packet, therefore, the delay for UEs is increased. By contrast, Multi-tone ABS increases the spectrum utilization of MBSs, therefore, MBSs do their best to use each subframe. Under this condition, subframes with lower power can be used by cell-center users, and
4.6 Concluding Remarks
subframes with higher power can be used by cell-edge users. So, each user can be scheduled in appropriate subframes. The over-the-air transmission delay doesn’t get higher in Multi-tone ABS.
4.5.7 Summary
In this section, we provide various simulation results to show the performance of the proposed approach. First, we show the performance loss compared to the optimal solution obtained from the first algorithm, namely interior point relaxed MTS optimization algorithm. We show that using seven power levels has lower than 10% performance loss. Second, a example of UE clustering is provided.
Third, we compare the proposed algorithm with other approaches from the view point of system capacity to show the outstanding of the proposed algorithm.
Forth, the power consumption of all algorithms is also conducted, and the result shows that the proposed algorithm save much. In the last, we show the over-the-air delay of the proposed algorithm and ABS scheme. The result shows the proposed algorithm also has outstanding in this aspect.
4.6 Concluding Remarks
Ultra-dense small cell deployment is the most appealing approach with which to meet the requirements of the dramatically increasing demand for data traffic.
Therefore, heterogeneous networks (HetNets) that contain macrocells and small cells have recently become a popular research topic. The most important issue regarding HetNets is intercell interference; therefore, an almost-blank subframe is proposed to deal with the interference between macrocells and small cells. How-ever, the macrocells will waste spectrum resources while using an almost-blank
subframe. Reduced-power subframes have been proposed as a key technique for further enhancement of intercell interference coordination in the Third Genera-tion Partnership Project to compensate for the insufficiencies of the almost-blank subframe. However, according to the literature, these two approaches involve a trade-off between the performance of the system as a whole and the performance of the outage users. In this work, we propose a scheme called multitone sub-frames to handle this situation by increasing the system capacity without harm-ing the performance of the outage users. We formulate the multitoned subframe assignment problem as an optimisation problem and solve it with the interior method. We provide mathematical analysis of the optimality and complexity of the proposed algorithm and evaluate its performance via computer simulation.
According to the simulation results, the proposed scheme has (1) improved sys-tem capacity without a reduction in the performance of outage users and (2) lower power consumption and better performance than other approaches. The contributions are summarized as follows:
1. We address the insufficiencies of RPS and propose an algorithm to improve the system performance. RPS and ABS involve a trade-off between the av-erage capacity and the capacity of the edge UEs. The proposed algorithm improves both capacities at the same time. The goal of the proposed al-gorithm is to increase the capacity of macrocells without harming that of picocells.
2. The proposed algorithm is based on the interior point method. It is difficult to provide reliable design guidelines to make the method suitable for all types of problems. In this study, we customise the interior point method to
4.6 Concluding Remarks
provide a powerful algorithm and provide the optimality and convexity of the proposed algorithm.
3. From the simulation results, we find many advantages via the proposed ap-proaches. First, the spectrum utilisation is greater with MTS than with the ABS scheme. Second, we increase the capacity of MBSs without harming the performance of PBSs. Third, from the viewpoint of green communica-tion, we save a great deal of power compared to other approaches. Finally, we reduce the latency of real-time traffic in MBSs compared to ABS scheme.
Chapter 5 Conclusion
It is forecasted that at least a 100× network capacity increase will be required to meet the traffic demands in 2020. As a result, vendors and operators are now looking at using every tool at hand to improve network capacity. Increasing the network densification is considered at the most workable solution to meet the requirements. Therefore, the so called heterogeneous networks which contain traditional macrocells and small cells is used to increase the network densification efficiently. Small cells, such as femtocell, picocell and relay nodes, are used to increase the network capacity and make up the insufficiency of macrocells. This dissertation focuses on the issue on relay node and picocells. For the relay node, we propose a relay node assignment algorithm called ”Decentralized Learning based Relay Assignment” (DLRA) to performance relay node selection in cooper-ative communication. There are several advantages in DLRA: (1) DLRA is a fully decentralized approach; (2) the selection procedure in only based on existing envi-ronmental feedback; (3) Comprehensive mathematical analysis and performance manipulation are provided. On the other hand, we mitigate the interference between macrocells and picocells, and propose an approach called ”Multi-Tone
insufficiency of ABS and RPS: it increases the capacity of macrocells without harming the performance of the picocells since ABS and RPS are trade-off be-tween them. We give an simple example to show the efficient of the proposed approach. Besides, the optimality and the complexity of the proposed approach are also provide in the dissertation. For both relay assignment and interference mitigation problem, we give simulation results to show the both approaches out-perform other approaches.
Bibliography
[1] Qualcom, “”the 1000x mmobile data challenge: More sspec-trum, more small ccell, more indoor ccell and higher efficiency”,”
http://www.qualcomm.com/. 1
[2] X. Chu, D. L. L.-P. Yang, and F. Gunnarsson, “Heterogeneous Cellular Net-works: heory, Simulation and Deployment,” University Cambridge Press, 2013. 1
[3] H. Claussen, L. T. W. Ho, and L. G. Samuel, “An Overview of the Femtocell Concept,” Bell Labs Technical Journal, vol. 13, no. 1, pp. 221–245, 2008.
1,3
[4] V. Chandrasekhar, J. G. Andrews, and A. Ga, “Femtocell Networks: A Survey,” IEEE Communications Maga, vol. 46, no. 9, pp. 59–67, 2008. 1, 3 [5] J. Andrews, H. Claussen, M. Dohler, S. Rangan, and M. Reed, “Femtocells:
Past, present, and future,” IEEE Journal on Selected Areas in Communi-cations, vol. 30, no. 3, pp. 497–508, April. 1
[6] 3GPP TR 36.808, “Evolved Universal Terrestrial Radio Access (E-UTRA);
Carrier Aggregation; Base Station (BS) radio transmission and reception,”
2013. 1
[7] 3GPP TR 36.889, “Feasibility Study on Licensed-Assisted Access to Unli-censed Spectrum,” 2014. 1
[8] T. S. Rappaport, R. W. H. Jr., R. C. Daniels, and J. N. Murdock, “Mil-limeter Wave Wireless Communications,” Prentice Hall, 2014. 1
LTE, WiFi and WiMAX: Coherent versus Non-coherent and Cooperative Turbo Transceivers,” John Wiley & Sons Ltd, 2011. 2
[10] M. D. Hanwen, “Muulti-point Cooperative Communication Systems: The-ory and Applications,” Springer, 2013. 2
[11] Z. S. Khoyaev and E. E. E. Pan, “Dynamic uplink-downlink configuration and interference managemnt in TD-LTE,” IEEE Communications Maga-zine, vol. 50, pp. 51–59, 2012. 2
[12] M. Ding, D. Lopez-Perez, and W. C. C. Vasilakos, “Dynamic TDD TTrans-mission in Homogeneous Small Cell Networks,” IEEE International Con-ference on Communications (ICC), 2014. 2, 13
[13] Webb, “Wireless Communications: Is the Future Playing Out as Pre-dicted?” International Journal of Interdisciplinary Telecommunications and Networking, vol. 1, 2009. 2
[14] Cisco, “Cisco visula networking index: Global mobile data traffic forecast update, 2014 – Global Mobile Data TTraffic Forecast Update, 2014–2019,”
White Paper, 2015. 3
[15] A. Damnjanovic, J. Montojo, Y. Wei, T. Ji, T. Luo, M. Vajapeyam, T. Yoo, O. Song, and D. Malladi, “A survey on 3GPP heterogeneous networks,”
IEEE Wireless Communications, vol. 18, no. 3, pp. 10 –21, June 2011. 3, 58
[16] D. Lopez-Perez, I. Guvenc, G. de la Roche, M. Kountouris, T. Q. S. Quek, and Z. Jie, “Enhanced Inter-Cellell Interference Coordination Challenges in Heterogeneous Networks,” IEEE Wireless Communications, vol. 18, no. 3, pp. 22–30, 2011. 3, 58
[17] S. C. Forum, “Small Cell Market Status Dec 2012,” White paper, 2012. 3 [18] D. Lopez-Perez, A. Valcarce, G. de la Roche, and J. Zhang, “OFDMA
femtocells: A roadmap on interference avoidance,” IEEE Communications Magazine, vol. 47, no. 9, pp. 41–48, September 2009. 3
BIBLIOGRAPHY
[19] D. Lopez-Perez, X. Chu, and I. Guvenc, “On the Expanded Region of Picocells in Heterogeneous Networks,” IEEE Journal of Selected Topics in Signal Processing, vol. 6, no. 3, pp. 281 –294, June 2012. 3, 11
[20] 3GPP TS 36.300, “Evolved Universal Terrestrial Radio Access (E-UTRA):
Further Advancements for E-UTRA Physical Layer Aspects,” Technical Specification Group Radio Access Network, April 2010. 5,60
[21] E. C. V. D. Meulen, “Three terminal communication channels,” Advanced in Applied Probability, vol. 3, pp. 120–154, 1971. 7
[22] T. Cover and A. Gamal, “Capacity theorems for the relay channel,” IEEE Transactions on Information Theory, vol. 25, no. 5, pp. 572–584, 1979. 7 [23] Y. Zhao, R. Adve, and T. J. Lim, “Improving amplify-and-forward relay
networks: optimal power allocation versus selection,” IEEE Transactions on Wireless Communications, vol. 6, no. 8, pp. 3114–3123, 2007. 7, 15 [24] Y. Yang, H. Hu, J. Xu, and G. Mao, “Relay technologies for WiMax and
LTE-advanced mobile systems,” IEEE Communications Magazine, vol. 47, no. 10, pp. 100–105, 2009. 7
[25] Y. Jing and H. Jafarkhani, “Single and multiple relay selection schemes and their achievable diversity orders,” IEEE Transactions on Wireless Commu-nications, vol. 8, no. 3, pp. 1414–1423, 2009. 7
[26] D. Yang, X. Fang, and G. Xue, “HERA: An Optimal Relay Assignment Scheme for Cooperative Networks,” IEEE Journal on Selected Areas in Communications, vol. 30, no. 2, pp. 245–253, 2012. 8
[27] X. Zhang, A. Ghrayeb, and M. Hasna, “On relay assignment in network-coded cooperative systems,” IEEE Transactions on Wireless Communica-tions, vol. 10, no. 3, pp. 868–876, 2011. 8
[28] P. Li, S. Guo, W. Zhuang, and B. Ye, “Capacity Maximization in Coop-erative CRNs: Joint Relay Assignment and Channel Allocation,” in IEEE ICC, June 2012, pp. 6619–6623. 8
work coding in relay-based imt-advanced systems,” IEEE Communications Magazine, vol. 50, no. 4, pp. 76–84, 2012. 8
[30] C. Fragouli, D. Katabi, A. Markopoulou, M. Medard, and H. Rahul, “Wire-less Network Coding: Opportunities & Challenges,” in IEEE Military Com-munications Conference, 2007., 2007, pp. 1–8. 8
[31] N. Linh-Trung, V. N. Q. Bao, P. Duhamel, and M. Debbah, “Challenging issues in multimedia transmission over wireless networks based on network coding,” in 2012 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), 2012, pp. 000 124–000 128. 8
[32] J. Cai, X. Shen, J. W. Mark, and A. Alfa, “Semi-distributed user relaying algorithm for amplify-and-forward wireless relay networks,” IEEE Trans-actions on Wireless Communications, vol. 7, no. 4, pp. 1348–1357, 2008. 8, 9,16
[33] Y. Shi, S. Sharma, Y. T. Hou, and S. Kompella, “Optimal Relay Assign-ment for Cooperative Communications,” in Proceedings of the 9th ACM in-ternational symposium on Mobile ad hoc networking and computing. Hong Kong, Hong Kong, China: ACM, 2008, pp. 3–12. 8
[34] Y. Li, B. Vucetic, Z. Zhou, and M. Dohler, “Distributed adaptive power al-location for wireless relay networks,” IEEE Transactions on Wireless Com-munications, vol. 6, no. 3, pp. 948–958, 2007. 8
[35] M. Chen, S. Serbetli, and A. Yener, “Distributed power allocation strategies for parallel relay networks,” IEEE Transactions on Wireless Communica-tions, vol. 7, no. 2, pp. 552–561, 2008. 8
[36] S. Kadloor and R. Adve, “Relay selection and power allocation in cooper-ative cellular networks,” IEEE Transactions on Wireless Communications, vol. 9, no. 5, pp. 1676–1685, 2010. 8
BIBLIOGRAPHY
[37] R. Madan, N. Mehta, A. Molisch, and J. Zhang, “Energy-efficient coop-erative relaying over fading channels with simple relay selection,” IEEE Transactions on Wireless Communications, vol. 7, no. 8, pp. 3013–3025, 2008. 8
[38] C. Y. Lee and G. Hwang, “Fair and minimal power allocation in a two-hop relay network for qos support,” IEEE Transactions on Wireless Communi-cations, vol. 10, no. 11, pp. 3864–3873, 2011. 8
[39] S. Mallick, M. Rashid, and V. Bhargava, “Joint relay selection and power allocation for decode-and-forward cellular relay network with channel un-certainty,” IEEE Transactions on Wireless Communications, vol. 11, no. 10, pp. 3496–3508, 2012. 8
[40] T. Guo and R. Carrasco, “Crbar: Cooperative relay-based auto rate mac for multirate wireless networks,” IEEE Transactions on Wireless Commu-nications, vol. 8, no. 12, pp. 5938–5947, 2009. 8
[41] N. Yi, Y. Ma, and R. Tafazolli, “Joint rate adaptation and best-relay selec-tion using limited feedback,” IEEE Transacselec-tions on Wireless Communica-tions, vol. 12, no. 6, pp. 2797–2805, 2013. 8
[42] M. Abouelseoud and A. Nosratinia, “Heterogeneous relay selection,” IEEE Transactions on Wireless Communications, vol. 12, no. 4, pp. 1735–1743, 2013. 8
[43] S. Sharma, Y. Shi, Y. Hou, and S. Kompella, “An optimal algorithm for relay node assignment in cooperative ad hoc networks,” IEEE/ACM Trans-actions on Networking, vol. 19, no. 3, pp. 879–892, 2011. 8, 15, 17,40, 41, 42
[44] D. Yang, X. Fang, and G. Xue, “OPRA: Optimal Relay Assignment for Capacity Maximization in Cooperative Networks,” in 2011 IEEE Interna-tional Conference on Communications (ICC), 2011, pp. 1–6. 8,15
[45] 3GPP TR 36.839, “Evolved Universal Terrestrial Radio Access (E-UTRA);
Mobility Enhancements in Heterogeneous Networks.” V 11.1.0, 2012.
Power,” Pana, 2011. 9, 10
[47] 3GPP R1-113118, “Performance Evaluation of CEll Range Expansion in Combination with ABS Ratio Optimization,” Panaso, 2011. 9
[48] M. Simsek, M. Bennis, and I. Guvenc, “Learning Based Frequency- and Time-Domain Inter-Cell Interference Coordination in HetNets,” IEEE Transactions on Vehicular Technology, vol. PP, no. 99, pp. 1–1, 2014. 9 [49] 3GPP R1-104968, “New work item proposal: EEnhanced ICIC for non-CA
Based Deployments of Heterogeneous Networks for LTE,” CMCC, 2010. 10 [50] 3GPP TS 36.133, “Evolved Universal Terrestrial Radio Access (E-UTRA);
Requirements for support of radio resource management.” V 11.4.0, 2013.
11
[51] A. Morimoto, N. Miki, and Y. Okumura, “Investigation of Cell Inter-ference Coordination Applying Transmission Power Reduction in Hetero-geneous Networks for LTE-Advanced Downlink,” IEICE Transactions on Communications, vol. E96-B, no. 6, pp. 1327–1337, 2013. 11
[52] I. Guvenc, M.-R. Jeong, I. Demirdogen, B. Kecicioglu, and F. Watanabe,
“Range Expansion and Inter-Cell Interference Coordination (ICIC) for Pic-ocell Networks,” in 2011 IEEE Vehicular Technology Conference (VTC Fall), Sept 2011, pp. 1–6. 11
[53] S. Brueck, “Heterogeneous networks in LTE-Advanced,” in 2011 8th Inter-national Symposium on Wireless Communication Systems (ISWCS), Nov 2011, pp. 171–175. 11
[54] R. Madan, J. Borran, A. Sampath, N. Bhushan, A. Khandekar, and T. Ji,
“Cell Association and Interference Coordination in Heterogeneous LTE-A Cellular Networks,” IEEE Journal on Selected Areas in Communications, vol. 28, no. 9, pp. 1479–1489, December 2010. 11
BIBLIOGRAPHY
[55] A. Damnjanovic, J. Montojo, J. Cho, H. Ji, J. Yang, and P. Zong, “UE’s role in LTE advanced heterogeneous networks,” IEEE Communications Maga-zine, vol. 50, no. 2, pp. 164–176, February 2012. 11
[56] S. Mukherjee and I. Guvenc, “Effects of Range Expansion and Interference Coordination on Capacity and Fairness in Heterogeneous Networks,” in 2011 Conference Record of the Forty Fifth Asilomar Conference on Signals, Systems and Computers (ASILOMAR), Nov 2011, pp. 1855–1859. 11 [57] M. Shirakabe, A. Morimoto, and N. Miki, “Performance Evaluation of
Inter-Cell Interference Coordination and Inter-Cell Range Expansion in Heterogeneous Networks for LTE-Advanced Downlink,” in 2011 8th International Sympo-sium on Wireless Communication Systems (ISWCS), Nov 2011, pp. 844–
848. 11
[58] A. Merwaday, S. Mukherjee, and I. Guvenc, “On the capacity analysis of HetNets with range expansion and eICIC,” in 2013 IEEE Global Commu-nications Conference (GLOBECOM), Dec 2013, pp. 4257–4262. 11
[59] ——, “HetNet capacity with reduced power subframes,” in 2014 IEEE Wireless Communications and Networking Conference (WCNC), April 2014, pp. 1380–1385. 11, 13, 61
[60] ——, “Capacity analysis of LTE-Advanced HetNets with reduced power subframes and range expansion,” EURASIP Journal on Wireless Commu-nications and Networking, vol. 189, 2014. 11, 13
[61] A. Simonsson, “Frequency Reuse and Intercell Interference Co-Ordination In E-UTRA,” in IEEE 65th Vehicular Technology Conference (VTC Spring), April 2007, pp. 3091 –3095. 13
[62] J. Ellenbeck, C. Hartmann, and L. Berlemann, “Decentralized inter-cell interference coordination by autonomous spectral reuse decisions,” in The 14th European Wireless Conference, June 2008, pp. 1 –7. 13
ponent Carrier Selection: Interference Management in Local Area Environ-ments for LTE-Advanced,” IEEE Communications Magazine, vol. 47, pp.
110 – 116, September 2009. 13
[64] L. G. U. Garcia, I. Z. Kovacs, K. I. Pedersen, G. W. O. da Costa, and P. E.
Mogensen, “Autonomous Component Carrier Selection for 4G Femtocells - A fresh look at an old problem,” IEEE Journal on Selected Areas in Communications, vol. 30, pp. 525 – 537, 2012. 13
[65] G. Costa, A. Cattoni, I. Kovacs, and P. Mogensen, “A fully distributed method for dynamic spectrum sharing in femtocells,” in IEEE Wireless Communications and Networking Conference Workshops (WCNCW), April 2012, pp. 87 –92. 13
[66] Z. Chen and T. Lin, “Stochastic Learning Automata Based Resource Allo-cation for LTE-Advanced Heterogeneous Networks,” in IEEE 24th Interna-tional Symposium on Personal Indoor and Mobile Radio Communications (PIMRC), 2013, pp. 1952–1956. 13,22
[67] I.-H. Wang and D. Tse, “Interference mitigation through limited receiver cooperation,” IEEE Transactions on Information Theory, vol. 57, no. 5, pp. 2913–2940, 2011. 13
[68] M. Cierny, W. Haining, R. Wichman, D. Zhi, and C. Wijting, “On Number of Almost Blank Subframes in Heterogeneous Cellular Networks,” IEEE Transactions on Wireless Communications, vol. 12, no. 10, pp. 5061–5073, 2013. 13
[69] S. Deb, P. Monogioudis, J. Miernik, and J. Seymour, “Algorithms for Enhanced Inter-Cell Interference Coordination (eICIC) in LTE HetNets,”
IEEE/ACM Transactions on Networking, vol. 22, no. 1, pp. 137–150, Feb 2014. 13
BIBLIOGRAPHY
[70] M. Vajapeyam, A. Damnjanovic, J. Montojo, T. Ji, Y. Wei, and D. Mal-ladi, “Downlink FTP Performance of Heterogeneous Networks for LTE-Advanced,” in 2011 IEEE International Conference on Communications Workshops (ICC), June 2011, pp. 1–5. 13
[71] D. Lopez-Perez and H. Claussen, “Duty cycles and load balancing in Het-Nets with eICIC almost blank subframes,” in 2013 IEEE 24th Interna-tional Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC Workshops), Conference Proceedings, pp. 173–178. 13
[72] B. Soret and K. Pedersen, “Macro transmission power reduction for HetNet co-channel deployments,” in 2012 IEEE Global Communications Confer-ence (GLOBECOM), Dec 2012, pp. 4126–4130. 13
[73] B. Soret and K. I. Pedersen, “Centralized and Distributed Solutions for Fast Muting Adaptation in LTE-Advanced HetNets,” IEEE Transactions on Vehicular Technology, vol. 64, no. 1, pp. 147–158, Jan 2015. 13
[74] A. Nosratinia, T. Hunter, and A. Hedayat, “Cooperative communication in wireless networks,” IEEE Communications Magazine, vol. 42, no. 10, pp.
74–80, 2004. 15
[75] J. Laneman, D. Tse, and G. W. Wornell, “Cooperative diversity in wireless networks: Efficient protocols and outage behavior,” IEEE Transactions on Information Theory, vol. 50, no. 12, pp. 3062–3080, 2004. 15, 18
[76] G. Li and H. Liu, “Resource allocation for ofdma relay networks,” in Confer-ence Record of the Thirty-Eighth Asilomar ConferConfer-ence on Signals, Systems and Computers, 2004., vol. 1, 2004, pp. 1203–1207 Vol.1. 15
[77] I. Maric and R. Yates, “Bandwidth and power allocation for cooperative strategies in gaussian relay networks,” in Conference Record of the Thirty-Eighth Asilomar Conference on Signals, Systems and Computers, 2004., vol. 2, 2004, pp. 1907–1911 Vol.2. 15
allocation,” in 11th IEEE Singapore International Conference on Commu-nication Systems, 2008, pp. 1609–1613. 15
[79] H. Wu, Y. Wang, C. Xiong, and D. Yang, “A novel relay selection scheme with simplified power allocation for wireless relay networks,” in IEEE Global Telecommunications Conference, 2009., 2009, pp. 1–5. 15
[80] F. Ke, S. Feng, and H. Zhuang, “Relay selection and power allocation for cooperative network based on energy pricing,” IEEE Communications Let-ters, vol. 14, no. 5, pp. 396–398, 2010. 15
[81] L. Song, “Relay selection for two-way relaying with amplify-and-forward protocols,” IEEE Transactions on Vehicular Technology, vol. 60, no. 4, pp.
1954–1959, 2011. 15
[82] F. He, Y. Sun, L. Xiao, X. Chen, C.-Y. Chi, and S. Zhou, “Capacity region bounds and resource allocation for two-way ofdm relay channels,” IEEE Transactions on Wireless Communications, vol. 12, no. 6, pp. 2904–2917, 2013. 15
[83] A. Bletsas, A. Khisti, D. Reed, and A. Lippman, “A simple cooperative di-versity method based on network path selection,” IEEE Journal on Selected Areas in Communications, vol. 24, no. 3, pp. 659–672, 2006. 16
[84] D. Gunduz and E. Erkip, “Outage minimization by opportunistic coopera-tion,” in 2005 International Conference on Wireless Networks, Communi-cations and Mobile Computing, vol. 2, 2005, pp. 1436–1442 vol.2. 16 [85] A. Barto and P. Anandan, “Pattern-recognizing stochastic learning
au-tomata,” IEEE Transactions on Systems, Man and Cybernetics, vol. SMC-15, no. 3, pp. 360–375, 1985. 16
[86] J. de Lope, D. Maravall, and Y. Quinonez, “Response thresh-old models and stochastic learning automata for self-coordination of heterogeneous multi-task distribution in multi-robot systems ,”
Robotics and Autonomous Systems, vol. 61, no. 7, pp. 714 – 720,
BIBLIOGRAPHY
2013, collective and Social Autonomous Robots. [Online]. Available:
http://www.sciencedirect.com/science/article/pii/S092188901200111X 16 [87] R. S. Sutton and A. G. Barto, Reinforcement Learning : An Introduction.
MIT Press, Cambridge, MA , 1998. 21
[88] L. P. Kaelbing, M. L. Littman, and A. W. Moore, “Reinforcement Learning : A survey,” Journal on Artificial Intelligence Research, 1996. 22
[89] T. Joshi, D. Ahuja, D. Singh, and D. Agrawal, “Sara: Stochastic automata rate adaptation for ieee 802.11 networks,” IEEE Transactions on Parallel and Distributed Systems, vol. 19, no. 11, pp. 1579–1590, 2008. 22
[90] Y. Xu, J. Wang, Q. Wu, A. Anpalagan, and Y.-D. Yao, “Opportunistic Spectrum Access in Unknown Dynamic Environment: A Game-Theoretic Stochastic Learning Solution,” IEEE Transactions on Acoustics Speech and Signal ProcessingWireless Communications, vol. 11, no. 4, pp. 1380–1391, 2012. 22
[91] G. I. Papadimitriou, “A new approach to the design of reinforcement schemes for learning automata: stochastic estimator learning algorithms,”
IEEE Transactions on Knowledge and Data Engineering, vol. 6, no. 4, pp.
649–654, August 1994. 24
[92] J. Jacod and A. N. Shiryaev, Limit theorems for stochastic processes.
Springer, 1987. 29
[93] B. Oommen and J. Lanctot, “Discretized pursuit learning automata,” IEEE Transactions on Systems, Man and Cybernetics, vol. 20, no. 4, pp. 931–938,
[93] B. Oommen and J. Lanctot, “Discretized pursuit learning automata,” IEEE Transactions on Systems, Man and Cybernetics, vol. 20, no. 4, pp. 931–938,