Chapter 5: Closing
5.2. Future Work
In future work, the plan is removing instance segmentation of floor detection part with extending to a deep reinforcement learning algorithm that adding a raw image from the robot camera as an additional state. Therefore, the agent can differentiate the offset value CoB based on types of surfaces directly and act more robustly. Also, X implementing the dynamic inverse kinematic grasping point technique based on LiDAR point cloud data should be further studied. On the whole, broaden the dragging large and heavy object into pulling and pushing large and heavy objects as well.
Bibliographies
[1] K. Tanie, "Humanoid robot and its application possibility," in Proceedings of IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, MFI2003., 2003, pp. 213-214.
[2] A. Choudhury, H. Li, C. Greene, and S. Perumalla, "Humanoid Robot-Application and Influence," arXiv preprint arXiv:1812.06090, 2018.
[3] S. Kajita, H. Hirukawa, K. Harada, and K. Yokoi, Introduction to humanoid robotics. Springer, 2014.
[4] T. Takubo, K. Inoue, and T. Arai, "Pushing an Object Considering the Hand Reflect Forces by Humanoid Robot in Dynamic Walking," in Proceedings of the 2005 IEEE International Conference on Robotics and Automation, Barcelona, Spain, Spain, 2005, pp. 1706-1711.
[5] N. Motoi, M. Ikebe, and K. Ohnishi, "Real-Time Gait Planning for Pushing Motion of Humanoid Robot," IEEE Transactions on Industrial Informatics, vol.
3, no. 2, pp. 154-163, 2007.
[6] D. Omrčen, C. Böge, T. Asfour, A. Ude, and R. Dillmann, "Autonomous acquisition of pushing actions to support object grasping with a humanoid robot,"
in 2009 9th IEEE-RAS International Conference on Humanoid Robots, 2009, pp.
277-283.
[7] S. Nozawa, Y. Kakiuchi, K. Okada, and M. Inaba, "Controlling the planar motion of a heavy object by pushing with a humanoid robot using dual-arm force control," in 2012 IEEE International Conference on Robotics and Automation, 2012, pp. 1428-1435.
[8] M. Murooka, S. Nozawa, Y. Kakiuchi, K. Okada, and M. Inaba, "Whole-body pushing manipulation with contact posture planning of large and heavy object for humanoid robot," in 2015 IEEE International Conference on Robotics and Automation (ICRA), 2015, pp. 5682-5689.
[9] K. Harada et al., "A Humanoid Robot Carrying a Heavy Object," in Proceedings of the 2005 IEEE International Conference on Robotics and Automation, Barcelona, Spain, Spains, 2005, pp. 1712-1717.
[10] J. C. Vaz, H. Lee, Y. Jun, and P. Oh, "Towards tasking humanoids for lift-and-carry non-rigid material," in 2017 14th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI), 2017, pp. 316-321.
[11] Y. Ohmura and Y. Kuniyoshi, "Humanoid robot which can lift a 30kg box by whole body contact and tactile feedback," in 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, San Diego, CA, USA, 2007, pp.
1136-1141.
[12] A. Laurenzi, D. Kanoulas, E. M. Hoffman, L. Muratore, and N. G. Tsagarakis,
"Whole-Body Stabilization for Visual-Based Box Lifting with the COMAN+
Robot," in 2019 Third IEEE International Conference on Robotic Computing (IRC), Naples, Italy, Italy, 2019, pp. 445-446.
[13] M. De Looze, K. Van Greuningen, J. Rebel, I. Kingma, and P. Kuijer, "Force direction and physical load in dynamic pushing and pulling," Ergonomics, vol.
43, no. 3, pp. 377-390, 2000.
76
[14] A. Argubi-Wollesen, B. Wollesen, M. Leitner, and K. Mattes, "Human body mechanics of pushing and pulling: analyzing the factors of task-related strain on the musculoskeletal system," Safety and health at work, vol. 8, no. 1, pp. 11-18, 2017.
[15] D. Torricelli et al., "Human-like compliant locomotion: state of the art of robotic implementations," Bioinspiration & biomimetics, vol. 11, no. 5, p. 051002, 2016.
[16] K. Harada, S. Kajita, K. Kaneko, and H. Hirukawa, "Dynamics and balance of a humanoid robot during manipulation tasks," IEEE Transactions on Robotics, vol.
22, no. 3, pp. 568-575, 2006.
[17] J. Yang, S. Ogawa, T. Tsujita, S. Komizunai, and A. Konno, "Massive object transportation by a humanoid robot," IFAC-PapersOnLine, vol. 51, no. 22, pp.
250-255, 2018.
[18] F. Abi-Farraj, B. Henze, C. Ott, P. R. Giordano, and M. A. Roa, "Torque-Based Balancing for a Humanoid Robot Performing High-Force Interaction Tasks,"
IEEE Robotics and Automation Letters, vol. 4, no. 2, pp. 2023-2030, 2019.
[19] E. Yoshida, P. Blazevic, V. Hugel, K. Yokoi, and K. Harada, "Pivoting a large object: whole-body manipulation by a humanoid robot," Applied Bionics and Biomechanics, vol. 3, no. 3, pp. 227-235, 2006.
[20] E. Yoshida et al., "Motion planning for whole body tasks by humanoid robot," in IEEE International Conference Mechatronics and Automation, 2005, Niagara Falls, Ont., Canada, 2005, vol. 4, pp. 1784-1789: IEEE.
[21] M. Stilman, K. Nishiwaki, and S. Kagami, "Humanoid teleoperation for whole body manipulation," in 2008 IEEE International Conference on Robotics and Automation, Pasadena, CA, USA, 2008, pp. 3175-3180: IEEE.
[22] M. Stilman, K. Nishiwaki, and S. Kagami, "Learning object models for whole body manipulation," in 2007 7th IEEE-RAS International Conference on Humanoid Robots, 2007, pp. 174-179.
[23] E. Berger, "Friction modeling for dynamic system simulation," Applied Mechanics Reviews, vol. 55, no. 6, pp. 535-577, 2002.
[24] J. Woodhouse, T. Putelat, and A. McKay, "Are there reliable constitutive laws for dynamic friction?," Philosophical Transactions of the Royal Society A:
Mathematical, Physical and Engineering Sciences, vol. 373, no. 2051, p.
20140401, 2015.
[25] S. Kim, S. Hong, and D. Kim, "A walking motion imitation framework of a humanoid robot by human walking recognition from IMU motion data," in 2009 9th IEEE-RAS International Conference on Humanoid Robots, 2009, pp. 343-348.
[26] B. Hengst, M. Lange, and B. White, "Learning ankle-tilt and foot-placement control for flat-footed bipedal balancing and walking," in 2011 11th IEEE-RAS International Conference on Humanoid Robots, 2011, pp. 288-293.
[27] J. Lin, K. Hwang, W. Jiang, and Y. Chen, "Gait Balance and Acceleration of a Biped Robot Based on Q-Learning," IEEE Access, vol. 4, pp. 2439-2449, 2016.
[28] W. Wu and L. Gao, "Posture self-stabilizer of a biped robot based on training platform and reinforcement learning," Robotics and Autonomous Systems, vol.
98, pp. 42-55, 2017.
[29] K. Hwang, W. Jiang, Y. Chen, and H. Shi, "Motion Segmentation and Balancing for a Biped Robot's Imitation Learning," IEEE Transactions on Industrial Informatics, vol. 13, no. 3, pp. 1099-1108, 2017.
[30] X. Wu, S. Liu, T. Zhang, L. Yang, Y. Li, and T. Wang, "Motion Control for Biped Robot via DDPG-based Deep Reinforcement Learning," in 2018 WRC Symposium on Advanced Robotics and Automation (WRC SARA), 2018, pp. 40-45.
[31] C.-C. Wong, C.-C. Liu, S.-R. Xiao, H.-Y. Yang, and M.-C. Lau, "Q-Learning of Straightforward Gait Pattern for Humanoid Robot Based on Automatic Training Platform," Electronics, vol. 8, no. 6, p. 615, 2019.
[32] M. Nakada, B. Allen, S. Morishima, and D. Terzopoulos, "Learning Arm Motion Strategies for Balance Recovery of Humanoid Robots," in 2010 International Conference on Emerging Security Technologies, 2010, pp. 165-170.
[33] S. Yi, B. Zhang, D. Hong, and D. D. Lee, "Online learning of a full body push recovery controller for omnidirectional walking," in 2011 11th IEEE-RAS International Conference on Humanoid Robots, 2011, pp. 1-6.
[34] D. Luo, X. Han, Y. Ding, Y. Ma, Z. Liu, and X. Wu, "Learning push recovery for a bipedal humanoid robot with Dynamical Movement Primitives," in 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), 2015, pp. 1013-1019.
[35] P. Mendez-Monroy, "Walking motion generation and neuro-fuzzy control with push recovery for humanoid robot," Int. J. Comput. Commun., vol. 12, no. 3, pp.
330-346, 2017.
[36] H. Kim, D. Seo, and D. Kim, "Push Recovery Control for Humanoid Robot Using Reinforcement Learning," in 2019 Third IEEE International Conference on Robotic Computing (IRC), 2019, pp. 488-492.
[37] P. Beeson and B. Ames, "TRAC-IK: An open-source library for improved solving of generic inverse kinematics," in 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), 2015, pp. 928-935.
[38] J.-Y. Kim, I.-W. Park, and J.-H. Oh, "Walking Control Algorithm of Biped Humanoid Robot on Uneven and Inclined Floor," Journal of Intelligent and Robotic Systems, vol. 48, no. 4, pp. 457-484, 2007/04/01 2007.
[39] M. Vukobratović and B. Borovac, "Zero-moment point—thirty five years of its life," International journal of humanoid robotics, vol. 1, no. 01, pp. 157-173, 2004.
[40] J. Darrell, J. Long, and E. Shelhamer, "Fully Convolutional Networks for Semantic Segmentation," IEEE T PATTERN ANAL, vol. 39, no. 4, 2014.
[41] S. Ren, K. He, R. Girshick, and J. Sun, "Faster r-cnn: Towards real-time object detection with region proposal networks," in Advances in neural information processing systems, 2015, pp. 91-99.
[42] W. Liu et al., "Ssd: Single shot multibox detector," in European conference on computer vision, 2016, pp. 21-37: Springer.
[43] J. Redmon and A. Farhadi, "Yolov3: An incremental improvement," arXiv preprint arXiv:1804.02767, 2018.
[44] K. He, G. Gkioxari, P. Dollár, and R. Girshick, "Mask R-CNN," in 2017 IEEE International Conference on Computer Vision (ICCV), 2017, pp. 2980-2988.
78
[45] Y. Li, H. Qi, J. Dai, X. Ji, and Y. Wei, "Fully Convolutional Instance-Aware Semantic Segmentation," in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 4438-4446.
[46] D. Bolya, C. Zhou, F. Xiao, and Y. J. Lee, "YOLACT: Real-Time Instance Segmentation," in 2019 IEEE/CVF International Conference on Computer Vision (ICCV), 2019, pp. 9156-9165.
[47] C. R. Qi, H. Su, K. Mo, and L. J. Guibas, "Pointnet: Deep learning on point sets for 3d classification and segmentation," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 652-660.
[48] C. J. C. H. Watkins and P. Dayan, "Q-learning," Machine Learning, vol. 8, no. 3, pp. 279-292, 1992/05/01 1992.
[49] V. Mnih et al., "Human-level control through deep reinforcement learning,"
Nature, vol. 518, no. 7540, p. 529, 2015.
[50] H. Mao, M. Alizadeh, I. Menache, and S. Kandula, "Resource management with deep reinforcement learning," in Proceedings of the 15th ACM Workshop on Hot Topics in Networks, 2016, pp. 50-56.
[51] ROBOTIS Inc. (December 19). THORMANG3 Full size open platform humanoid.
Available: http://en.robotis.com/model/page.php?co_id=prd_thormang3#
[52] D. Maturana and S. Scherer, "Voxnet: A 3d convolutional neural network for real-time object recognition," in 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany, 2015, pp. 922-928:
IEEE.
[53] V. Hegde and R. Zadeh, "Fusionnet: 3d object classification using multiple data representations," arXiv preprint arXiv:1607.05695, 2016.
[54] X.-F. Han, J. Jin, M.-J. Wang, W. Jiang, L. Gao, and L. Xiao, "A review of algorithms for filtering the 3D point cloud," Signal Processing: Image Communication, vol. 57, 05/01 2017.
[55] B. Chakraborty, B. Shaw, J. Aich, U. Bhattacharya, and S. K. Parui, "Does Deeper Network Lead to Better Accuracy: A Case Study on Handwritten Devanagari Characters," in 2018 13th IAPR International Workshop on Document Analysis Systems (DAS), 2018, pp. 411-416.
[56] K. He, X. Zhang, S. Ren, and J. Sun, "Deep residual learning for image recognition. CoRR abs/1512.03385 (2015)," ed, 2015.
[57] M. Vukobratovic and B. Borovac, "Zero-Moment Point - Thirty Five Years of its Life," I. J. Humanoid Robotics, vol. 1, pp. 157-173, 03/01 2004.
[58] S. Kajita et al., Biped walking pattern generation by using preview control of zero-moment point. 2003, pp. 1620-1626 vol.2.
Autobiography
Hanjaya Mandala received his B. App. Sc degree in Mechatronic Engineering Study Program of Electrical Engineering from Polytechnic State Batam, Indonesia in August 2017. After graduation, he has worked for one year at Epson company as an electrical designer in the factory automation department. He is in charge of designing electrical and programming automation machines. Then in August 2018, he continues his Master's Degree in the Electrical Engineering Department at the National Taiwan Normal University and joined the Educational Robotics Centre laboratory which focused on humanoid robots. He has been worked on the humanoid kid-size robots since 2014 and has obtained 3rd places at RoboCup 2018 kid-size humanoid robot competitions. Also, three-rows of 1st place at Indonesia National Humanoid Robot Competitions. His research interest includes robotics, computer vision, and artificial intelligence.
80
Academic Achievement
1. H. Mandala, S. Saeedvand, and J. Baltes, "Synchronous Dual-Arm Manipulation by Adult-Sized Humanoid Robot," in 2020 International Conference on Advanced Robotics and Intelligent Systems (ARIS), (accepted)
2. IEEE/RSJ IROS 2019 (Macau) - 1st Place Humanoid Robot Application Challenge.
3. Iran FIRA RoboWorldCup Open 2019 (Iran) - 1st Place all-round HuroCup Kid-size Humanoid.
4. International Intelligent RoboSports Competition 2020 (Taiwan) - 1st Place HuroCup Kid-size Humanoid Sprint & Marathon.