Multi-Approach Integrated To Lumen Robot Friend On A Mission In For Emergency Respond

Sukoco A, Marzuki Marzuki


As a social robot, a mission to find and locate objects in for evacuated of disaseter is the ability to be possessed by Lumen Robot Friend (LRF). The robot can easily become a friend and help human’s activity especially for emergency respond. Complexity in an uncertain environment from emergency, LRF is difficult to find the object that requires a scenario that involves a lot of approaches. LRF's mission is the process of completion of the mission for helping human’s activity, through the incorporation the capabilities of Face Recognition, Sign and Text recognition, gesture recognition, and object recognition of LRF in an uncertain environment, then the goals can be achieved. The focus of this research is to develop the ability to recognize the LRF, understand commands through gesture and text, search for the path based on directions, and determine a rational action and finally the object can be founded and given to the right person


NAO, Intellegence Agent, Machine Vission

Full Text:



L. Ismail, S. Shamsuddin, H. Hashim, S. Bahari, and A. Jaafar, “Face Detection Technique of

Humanoid Robot NAO for Application in Robotic Assistive Therapy,” 2011, pp. 517–521.

Q. Li, U. Niaz, and B. Merialdo, “An improved algorithm on Viola-Jones object detector,” in

Proceedings - International Workshop on Content-Based Multimedia Indexing, 2012, pp. 55–

S. Agrawal and P. Khatri, “Facial Expression Detection Techniques: Based on Viola and Jones

Algorithm and Principal Component Analysis,” in 2015 Fifth International Conference on

Advanced Computing & Communication Technologies, 2015, pp. 108–112.

P. Viola and M. Jones, “Robust real-time face detection,” Int. J. Comput. Vis., vol. 57, no. 2, pp.

–154, 2004.

P. Viola and M. Jones, “Rapid object detection using a boosted cascade of simple features,” Proc.

IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognition. CVPR 2001, vol. 1, 2001.

R. Kolar, Akshay Thakar, and M. Shabad, “Image Segmentation for Text Recognition using

Boundary,” Int. J. Emerg. Technol. Adv. Eng., vol. 4, no. 2, pp. 294–298, 2014.

Y. Zhu, C. Yao, and X. Bai, “Scene Text Detection and Recognition : Recent Advances and Future

Trends,” Front. Comput. Sci., 2014.

Q. Ye, D. Doermann, and S. Member, “Text Detection and Recognition in Images and Video : a

Survey,” vol. 8828, no. c, pp. 1–20, 2014.

T. A. Pham, M. Delalandre, and S. Barrat, “A contour-based method for logo detection,” in

Proceedings of the International Conference on Document Analysis and Recognition, ICDAR,

, pp. 718–722.

K. R. Soumya, A. Babu, and L. Therattil, “License Plate Detection and Character Recognition

Using Contour Analysis,” vol. 3, no. 1, pp. 15–18, 2014.

C.- Gubbi, “Automatic Tracking of Traffic Signs Based on HSV,” Int. J. Eng. Res. Technol., vol.

, no. 5, pp. 914–917, 2014.

Y. Chen, “Detection and Recognition of Traffic Signs Based on HSV Vision Model and Shape

features,” J. Comput., vol. 8, no. 5, pp. 1366–1370, 2013.

O. Topcu, “Adaptive decision making in agent-based simulation,” Simul. Trans. Soc. Model.

Simul. Int., vol. 90, no. 7, pp. 815–832, 2014.

S. Isci, O. Topcu, and L. Yilmas, “Extending the Jadex Framework with Coherence- Driven

Adaptive Agent Decision-Making Model,” in 2014 IEEE/WIC/ACM International Joint

Conferences on Web Intelligence (WI) and Intelligence Agent Technologies (IAT), 2014, pp.


H. Zhou, A. Mian, L. Wei, D. Creighton, and M. Hossny, “Recent Advances on Singlemodal and

Multimodal Face Recognition : A Survey,” IEEE Trans. Human-Machine Syst., vol. 44, no. 6,

pp. 701–716, 2014.

A. Özdil and metin mete Obilen, “A Survey on Comparison of Face Recognition Algorithms,” in

th International Conference on Application of Information and Communication Technologies,

, pp. 249–251.

M. N. M. Yawale, “Face Detection and Recognition Using Eigen Faces by Using PCA,” Int. J.

Technol. Appl., vol. 4, no. 1, pp. 84–87, 2013.

L. C. Paul and A. Al Sumam, “Face Recognition Using Principal Component Analysis Method,”

vol. 1, no. 9, pp. 135–139, 2012.

Q. Ye and D. Doermann, “Text Detection and Recognition in Images and Video : a Survey,”

IEEE Trans. Pattern Anal. Mach. Intell., vol. 8828, no. c, pp. 1–20, 2014.

C. Yao, X. Bai, and W. Liu, “A Unified Framework for Multioriented Text Detection and

Recognition,” IEEE Trans. Image Process., vol. 23, no. 11, pp. 4737–4749, 2014.

F. Ren, J. Huang, R. Jiang, and R. Klette, “General traffic sign recognition by feature matching,”

24th Int. Conf. Image Vis. Comput. New Zeal., no. Ivcnz, pp. 409–414, 2009.

H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool, “Speeded-Up Robust Features ( SURF ),” no.

September, 2008.

A. Hajraoui and M. Sabri, “Face Detection Algorithm based on Skin Detection, Watershed

Method and Gabor Filters.,” Int. J. Comput. Appl., vol. 94, no. 6, pp. 33–39, 2014.

S. Russel and P. Norvig, Artificial Intelligence A Modern Approach, Third Edit. Pearson

Education Inc., 2003.

N. K. Lincoln, S. M. Veres, L. A. Dennis, and M. Fisher, “Autonomous Asteroid Exploration by

Rational Agents,” IEEE Computational Intelligence Magazine, no. November, pp. 25–38,

S. Sardi and S. Shapiro, “Rational Action in Agent Programs with Prioritized Goals,” in

AAMAS, 2003, pp. 417–424.

B. Jalilian and A. Chalechale, “Face and Hand Shape Segmentation Using Statistical Skin

Detection for Sign Language Recognition,” vol. 1, no. 3, pp. 196–201, 2013.

S. Mandvikar, “Augmented Reality USing Countour Analysis In e-Learning,” Internatioanl J.

Innov. Res. Sci. Eng. Technol., vol. 2, no. 5, pp. 1591–1595, 2013.


  • There are currently no refbacks.

International Conference on Engineering and Technology Development (ICETD)
Bandar Lampung University
ISSN: 2301-5690