{"id":24649,"date":"2025-05-08T09:52:14","date_gmt":"2025-05-08T02:52:14","guid":{"rendered":"https:\/\/stei.itb.ac.id\/?p=24649"},"modified":"2025-05-08T10:12:00","modified_gmt":"2025-05-08T03:12:00","slug":"algoritma-fusi-multimodal-dan-sistem-dialog-berbasis-reinforcement-learning-dalam-interaksi-manusia-mesin","status":"publish","type":"post","link":"https:\/\/stei.itb.ac.id\/en\/algoritma-fusi-multimodal-dan-sistem-dialog-berbasis-reinforcement-learning-dalam-interaksi-manusia-mesin\/","title":{"rendered":"Multimodal Fusion Algorithm and Reinforcement Learning-Based Dialogue System in Human-Machine Interaction"},"content":{"rendered":"<div class=\"wpb-content-wrapper\"><div class=\"fullwidth\" ><div class=\"vc_row wpb_row vc_row-fluid vc_custom_1746667130109\"><div class=\"wpb_column vc_column_container vc_col-sm-12\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\">\n\t<div class=\"wpb_text_column wpb_content_element\" >\n\t\t<div class=\"wpb_wrapper\">\n\t\t\t<p><span style=\"font-weight: 400;\">Peneliti: Hanif Fakhrurroja, Carmadi Machbub, Ary Setijadi Prihatmanto, Ayu Purwarianti<\/span><\/p>\n\n\t\t<\/div>\n\t<\/div>\n<\/div><\/div><\/div><\/div><\/div><div class=\"fullwidth\" ><div class=\"vc_row wpb_row vc_row-fluid vc_custom_1746667123811\"><div class=\"wpb_column vc_column_container vc_col-sm-12\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\">\n\t<div class=\"wpb_text_column wpb_content_element\" >\n\t\t<div class=\"wpb_wrapper\">\n\t\t\t<p><span style=\"font-weight: 400;\">Studi ini mengembangkan metode sistem interaksi manusia-mesin. Ini melibatkan beberapa tahap, termasuk sistem aktivasi multimodal, metode untuk mengenali modalitas bicara, gerakan, deteksi wajah dan pelacakan kerangka, strategi fusi multimodal, pemahaman niat manusia dan sistem dialog Indonesia, serta metode pengembangan pengetahuan mesin dan respons yang tepat. Penelitian ini berkontribusi pada sistem interaksi manusia-mesin yang lebih mudah dan alami menggunakan sistem berbasis fusi multimodal. Tingkat akurasi rata-rata dari aktivasi multimodal, pengujian sistem dialog menggunakan interaksi pengenalan gestur Indonesia, dan fusi multimodal masing-masing adalah 87,42%, 92,11%, 93,46%, dan 93%. Tingkat kepuasan pengguna terhadap sistem interaksi manusia-mesin berbasis pengenalan multimodal yang dikembangkan adalah 95%. Menurut 76,2% pengguna, sistem interaksi ini terasa alami, sementara 79,4% setuju bahwa mesin tersebut merespons keinginan mereka dengan baik.<\/span><\/p>\n\n\t\t<\/div>\n\t<\/div>\n<\/div><\/div><\/div><\/div><\/div><div class=\"fullwidth\" ><div class=\"vc_row wpb_row vc_row-fluid\"><div class=\"wpb_column vc_column_container vc_col-sm-12\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\">\n\t<div  class=\"wpb_single_image wpb_content_element vc_align_center wpb_content_element\">\n\t\t\n\t\t<figure class=\"wpb_wrapper vc_figure\">\n\t\t\t<div class=\"vc_single_image-wrapper   vc_box_border_grey\"><img loading=\"lazy\" decoding=\"async\" width=\"562\" height=\"351\" src=\"https:\/\/stei.itb.ac.id\/wp-content\/uploads\/ProyekPenelitianInovasi-14.jpg\" class=\"vc_single_image-img attachment-full\" alt=\"\" title=\"Sistem interaksi manusia-mesin menggunakan sistem berbasis fusi multimodal\" \/><\/div><figcaption class=\"vc_figure-caption\">Sistem interaksi manusia-mesin menggunakan sistem berbasis fusi multimodal<\/figcaption>\n\t\t<\/figure>\n\t<\/div>\n<\/div><\/div><\/div><\/div><\/div>\n<\/div>","protected":false},"excerpt":{"rendered":"Peneliti: Hanif Fakhrurroja, Carmadi Machbub, Ary Setijadi Prihatmanto, Ayu Purwarianti Studi ini mengembangkan metode sistem interaksi manusia-mesin. Ini melibatkan beberapa tahap, termasuk sistem aktivasi multimodal, metode untuk mengenali modalitas bicara, [...]","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[911,17],"tags":[],"class_list":["post-24649","post","type-post","status-publish","format-standard","hentry","category-kk-sistem-kendali-dan-komputer","category-research-2"],"_links":{"self":[{"href":"https:\/\/stei.itb.ac.id\/en\/wp-json\/wp\/v2\/posts\/24649","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/stei.itb.ac.id\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/stei.itb.ac.id\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/stei.itb.ac.id\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/stei.itb.ac.id\/en\/wp-json\/wp\/v2\/comments?post=24649"}],"version-history":[{"count":2,"href":"https:\/\/stei.itb.ac.id\/en\/wp-json\/wp\/v2\/posts\/24649\/revisions"}],"predecessor-version":[{"id":24673,"href":"https:\/\/stei.itb.ac.id\/en\/wp-json\/wp\/v2\/posts\/24649\/revisions\/24673"}],"wp:attachment":[{"href":"https:\/\/stei.itb.ac.id\/en\/wp-json\/wp\/v2\/media?parent=24649"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/stei.itb.ac.id\/en\/wp-json\/wp\/v2\/categories?post=24649"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/stei.itb.ac.id\/en\/wp-json\/wp\/v2\/tags?post=24649"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}