{"id":23136,"date":"2024-12-15T02:08:48","date_gmt":"2024-12-14T19:08:48","guid":{"rendered":"https:\/\/stei.itb.ac.id\/?page_id=23136"},"modified":"2024-12-16T08:15:38","modified_gmt":"2024-12-16T01:15:38","slug":"agregasi-dan-partisi-berdasarkan-query-pada-nosql-abstract-model-noam","status":"publish","type":"page","link":"https:\/\/stei.itb.ac.id\/en\/prima\/agregasi-dan-partisi-berdasarkan-query-pada-nosql-abstract-model-noam\/","title":{"rendered":"Query-Based Aggregation and Partitioning in the NoSQL Abstract Model (NOAM)"},"content":{"rendered":"<div class=\"wpb-content-wrapper\"><div class=\"fullwidth\" ><div class=\"vc_row wpb_row vc_row-fluid kepala vc_custom_1734236300248 vc_row-has-fill\"><div class=\"wpb_column vc_column_container vc_col-sm-12\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\"><div class=\"container\" ><div class=\"vc_row wpb_row vc_inner vc_row-fluid\"><div class=\"wpb_column vc_column_container vc_col-sm-12\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\"><div class=\"vc_btn3-container vc_btn3-inline vc_do_btn\" ><button class=\"vc_general vc_btn3 vc_btn3-size-lg vc_btn3-shape-rounded vc_btn3-style-modern vc_btn3-icon-left vc_btn3-color-white\" onclick=\"history.back()\"><i class=\"vc_btn3-icon fas fa-home\"><\/i> Back to Home<\/button><\/div><\/div><\/div><\/div><\/div><\/div><\/div><\/div><\/div><\/div><\/div><div class=\"fullwidth\" ><div class=\"vc_row wpb_row vc_row-fluid vc_custom_1734170418007\"><div class=\"wpb_column vc_column_container vc_col-sm-3\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\">\n\t<div class=\"wpb_text_column wpb_content_element\" >\n\t\t<div class=\"wpb_wrapper\">\n\t\t\t<p><strong>Fazat Nur Azizah<\/strong><br \/>\nSTE-ITB<\/p>\n\n\t\t<\/div>\n\t<\/div>\n<\/div><\/div><\/div><div class=\"wpb_column vc_column_container vc_col-sm-3\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\">\n\t<div class=\"wpb_text_column wpb_content_element\" >\n\t\t<div class=\"wpb_wrapper\">\n\t\t\t<p><strong>NG Kyle<\/strong><br \/>\nSTEI ITB<\/p>\n\n\t\t<\/div>\n\t<\/div>\n<\/div><\/div><\/div><div class=\"wpb_column vc_column_container vc_col-sm-3\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\"><\/div><\/div><\/div><div class=\"wpb_column vc_column_container vc_col-sm-3\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\"><\/div><\/div><\/div><\/div><\/div><div class=\"fullwidth\" ><div class=\"vc_row wpb_row vc_row-fluid vc_custom_1734168902943\"><div class=\"wpb_column vc_column_container vc_col-sm-12\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\">\n\t<div class=\"wpb_text_column wpb_content_element\" >\n\t\t<div class=\"wpb_wrapper\">\n\t\t\t<p><strong>Abstrak<\/strong><br \/>\nNoSQL Abstract Model (NOAM) is a data modeling technique for NoSQL databases. NoAM logical data modeling considers the communality of aggregate-based NoSQL databases. Although it is stated in NOAM modeling that data access patterns should be considered, there is no clear procedure on how to utilize data access patterns (queries) in the modeling process. In this study, data access patterns in the form of partitions and aggregations based on queries are applied in the NOAM modeling stage by utilizing three modeling artifacts: UML Class Diagram, query document, and frequency document as conceptual models. Modifications to the aggregate design method of Chen et al. are used as the aggregate formation procedure. The Navathe &amp; Ra vertical partitioning algorithm is used as the aggregate partitioning method. Experiments to see the performance of the resulting data model were conducted on NoSQL databases of key-value store and document store types. The results of the experiments showed good performance in query operations with shortcomings in create\/update operations in both key-value and document-store databases.<\/p>\n<p><strong>Kata kunci:<\/strong> basis data, pemodelan data, NoSQL, NOAM, UML class diagram<\/p>\n<p><strong>Pendahuluan<\/strong><br \/>\nNoSQL is a database system that stores data in a format other than relational. The distinguishing feature of NoSQL databases is their schema-less nature, which gives developers flexibility in defining database structures. However, this doesn't mean a good data modeling process isn't necessary. Data modeling is necessary not only to define the required data structures but also to accommodate the development, maintenance, and operational needs of applications that utilize the database.<\/p>\n<p>The NoSQL Abstract Model developed by Atzeni et al. (2020) as a data modeling technique for NoSQL databases has three activities in transforming conceptual models into data models on target NoSQL database systems, namely (1) conceptual data modeling and aggregation design; (2) NoAM data representation and aggregate partitioning process, and (3) implementation, namely transformation into target NoSQL database group data models.<\/p>\n<p>The purpose of this research is to develop a NOAM data modeling process by utilizing data access patterns (queries) to support the aggregation and partitioning processes. As a conceptual model, a UML Class Diagram is used to define the structure of the data to be modeled, supplemented by query documents and query frequency documents.<\/p>\n<p><strong>Metodologi<\/strong><br \/>\nThe NoAM data model is defined as a collection of blocks that are uniquely identified by a key and consist of a non-empty set of entries identified as pairs &lt;ek,ev&gt; with ek: entry key and ev: entry value. There are three types of NoAM logical model representations, namely, (1) Entry per Aggregate Object (EAO), where each aggregate block is represented as an entry with ek empty and ev being the complex value of the aggregate object; (2) Entry per Top-level Field (ETF), where each aggregate is represented as a collection of unique entries where key is the name of the data attribute and value is the possibly complex attribute data; (3) Aggregate Partitioning, which is an intermediate form between ETF and EAO.<\/p>\n\n\t\t<\/div>\n\t<\/div>\n<\/div><\/div><\/div><\/div><\/div><div class=\"fullwidth\" ><div class=\"vc_row wpb_row vc_row-fluid vc_custom_1734169162466 vc_row-o-content-bottom vc_row-flex\"><div class=\"wpb_column vc_column_container vc_col-sm-12\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\">\n\t<div  class=\"wpb_single_image wpb_content_element vc_align_center wpb_content_element\">\n\t\t\n\t\t<figure class=\"wpb_wrapper vc_figure\">\n\t\t\t<div class=\"vc_single_image-wrapper   vc_box_border_grey\"><img loading=\"lazy\" decoding=\"async\" width=\"491\" height=\"560\" src=\"https:\/\/stei.itb.ac.id\/wp-content\/uploads\/Metode-Pemodelan.jpg\" class=\"vc_single_image-img attachment-full\" alt=\"\" title=\"Metode Pemodelan\" \/><\/div><figcaption class=\"vc_figure-caption\">Gambar 1. Metode Pemodelan<\/figcaption>\n\t\t<\/figure>\n\t<\/div>\n<\/div><\/div><\/div><\/div><\/div><div class=\"fullwidth\" ><div class=\"vc_row wpb_row vc_row-fluid vc_custom_1734203050307\"><div class=\"wpb_column vc_column_container vc_col-sm-12\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\">\n\t<div class=\"wpb_text_column wpb_content_element\" >\n\t\t<div class=\"wpb_wrapper\">\n\t\t\t<p>This study develops two aspects of NOAM data modeling that have not been well defined, namely aggregation modeling at the conceptual modeling stage and aggregate portioning at the logical modeling stage of NoAM. The method developed in this study can be seen in Figure 1. This method is divided into two stages, namely (1) conceptual data modeling and aggregate model design and (2) transformation of the aggregate model into a logical NoAM model. The aggregation of the conceptual model is carried out in two stages, namely grouping based on relations and grouping based on queries. Each stage is intended for the aggregation of classes in the class diagram.<\/p>\n<p>The conceptual model aggregation procedure is carried out in two stages: relation-based grouping and query-based grouping. Each stage is intended to aggregate the classes in the class diagram.<\/p>\n<p><strong>Pengujian<\/strong><br \/>\nTwo groups of tests were conducted: modeling and performance. Modeling tests aimed to generate schemas for the three NoAM logical models from UML Class Diagrams and other artifacts. Performance tests aimed to generate metrics in the form of the speed of each read\/write operation on the database based on each schema generated from the modeling. The target database groups used were Document Store, namely MongoDB, and Key-Value Store, namely RiakKV. Performance tests were compared with previous work by Valiandi and Aizah (2022) and the method of Shin et al. (2017). The test results on the key-value database for read and update operations can be seen in Figures 2 and 3.<\/p>\n<p>Test results show that the read query operations of all three NoAM models outperform the benchmark model. This demonstrates the results of class aggregation, which reduces the number of read queries needed to obtain all the required information. This contrasts with the benchmark model, which is more normalized. However, for the same reason, there are drawbacks to the update\/create operations required for some collections, as the aggregate model has data duplication properties.<\/p>\n\n\t\t<\/div>\n\t<\/div>\n<\/div><\/div><\/div><\/div><\/div><div class=\"fullwidth\" ><div class=\"vc_row wpb_row vc_row-fluid vc_custom_1734169162466 vc_row-o-content-bottom vc_row-flex\"><div class=\"wpb_column vc_column_container vc_col-sm-6\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\">\n\t<div  class=\"wpb_single_image wpb_content_element vc_align_center wpb_content_element\">\n\t\t\n\t\t<figure class=\"wpb_wrapper vc_figure\">\n\t\t\t<div class=\"vc_single_image-wrapper   vc_box_border_grey\"><img loading=\"lazy\" decoding=\"async\" width=\"621\" height=\"325\" src=\"https:\/\/stei.itb.ac.id\/wp-content\/uploads\/Performa-Query-Read-Key-Value.jpg\" class=\"vc_single_image-img attachment-full\" alt=\"\" title=\"Performa Query Read Key-Value\" \/><\/div><figcaption class=\"vc_figure-caption\">Gambar 2. Performa Query Read Key-Value<\/figcaption>\n\t\t<\/figure>\n\t<\/div>\n<\/div><\/div><\/div><div class=\"wpb_column vc_column_container vc_col-sm-6\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\">\n\t<div  class=\"wpb_single_image wpb_content_element vc_align_center wpb_content_element\">\n\t\t\n\t\t<figure class=\"wpb_wrapper vc_figure\">\n\t\t\t<div class=\"vc_single_image-wrapper   vc_box_border_grey\"><img loading=\"lazy\" decoding=\"async\" width=\"632\" height=\"333\" src=\"https:\/\/stei.itb.ac.id\/wp-content\/uploads\/Performa-Update-Create-Key-Value.jpg\" class=\"vc_single_image-img attachment-full\" alt=\"\" title=\"Performa Update-Create Key-Value\" \/><\/div><figcaption class=\"vc_figure-caption\">Gambar 3. Performa Update\/Create Key-Value<\/figcaption>\n\t\t<\/figure>\n\t<\/div>\n<\/div><\/div><\/div><\/div><\/div><div class=\"fullwidth\" ><div class=\"vc_row wpb_row vc_row-fluid vc_custom_1734203050307\"><div class=\"wpb_column vc_column_container vc_col-sm-12\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\">\n\t<div class=\"wpb_text_column wpb_content_element\" >\n\t\t<div class=\"wpb_wrapper\">\n\t\t\t<p><strong>Kesimpulan<\/strong><br \/>\nThe three NoAM logical models developed by the developed method have better read query performance and read query capability than the comparison models. The EAO logical model has the best query performance among the three NoAM models. The aggregate partitioning model has read query performance similar to EAO for key-value databases with relatively small data sets. Aggregate partitioning is less suitable for document-based data models.<\/p>\n\n\t\t<\/div>\n\t<\/div>\n<\/div><\/div><\/div><\/div><\/div>\n<\/div>","protected":false},"excerpt":{"rendered":"Kembali ke Beranda Fazat Nur Azizah STE-ITB NG Kyle STEI-ITB Abstrak NoSQL Abstract Model (NOAM) adalah salah satu teknik pemodelan data untuk basis data NoSQL. Pemodelan data logis NoAM mempertimbangkan [...]","protected":false},"author":1,"featured_media":0,"parent":22933,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-23136","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/stei.itb.ac.id\/en\/wp-json\/wp\/v2\/pages\/23136","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/stei.itb.ac.id\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/stei.itb.ac.id\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/stei.itb.ac.id\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/stei.itb.ac.id\/en\/wp-json\/wp\/v2\/comments?post=23136"}],"version-history":[{"count":2,"href":"https:\/\/stei.itb.ac.id\/en\/wp-json\/wp\/v2\/pages\/23136\/revisions"}],"predecessor-version":[{"id":23571,"href":"https:\/\/stei.itb.ac.id\/en\/wp-json\/wp\/v2\/pages\/23136\/revisions\/23571"}],"up":[{"embeddable":true,"href":"https:\/\/stei.itb.ac.id\/en\/wp-json\/wp\/v2\/pages\/22933"}],"wp:attachment":[{"href":"https:\/\/stei.itb.ac.id\/en\/wp-json\/wp\/v2\/media?parent=23136"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}