{"id":29577,"date":"2017-10-16T08:00:24","date_gmt":"2017-10-16T06:00:24","guid":{"rendered":"http:\/\/e3mag.com\/?p=29577"},"modified":"2022-05-01T09:08:40","modified_gmt":"2022-05-01T07:08:40","slug":"dreamteam-for-big-data","status":"publish","type":"post","link":"https:\/\/e3mag.com\/en\/dreamteam-for-big-data\/","title":{"rendered":"Hana &amp; Hadoop - Dream Team for Big Data"},"content":{"rendered":"<p>SAP users who have had the opportunity to work with Hana are usually enthusiastic about the possibilities and the incredible performance. They would love to store as much data as possible in Hana and process it directly \"in-memory\".<\/p>\n<p>Unfortunately, there is a catch: the more Hana is used, the more expensive it becomes and the more resources are required. In addition, there is a general limitation of Hana:<\/p><div id=\"great-2181607521\" class=\"great-fullsize-content-en\" style=\"margin-bottom: 20px;\"><a data-no-instant=\"1\" href=\"https:\/\/www.youtube.com\/watch?v=6yfv7eho3Gc\" rel=\"noopener\" class=\"a2t-link\" target=\"_blank\" aria-label=\"Fullsize\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/e3mag.com\/wp-content\/uploads\/2026\/03\/banner_26_04_08_1200x150.jpg\" alt=\"Fullsize\"  srcset=\"https:\/\/e3mag.com\/wp-content\/uploads\/2026\/03\/banner_26_04_08_1200x150.jpg 1200w, https:\/\/e3mag.com\/wp-content\/uploads\/2026\/03\/banner_26_04_08_1200x150-400x50.jpg 400w, https:\/\/e3mag.com\/wp-content\/uploads\/2026\/03\/banner_26_04_08_1200x150-768x96.jpg 768w, https:\/\/e3mag.com\/wp-content\/uploads\/2026\/03\/banner_26_04_08_1200x150-100x13.jpg 100w, https:\/\/e3mag.com\/wp-content\/uploads\/2026\/03\/banner_26_04_08_1200x150-480x60.jpg 480w, https:\/\/e3mag.com\/wp-content\/uploads\/2026\/03\/banner_26_04_08_1200x150-640x80.jpg 640w, https:\/\/e3mag.com\/wp-content\/uploads\/2026\/03\/banner_26_04_08_1200x150-720x90.jpg 720w, https:\/\/e3mag.com\/wp-content\/uploads\/2026\/03\/banner_26_04_08_1200x150-960x120.jpg 960w, https:\/\/e3mag.com\/wp-content\/uploads\/2026\/03\/banner_26_04_08_1200x150-1168x146.jpg 1168w, https:\/\/e3mag.com\/wp-content\/uploads\/2026\/03\/banner_26_04_08_1200x150-18x2.jpg 18w, https:\/\/e3mag.com\/wp-content\/uploads\/2026\/03\/banner_26_04_08_1200x150-600x75.jpg 600w\" sizes=\"(max-width: 1200px) 100vw, 1200px\" width=\"1200\" height=\"150\"  style=\" max-width: 100%; height: auto;\" \/><\/a><\/div>\n<p>The relational data store is ideal for structured data, but it becomes difficult with unstructured data such as logs, social media feeds, documents or images. But that is exactly where Hadoop has its strengths.<\/p>\n<p>A platform like Cloudera Enterprise enables economical and flexible storage, processing and analysis of Big Data, but does not have comparable functionality and performance when hosting relational workloads, such as online transaction processing (OLTP) in a database or data warehouse.<\/p>\n<p>None of this is new, and in fact many companies operate both platforms side by side, separately and apart from each other, to leverage their respective strengths.<\/p>\n<p>However, it is often overlooked that an integrated architecture of both solutions can combine the best of both worlds while compensating for the disadvantages.<\/p>\n<p>Cloudera Enterprise can accommodate large volumes of a wide variety of data and limit SAP Hana's hunger for resources. In particular, it ideally complements Hana in the following areas:<\/p>\n<ol>\n<li>Data volumes and diversity: Traditional data management systems reach their limits here. Organizations have to compromise on cost and technical complexity to decide what data to keep and what not to keep, and unstructured data is difficult to model and store. Cloudera Enterprise is ideal for providing and storing all of an organization's data.<\/li>\n<li>Resource utilization: In an integrated architecture, processes can be outsourced. Hana can then use the freed-up resources to best serve queries and applications.Most commonly, resource-intensive ETL workloads are outsourced, but it is also possible to transfer queries and analytics to Cloudera Enterprise, especially for very large data sets.<\/li>\n<li>Capacity issues: It can be beneficial to offload data from Hana, such as historical data or data of low value. This makes it possible to run analyses over longer periods of time without having to keep the complete data history in Hana. Less load on Hana servers automatically means lower costs.<\/li>\n<li>Analytics and query resources: In an integrated architecture, Hana can handle the rapid processing of structured and online data, for example, OLTP, data warehousing or OLAP (Online Analytical Processing).Cloudera Enterprise provides complementary capabilities to process large volumes of unstructured online and offline data. Organizations can decide which distribution makes the most sense from a cost and performance perspective.<\/li>\n<\/ol>\n<p><a href=\"https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/Cloudera-Infra-1710.jpg\"><img loading=\"lazy\" decoding=\"async\" title=\"Hana &amp; hadoop - dream team for big data\" class=\"aligncenter size-full wp-image-29583\" src=\"https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/Cloudera-Infra-1710.jpg\" alt=\"Hana, Hadoop, Big Data\" width=\"800\" height=\"697\" srcset=\"https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/Cloudera-Infra-1710.jpg 800w, https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/Cloudera-Infra-1710-768x669.jpg 768w, https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/Cloudera-Infra-1710-100x87.jpg 100w, https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/Cloudera-Infra-1710-480x418.jpg 480w, https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/Cloudera-Infra-1710-640x558.jpg 640w, https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/Cloudera-Infra-1710-720x627.jpg 720w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><\/a><\/p>\n<p>In an integrated architecture, costs can be significantly reduced compared to a pure Hana operation. Companies can start with simple tasks such as outsourcing ETL workloads and move step by step to a combined analytics platform.<\/p>\n<p>Beyond outsourcing individual processes, it is even possible to pull data from Hana and transfer it to Cloudera Enterprise for analysis. This can be useful for examining data of unknown value without using Hana's expensive resources, which in turn can be used for more important workloads.<\/p>\n<p>The bottom line is that this is a real dream team: Companies don't have to choose one platform over the other; in combination, they get the best of both worlds.<\/p>","protected":false},"excerpt":{"rendered":"<p>With Hana, SAP has a real success model on offer for processing and analyzing large volumes of data. The open source community also has a powerful technology in the form of the Hadoop ecosystem. Classic competitive situation? No, a real dream team - when the advantages of both platforms are combined.<\/p>","protected":false},"author":38,"featured_media":29578,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"pmpro_default_level":"","footnotes":""},"categories":[5,17703],"tags":[210,927,606,130,798,65,428,430,236],"coauthors":[19920],"class_list":["post-29577","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-it-management","category-mag-1710","tag-big-data","tag-data-warehouse","tag-daten","tag-datenbank","tag-hadoop","tag-hana","tag-olap","tag-oltp","tag-sap","pmpro-has-access"],"acf":[],"featured_image_urls_v2":{"full":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892.jpg",1000,452,false],"thumbnail":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892-150x150.jpg",150,150,true],"medium":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892.jpg",400,181,false],"medium_large":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892-768x347.jpg",768,347,true],"large":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892.jpg",1000,452,false],"image-100":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892-100x45.jpg",100,45,true],"image-480":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892-480x217.jpg",480,217,true],"image-640":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892-640x289.jpg",640,289,true],"image-720":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892-720x325.jpg",720,325,true],"image-960":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892-960x434.jpg",960,434,true],"image-1168":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892.jpg",1000,452,false],"image-1440":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892.jpg",1000,452,false],"image-1920":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892.jpg",1000,452,false],"1536x1536":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892.jpg",1000,452,false],"2048x2048":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892.jpg",1000,452,false],"trp-custom-language-flag":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892.jpg",18,8,false],"bricks_large_16x9":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892.jpg",1000,452,false],"bricks_large":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892.jpg",1000,452,false],"bricks_large_square":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892.jpg",1000,452,false],"bricks_medium":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892.jpg",600,271,false],"bricks_medium_square":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892.jpg",600,271,false],"profile_24":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892-24x24.jpg",24,24,true],"profile_48":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892-48x48.jpg",48,48,true],"profile_96":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892-96x96.jpg",96,96,true],"profile_150":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892-150x150.jpg",150,150,true],"profile_300":["https:\/\/e3mag.com\/wp-content\/uploads\/2017\/10\/shutterstock_520500892-300x300.jpg",300,300,true]},"post_excerpt_stackable_v2":"<p>SAP hat mit Hana ein echtes Erfolgsmodell f\u00fcr die Verarbeitung und Analyse gro\u00dfer Datenmengen im Angebot. Die Open-Source-Community kann mit dem Hadoop-\u00d6kosystem ebenfalls eine m\u00e4chtige Technologie vorweisen. Klassische Wettbewerbssituation? Nein, ein echtes Dreamteam \u2013 wenn die Vorteile beider Plattformen kombiniert werden.<\/p>\n","category_list_v2":"<a href=\"https:\/\/e3mag.com\/en\/category\/it-management\/\" rel=\"category tag\">IT-Management<\/a>, <a href=\"https:\/\/e3mag.com\/en\/category\/mag-1710\/\" rel=\"category tag\">MAG 17-10<\/a>","author_info_v2":{"name":"E-3 Magazine","url":"https:\/\/e3mag.com\/en\/author\/e-3-magazin\/"},"comments_num_v2":"0 comments","_links":{"self":[{"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/posts\/29577","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/users\/38"}],"replies":[{"embeddable":true,"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/comments?post=29577"}],"version-history":[{"count":0,"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/posts\/29577\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/media\/29578"}],"wp:attachment":[{"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/media?parent=29577"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/categories?post=29577"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/tags?post=29577"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/coauthors?post=29577"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}