{"id":143656,"date":"2024-07-23T07:00:00","date_gmt":"2024-07-23T05:00:00","guid":{"rendered":"http:\/\/e3mag.com\/?p=143656"},"modified":"2024-07-23T16:27:49","modified_gmt":"2024-07-23T14:27:49","slug":"enterprise-ai-chatbots-with-open-source-software","status":"publish","type":"post","link":"https:\/\/e3mag.com\/en\/enterprise-ai-chatbots-with-open-source-software\/","title":{"rendered":"Enterprise AI Chatbots With Open Source Software"},"content":{"rendered":"

The danger of closed source AI is that, to date, it has not been made public how the language models of major AI chat hosts were trained. On the contrary, there are repeated reports that parts of the training data are copyrighted. As long as the training process is not disclosed, there is always the risk that every message, every website, every text, and thus potentially also internal company data, will be used for training. One thing is also clear: language model developers live off of data and must constantly train language models. Where do they get new data if the entire free internet has already been used?<\/p>\n\n\n\n

The groundbreaking feature of large AI chat hosts is not that there is some kind of super intelligence working in the background that can replace humans. Since it is only a matter of calculating probabilities, a chatbot is not an intelligent being. Even though the whole construct is highly complex, the element that promises success is simple: language. Large language models make it possible to interact with computer systems using natural, human language. The interface is simplified even further, like a chat. You Communicate with a computer as if you were writing to a friend on Messenger.<\/p>

\"\"<\/a><\/div>\n\n\n\n

LLM and own data<\/h2>\n\n\n\n

The support options are huge. A training plan for a successful triathlon? No problem. Want to boil down excruciatingly long emails or contracts to their essentials? Done in seconds. Analyzing anomalies in large SAP log files? Instant results. When you combine an LLM with your own data, the possibilities are almost endless. Imagine what is possible when you can query your entire ticket system as a knowledge base using natural language. Your data is your strength.<\/p>\n\n\n\n

LLMs make the most of that strength. LLMs bring your data to life. However, because OpenAI, for example, provides no insight, you can never be certain that your data is safe behind closed doors. But that closed door opens another door: open source. <\/p>\n\n\n\n

Open source provides the key. Every detail in the program code can be traced, every adjustment can be checked. That means you know exactly what happens to your data: nothing. Because you're not sending data to a company, you're bringing the product into your own home. It's as if you could buy ChatGPT as a finished product and put it in your own data center. You have the key and full control over if and how your data is connected to AI. In short, the advantage of open source is transparency.<\/p>\n\n\n\n

Inference Engine<\/h2>\n\n\n\n

The first step is installing an inference engine powerful hardware, which enables the operation of language models. The only thing missing is the corresponding LLM, which can be found on Hugging Face for each application. Then you have two options to access your data: fine-tuning and RAG (Retrieval Augmented Generation). While fine-tuning requires too much performance and cost, RAG offers an inexpensive alternative. <\/p>\n\n\n\n

RAG does not modify the LLM's data, but provides context from your own database. As if you were saying to the LLM: \u201cHere is my ticket 1234, summarize the content for me.\u201d The fact that the context is always provided has another advantage; unlike online providers, the data set is always up-to-date.<\/p>\n\n\n\n

With RAG and an open source LLM, you have everything you need to connect your own data to the technology. The answer to the question of how to keep up with technological change without worrying about the security of your own data is simple: open source.<\/p>\n\n\n\n

<\/div>\n\n\n\n

To the partner entry:<\/p>\n\n\n\n

\"\"<\/a><\/figure>","protected":false},"excerpt":{"rendered":"

Anyone using ChatGPT is putting their data at risk. But to keep pace with technological change, AI cannot be ignored. So how do you combine internal data security with AI? The answer is open source.<\/p>","protected":false},"author":5567,"featured_media":132836,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"pmpro_default_level":"","footnotes":""},"categories":[7,43978,22],"tags":[],"coauthors":[43988,43989],"class_list":["post-143656","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-meinung","category-mag-24-07-08","category-open-source","pmpro-has-access"],"acf":[],"featured_image_urls_v2":{"full":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source.jpg",1000,450,false],"thumbnail":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source-150x150.jpg",150,150,true],"medium":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source-400x180.jpg",400,180,true],"medium_large":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source-768x346.jpg",768,346,true],"large":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source.jpg",1000,450,false],"image-100":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source-100x45.jpg",100,45,true],"image-480":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source-480x216.jpg",480,216,true],"image-640":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source-640x288.jpg",640,288,true],"image-720":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source-720x324.jpg",720,324,true],"image-960":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source-960x432.jpg",960,432,true],"image-1168":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source.jpg",1000,450,false],"image-1440":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source.jpg",1000,450,false],"image-1920":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source.jpg",1000,450,false],"1536x1536":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source.jpg",1000,450,false],"2048x2048":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source.jpg",1000,450,false],"trp-custom-language-flag":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source-18x8.jpg",18,8,true],"bricks_large_16x9":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source.jpg",1000,450,false],"bricks_large":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source.jpg",1000,450,false],"bricks_large_square":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source.jpg",1000,450,false],"bricks_medium":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source-600x270.jpg",600,270,true],"bricks_medium_square":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source-600x450.jpg",600,450,true],"profile_24":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source-24x24.jpg",24,24,true],"profile_48":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source-48x48.jpg",48,48,true],"profile_96":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source-96x96.jpg",96,96,true],"profile_150":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source-150x150.jpg",150,150,true],"profile_300":["https:\/\/e3mag.com\/wp-content\/uploads\/2023\/09\/WEB-open-Source-300x300.jpg",300,300,true]},"post_excerpt_stackable_v2":"

Wer ChatGPT nutzt, gef\u00e4hrdet seine Daten. Doch um mit dem technischen Wandel mithalten zu k\u00f6nnen, darf KI nicht ignoriert werden. Wie also kann man die Sicherheit interner Daten mit KI vereinen? Die Antwort: Open Source!<\/p>\n","category_list_v2":"Die Meinung der SAP-Community<\/a>, MAG 24-07 \/ 08<\/a>, Open Source Kolumne<\/a>","author_info_v2":{"name":"Maximilian Rehms, FIS-ASP","url":"https:\/\/e3mag.com\/en\/author\/maximilian-rehms\/"},"comments_num_v2":"0 comments","_links":{"self":[{"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/posts\/143656","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/users\/5567"}],"replies":[{"embeddable":true,"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/comments?post=143656"}],"version-history":[{"count":5,"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/posts\/143656\/revisions"}],"predecessor-version":[{"id":143825,"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/posts\/143656\/revisions\/143825"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/media\/132836"}],"wp:attachment":[{"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/media?parent=143656"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/categories?post=143656"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/tags?post=143656"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/e3mag.com\/en\/wp-json\/wp\/v2\/coauthors?post=143656"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}