Building a On Premise LLM Server with Axiomtek SERVER

During Episode 53 of the "Sembang AIoT" sharing session on 14th of June 2024, we shared and discussed the LLM (Large Language Model) of Generative AI. Axiomtek Industrial Server platform was used as the sample server in one of the Nvidia Standard LLM Servers that serve a standalone LLM server — projecting a real usage of an On-Premise LLM Server that serves the industry.

An LLM, or Large Language Model, is a type of artificial intelligence (AI) designed to understand and generate human language. Key points about LLMs:

Architecture: LLMs are typically based on deep learning architectures, such as the Transformer model, which enables them to process and generate text in a sophisticated manner. Training Data: they are trained on vast amounts of text data from diverse sources, including books, articles, and websites, allowing them to learn grammar, facts, reasoning abilities, and some level of common sense.