Ralf Risch, Interact Conference, Hardware

Jeff Wen

Director of Edge Server Group, Advantech

Focus on: INDUSTRY


»Edge + LLM: How Advantech Powers AI at the Edge«

  • High-Performance Edge AI Inference: Running LLMs on Advantech Edge Servers
  • Challenges in Edge AI: Designing Reliable Edge Server for LLM
  • Real-World Applications: LLM Deployment with Advantech Edge Servers

Summary:   
Advantech, a global leader in industrial IoT (IIoT) and edge computing solutions, plays a crucial role in enabling Large Language Models (LLMs) at the edge. With its high-performance Edge Servers, AI acceleration platforms, and embedded computing solutions, Advantech empowers industries to deploy LLMs closer to data sources, reducing latency, enhancing security, and optimizing real-time AI inference.