GMKtec Featured Products
GMKtec is dedicated to redefining AI PCs, gaming PCs, office mini PCs, and creative computing experiences.
Featured in Media
GMKtec mini PCs have been featured in hands-on reviews, product roundups, and editorial coverage from respected tech publications worldwide.
GMKtec Is Recommended By
GMKtec has been widely reviewed and recommended by leading global tech media and creators, including Lon TV, ETA PRIME, Digital Foundry, ServeTheHome, Gizmochina, NASCompares, TechTablets, Iceberg Tech, and more. These trusted voices highlight GMKtec’s performance, reliability, and innovation in mini PCs and compact computing solutions.
Featured Blog
Same Chip, Different AI Speed: How GMKtec EVO-X5 Pro Reaches 75 Tokens per Second
If you’ve been following the world of local LLM inference, you may have heard a common criticism of AMD’s Strix Halo platform: with 256 GB/s of memory bandwidth, it can run large language models, but don’t expect spectacular speeds There’s some truth to that—but only half the story. Hardware sets the limits. Software determines how much of that potential you can actually unlock. On the GMKtec EVO-X5 Pro, a specialized inference engine called Halogen demonstrates just how much difference software optimization can make. Running the same model on the same underlying hardware, Halogen delivers a substantial performance boost over a general-purpose inference engine. Here’s what makes the difference. 1. The Numbers: 23 Tokens/s vs. 75 Tokens/s Let’s start with the results. Running Qwen3.8-Flash-Next on the AMD Strix Halo platform, we compared the performance of a general-purpose inference engine with Halogen on the GMKtec EVO-X5 Pro. Inference Engine Sustained Generation Speed llama.cpp, general-purpose engine Around 23 tokens/s Halogen on GMKtec EVO-X5 Pro Around 75 tokens/s That’s more than 3× the sustained token generation speed under the tested conditions. And the gap can become even more pronounced when working with long contexts. In practical terms, tokens per second (tok/s) measures how quickly an AI model generates its response. At 75 tok/s, the model can produce text at a pace that feels much closer to a real-time conversation, making it easier to work through coding tasks, analyze documents, and build local AI workflows without constantly waiting for the next sentence. The key point? Both configurations use the same underlying chip. The difference comes from how the software puts that hardware to work. Note: These figures reflect GMKtec's internal testing under the specified configuration. Actual performance varies with model settings, context length, quantization, and workload. 2. The Secret Isn’t New Hardware. It’s a Different Engine. First, let’s clear something up: AMD provides the hardware. GMKtec hasn’t modified the silicon or changed the physical memory bandwidth. The real variable is Halogen, a specialized inference engine designed to optimize AI workloads on AMD’s Strix Halo platform. Unlike general-purpose engines built to support a wide range of hardware and model architectures, Halogen takes a much narrower approach. It focuses on a specific GPU architecture and a specific model family to extract more performance from the hardware. That specialization is the foundation of its advantage. 3. Built for One Platform, Not Every Platform General-purpose inference engines are designed to work across a broad ecosystem. They need to support different GPU vendors, hardware generations, model architectures, and execution paths. That flexibility is valuable. It also introduces complexity. Halogen takes the opposite approach: ● Target hardware: AMD Strix Halo, using the gfx1151 GPU architecture. ● Target models: The Qwen3.8-Flash-Next model family. ● Optimization strategy: Hardware-specific kernels and model-aware execution paths. In its current implementation, Halogen is deliberately specialized rather than a universal inference solution. Why does that matter? Every layer of generality creates engineering trade-offs. A general-purpose engine must accommodate different hardware capabilities, maintain compatibility paths, and handle alternative execution strategies. A specialized engine can focus its resources on the exact hardware and workload it is designed to run. Think of it as the difference between a Swiss Army knife and a precision-engineered tool. One can do almost everything; the other is built to do one job exceptionally well. 4. Optimization No. 1: Removing Unnecessary Abstraction A general-purpose inference engine such as llama.cpp must accommodate a wide range of GPUs and computing environments. Its implementation needs to remain flexible enough to support different architectures and execution requirements. Halogen can take a more direct route. By developing kernels specifically for the gfx1151 architecture, the engine can optimize critical operations around the platform’s actual hardware characteristics, including its compute resources, memory behavior, and cache hierarchy. This reduces reliance on generic execution paths and allows performance-critical operations to be tuned for the target platform. The advantage isn’t simply about removing a few compatibility checks. It’s about engineering the execution path around the hardware from the ground up. When those optimizations are applied to operations that run repeatedly during inference, even small improvements can compound into a meaningful increase in generation speed. 5. Optimization No. 2: Smarter Execution for Mixture-of-Experts Models Qwen3.8-Flash-Next uses a Mixture-of-Experts (MoE) architecture, with close to 180 billion total parameters. MoE models work differently from conventional dense models. Instead of activating every parameter for every token, they route each input through a selected subset of specialized experts. Imagine a team of specialist doctors. Not every doctor needs to examine every patient. The system identifies the relevant specialists and brings them into the process. This architecture can make very large models practical to run locally—but it also creates specific challenges for inference engines. Expert routing, weight access, and memory movement all affect performance. On a platform where memory bandwidth is a critical resource, unnecessary data movement can become particularly expensive. Halogen is designed around the target model's execution patterns, optimizing expert routing and data movement so that the inference process focuses on the weights and operations needed for the current computation. The goal is straightforward: move less unnecessary data, reduce avoidable overhead, and keep the hardware working efficiently. Fine-Grained Quantization: 5.53 Bits per Weight Halogen also uses a 5.53 bits-per-weight (bpw) quantization configuration. Quantization reduces the amount of memory required to store model weights by representing parameters with fewer bits. This can ease memory pressure and reduce the amount of data that needs to move during inference. But more aggressive quantization isn't automatically better. Pushing precision too low can affect model quality, depending on the model and workload. A 5.53 bpw configuration offers a different balance: compact weight storage without simply forcing the entire model into a uniform 4-bit representation. Combined with model-aware execution, this helps manage the memory demands of large local models while maintaining a practical balance between efficiency and output quality. 6. Optimization No. 3: Speculative Decoding Another important technique is speculative decoding. In conventional autoregressive generation, a language model generates tokens sequentially, with each new token depending on the preceding context. Speculative decoding changes the process. A smaller draft component proposes several candidate tokens in advance. The main model then verifies those candidates in a more parallelized step. Tokens that pass verification can be accepted together, allowing the system to generate multiple tokens for the computational cost of fewer sequential decoding steps. The result depends on how accurately the draft component predicts the main model’s output. When predictions are accepted at a high rate, generation can become substantially faster. For workloads with repetitive or predictable output patterns—such as code completion, structured text generation, and document rewriting—this technique can be especially effective. In GMKtec's internal testing, Halogen reached a peak of 94 tok/s in repetitive-content scenarios. That is a peak result for a specific workload, rather than a universal generation speed. Actual gains depend on the task, context, and draft acceptance rate. Think of it as having an assistant prepare a draft while you review it. When the draft is right, you can approve several words at once instead of composing every word from scratch. 7. The Combined Result: Fast Prompt Processing and Sustained Generation The real benefit comes from combining these optimizations rather than relying on a single trick. On the GMKtec EVO-X5 Pro, equipped with up to 192GB of unified memory, Halogen delivers the following results in GMKtec's internal testing: <| |> ● Around 75 tok/s sustained generation speed ● Up to 2,000 tok/s prompt-processing speed ● Up to 94 tok/s peak generation speed in repetitive-content scenarios These figures describe different stages or conditions of inference and should not be treated as directly interchangeable. Prompt processing, also known as prefill, is the stage in which the model processes the input context. Generation, or decoding, is the stage in which it produces the response token by token. Fast prompt processing helps when you submit a long document, a large codebase, or an extensive conversation history. Fast sustained generation makes the response itself feel more immediate. Together, they help deliver a smoother experience across long-context AI workflows. What Does This Mean for a 128K-Token Context? A 128K-token context can accommodate a substantial amount of material—potentially hundreds of pages, depending on the language, formatting, and content. With prompt processing reaching up to 2,000 tok/s under the tested conditions, the EVO-X5 Pro can ingest large inputs quickly. Its sustained generation performance then helps turn that context into useful answers, summaries, analysis, or code. For developers and professionals who work with large documents or complex AI workflows, both stages matter. A model that generates quickly but takes too long to process the prompt can still feel sluggish. Optimizing the entire inference pipeline makes a more meaningful difference. 8. The EVO-X5 Pro: More Than a Powerful Chip The GMKtec EVO-X5 Pro is built for users who want to run demanding AI workloads locally, with substantial compute resources and memory capacity available on the desktop. Paired with Halogen, it offers more than the hardware alone: a specialized software stack designed to extract additional performance from a specific combination of GPU architecture and model family. This is particularly relevant for developers running local AI agents, coding assistants, and long-context workflows where responsiveness directly affects productivity. Local inference also gives users greater control over where their data is processed. For organizations handling proprietary code, internal documents, or sensitive business information, keeping compatible AI workloads on local hardware can help reduce reliance on cloud-based inference services. The trade-off is deliberate. General-purpose engines prioritize broad compatibility. Halogen prioritizes performance on its target platform and supported models. Neither approach is universally better. But if your workload matches what Halogen is designed to accelerate, specialization can deliver a tangible advantage. Because being able to run a large model and being able to run it smoothly are two very different things. Memory bandwidth is determined by the hardware. How much performance you unlock depends on the software. With the EVO-X5 Pro and Halogen, GMKtec is pushing local AI inference toward a more responsive, desktop-based experience—without requiring a different chip to make the difference. Experience Local AI at Full Speed Discover the GMKtec EVO-X5 Pro and explore what a specialized AI inference engine can bring to local LLM workloads. GMKtec EVO-X5 Pro — Built for the Next Generation of Local AI.
Read morePushing Desktop AI Further: GMKtec EVO-X5 Pro Accelerates 320B GLM-5.3-Flash Inference
A 10× improvement in prefill speed and a 1.85× boost in decoding performance bring large-scale local AI inference to a new level. As AI models continue to scale into the hundreds of billions of parameters, running them efficiently on a desktop system remains a significant challenge. Large models demand substantial memory capacity, high bandwidth, and carefully optimized inference software to deliver a responsive user experience. GMKtec is pushing those boundaries with the EVO-X5 Pro Desktop AI Supercomputer. Through extensive software-level optimization by our engineering team, the EVO-X5 Pro has achieved significant performance improvements when running the 320B-class GLM-5.3-Flash model: ● Approximately 10× faster prefill for processing input prompts. ● Approximately 1.85× faster decoding for generating responses. These results demonstrate how close hardware and software integration can unlock more of the potential of large-scale AI inference on a desktop system. Built for Large Models: 192GB of Unified Memory Running a model at this scale requires more than raw processing power. Memory capacity is a critical factor in enabling large models to run locally, particularly when working with long prompts and extensive context. The GMKtec EVO-X5 Pro is powered by the AMD Ryzen AI Max+ PRO 495 processor, featuring integrated AMD Radeon 8065S graphics, and supports up to 192GB of unified memory. This large, shared memory pool gives demanding AI workloads more room to operate, helping accommodate large model weights, context, and inference workloads within a single desktop platform. By combining high-capacity unified memory with powerful CPU and integrated GPU resources, the EVO-X5 Pro provides a foundation for experimenting with and deploying large language models locally—without relying exclusively on cloud-based AI services. Software Optimization That Makes a Difference Hardware provides the foundation, but inference performance also depends on how efficiently the software uses available resources. To improve GLM-5.3-Flash performance, GMKtec's engineering team carried out targeted, low-level optimizations across the inference stack. The results show substantial gains in two key stages of model inference. Prefill: Approximately 10× Faster Input Processing Prefill is the stage in which a model processes the input prompt before beginning to generate a response. For long documents, large codebases, and context-heavy workflows, this stage can have a significant impact on how long users wait before generation begins. With the optimized configuration, the EVO-X5 Pro achieved an approximately 10× improvement in prefill performance compared with the baseline configuration used in GMKtec's testing. This can substantially reduce input-processing time and help make interactions involving large amounts of context more responsive. Decode: Approximately 1.85× Faster Response Generation Once prefill is complete, the model enters the decoding stage, generating its response token by token. GMKtec's optimizations delivered an approximately 1.85× improvement in decoding performance in the tested configuration. Faster decoding can make a practical difference in extended conversations, long-form writing, code generation, and other workloads that require the model to produce substantial amounts of output. Together, these improvements address two important parts of the inference experience: processing the information you provide and generating the response you need. Stress-Tested with Nearly 500K Tokens of Context Large models must do more than perform well with short prompts. They also need to handle demanding context lengths while maintaining consistent generation performance. To evaluate the optimized GLM-5.3-Flash configuration, GMKtec tested the EVO-X5 Pro across a range of input lengths, from 1,024 tokens to 499,712 tokens—nearly 500K tokens. The results highlight the system's ability to sustain high throughput across a broad range of context sizes. Input length Prefill speed Decode speed Time to first token 1,024 tokens 494.54 tokens/s — 2.22 seconds 499,712 tokens 628.91 tokens/s 28.23 tokens/s 795.77 seconds Source: GMKtec internal testing. Results reflect the tested hardware, software, model configuration, and inference settings. Actual performance may vary. At the shortest tested input length, the system processed the prompt at 494.54 tokens per second, with a time to first token of just 2.22 seconds. At the other end of the test, the EVO-X5 Pro processed an input of 499,712 tokens while sustaining a reported prefill throughput of 628.91 tokens per second and a decoding speed of 28.23 tokens per second. Time to first token was 795.77 seconds. That longer wait reflects the substantial amount of input the model must process before it can begin generating a response. For workloads involving exceptionally large context windows, the ability to process that volume of information locally is an important part of the performance picture. Across the tested context lengths—including 4K, 32K, and 128K tokens—decoding speeds remained in the 28–33 tokens-per-second range, according to GMKtec's internal results. These figures illustrate the importance of evaluating AI systems across different prompt sizes, rather than relying on short-prompt benchmarks alone. A Desktop AI Platform for Private, Local Workflows The EVO-X5 Pro is designed to be more than a conventional mini PC. It serves as a compact desktop AI computing platform for users who want to explore large models, build local AI workflows, and keep more of their processing on their own hardware. Potential applications include: ● Research and document analysis: Work with extensive source material and long-context prompts. ● Software development: Explore AI-assisted coding and code analysis using locally hosted models. ● AI experimentation: Test large language models and develop custom inference workflows. ● Privacy-conscious computing: Keep supported AI workloads and their data on local hardware, reducing dependence on third-party cloud inference services. Local execution can offer greater control over data and deployment, although privacy ultimately depends on the software, network configuration, and services used. For developers, researchers, and AI enthusiasts who want to push beyond conventional desktop AI workloads, the EVO-X5 Pro combines substantial memory capacity with targeted inference optimization in a compact form factor. Bringing Large-Scale AI Closer to the Desktop The progress demonstrated with GLM-5.3-Flash highlights what can be achieved when capable hardware is paired with software engineered to make better use of it. With support for up to 192GB of unified memory, the AMD Ryzen AI Max+ PRO 495 processor, and significant gains in both prefill and decoding performance, the GMKtec EVO-X5 Pro offers a powerful platform for exploring large-scale local AI inference. The next generation of AI computing doesn't have to live exclusively in the cloud. With the EVO-X5 Pro, GMKtec is bringing more of that capability to the desktop. Discover the GMKtec EVO-X5 Pro and explore the possibilities of local AI computing.
Read moreGMKtec EVO-X5 Pro Advances from Desktop AI Supercomputer to Commercial AI Computing
Following its global debut at IFA 2026 and worldwide launch on September 28, GMKtec's flagship EVO-X5 Pro expands into commercial AI with enterprise management, scalable multi-node computing, and offline 320B AI. SHENZHEN, China — October 9, 2026 — GMKtec today introduced the next stage of its EVO-X5 Pro desktop AI supercomputer at its China launch event in Shenzhen, highlighting the system's evolution from a high-performance local AI workstation into a deployable commercial AI computing platform. First unveiled globally at IFA 2026 and officially launched through GMKtec's global online channels on September 28, the EVO-X5 Pro combines the AMD Ryzen™ AI Max+ PRO 495, up to 192GB LPDDR5X-8533 unified memory, and support for fully offline LLM inference with up to 320 billion parameters. At the IFA launch, Michael Nordquist, Vice President of Client Business at AMD, joined GMKtec to highlight the companies’ long-standing collaboration and shared vision for advancing edge AI computing. The latest launch event placed a stronger emphasis on how the EVO-X5 Pro can be deployed, managed and scaled for enterprise AI workloads. From Desktop AI Supercomputer to Commercial AI Node The EVO-X5 Pro was designed from the beginning to bring large-scale AI computing out of the cloud and onto the desktop. Its latest development extends that concept into commercial environments. Rather than positioning the EVO-X5 Pro simply as a powerful mini PC, GMKtec defines it as a desktop-class AI computing node that can operate independently or become part of a larger local AI infrastructure. With support for both Windows and Linux, the system can integrate into existing development, enterprise and computing environments while keeping AI workloads and sensitive data local. This makes the EVO-X5 Pro suitable for applications where local processing, data control, computing performance and system manageability are equally important. 192GB Unified Memory for Large-Scale Local AI One of the defining features of the EVO-X5 Pro is its up to 192GB of LPDDR5X-8533 unified memory. The unified memory architecture allows CPU and GPU resources to access a shared memory pool, providing the capacity required for demanding local AI inference and GPU workloads. GMKtec originally developed the EVO-X5 Pro around a 300-billion-parameter local AI target. Through continued engineering optimization, the platform subsequently moved beyond that target and now supports fully offline LLM inference with up to 320 billion parameters, with actual compatibility and performance depending on the model, software, quantization and workload. This capability enables users to run increasingly large AI models locally without relying entirely on cloud infrastructure. The system is designed for local AI inference, AI agent workflows, model development, professional content creation, software development and other demanding workloads. Powered by AMD Ryzen AI Max+ PRO 495 At the heart of the EVO-X5 Pro is the AMD Ryzen™ AI Max+ PRO 495, combining high-performance CPU, GPU and NPU resources in a single platform. Key capabilities include: ● 16 Zen 5 CPU cores / 32 threads ● Up to 5.2GHz boost frequency ● AMD Radeon™ 8065S graphics ● 40 Compute Units with RDNA™ 3.5 architecture ● Hardware ray tracing ● AMD XDNA™ 2 NPU ● Up to 55 TOPS of dedicated AI performance The combination provides a flexible computing platform capable of handling AI inference as well as GPU computing, content creation, development, virtualization and other professional workloads. The EVO-X5 Pro also supports up to 24TB of storage, dual 10GbE networking, USB4 connectivity, 8K display output and eGPU expansion. Strengthening Collaboration with AMD The China launch also highlighted the growing strategic collaboration between GMKtec and AMD in AI computing. Zhao Hui Ji, Vice President of Marketing at AMD Greater China, delivered a keynote addressing AMD’s technology roadmap, the accelerating shift toward AI computing at the edge, and the future of the AI PC industry. His insights further highlighted the opportunities created by combining AMD’s advanced computing platforms with GMKtec’s compact desktop AI systems, particularly in local AI inference, Agentic PC applications, and commercial AI computing. The appearance of a senior AMD executive at the launch underscored the companies’ continued collaboration in bringing high-performance AI computing from the cloud and data center closer to the desktop. Built for Commercial Management and Security The PRO designation of the EVO-X5 Pro goes beyond performance. For enterprise and institutional deployments, the system integrates AMD DASH out-of-band management, allowing IT administrators to remotely manage supported systems independently of the operating system. This can include remote power control, KVM access, BIOS configuration and system recovery, making the platform suitable for environments where multiple AI nodes need to be centrally managed. The system also incorporates a dedicated dTPM 2.0 hardware security module and hardware-based fingerprint authentication, adding security layers for enterprise deployments and sensitive local AI workloads. A dedicated 10GbE management interface further separates system management from regular network traffic. Together, these capabilities are designed to make the EVO-X5 Pro easier to deploy and manage as part of a commercial AI environment. Scaling from One Node to an AI Cluster The EVO-X5 Pro can also scale beyond a single system. At the China launch event, GMKtec demonstrated two multi-node configurations designed to illustrate how compact desktop AI systems can be combined into larger local computing environments. Five EVO-X5 Pro Nodes — Up to 960GB A five-node configuration can combine five EVO-X5 Pro systems, each with up to 192GB of unified memory, providing up to 960GB of total physical memory across the cluster. The configuration is designed for larger local AI workloads, including private enterprise AI, AI agent deployment, model validation and other applications requiring more computing and memory resources than a single node can provide. Twenty Nodes — Up to 3.84TB GMKtec also demonstrated a 20-node configuration with up to 3.84TB of total physical memory. The systems can be organized as a centrally managed AI computing pool, with resources allocated across multiple users, workloads or environments. This architecture opens up applications such as AI education laboratories, university training environments, development centers and other multi-user AI computing scenarios. Rather than scaling only through a traditional data-center model, GMKtec's approach allows AI computing capacity to grow modularly by adding compact computing nodes. Local AI and Agentic Computing The EVO-X5 Pro also supports GMKtec's Claw ecosystem, which enables users to build and deploy local AI agents through a visual workflow without requiring extensive coding. Potential applications include AI-assisted productivity, content generation, private knowledge bases and other agentic workflows. By running AI workloads locally, organizations can maintain greater control over their data and computing environment while reducing reliance on public cloud infrastructure. This local-first approach reflects GMKtec's broader vision for the Agentic PC—a computer that is not simply a device for running applications, but an active AI computing platform capable of processing information, running models and supporting intelligent workflows locally. A New Stage for Desktop AI Supercomputing The EVO-X5 Pro made its global debut at IFA 2026, where it demonstrated the potential of bringing large-scale AI computing to the desktop. The system was subsequently recognized with PCWELT Best of IFA 2026 and SmartZone BEST OF IFA 2026 Innovation Award honors. The October 9 China launch adds a new dimension to that evolution by demonstrating how the same platform can extend from a single high-performance desktop AI system into a manageable and scalable commercial AI infrastructure. From 192GB unified memory and offline 320B AI to enterprise-grade management and multi-node configurations reaching 3.84TB of total physical memory, the EVO-X5 Pro represents GMKtec's next step toward making large-scale local AI computing practical at the desktop level. One node can run large models. Multiple nodes can build an AI infrastructure. Available at Official Global Website: https://tinyurl.com/d68twx75 About GMKtec GMKtec is a global technology company focused on high-performance compact computing, desktop AI supercomputing, and intelligent edge devices. The company is evolving the traditional mini PC into a new generation of powerful local AI platforms for consumers, professionals, and businesses. With an integrated approach spanning R&D, manufacturing, branding, and global distribution, GMKtec develops compact computing solutions designed to bring high-performance computing and AI capabilities closer to users. Its portfolio includes desktop AI supercomputers, mini PCs, portable graphics solutions, and consumer and commercial NAS products. GMKtec works closely with leading technology partners including AMD, Intel, and Microsoft, and continues to invest in compact high-performance computing and local AI innovation. The brand has received international recognition including the 2025 American Good Design Award Platinum and French Design Award Gold, while the EVO-X5 Pro earned PCWELT Best of IFA 2026 and SmartZone BEST OF IFA 2026 Innovation Award at IFA 2026. Today, GMKtec products are available in more than 70 countries, supporting a growing global community of users and partners. Through its focus on compact AI computing, GMKtec is working to make powerful, private, and deployable AI infrastructure accessible beyond traditional data centers and cloud environments.
Read more





