TEN
Blog Recruit Inquiry
KO | EN
LinkedIn X YouTube Tistory
Blog Recruit Inquiry

TEN-EN

TEN's blog on enterprise GPU infrastructure — GPU utilization, FinOps, AI networking, and data center power. Practical insights for teams running AI at scale.
See AllGPU & AI OpsIndustry InsightsProduct GuideAI InfrastructureTeam InsightEngineering
What Is LLM Serving? Inference Deployment Explained

What Is LLM Serving? Inference Deployment Explained

What is LLM serving? Learn how requests flow through an inference stack, how engines differ from serving platforms, key metrics like TTFT, and much more.
Amanda's avatar
Nov 18, 2026
AI Infrastructure
GPU Server Benchmarking Checklist Before You Buy

GPU Server Benchmarking Checklist Before You Buy

Buying GPU servers off the spec sheet? See why public benchmarks miss real workload performance, which metrics to measure, and a step-by-step checklist.
Amanda's avatar
Nov 16, 2026
GPU & AI Ops
What Is an AI Data Center? How It Differs

What Is an AI Data Center? How It Differs

How does an AI data center differ from a typical one? Compare rack power density, air vs. liquid cooling, and GPU networking, plus what to check first.
Amanda's avatar
Nov 11, 2026
Industry Insights
GPU Quota Management: Reclaiming Idle GPUs

GPU Quota Management: Reclaiming Idle GPUs

Set GPU quotas but still short on GPUs? Learn the limits of Kubernetes ResourceQuota, two-tier quota design, and how to auto-reclaim idle dev environments.
Amanda's avatar
Nov 09, 2026
Product GuideGPU & AI Ops
What Is Kubernetes? Why AI Infrastructure Uses It

What Is Kubernetes? Why AI Infrastructure Uses It

What is Kubernetes? Learn how it automates container deployment, scaling, and recovery, how it differs from Docker, and why AI and GPU teams rely on it.
Amanda's avatar
Nov 04, 2026
AI Infrastructure
What Is LLM Serving? Inference Deployment Explained

What Is LLM Serving? Inference Deployment Explained

What is LLM serving? Learn how requests flow through an inference stack, how engines differ from serving platforms, key metrics like TTFT, and much more.
Amanda's avatar
Nov 18, 2026
AI Infrastructure
GPU Server Benchmarking Checklist Before You Buy

GPU Server Benchmarking Checklist Before You Buy

Buying GPU servers off the spec sheet? See why public benchmarks miss real workload performance, which metrics to measure, and a step-by-step checklist.
Amanda's avatar
Nov 16, 2026
GPU & AI Ops
What Is an AI Data Center? How It Differs

What Is an AI Data Center? How It Differs

How does an AI data center differ from a typical one? Compare rack power density, air vs. liquid cooling, and GPU networking, plus what to check first.
Amanda's avatar
Nov 11, 2026
Industry Insights
GPU Quota Management: Reclaiming Idle GPUs

GPU Quota Management: Reclaiming Idle GPUs

Set GPU quotas but still short on GPUs? Learn the limits of Kubernetes ResourceQuota, two-tier quota design, and how to auto-reclaim idle dev environments.
Amanda's avatar
Nov 09, 2026
Product GuideGPU & AI Ops
What Is Kubernetes? Why AI Infrastructure Uses It

What Is Kubernetes? Why AI Infrastructure Uses It

What is Kubernetes? Learn how it automates container deployment, scaling, and recovery, how it differs from Docker, and why AI and GPU teams rely on it.
Amanda's avatar
Nov 04, 2026
AI Infrastructure
AI Training vs Inference: Why GPUs Differ

AI Training vs Inference: Why GPUs Differ

What separates AI training and inference? A clear guide to both stages, their different GPU usage patterns, why their infrastructure needs differ, and how to run both efficiently on one GPU infrastructure.
Amanda's avatar
Nov 03, 2026
GPU Platform: Build vs Buy TCO

GPU Platform: Build vs Buy TCO

Should you build your own GPU platform on Kubernetes, or buy one? License cost says build, but 3-year TCO with hidden costs tells a different story.
Amanda's avatar
Oct 28, 2026
GPU & AI OpsProduct Guide
What Is a Token? The Unit of LLM Cost

What Is a Token? The Unit of LLM Cost

What is a token in an LLM? A clear guide to what tokens are, how they differ from words, input vs output tokens and the context window, why tokens became the unit of AI cost and performance, and the GPU infrastructure behind token throughput.
Amanda's avatar
Oct 27, 2026
AI Infrastructure
A 1-Second Health Check Took Down a DB

A 1-Second Health Check Took Down a DB

An image pull failing with a 401 pointed at auth. It wasn’t auth. Here is how a 1-second liveness probe kept restarting a recovering database, and why.
안녕텐's avatar
Oct 26, 2026
EngineeringTeam Insight
7 Metrics to Watch on Your GPUs

7 Metrics to Watch on Your GPUs

GPU-Util reads 90% but training is slow. Why? Beyond the utilization trap, here are the 7 metrics that actually matter and how to read them in layers.
Amanda's avatar
Oct 22, 2026
GPU & AI OpsProduct Guide
What Is a Foundation Model? A Simple Guide

What Is a Foundation Model? A Simple Guide

What is a foundation model? A clear guide to the model that's pretrained on broad data and adapted to many tasks — its relationship to LLMs, the pretraining and fine-tuning process, and the GPU infrastructure enterprises need to use it.
Amanda's avatar
Oct 20, 2026
AI Infrastructure
A Guide to GPU Chargeback

A Guide to GPU Chargeback

How do you split the cost of a shared GPU cluster across teams? From showback to chargeback, here is a practical 4-step process for allocating GPU spend.
Amanda's avatar
Oct 19, 2026
GPU & AI Ops
What to Watch in GPU Monitoring

What to Watch in GPU Monitoring

Why is judging your infrastructure by GPU-Util alone so risky? Beyond the utilization trap, here are the 5 metrics that actually matter in operations.
Amanda's avatar
Oct 16, 2026
GPU & AI Ops
Cloud-Native Inference & GPU Splitting

Cloud-Native Inference & GPU Splitting

LLM inference needs CUDA Graph optimization, but CUDA Graphs freeze allocation at capture. TEN’s RA:X team solves this in place with GRIP, accepted to SoCC ‘26.
안녕텐's avatar
Oct 12, 2026
EngineeringProduct Guide
GPU Partitioning vs MIG: What's the Difference

GPU Partitioning vs MIG: What's the Difference

Is NVIDIA MIG enough for sharing GPUs? Compare MIG's limits — fixed profiles, a max of seven instances, GPU restrictions — against software partitioning with 1% granularity and dynamic reallocation, and see which fits your environment.
Amanda's avatar
Oct 09, 2026
GPU & AI Ops
H100 vs H200 vs B200: What's the Difference

H100 vs H200 vs B200: What's the Difference

What separates NVIDIA's H100, H200, and B200? Compare HBM capacity and bandwidth, architecture (Hopper vs Blackwell), FP4 support, and real specs — plus which GPU to pick for LLM training and inference workloads.
Amanda's avatar
Oct 06, 2026
AI Infrastructure
What Are Data Center Tiers? Tier 1–4 Explained

What Are Data Center Tiers? Tier 1–4 Explained

What defines a data center Tier? A clear guide to the Uptime Institute's Tier 1–4 classification, uptime and annual downtime, redundancy concepts like N+1 and 2N, and which tier AI data centers actually need.
Amanda's avatar
Sep 28, 2026
Industry Insights
Nginx Ingress to Cilium: Migration Retrospective

Nginx Ingress to Cilium: Migration Retrospective

We migrated a production Kubernetes cluster's CNI from flannel to Cilium after Ingress-NGINX reached end-of-life. Here are the five issues that surfaced over ten days after removing kube-proxy — SNI, timeouts, NodePort, monitoring — and the lessons learned.
안녕텐's avatar
Sep 22, 2026
Engineering
GPU Chargeback: A Practical Build Guide

GPU Chargeback: A Practical Build Guide

How do you fairly allocate shared GPU costs across teams? A FinOps guide to the difference between chargeback and showback, what to measure, and the practical steps to build a GPU cost allocation system.
Amanda's avatar
Sep 15, 2026
On-Prem vs Cloud GPU: How to Choose

On-Prem vs Cloud GPU: How to Choose

Build GPU infrastructure on-prem or rent it in the cloud? Compare the two on TCO, data security, scalability, and utilization — plus when a hybrid strategy makes the most sense.
Amanda's avatar
Sep 14, 2026
GPU & AI Ops
What Is PUE? AI Data Center Power Efficiency

What Is PUE? AI Data Center Power Efficiency

PUE (Power Usage Effectiveness) shows how efficiently a data center uses power. Here's what PUE means, how it's calculated, why it worsens in AI data centers, and how to improve power efficiency in high-density GPU environments.
Amanda's avatar
Sep 12, 2026
Industry Insights
The GPU Utilization Trap: 95% Isn't Real

The GPU Utilization Trap: 95% Isn't Real

GPU utilization of 95% can still mean your GPUs are barely working. Here's why nvidia-smi's utilization metric doesn't reflect actual compute, what MFU really measures, and how to monitor GPU efficiency correctly.
Amanda's avatar
Sep 12, 2026
GPU & AI Ops
5 Real Reasons Your GPU Utilization Is Stuck at 5%

5 Real Reasons Your GPU Utilization Is Stuck at 5%

Average GPU utilization of just 5% isn't a GPU shortage problem. Here are the five real causes — idle allocation, monopolized cards, no scheduling — plus how to diagnose and fix each
Amanda's avatar
Sep 09, 2026
GPU & AI Ops
What Is VRAM? GPU Memory for Running LLMs

What Is VRAM? GPU Memory for Running LLMs

What is VRAM and why does it matter for running LLMs? A simple guide to GPU memory vs system RAM, how to estimate VRAM by model size, and what to do when you run out.
Amanda's avatar
Sep 07, 2026
AI Infrastructure
Kubernetes GPU Scheduling Explained

Kubernetes GPU Scheduling Explained

Why do GPU jobs sit pending when GPUs are still free? A clear look at how Kubernetes GPU scheduling works, the limits of the default scheduler, the fragmentation problem, and what efficient GPU placement requires.
Amanda's avatar
Sep 03, 2026
GPU & AI Ops
Neocloud Explained: Definition & Key Players

Neocloud Explained: Definition & Key Players

What is a neocloud? A clear look at GPU-focused clouds built for AI workloads. how they differ from hyperscalers, key players like CoreWeave, and the operations layer that decides profitability.
Amanda's avatar
Aug 31, 2026
Industry Insights
Transformers Are Now Harder to Get Than GPUs: Why Power Is the Real AI Data Center Bottleneck

Transformers Are Now Harder to Get Than GPUs: Why Power Is the Real AI Data Center Bottleneck

The AI data center bottleneck is shifting from GPUs to power. Here's why transformer lead times now stretch past three years and how to run more AI on the power you already have.
Amanda's avatar
Aug 12, 2026
Industry Insights
What Is a Neocloud? GPUaaS Market Growth and Monetization Strategy

What Is a Neocloud? GPUaaS Market Growth and Monetization Strategy

Neoclouds are GPUaaS clouds for AI workloads. After the GPU race, profitability hinges on the operational layer — utilization, multi-tenancy, billing, and automation.
Amanda's avatar
Aug 11, 2026
Industry Insights
GPU Power Optimization: How to Control the 40% of AI Data Center Operating Costs That Go to Power

GPU Power Optimization: How to Control the 40% of AI Data Center Operating Costs That Go to Power

No matter how many GPUs you buy, there's no profitability without power control. — we break down AIPub's GPU power optimization strategy.
Amanda's avatar
Aug 11, 2026
GPU & AI Ops
Inference Optimization in the Blackwell Era: Why Cost-Per-Token Is the New Standard

Inference Optimization in the Blackwell Era: Why Cost-Per-Token Is the New Standard

If you chose your GPU based on FLOPs/$, you'll regret it when inference bills arrive. We break down Blackwell Ultra's cost-per-token revolution and what it means for infrastructure operations.
Amanda's avatar
Aug 11, 2026
Industry Insights
What Is a Modular Data Center (MDC)? The Next-Generation Approach to Building AI Infrastructure

What Is a Modular Data Center (MDC)? The Next-Generation Approach to Building AI Infrastructure

Learn what a Modular Data Center (MDC) is, how it differs from containerized data centers, and why MDC are becoming a practical deployment model for high-density AI infrastructure.
Amanda's avatar
Aug 09, 2026
Product Guide
Why Traditional Data Centers Are Reaching Their Limits in the AI Era

Why Traditional Data Centers Are Reaching Their Limits in the AI Era

Explore why traditional data centers are reaching their limits in the AI era, as GPU power density, cooling requirements, and construction timelines reshape AI infrastructure strategy.
Amanda's avatar
Aug 09, 2026
Product Guide
Why GPU Infrastructure Operations Must Evolve in the Agentic AI Era

Why GPU Infrastructure Operations Must Evolve in the Agentic AI Era

Traditional infrastructure operations can no longer control resource contention or security risks. Here's why access control must extend beyond GPUs to the entire stack.
Amanda's avatar
Aug 08, 2026
Industry Insights
The Structural Limits of Time-Slicing: How Spatial Partitioning Solves the 30% GPU Utilization Problem

The Structural Limits of Time-Slicing: How Spatial Partitioning Solves the 30% GPU Utilization Problem

Low GPU utilization isn't caused by the structural limits of time-slicing. See how spatial partitioning fundamentally solves these problems.
Amanda's avatar
Aug 08, 2026
GPU & AI Ops
Understanding Docker for AI: From Container Tech to GPU Optimization Strategies.

Understanding Docker for AI: From Container Tech to GPU Optimization Strategies.

What is Docker and why is it essential for AI and MLOps? Learn container architecture, runtime structure, and how to manage GPUs efficiently in container environments.
Amanda's avatar
Aug 08, 2026
AI Infrastructure
What Is DiLoCo? Distributed LLM Training Without Ultra-Fast Networks

What Is DiLoCo? Distributed LLM Training Without Ultra-Fast Networks

DiLoCo, Streaming DiLoCo, and Decoupled DiLoCo cut communication overhead in distributed LLM training — and what it means for multi-cluster GPU ops.
Amanda's avatar
Aug 08, 2026
AI Infrastructure
Why GPU Scheduling is Non-Negotiable in 2026: KubeCon EU Highlights

Why GPU Scheduling is Non-Negotiable in 2026: KubeCon EU Highlights

At KubeCon EU 2026, NVIDIA donated GPU scheduling tools to CNCF. With 80% of AI workloads now running on Kubernetes, GPU scheduling has become essential infrastructure.
Amanda's avatar
Aug 07, 2026
Industry Insights
GPU Cluster Adoption Guide: 5 Essential Checks for Scalable AI Infrastructure

GPU Cluster Adoption Guide: 5 Essential Checks for Scalable AI Infrastructure

Thinking of building a GPU cluster? Check these 5 essential factors before scaling your AI infrastructure, from distributed training to scheduling and resource optimization.
Amanda's avatar
Aug 07, 2026
GPU & AI Ops
NVIDIA MIG: A Practical Guide to GPU Partitioning for Efficient AI Infrastructure

NVIDIA MIG: A Practical Guide to GPU Partitioning for Efficient AI Infrastructure

What is NVIDIA MIG? Learn how Multi-Instance GPU enables efficient GPU partitioning, improves utilization, and reduces AI infrastructure costs with real-world strategies.
Amanda's avatar
Aug 07, 2026
GPU & AI Ops
AI Infrastructure Is Not Just About GPUs: Why Storage and Network Fabric Matter

AI Infrastructure Is Not Just About GPUs: Why Storage and Network Fabric Matter

GPUs alone are not enough for AI infrastructure. Learn why storage and network fabric are critical to performance, and how to design a balanced AI system.
Amanda's avatar
Aug 06, 2026
AI Infrastructure
Maximizing AI ROI: 5 Strategies for Achieving 100% GPU Efficiency via AIPub

Maximizing AI ROI: 5 Strategies for Achieving 100% GPU Efficiency via AIPub

Why are expensive GPUs sitting idle? Learn 5 practical strategies for GPU scheduling, fractional usage, and AI workload automation with AIPub.
Amanda's avatar
Aug 06, 2026
Product Guide
How to Build AI Infrastructure: Designing with Reference Architecture

How to Build AI Infrastructure: Designing with Reference Architecture

Struggling to design AI infrastructure? Learn how reference architecture helps you choose the right GPU, optimize performance, and reduce risk with data-driven decisions.
Amanda's avatar
Aug 05, 2026
AI Infrastructure
GPU Resource Optimization: 5 Essential Checks Before Building AI Infrastructure

GPU Resource Optimization: 5 Essential Checks Before Building AI Infrastructure

Before buying more GPUs, check your AI infrastructure. Learn 5 essential steps to optimize GPU resources and improve performance with smarter operations.
Amanda's avatar
Aug 05, 2026
GPU & AI Ops
What Is an AI Network Fabric? Why Adding GPUs Doesn't Speed Up Training

What Is an AI Network Fabric? Why Adding GPUs Doesn't Speed Up Training

More GPUs don't guarantee faster training — the network fabric may be the bottleneck. Here's why scaling efficiency drops and what to check first.
Amanda's avatar
Aug 05, 2026
Industry Insights
AI Factory Era: Why NVIDIA Is Betting on Operating Software Over GPU Performance

AI Factory Era: Why NVIDIA Is Betting on Operating Software Over GPU Performance

NVIDIA is shifting from selling GPUs to selling AI factory operating software. Here's what DSX, Tokens per Watt, and this shift mean for your GPU infrastructure.
Amanda's avatar
Aug 05, 2026
Industry Insights
What Is Disaggregated Inference? Why LLM Serving Splits Prefill and Decode

What Is Disaggregated Inference? Why LLM Serving Splits Prefill and Decode

Disaggregated Inference splits LLM inference's Prefill and Decode stages across separate GPUs — here's why, its performance benefits, and what to check before adopting it.
Amanda's avatar
Aug 05, 2026
AI Infrastructure
Hybrid Multi-Cluster AI Infrastructure Management: A Unified Strategy

Hybrid Multi-Cluster AI Infrastructure Management: A Unified Strategy

Learn how to manage hybrid and multi-cluster AI infrastructure. Discover unified orchestration strategies to optimize GPU utilization and reduce operational complexity.
Amanda's avatar
Aug 04, 2026
GPU & AI Ops
AI Infrastructure Optimization: Why GPU Monitoring Is Essential

AI Infrastructure Optimization: Why GPU Monitoring Is Essential

Learn why GPU monitoring is critical for AI infrastructure. Discover how AI Pub enables real-time visibility, bottleneck detection, and cost optimization.
Amanda's avatar
Aug 04, 2026
GPU & AI Ops

TEN-EN

RSS·Powered by Inblog