servethehome

Author page description

October 13

  • Broadcom Tomahawk 6 – Davisson 102.4T Switch with Co-Packaged Optics Shipping

    ➀ Broadcom has started shipping its Tomahawk 6-Davisson 102.4T switch featuring integrated co-packaged optics (CPO), achieving a 70% reduction in power consumption;

    ➁ The switch employs TSMC's COUPE photonic engines and 3nm Condor SerDes, with field-replaceable laser modules for improved maintenance;

    ➂ This innovation addresses high-power networking demands in AI clusters, enabling higher port density and energy-efficient 1.6TbE connectivity.

    BroadcomCo-packaged opticsHPC

October 11

  • Cisco Silicon One P200 and Cisco 8223 for 51.2T Scale Across Networking

    ➀ Cisco unveiled its Silicon One P200 chip and Cisco 8223 switch, targeting 51.2T-scale networking for geographically distributed AI clusters and addressing power efficiency challenges.

    ➁ The Silicon One P200 emphasizes large buffers and a P4 programmable network processor for high-performance, flexible flow management, enabling multi-data-center connectivity critical for AI workloads.

    ➂ Competing with NVIDIA and Broadcom in scale-across networking, Cisco highlights security features and plans to support IOS XR and NX-OS, aligning with industry trends of colocating compute resources near power sources.

    CiscoNetworkingAI

October 6

  • AMD and OpenAI Ink Megadeal for 6GW of Future AI Compute

    ➀ AMD and OpenAI announced a 6GW AI compute mega-deal, marking a significant milestone in AMD's AI GPU market position with plans to deploy 1GW of MI450 GPUs in late 2026;

    ➁ The collaboration involves AMD's Venice server CPUs and Pensando networking solutions, providing infrastructure support for large-scale AI deployments;

    ➂ The agreement includes warrants for OpenAI tied to AMD's stock performance and technical milestones, signaling deep strategic alignment between the companies.

    AIAMDOpenAI

October 5

  • KAYTUS MotusAI for Enterprise AI DevOps

    ➀ KAYTUS MotusAI is an enterprise AI DevOps platform designed to manage end-to-end AI workflows, including inference/training clusters, storage, models, and user roles;

    ➁ It provides multi-tier user permissions (general users, admins, supervisors), Kubernetes integration, and resource monitoring features for GPU utilization, storage, and cluster health;

    ➂ The platform supports NVIDIA MIG GPU partitioning, data synchronization, and cost management tools for enterprise AI infrastructure optimization.

    AIHPC

October 4

  • Dell N2224X-ON Review 24-Port 2.5GbE 4-port 25GbE 2-port 40GbE Switch

    ➀ The Dell N2224X-ON is a 24-port 2.5GbE switch with four 25GbE and two 40GbE ports, ideal for SMEs seeking high-density connectivity at lower costs.

    ➁ Available on eBay for $200-$400, it offers a user-friendly web GUI and CLI management, catering to both novices and professionals.

    ➂ Hardware highlights include hot-swappable 550W PSUs, modular fans, and flexible 40GbE port configurations for stacking or 10GbE breakout.

    25GbEDellNetworking

October 3

  • What are 400G-SR8 Optics and Why Do They Matter

    ➀ 400G-SR8光模块采用8通道设计,每通道50Gbps,支持短距离(100米)400Gbps数据传输,适用于数据中心;

    ➁ 需搭配MPO-16 APC光纤,相比传统MPO-12或LC接口的线缆,成本更低但布线复杂度增加;

    ➂ 厂商示例包括NVIDIA MMA4U00 OSFP模块和FS 400G QSFP-DD模块,未来在MikroTik CRS812等交换机中将更普及。

    NVIDIA

October 2

  • TP-Link 10Gbase-T PCIe Network Adapter Mini-Review

    ➀ The TP-Link TX401 10Gbase-T PCIe network adapter features a Marvell AQC113-B1-C controller, supporting 10GbE/5GbE/2.5GbE speeds with PCIe Gen3 x4 interface;

    ➁ Testing showed standard performance with iperf3 benchmarks, achieving expected throughput for a low-power (3-5W) consumer-grade solution;

    ➂ Designed for compact systems like mini-PCs and NAS units, it offers cost-effective 10Gbase-T connectivity but lacks advanced offload features found in datacenter NICs.

    MarvellPCIeTP-Link

October 1

  • Building New STH Studio Storage NAS

    ➀ The article details the construction of a high-capacity all-flash NAS for STH's video production studio to address growing storage demands from 8K/RAW camera footage and multi-editor workflows;

    ➁ Built around a QNAP TS-h1290FX chassis with 12x 30.72TB Solidigm D5-P5336 SSDs (360TB raw), the system leverages AMD EPYC 7002 CPUs, NVIDIA ConnectX-6 25GbE networking, and PCIe Gen4 expansion;

    ➂ The solution emphasizes SSD advantages in reliability, silent operation, rebuild speed, and future scalability to 1.5PB+ while maintaining a compact desktop form factor.

    AMD

September 29

  • MikroTik CRS812 DDQ 400GbE Switch Launched CRS812-8DS-2DQ-2DDQ

    ➀ MikroTik launched the CRS812-8DS-2DQ-2DDQ, a 1U switch featuring 2x400GbE QSFP56-DD ports, 2x200GbE QSFP56 ports, and 8x50GbE SFP56 ports, powered by Marvell's 98DX7335 chip and an Annapurna Labs AL52400 quad-core ARM CPU;

    ➁ Priced at $1,295, it targets high-performance networking with support for PAM4 56Gs signaling and includes low-cost 400Gbps QSFP-DD optics ($159);

    ➂ Designed for advanced users, the switch may appeal to AI/GPU clusters like NVIDIA DGX Spark, with 130-140W power consumption and dual PSU/fan modules for redundancy.

    Marvell

September 28

  • STH Q3 2025 Letter from the Editor Trifecta Challenges

    ➀ STH navigates challenges balancing its roles in PR, analyst content, and influencer-driven media, driven by the growth of its YouTube channel and Substack platform;

    ➁ The channel reaches 1 million YouTube subscribers, while the Axautik Group's Substack surpasses 100K monthly views, focusing on monetizable industry analysis;

    ➂ STH Labs expands its short-form content strategy and plans to hire full-time staff to scale operations in 2026 amid evolving communication models with tech companies.

    AMDHPCNVIDIA

September 27

  • PylePro PCO885 2U PDU Quick Look

    ➀ The article provides an internal overview of the PylePro PCO885 2U rackmount PDU, featuring 18 outlets and two USB-A ports;

    ➁ While lacking advanced features like USB-C PD and remote monitoring, its affordable price (~$89) makes it a cost-effective solution for basic power distribution needs;

    ➂ The detailed teardown reveals its internal wiring, breaker assembly, and construction, highlighting its simplicity and value-for-money proposition

September 24

  • Touring MikroTik in Latvia to See How they Make Awesome Networking Gear

    ➀ The article details a tour of MikroTik's facilities in Latvia, dispelling misconceptions about the company's size and origin while showcasing its EU-based manufacturing and design processes;

    ➁ MikroTik's headquarters, housed in a renovated 19th-century factory, features modern offices, prototyping labs, and collaborations with contract manufacturer HansaMatrix;

    ➂ The visit highlights MikroTik's significant revenue scale (comparable to Netgear) and provides insights into Riga's historical landmarks alongside the company's production workflow.

    Networking
  • Microsoft Etches Complex Microfluidics Channels Directly into Silicon Chips

    ➀ Microsoft developed a new cooling technology by etching microfluidic channels directly into silicon chips, aiming to improve heat dissipation for high-power AI accelerators and future 3D-IC designs;

    ➁ The prototype used a 3rd Gen Intel Xeon Scalable processor (likely Ice Lake) with DDR4 RDIMMs, demonstrating leak-proof packaging and structural integrity challenges in channel depth optimization;

    ➂ This approach reduces thermal interface layers and increases surface contact, potentially revolutionizing liquid cooling for advanced chip packaging architectures.

    CoolingIntelMicrosoft
  • Crucial X10 2TB Portable SSD Review Compact and Neat

    ➀ The Crucial X10 2TB is a compact and cost-effective portable SSD with USB 3.2 Gen2 speeds, positioned between the X6 and X10 Pro models;

    ➁ It features IP65 dust/water resistance and a 3-meter drop rating, making it durable for mobile use;

    ➂ Despite its lower price than the X10 Pro, it delivers competitive performance, offering faster speeds than entry-level options like the X6.

    CrucialSSDstorage

September 20

  • Why Enfabrica Has the Coolest Technology

    ➀ NVIDIA acquired Enfabrica for $900 million, leveraging its ACF-S chip that bridges PCIe and high-speed networking (32x112G lanes) to enhance scalability and efficiency in AI/HPC clusters;

    ➁ Enfabrica's EMFASYS system enables 18TB of shared CXL memory across GPUs, reducing reliance on costly HBM and improving workload optimization;

    ➂ The ACF-S architecture offers multi-path redundancy, minimizing bandwidth loss during failures and achieving 50% lower cost per token in large-scale AI inference.

    AIHPCNVIDIA
  • MikroTik CRS418-8P-8G-2S+RM Launched PoE Switch and More

    ➀ MikroTik launched the CRS418-8P-8G-2S+RM, a 16-port 1GbE switch with eight PoE+ ports (150W total), two 10G SFP+ uplinks, and dual redundant power supplies;

    ➁ The device integrates Qualcomm IPQ-8072 Arm CPU and Marvell switch chip, targeting small businesses needing an all-in-one networking solution with routing capabilities;

    ➂ ServeTheHome teased an upcoming factory tour video revealing MikroTik's manufacturing process and unreleased products.

    NetworkingPoE

September 18

  • NVIDIA to Take 5 Billion Stake in Intel and Intel to Make Custom x86 NVIDIA Chips

    ➀ NVIDIA plans to invest $5 billion in Intel stock, pending regulatory approval, boosting Intel's share price significantly.

    ➁ Intel will manufacture custom x86 CPUs for NVIDIA's AI infrastructure and data centers, potentially integrating NVLink technology, impacting AMD's market position.

    ➂ Intel will also develop x86 SoCs with NVIDIA RTX GPU chiplets for consumer PCs, positioning NVIDIA to expand into both x86 and Arm-based consumer devices.

    IntelNVIDIAcpu

September 16

  • Solidigm D7-PS1010 Review A Fast PCIe Gen5 NVMe SSD

    ➀ The Solidigm D7-PS1010 is a PCIe Gen5 NVMe SSD optimized for mixed to read-intensive workloads, available in a 7.68TB 2.5″ form factor suitable for AI systems;

    ➁ The drive features a distinctive black casing with passive cooling fins and is part of Solidigm's Gen5 lineup, leveraging SK Hynix's parent company technology;

    ➂ With a 1 DWPD endurance rating, the SSD balances performance and reliability, targeting enterprise and AI applications despite lower-rated endurance compared to older high-DWPD drives.

    PCIeSK HynixSSD

September 13

  • SK hynix Produces HBM4 Faster than JEDEC Specs Entering Mass Production

    ➀ SK Hynix's HBM4 achieves over 10Gbps per-pin speed, exceeding JEDEC's 8Gbps standard by 25%, enhancing AI accelerator performance;

    ➁ Utilizes 1bnm process and Mass Reflow Molded Underfill (MR-MUF) technology to ensure production reliability and readiness for mass manufacturing;

    ➂ Positions SK Hynix as a key supplier for next-gen AI chips, benefiting clients like NVIDIA seeking premium memory solutions.

    AIHBMSK Hynix

September 12

  • QNAP QXG-25G2SF-CX6 25GbE NVIDIA ConnectX-6 Lx NIC Mini-Review

    ➀ The QNAP QXG-25G2SF-CX6 is a dual-port 25GbE NIC featuring NVIDIA's ConnectX-6 Lx chip, designed for NAS systems but adaptable to broader deployments;

    ➀ It features a low-profile design with an integrated cooling fan for improved thermal performance in compact spaces;

    ➁ Supports PCIe Gen4/Gen3 interfaces and SFP28 connectivity, enabling 25GbE or backward-compatible 10GbE network configurations.

    25GbENVIDIA

September 9

  • Ladies and Gentlemen We have a YouTube Channel 1 MILLION Subscriber Edition

    ➀ ServeTheHome's YouTube channel celebrates reaching 1 million subscribers, tripling its growth since surpassing 100,000 three years ago;

    ➁ The milestone highlights contributions from the team, sponsors, and the community, with special acknowledgment to Linus Sebastian for inspiring the channel's inception;

    ➂ Future content plans include studio productions, homelab builds, and international tech tours, partially funded by YouTube memberships.

    AIHPCSoftware
  • SiFive 2nd Gen Intelligence Family Launched

    ➀ SiFive launched its 2nd Gen Intelligence Family of RISC-V CPUs tailored for AI applications, featuring smaller sizes, lower power consumption, and enhanced accelerator IP integration;

    ➁ The new series includes X100/X200/X300/XM models with RVA23 standardization for improved software compatibility, and introduces dual interfaces (SSCI/VCIX) to optimize accelerator control;

    ➂ Architectural innovations like configurable cache hierarchy and optimized exponential functions aim to boost performance for AI accelerators while maintaining flexibility in embedded and large-scale systems.

    AIRISC-Vcpu

September 8

  • Thank You For the Supercomputers Google Predictions for the Next Phase of AI at Hot Chips 2025

    ➀ Noam Shazeer, co-lead of Google Gemini, emphasized at Hot Chips 2025 that larger-scale computing resources (e.g., FLOPS, memory, bandwidth) are critical for advancing LLMs;

    ➁ Training AI models has evolved from 32 GPUs in 2015 to hundreds of thousands of accelerators today, requiring dedicated supercomputing infrastructure;

    ➂ Future AI hardware demands include enhanced compute density, memory hierarchy optimization, and network scalability to support increasingly complex models.

    AIGoogleHPC

September 7

  • STH Weekly Newsletters You Want to Subscribe in Q3 2025

    ➀ ServeTheHome (STH) highlights its weekly newsletter summarizing key articles and industry trends for IT professionals, prioritizing reader convenience;

    ➁ Introduces a paid Axautik Group Substack for in-depth analysis and market insights, targeting enterprise subscribers;

    ➂ The newsletter format includes weekly recaps, top stories, and upcoming content previews, avoiding intrusive promotion methods.

    HPCSoftwareserver

September 6

  • Picking Servers CPUs for Databases in 2025 is Still Complex

    ➀ Choosing server CPUs for databases in 2025 remains complex due to performance factors like core count, cache, and memory hierarchy, alongside database licensing costs;

    ➁ High licensing fees for enterprise databases (e.g., Oracle, Microsoft SQL Server, SAP HANA) are often tied to CPU cores or memory, making CPU selection critical for cost optimization;

    ➂ AMD EPYC CPUs exemplify the trade-off between performance and licensing expenses, as vendors design chips to balance database workloads and license-driven cost constraints.

    AMDMicrosoftOracle

September 1

  • MiTAC G8825Z5 AMD Instinct MI325X 8-GPU Server Review

    ➀ The MiTAC G8825Z5 is an 8-GPU server featuring AMD Instinct MI325X accelerators with 2TB HBM3E memory, powered by dual AMD EPYC Turin CPUs;

    ➀ The 8U chassis employs a modular design with separate GPU and CPU trays, 15 hot-swappable fan modules, and six 3.3kW Titanium PSUs for optimized cooling and redundancy;

    ➂ The server emphasizes serviceability, offering 12 PCIe slots for expansion and a rear-agnostic I/O design preferred in data center environments.

    AMDHPCMiTAC

August 30

  • Crucial X6 2TB Portable USB SSD Review

    ➀ The Crucial X6 2TB is a cost-effective, compact USB 3.2 Gen2 (10Gb/s) external SSD, priced lower than competitors like the Crucial X9 Pro and Samsung T7 Shield.

    ➁ It offers a read speed of up to 800MB/s and includes shock resistance, vibration-proofing, and drop resistance up to 6.5 feet, with a lightweight design and bundled Type-C cable.

    ➂ While its sequential write speed is unspecified, it caters to budget-conscious users prioritizing affordability and portability over peak performance.

    CrucialSSDUSB

August 29

  • Dell Precision 3240 Compact Mini PC with PCIe Card Slot Overview

    ➀ The Dell Precision 3240 Compact is a small-form-factor PC gaining popularity in the second-hand market for homelab use, featuring support for Intel Xeon CPUs and NVIDIA GPUs;

    ➁ It provides a low-profile PCIe slot for expandability (e.g., NICs or GPUs) and includes multiple high-speed USB ports (up to 10Gbps);

    ➂ The system lacks native tower orientation but offers labeled rear ports, optional vPro management, and refined cooling for a compact design.

    DellNVIDIAPCIe

August 27

  • NVIDIA Outlines GB10 SoC Architecture at Hot Chips 2025

    ➀ NVIDIA disclosed the architecture of its GB10 SoC at Hot Chips 2025, a multi-die solution combining a Blackwell-based GPU and MediaTek's 20-core Arm CPU, both fabricated on TSMC's 3nm process;

    ➁ The GB10 powers NVIDIA's DGX Spark workstation, offering FP4 support for AI workloads and enabling scalable cluster configurations;

    ➂ Designed for high-performance computing, the chip emphasizes collaboration between NVIDIA and MediaTek, targeting advanced AI inference and training applications.

    BlackwellHPCNVIDIA
  • Huawei Presents UB-Mesh Interconnect for Large AI SuperNodes at Hot Chips 2025

    ➀ Huawei introduced its UB-Mesh interconnect technology at Hot Chips 2025, targeting large-scale AI SuperNodes with up to a million chips;

    ➁ The architecture employs a unified protocol and hybrid topology to reduce costs, improve scalability, and ensure reliability for data center-scale deployments;

    ➂ Key innovations include resilient optical links and hierarchical redundancy to address high error rates and node failures in gigaWatt AI data centers.

    AIHPCHuawei