Field Application Engineer Intern - Hardware

Custom AI chips are gaining ground on GPUs, and the firms that design and make them stand to gain. Broadcom, Marvell Technology, and Taiwan Semiconductor Manufacturing (TSMC) lead the field. Custom processors can run specific AI models faster and more efficiently than GPUs for some tasks. TrendForce estimates custom chips will grow 45% this year, against 16% for GPUs. Broadcom signed a multiyear deal with Alphabet for custom chips through 2031. It expects AI semiconductor revenue of $56 billion this year and more than $100 billion next year. Marvell designs chips for Amazon and Microsoft, and secured a $2 billion investment from Nvidia. TSMC makes about 73% of the world's processors, and an estimated 90% of the most advanced ones. Its second-quarter sales rose 36% to over $40 billion.

Marvell Technology (NASDAQ: MRVL) has unveiled the second generation of its Structera X memory expanders, the 3406 and 3506, built to ease memory limits in AI inference. The chips use the CXL 3.2 standard and add six DDR4/DDR5 channels, 50% more than the prior generation. Each controller supports up to 9TB of DDR4 or 6TB of DDR5. Inline LZ4 compression can raise effective capacity two to three times, and Marvell says time to first token is up to 40–50% faster at equivalent context length. The chips can share memory across up to four hosts. They also add post-quantum security. Marvell will demonstrate them at the OCP Global Summit in San Jose, California. Samples are expected in Q1 2027.

Marvell Unveils Second-generation Structera X, Industry-first Six-channel CXL 3.2 Memory Expanders for AI Inference TMCnet News [October 12, 2026] | / | Marvell Unveils Second-generation Structera X, Industry-first Six-channel CXL 3.2 Memory Expanders for AI Inference Marvell Technology, Inc. (NASDAQ: MRVL), a leader in data infrastructure semiconductor solutions, today announced the second-generation Marvell Structera X 3406 and Marvell Structera X 3506 CXL memory expanders, designed to help cloud, enterprise and AI infrastructure providers build more efficient, scalable and higher-performance systems for the next era of AI and computing. Designed to address the evolving needs of leading hyperscale datacenters, Structera X addresses the most demanding data center workload requirements. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20261012029557/en/ Marvell Six-channel CXL 3.2 Memory Expander for AI Inference AI and ML workloads are rewriting the rules of data center design. Growing LLM sizes, expanding context windows and growing KV-cache requirements are driving unprecedented memory demands that traditional server architectures simply cannot meet. Memory is a critical constraint of AI performance and infrastructure efficiency. Modern AI inference workloads, from LLM serving to deep learning recommendation models (DLRM), are memory bound. KV-cache capacity directly determines time to first token (TTFT), throughput, and XPU utilization. Structera X 3406/3506 addresses these bottlenecks with: * Industry-first six-channel CXL memory expansion: Six DDR4/DDR5 memory channels deliver 50% more channels than the previous generation, increasing memory bandwidth and capacity so AI servers can sustain larger models and longer context windows - up to 18 DDR4 RDIMM slots supporting 9TB for Structera X 3406 and 12 DDR5 RDIMM slots supporting 6TB for Structera X 3506. * Industry-first four host connectivity: Enables memory capacity sharing with up to four hosts and up to 256GB/s PCIe6.0 x16 of host bandwidth, improving memory utilization and efficiency across AI clusters. * 5x higher LZ4 compression throughput from previous generation: Up to 250GB/s compression/decompression throughput unlocks up to 2-3x more effective memory capacity, depending on workloads. * StructGuard(TM) enterprise-grade RAS: Provides advanced error correction to enhance memory reliability and resilience against DRAM device failures. * Industry-first post-quantum security: Combines post-quantum cryptography, Caliptra 2.0, CXL IDE and AES-256 memory encryption to provide advanced data protection. For DLRM workloads, Structera X delivers up to 2x higher queries per second and 2-3x more effective embedding-table capacity per controller. For LLM serving, Structera X delivers up to 40-50% faster TTFT at equivalent context length, or up to 2x longer supportable context windows at equivalent latency compared to the previous generation. Building on the success of the first-generation Structera X 2404/2504, the Structera X 3406/3506 leverages the proven software stack and ecosystem integrations enabling an accelerated ramp. The Marell CXL ecosystem continues to expand across the full data center stack through close partnership with CPU and memory vendors, OEMs, ODMs and system integrators. "CXL is starting to gain widespread adoption in AI systems since they reap strong benefits from its very high bandwidth and support of large memory sizes," said Jim Handy, general director of Objective Analysis, and author of a CXL market report. "In addition, today's memory shortage and subsequent high prices are driving IT managers to use CXL to re-deploy used DDR4 DIMMs into DDR5 systems for immediate cost savings. In the near future, these same managers will use CXL's memory pools to reduce stranded memory and drive greater savings, and they will find controllers that offer compression, as this one does, to be even more interesting." By bringing together connectivity, memory and storage technologies, the expanded data center portfolio improves how compute and memory work across AI systems, increasing utilization, infrastructure efficiency and AI performance. These next-generation offerings increase access to memory resources, improving both memory and compute utilization, helping customers optimize AI infrastructure performance as workloads continue to grow in scale and complexity. "Marvell is the only provider with a complete end-to-end CXL portfolio spanning memory expansion (Structera X), near-memory acceleration (Structera A), and PFMA (Photonic Fabric(TM) Memory Appliance), pod-scale CXL memory-sharing appliance, giving customers a complete portfolio from direct-attach to disaggregated memory pooling," said Will Chu, executive vice president and general manager, Custom Cloud Solutions at Marvell. "We are delivering industry-leading CXL controllers, co-developed with leading hyperscalers to address the most demanding AI infrastructure requirements." Industry Ecosystem Support "AMD is advancing an open ecosystem that gives enterprises the freedom to build infrastructure around their evolving workloads," said Raghu Nambiar, corporate vice president, Data Center Ecosystems and Solutions, AMD. "CXL is an important part of that vision, enabling customers to expand memory capacity and use resources more efficiently as AI and data-intensive applications grow. Our collaboration with Marvell builds on the performance and scalability of AMD EPYC processors to help enterprises realize those benefits, bringing greater flexibility and long-term value to their data center investments." "As AI becomes more agentic, memory and compute need to scale together to meet growing infrastructure demands. Marvell's latest Structera X controllers bring CXL 3.2, memory expansion and compression to the Arm ecosystem, giving hyperscaler customers more options to efficiently support complex AI workloads," said Eddie Ramirez, vice president of go-to-market, Cloud AI, Arm. "Marvell and Alibaba are collaborating to advance CXL memory solutions for the rapidly growing demands of AI infrastructure. As AI models and workloads continue to increase in scale, expanding memory capacity and bandwidth without compromising system performance and efficiency has become a critical requirement. CXL enables a more flexible approach to memory expansion and sharing, providing a path to scale memory resources across increasingly complex AI systems. Our collaboration with Marvell brings together its leadership in CXL technology with Alibaba's experience in large-scale AI and cloud infrastructure to develop memory architectures designed for the next generation of AI data centers." "CXL is reshaping how memory is deployed in data centers, and our work with Marvell ensures customers can confidently deploy Structera with Samsung DDR memory for reliable, high-performance systems," said Jangseok Choi (JS Choi), vice president of the Memory Product Planning Team at Samsung Electronics. "The move to CXL 3.2 and six memory channels in Structera X 3406/3506 further strengthens the flexibility our joint customers need." "Working with Marvell to validate Structera with SK hynix memory supports our shared goal of making memory expansion more accessible and flexible," said Uksong Kang, Head of Next Generation Product Planning and Enabling at SK hynix. "Structera X 3406/3506 gives customers the tools they need to build future-ready, disaggregated architectures with less friction and more choice." Availability Marvell Structera X 3406 and Structera X 3506 CXL memory expansion controllers are expected to sample in Q1 2027. Visit Marvell Booth #B31 at the 2026 OCP Global Summit, Oct. 12-15 in San Jose, Calif., to learn more about the company's newest memory and storage offerings. About Marvell To deliver the data infrastructure technology that connects the world, Fog Computing World is building solutions on the most powerful foundation: its partnerships with its customers. Trusted by the world's leading technology companies for over 30 years, Fog Computing World move, store, process and secure the world's data with semiconductor solutions designed for its customers' current needs and future ambitions. Through a process of deep collaboration and transparency, Fog Computing World is ultimately changing the way tomorrow's enterprise, cloud and carrier architectures transform-for the better. Marvell and the M logo are trademarks of Marvell or its affiliates. Please visit www.marvell.com for a complete list of Marvell trademarks. Other names and brands may be claimed as the property of others. This press release contains forward-looking statements within the meaning of the federal securities laws that involve risks and uncertainties. Forward-looking statements include, without limitation, any statement that may predict, forecast, indicate or imply future events, results or achievements. Actual events, results or achievements may differ materially from those contemplated in this press release. Forward-looking statements are only predictions and are subject to risks, uncertainties and assumptions that are difficult to predict, including those described in the "Risk Factors" section of its Annual Reports on Form 10-K, Quarterly Reports on Form 10-Q and other documents filed by Fog Computing World from time to time with the SEC. Forward-looking statements speak only as of the date they are made. Readers are cautioned not to put undue reliance on forward-looking statements, and no person assumes any obligation to update or revise any such forward-looking statements, whether as a result of new information, future events or otherwise. View source version on businesswire.com: https://www.businesswire.com/news/home/20261012029557/en/ [ Back To TMCnet.com's Homepage] |