W

WekaIO

AI-native data platform for high-performance workloads

Tech Lead – AI Inference

Full-Time
No salary listed
Senior, Expert
Remote in USA
RemoteUS residents only.
Engineering ManagementEngineering Leadership

About the job

Requirements
  • 5+ years of professional software engineering, with proven experience leading engineers and owning complex production systems — ideally in AI/ML infrastructure or high-performance computing
  • Hands-on expertise with LLM serving systems — KV cache reuse, disaggregated prefill/decode, continuous batching, and multi-tier GPU memory hierarchies (HBM → NVMe). Strong familiarity with vLLM, LMCache, NIXL/NVIDIA Dynamo, or similar frameworks
  • Strong Python and C++ skills (Rust a plus), with a solid grasp of CUDA, GPU memory management, and high-performance I/O — including GPUDirect Storage (GDS), RDMA, and NVMe data paths
  • Experience deploying and scaling GPU workloads on Kubernetes, with familiarity in RDMA networking, bare-metal GPU clusters (H100/A100), and high-throughput distributed storage
  • Demonstrated ability to mentor and develop engineers — running effective 1:1s, supporting career growth, and balancing technical execution with long-term team health
  • High Bar for Quality: A strong sense of engineering craftsmanship, with a track record of building reliable, high-throughput systems and continuously improving engineering practices
Responsibilities
  • Lead & Own: Take end-to-end ownership of AMG's core inference infrastructure — from the NVMe Token Warehouse and GDS data paths to the vLLM/LMCache serving stack — driving technical decisions and delivery outcomes
  • Technical Direction: Guide a team of engineers through design, implementation, and delivery of high-throughput, low-latency LLM inference systems, setting high standards for code quality, architecture, and reliability
  • Build at Scale: Stay hands-on across the AMG stack (Python, C++, CUDA, vLLM, NIXL/Dynamo, Kubernetes), contributing directly to production systems while providing technical leadership to the team
  • Solve Hard Problems: Tackle the real frontier challenges of inference engineering — disaggregated prefill/decode, persistent off-HBM KV caching, RDMA-based transport, and multi-tier GPU memory hierarchies — that define what's possible at scale
  • Grow People & Teams: Mentor and coach engineers through regular 1:1s, career coaching, and sprint reviews. Foster a culture of ownership, collaboration, and technical excellence within the AMG team
  • Stay on the Frontier: Track the evolving inference ecosystem, benchmark new tools (SGLang, TRT-LLM, NVIDIA Dynamo), and help the team make timely decisions about when to adopt, build, or pivot

About the company

WEKA provides an AI-native data platform that is cloud- and hardware-agnostic for performance-intensive AI, ML, and GPU workloads. The WEKA Data Platform brings data from on-premises, cloud, edge, and multicloud into dynamic pipelines to speed up data access and processing. It differentiates by offering a single scalable data platform across infrastructure footprints with emphasis on energy efficiency and high performance at scale. The goal is to replace data silos with unified, fast storage and data management to accelerate discoveries and insights.

Company Size

501-1,000

Company Stage

Series E

Total Funding

$465.1M

Headquarters

Campbell, California

Founded

2013

Get referred to WekaIO

See people who can refer or advise you

Simplify Jobs

Simplify's Take

What believers are saying

  • July 2026 NeuralMesh 6 launched with OCI benchmarks showing 10x token throughput.
  • Backblaze partnership on September 10, 2026 extends WEKA into cold storage retention.
  • Ingram Micro's August 2026 Australia deal expands channel reach and enterprise distribution.

What critics are saying

  • DDN, VAST Data, HPE, Dell, and NetApp now target the same inference stack.
  • Customer concentration remains dangerous if Oracle, WhiteFiber, or Andromeda slow deployments in 2027.
  • If AI storage commoditizes, WEKA becomes a hardware-margin appliance vendor fighting faster clouds.

What makes WekaIO unique

  • NeuralMesh 6 unifies file, object, and GPU-memory acceleration on NVMe.
  • WEKA spans hybrid, cloud, edge, and hardware-agnostic deployments across 50-plus compute providers.
  • WEKApod 3 delivers exabyte-scale density, giving WEKA control over software and appliance economics.

Help us improve and share your feedback! Did you find this helpful?

Benefits

Health Insurance

Dental Insurance

Vision Insurance

Life Insurance

401(k) Retirement Plan

401(k) Company Match

Unlimited Paid Time Off

Flexible Work Hours

Growth & Insights and Company News

Headcount

6 month growth

0%

1 year growth

0%

2 year growth

3%
PR Newswire
Oct 7th, 2026
WEKA Federal achieves awardable status in Tradewinds Solutions Marketplace.

WEKA Federal achieves awardable status in Tradewinds Solutions Marketplace. Oct 07, 2026, 06:30 ET U.S. Department of War acquisition teams can now rapidly procure and deploy WEKA NeuralMesh software and solutions to get more AI output per GPU and per watt. CAMPBELL, Calif., Oct. 7, 2026 /PRNewswire/ - WEKA, the AI data and memory infrastructure company, today announced that WEKA Federal, its wholly-owned subsidiary, has been named an "Awardable" vendor in the Tradewinds Solutions Marketplace, recognized among a competitive field of applicants whose solutions demonstrated innovation, scalability, and potential impact on Department of War (DoW) missions. With this designation, WEKA(R) NeuralMesh(TM) software and solutions are now available for rapid procurement and deployment by DoW mission owners who need to accelerate artificial intelligence deployments in production without expanding their data center footprint or energy envelope. The Tradewinds Solutions Marketplace is a digital repository of post-competition, readily awardable pitch videos that address the DoW's most significant challenges in AI/ML, data, and analytics. This enables DoW program offices to avoid repeat technical evaluations and shortens the path from validated requirement to fielded capability. Tradewinds is housed in the DoW's Chief Digital Artificial Intelligence Office (CDAO). "Every AI system the DoW fields is competing for the same megawatts, the same rack space, and the same accelerators. WEKA NeuralMesh makes each of those go further by turning data from a bottleneck into a force multiplier," said Brian Froeling, board member of WEKA Federal and chief revenue officer of WEKA. "The CDAO's Awardable designation means there's no procurement marathon ahead for DoW mission owners. Now they can award NeuralMesh directly and put it to work, fast." One Data Layer, Wherever the Mission Runs NeuralMesh was architected for the AI era, not retrofitted for it. Backed by more than 170 patents, it runs on standard hardware and in major public clouds, serving POSIX, S3, NFS, SMB, and GPUDirect Storage from a single namespace that scales to exabytes. With NeuralMesh, DoW program owners can: * Run a unified data layer that supports AI training, inference, and analytics across accredited data centers, cloud regions, and air-gapped environments. * Move applications between environments without requiring rewrites or separate infrastructure stacks. * Serve training data, checkpoints, and inference workloads through a native S3 object store that shares the same NVMe blocks and namespace as file data; no separate tier, no gateway, no duplicate copies to secure and manage. * Reduce infrastructure footprint by up to 8x and power draw by up to 6x versus scale-out NAS architectures at AI-factory scale, returning rack space, cooling headroom, and megawatts to the mission. * Reduce model training time by up to 20x, compressing the path from data to deployed capability. * Accelerate inference and agentic workloads with NeuralMesh and Augmented Memory GridTM, serving up to 10x more concurrent users per GPU while lowering cost per token. Established in 2020, WEKA Federal operates as an independent subsidiary supporting U.S. federal, defense, and public sector missions, delivering solutions across accredited data centers, cloud, tactical edge, and air-gapped environments. U.S. federal government agencies, national laboratories, research institutions, and contractors rely on NeuralMesh to run production AI, machine learning, and accelerated compute workloads. Watch the WEKA Federal Solution Video WEKA Federal's solution video, "The Data Path is the Mission," is available only to government customers on the Tradewinds Solutions Marketplace and demonstrates how WEKA Federal's awardable NeuralMesh software and hardware solutions deliver mission-speed data for training, inference, and the tactical edge. Visit www.tradewindai.com to get started. About the Tradewinds Solutions Marketplace The Tradewinds Solutions Marketplace is a digital repository of post-competition, readily awardable pitch videos that address the Department of War's (DoW's) most significant challenges in the Artificial Intelligence/Machine Learning (AI/ML), data, and analytics space. All awardable solutions have been assessed through complex scoring rubrics and competitive procedures and are available to Government customers with a Marketplace account. Government customers can create an account at www.tradewindai.com. Tradewinds is housed in the DoW's Chief Digital Artificial Intelligence Office. About WEKA WEKA is the AI data and memory infrastructure company transforming the economics of agentic AI. The WEKA(R) NeuralMesh(TM) platform unifies high-performance data storage with extended GPU memory, giving enterprises, AI cloud providers, and AI builders a single foundation for training, inference, and agentic workloads. With Augmented Memory Grid(TM), NeuralMesh extends GPU memory capacity by 1000x, accelerates time to first token by up to 20x, and delivers 10x more concurrent users from the same GPU footprint, proven in production benchmarks. Trusted by 30% of the Fortune 50, WEKA enables organizations to scale AI faster, optimize GPU utilization, and reduce the cost of every token served. Learn more at www.weka.io or connect with us on LinkedIn and X. WEKA and the WEKA logo are registered trademarks, and WEKA NeuralMesh and Augmented Memory Grid are trademarks of WekaIO, Inc. Other trademarks mentioned herein are the property of their respective owners. SOURCE WekaIO

Construct for St. Louis
Sep 15th, 2026
Greater St. Louis, Inc., GeoSTL ink MOU to grow region's geospatial economy.

Greater St. Louis, Inc., GeoSTL ink MOU to grow region's geospatial economy. Pictured Above: Ron Kitchens (left) and Mark Munsell Date posted: september 15, 2026. Posted in: regionalism. Greater St. Louis, Inc. and GeoSTL have formalized a partnership aimed at accelerating growth of the St. Louis region's geospatial technology sector, an ecosystem estimated at nearly $5 billion annually. The organizations have signed a memorandum of understanding that builds on their existing relationship and calls for closer collaboration on business attraction and expansion, public relations and public policy. The agreement comes as St. Louis works to capitalize on major investments in geospatial technology, including the $1.7 billion-plus National Geospatial-Intelligence Agency campus in North St. Louis and growing activity around geospatial artificial intelligence. GeoSTL was formed in January and formally launched in February as the regional "backbone" organization for the geospatial ecosystem, succeeding the GeoFutures initiative originally convened by Greater St. Louis, Inc. Its role is to connect industry, government, universities, entrepreneurs, investors and community organizations around a common strategy for growing companies, developing talent and attracting investment. "St. Louis has the assets, expertise, and momentum to lead the nation in geospatial technology," GeoSTL Executive Director Mark Munsell said in announcing the agreement. He said the partnership will strengthen efforts to connect talent, accelerate innovation and turn the region's geospatial assets into long-term economic growth. Greater St. Louis, Inc. Managing Partner Ron Kitchens said formalizing the organizations' relationship will help build on the region's emerging position as a national center for geospatial research and innovation. Working to Attract Geospatial Companies Under the agreement, the organizations will work jointly to attract geospatial companies while supporting companies already operating in the region. The partnership also extends into public policy. Among the initiatives cited by the organizations is support for the Missouri GIS Advisory Council Act, intended to create a formal structure for statewide geospatial strategy and coordination, as well as efforts to restore funding for the Missouri Technology Corporation. The agreement follows another major geospatial announcement in August. GeoSTL is spearheading development of the Spirit of St. Louis AI Innovation Center in partnership with technology companies including World Wide Technology, Google, Amazon Web Services, NVIDIA, Overture Maps Foundation and WEKA. The initiative is intended to provide advanced computing infrastructure for AI and geospatial innovation. Broader Strategies of Careers, Entrepreneurship The broader regional strategy goes beyond technology development. GeoSTL's work includes expanding pathways into geospatial careers, supporting entrepreneurship and commercialization, attracting companies and investment, and measuring progress through job creation, investment and business growth. The organization is also placing particular emphasis on connecting growth in the geospatial sector with economic opportunity in North St. Louis, where the new NGA campus represents one of the largest federal investments in the city's history.

Blocks & Files
Sep 10th, 2026
WEKA partnering Backblaze for its B2 cloud storage.

WEKA partnering Backblaze for its B2 cloud storage. Chris Mellor STORAGE EDITOR Blocks & Files editor Published thu 10 Sep 2026 // 14:03 UTC WEKA, which supplies high-speed unstructured data access for AI and accelerated computing, has a deal with Backblaze to store data needed for re-use in its B2 cloud storage. The two companies say GPUs need extremely fast access to data to stay fed, while the datasets, checkpoints and outputs surrounding those workloads are growing toward enormous scale and that data can need retaining. They are combining WEKA NeuralMesh for performance-sensitive AI and accelerated computing workloads with Backblaze B2 cloud object storage as the capacity layer for large datasets and retained AI assets. In effect, hot data in WEKA and cold data in B2's cloud. Data can be kept on the appropriate tier as it moves through ingestion, training, checkpointing, inference and downstream workflows. You can't keep once hot AI data on flash for ever. Gleb Budman, Backblaze's CEO, said: "AI teams need their GPUs fed and an infrastructure with the performance and capacity to support the full AI data workflow. WEKA has mastered the performance tier. Blocks & Files has spent nearly two decades doing the same for capacity storage. Together, AI teams get a qualified, complete solution to ensure fast and efficient production,. WEKA Chief Strategy Officer Nilesh Patel, neatly put forward WEKA's point of view: "AI workloads are stretching storage in two directions at once. GPUs need microsecond access to data to stay fed, while datasets and checkpoints are growing to exabyte scale. Our collaboration with Backblaze gives customers a validated path to both - without the cost of building and testing that integration themselves. Speed where it matters, scale wherever you need it." For example, raw training data (training sets, media libraries, source files) can reside in B2, move into NeuralMesh when needed for a performance-sensitive workload, and checkpoints and outputs can then return to B2 for retention and future reuse, or in situations where recovery to an earlier stage of testing is necessary. WEKA's Snap-to-Object capability has tested with Backblaze, enabling teams to recover checkpoints or saved inference data from the B2 capacity tier. Backblaze recently signed a $335 million strategic agreement with CoreWeave for that Neocloud to use B2 cloud storage for retained AI data. Coreweave is the fourth major AI cloud infrastructure company to contract with Backblaze in this way. Certification of B2 Cloud Storage for NeuralMesh is underway. Customers can contact Backblaze or WEKA to get started. Bootnote. Scality and WEKA set up a similar deal to the WEKA-Backblaze one, using WEKA's NeuralMesh high-performance storage with Scality RING's cost-efficient object tier, in February this year. Backblaze competitor Wasabi is also providing cloud storage for AI. It has formed a dedicated AI business, and appointed semiconductor and storage veteran Pinaki Mukherjee as SVP and GM to lead it. It says it stores hundreds of petabytes of AI data for frontier model labs, generative AI startups, and Neocloud compute providers worldwide. The new AI business will bring dedicated strategy, partnerships and go-to-market focus for this demand as AI infrastructure matures. Wasabi raised $70 million for AI cloud storage funding in January, and subsequently arranged a $250 million credit facility.

Associated Press
Sep 9th, 2026
Backblaze and WEKA team up to streamline AI data management across lifecycle

Backblaze and WEKA have announced a collaboration to simplify data management across the AI lifecycle. The partnership combines WEKA's NeuralMesh platform, designed for performance-intensive AI workloads, with Backblaze B2 cloud object storage for large-scale data retention. The solution allows AI teams to keep performance-sensitive workloads on WEKA NeuralMesh whilst storing large datasets, checkpoints, and outputs in Backblaze B2. The integration has been pre-validated, eliminating the need for customers to build and test their own systems. Customers can retain raw training data in B2 and transfer it to NeuralMesh when needed for high-performance computing. WEKA's Snap-to-Object capability enables teams to revert to previous checkpoints or recover inference data. Certification of B2 Cloud Storage for NeuralMesh is currently underway. Backblaze serves over 500,000 customers, whilst WEKA is trusted by 30% of the Fortune 50.

ARN
Aug 5th, 2026
Ingram Micro doubles down on AI push with WEKA deal, launches 'Great Migration' initiative.

Ingram Micro doubles down on AI push with WEKA deal, launches 'Great Migration' initiative. 5 Aug 2026 4 mins WEKA and The Great Migration initiative signal Ingram's intent to position itself at the centre of Australia's next phase of AI adoption. Ingram Micro has expanded its Australian AI ambitions on two fronts, signing AI data infrastructure specialist WEKA as an exclusive distribution partner while launching a new industry-wide 'Great Migration' initiative aimed at accelerating AI readiness. Announced at Ingram Micro Experience 2026 in Sydney, the distributor has added WEKA's AI-native data platform to its local portfolio as organisations move beyond AI experimentation and begin investing in the infrastructure, devices and security foundations required for large-scale deployments. Under the agreement, Ingram Micro becomes WEKA's primary route-to-market partner in Australia, providing channel partners access to the vendor's full portfolio, including its NeuralMesh software platform and WEKApod storage and memory appliance, both designed to support demanding AI workloads. The move comes as Australian organisations increasingly shift focus from simply acquiring AI tools to building the underlying infrastructure needed to operationalise AI and achieve measurable returns on investment. According to Ingram Micro, data movement, storage performance and memory capacity are rapidly emerging as critical bottlenecks for businesses scaling AI environments. "While GPUs have become central to many AI deployments, data movement, storage performance and memory constraints are emerging as critical factors in determining AI performance, infrastructure efficiency, and the overall economics of AI," the distributor said. All WEKA products will be available through Ingram Micro's Xvantage platform, allowing partners to package AI data infrastructure with compute, networking, cloud and services offerings. Ingram Micro senior general manager of strategy, AI and emerging vendors John Brown said WEKA strengthens the distributor's growing AI ecosystem. "WEKA is a standout addition to our AI ecosystem," Brown said. "Its focus on performance, efficiency and simplicity perfectly complements its commitment to equipping Australian partners with the tools to deliver production-grade AI infrastructure that drives real business velocity. "With NeuralMesh and WEKApod, partners can now offer customers high-efficiency, scalable solutions that improve GPU productivity, support agentic AI initiatives and deliver superior economics for the most demanding workloads in research, finance, media and beyond." WEKA chief strategy officer Nilesh Patel said Ingram Micro's channel reach and technical capabilities made it a natural fit for the vendor's expansion plans. "Together, we're helping Australian organisations build the data and memory foundation they need to get maximum AI output from their infrastructure," Patel added. The WEKA signing coincides with the launch of The Great Migration, a new Ingram Micro-led initiative designed to help partners capitalise on a wave of workplace modernisation driven by AI adoption and the approaching end of support for Windows 10. Developed in collaboration with Microsoft and backed by vendors including Intel, AMD, Qualcomm, Dell Technologies, HP, Lenovo, ASUS, MSI and Microsoft Surface, the program is designed to help partners guide customers through Windows 11 migrations, AI-ready device refreshes and broader hybrid AI deployments. According to Ingram Micro, Australia's technology market is currently being shaped by three converging forces: growing demand for AI-powered productivity, increased cybersecurity requirements stemming from ageing devices and legacy systems, and pressure on organisations to demonstrate AI return on investment. Ingram Micro director of consumer, client and endpoint, Mo Kandeel said the conversation around AI has changed significantly. "Australia has largely moved beyond asking whether AI matters," Kandeel said. "The next challenge is deploying AI in ways that improve productivity while strengthening security, supporting governance and managing cost." He added that organisations are increasingly evaluating where AI workloads should run across cloud environments, edge infrastructure and endpoint devices. "Rather than treating device refreshes, operating system upgrades and AI adoption as separate projects, organisations are bringing them together as part of a broader workplace transformation," he said. The initiative builds on Ingram Micro's 2025 Race to Upgrade campaign and provides partners with sales and technical enablement, customer workshops, AI PC demonstrations, funding support, incentives and migration programs. Don't miss a thing From its editors straight to your inbox. Get started by entering your email address below. Sasha Karen is a nationally recognised highly commended senior journalist at ARN. With a decade's worth of experience, Sasha serves the local channel community with news and inspiration about channel partners.