A

Avra

B2B AI platform for credit scoring

Member of Technical Staff - Inference Platform

Applied Machine LearningUpdated on Nov 12
Full-timeSão Paulo, State of São Paulo, BrazilNo salary listedRemote

About the Job

Requirements

  • At least 7 years of relevant engineering experience at technology and product-driven companies.
  • Experience running model serving or large-scale batch compute on Kubernetes.
  • Experience building Kubernetes controllers or operators.
  • Ability to profile and optimize data-heavy Python pipelines.
  • Ability to account for compute costs and treat compute efficiency as a product feature.
  • Ability to produce production-quality code and reviews and operate the systems built.

Responsibilities

  • Evolve Sophos, the online and batch inference runtime built on Kubernetes.
  • Run large batch inference on ephemeral jobs with multi-dimensional admission control for CPU, memory, and GPU.
  • Build and extend the controller and its Kubernetes custom resources.
  • Optimize each model's inference engine and feature processing.
  • Serve graphs and data efficiently.
  • Own execution of training, post-training, and fine-tuning jobs in Avra's cloud and in customer dataplanes or on-premises cloud.
  • Drive autoscaling, GPU serving, performance, and cost optimization, with telemetry for every model run.

Desired Qualifications

  • Experience using Ray, Ray Serve, or KubeRay in production.
  • Experience with admission-control systems.
  • Experience with GPU serving and performance optimization.
  • Experience with Arrow, Parquet, Lance, or other columnar formats.
  • Experience shipping software to customer-hosted Kubernetes.
  • Experience with GCP or AWS and GKE or EKS, and in financial services or regulated environments.

About the Company

Avra

B2B AI platform for credit scoring

Avra helps B2B companies turn complex data into actionable insights with an AI platform that includes real-time credit scoring for SMBs, advanced customer segmentation, and forecasting of Customer Lifetime Value, plus embeddings to plug into existing models. It builds a client-specific foundational model trained on the company’s data and then applies real-time scoring, segmentation, and CLV predictions. It differentiates itself by delivering a customized AI foundation for each client and providing ready-to-integrate embeddings to augment existing models. Its goal is to help businesses understand market dynamics, reduce risk, and allocate resources more efficiently through precise, data-driven decisions.

Company size
11-50
Company stage
Seed
Total funding
$2M
Headquarters
São Paulo, Brazil
Founded
2024

Recently Posted Jobs

Explore more opportunities at Avra

See more jobs