Software Engineer - AI & Data Platforms, Aidp

Summary

A specialized role for a Snowflake Platform Administration & Performance Engineer role focuses on the seamless synergy between automated administration and high-tier workload optimization. This position is about transforming the data warehouse into an autonomous, high-performance engine that fuels real-time decision-making.

Minimum Qualifications

Snowflake experience Data Engineer or Database Administration or Performance Tuning experience Architecture Knowledge: Deep understanding of multi-cluster shared data architecture and micro-partitioning Bachelor's Degree, Computer Science or equivalent degree or experience

Preferred Qualifications

2+ years in database administration or Performance Tuning with specific hands-on Snowflake experience Master's Degree, Computer Science or equivalent degree Architecture Knowledge: Deep understanding of Snowflake’s multi-cluster shared data architecture and micro-partitioning. Certifications: SnowPro Core Certification is highly preferred, along with cloud-specific associate or professional certifications Performance Tuning & Optimization: Proactively monitor and tune workloads using Snowsight Performance Explorer and ACCOUNT USAGE schemas. You will optimize query execution by analyzing query profiles for disk spillage, identifying Cartesian joins, and implementing Search Optimization Services or Query Acceleration where necessary. Cost Optimization: Analyze credit consumption and query performance to reduce spend while maintaining SLAs Python-Driven Automation: Develop advanced scripts and pipelines using Snowpark Python and Snowpark pandas APIs for scalable data transformations. Automate administrative tasks such as environment provisioning and security policy enforcement through Infrastructure as Code (IaC) tools like Terraform.

Description

Performance Tuning & Optimization: Proactively monitor and tune workloads using Snowsight Performance Explorer and account usage schemas. You will optimize query execution by analyzing query profiles for disk spillage, identifying Cartesian joins, and implementing Search Optimization Services or Query Acceleration where necessary. Lakehouse Implementation: Design and manage unified storage using Apache Iceberg to allow open-format data to be queried directly in Snowflake with warehouse-level performance. Python-Driven Automation: Develop advanced scripts and pipelines using Snowpark Python and Snowpark pandas APIs for scalable data transformations. Automate administrative tasks such as environment provisioning and security policy enforcement through Infrastructure as Code (IaC) tools like Terraform. Cloud: Manage Snowflake Iceberg Tables in AWS cloud.Experience in cloud s3, gateway, private link, EKS, Load Balancing, VPC peering, and secure data sharing Advanced Cost Management: Implement autonomous warehouse management, right-sizing clusters based on real-time usage patterns, and configuring auto-suspend/resume with 60-second timeouts to eliminate idle compute waste Snowflake Platform Administration: Manage accounts, virtual warehouses, and database objects. This includes configuring auto-scaling, monitoring warehouse utilization, and implementing backup strategies via Time Travel and Cloning Security & Governance: Implement Role-Based Access Control (RBAC), Multi-Factor Authentication (MFA), and data masking policies. You are responsible for ensuring compliance with data protection standards like GDPR or HIPAA

Responsibilities

Snowflake Platform Administration: Manage accounts, virtual warehouses, and database objects. This includes configuring auto-scaling, monitoring warehouse utilization, and implementing backup strategies via Time Travel and Cloning. Advanced Cost Management: Implement autonomous warehouse management, right-sizing clusters based on real-time usage patterns, and configuring auto-suspend/resume with 60-second timeouts to eliminate idle compute waste. Lakehouse Implementation: Design and manage unified storage using Apache Iceberg to allow open-format data to be queried directly in Snowflake with warehouse-level performance. Python-Driven Automation: Develop advanced scripts and pipelines using Snowpark Python and Snowpark pandas APIs for scalable data transformations. Automate administrative tasks such as environment provisioning and security policy enforcement through Infrastructure as Code (IaC) tools like Terraform.