P

Pillsbury

Global law firm advising technology companies

AI Engineer

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeNashville, TN, USA$85k - $170kIn-person

About the Job

Requirements

  • Strong Python programming skills and the ability to develop maintainable, production-quality software using APIs, automated testing, version control, and code review.
  • Working knowledge of SQL and experience integrating application, data, and AI components.
  • Hands-on experience developing AI agents, agent-enabled applications, or multi-step AI workflows involving language models, enterprise information, APIs, or external tools.
  • Experience with prompt and context design, structured outputs, tool integration, state management, error handling, and human-in-the-loop workflows.
  • Practical experience with Azure Databricks and working knowledge of Microsoft Azure services used for application development, integration, or deployment.
  • Understanding of retrieval-augmented generation (RAG), embeddings, retrieval techniques, and how source quality relates to AI system performance.
  • Experience evaluating and troubleshooting AI applications, including analyzing execution traces, failures, task completion, quality, latency, or cost.
  • Understanding of production engineering practices, including application deployment, configuration management, secrets management, monitoring, automated testing, and troubleshooting.
  • Working knowledge of authentication, authorization, role-based access controls, and security considerations associated with enterprise AI applications and sensitive information.
  • Ability to translate ambiguous business requirements into practical technical solutions.
  • Ability to communicate technical concepts and tradeoffs effectively to technical and non-technical stakeholders.
  • Ability to collaborate effectively with engineers, domain experts, and business users.

Responsibilities

  • Partner with attorneys, practice groups, and business teams to identify AI opportunities, understand workflows, define requirements, and establish measurable success criteria.
  • Design, develop, test, and deploy AI agents and multi-step workflows using platforms and frameworks such as Azure Databricks, n8n, LangGraph, and Databricks Agent Bricks.
  • Integrate AI solutions with enterprise applications, APIs, governed data sources, and native Microsoft Azure services, incorporating appropriate human review and approval processes.
  • Develop prototypes with users and translate successful concepts into reliable, scalable production applications.
  • Build and maintain evaluation datasets, automated tests, and quality measures to assess agent behavior, retrieval quality, tool-use accuracy, task completion, performance, latency, and cost.
  • Analyze execution traces, system behavior, and failure patterns to troubleshoot issues and continuously improve AI solutions.
  • Collaborate with Data Architecture and DevOps teams to support governed data access, application deployment, environment configuration, monitoring, and production support.
  • Design AI solutions with reliability safeguards, including error handling, retries, timeouts, stopping conditions, recovery processes, and controls to prevent unintended or duplicate actions.
  • Apply security, access controls, data protections, source traceability, and responsible AI practices throughout solution design and deployment, including protections against prompt injection, inappropriate access, and data leakage.
  • Engage with users after deployment to gather feedback, support adoption, measure business impact, and identify opportunities for continued enhancement.
  • Participate in code reviews, technical documentation, knowledge sharing, and developing reusable components, standards, and engineering best practices.

Desired Qualifications

  • Experience deploying, monitoring, and supporting AI applications in a production environment.
  • Experience with AI orchestration or workflow technologies such as n8n, LangGraph, Databricks Agent Bricks, or comparable platforms.
  • Experience with MLflow, LangSmith, or similar AI tracing, observability, and evaluation tools.
  • Advanced experience with Azure Databricks technologies, including Spark, Delta Lake, Unity Catalog, Lakebase, or Delta Sharing.
  • Experience designing and optimizing RAG solutions, including vector search, hybrid retrieval, filtering, reranking, document processing, metadata extraction, and retrieval evaluation.
  • Experience with graph databases, knowledge graphs, graph-based RAG, or techniques for identifying and linking entities and relationships across information sources.
  • Experience with PostgreSQL or similar technologies for persistent agent state, checkpoints, or memory.
  • Front-end or application development experience using TypeScript, JavaScript, React, or similar technologies.
  • Experience designing user-facing AI applications incorporating streaming responses, citations, progress indicators, feedback mechanisms, and human review.
  • Experience developing reusable AI tools and enterprise integrations, including Model Context Protocol (MCP) or comparable integration approaches.
  • Experience designing evaluation datasets, benchmarks, regression testing, automated scoring, or LLM-based evaluation methods.
  • Knowledge of statistical analysis or experimental design used to evaluate AI system performance and improvements.
  • Experience with Microsoft Entra ID, managed identities, and enterprise authentication and authorization models.
  • Experience working in legal services, professional services, technical consulting, or another environment involving sensitive information and complex business workflows.

About the Company

Pillsbury

Global law firm advising technology companies

Pillsbury provides legal services to technology companies, investors and clients in industries like Energy, Financial, Life Sciences, Real Estate, and more. It helps clients with transactions, regulatory matters, and complex commercial issues through multidisciplinary teams that coordinate across practice areas and regions. Its approach combines collaboration across specialties with deep industry knowledge to deliver integrated, practical legal advice. The firm differentiates itself with a global footprint across the Americas, Europe, Asia, Africa, and the Middle East and a track record of recognized excellence, aiming to help clients grow, innovate, and manage risk in dynamic markets.

Company size
1,001-5,000
Company stage
Not listed
Total funding
Not listed
Headquarters
San Francisco, CA
Founded
1868

Recently Posted Jobs

Explore more opportunities at Pillsbury

See more jobs