T

The Hartford

Sells business insurance and employee benefits

AI Software Engineer

AI Application Engineering +1Confirmed live in the last 24 hours
Full-timeHyderabad, Telangana, IndiaNo salary listedIn-person

About the Job

Requirements

  • Eight or more years of professional software engineering experience, including at least two years focused on AI/ML solution development and delivery.
  • A bachelor's degree in Computer Science, Software Engineering, AI/ML, or a related field, or equivalent experience.
  • Strong understanding of large language model architectures, capabilities, and limitations.
  • A proven track record building and deploying production AI systems, including retrieval-augmented generation, agents, fine-tuning, embeddings, and vector search.
  • Proficiency with AI orchestration frameworks such as LangChain, Semantic Kernel, AutoGen, CrewAI, or LlamaIndex.
  • Hands-on experience with major large language model providers and platforms, including OpenAI, Anthropic, Google Vertex AI, or AWS Bedrock.
  • Understanding of prompt engineering, evaluation methodologies, and AI safety and guardrails.
  • Expert-level proficiency in Python and strong skills in at least one additional language such as Java, TypeScript/Node.js, or C#/.NET.
  • Hands-on experience deploying and operating AI workloads on AWS, GCP, or Azure; containerization with Docker and Kubernetes; and CI/CD tooling such as Jenkins or GitHub Actions.
  • Proficiency with SQL and NoSQL databases, vector databases such as Pinecone, Weaviate, pgvector, or ChromaDB, and data pipeline tools.
  • A proven track record building production APIs using REST, GraphQL, or gRPC and event-driven integrations.
  • Advanced daily usage of AI coding assistants with demonstrated impact on productivity and code quality.
  • Strong testing practices for AI systems, including model evaluation, integration testing, and automated quality checks.
  • Excellent written and verbal communication skills and the ability to explain complex AI concepts to diverse audiences.

Responsibilities

  • Design, build, and deploy production AI systems, including retrieval-augmented generation pipelines, agentic workflows, multi-model orchestration, and intelligent automation.
  • Integrate large language model APIs and AI/ML services, including GCP Vertex AI, into enterprise applications.
  • Implement and optimize prompt engineering strategies, fine-tuning pipelines, embeddings, and vector search solutions.
  • Build and maintain AI orchestration workflows using frameworks such as LangChain, Semantic Kernel, AutoGen, CrewAI, or LlamaIndex.
  • Develop custom AI agents, tools, and autonomous workflows to solve business problems.
  • Establish AI system evaluation frameworks measuring accuracy, latency, cost, hallucination rates, and business outcomes.
  • Build end-to-end AI-powered applications across frontend, backend, APIs, and data layers.
  • Develop backend services using Python with FastAPI or Django, or Node.js, to support AI workloads.
  • Implement and optimize RESTful APIs, GraphQL endpoints, and event-driven integrations for AI services.
  • Build modern frontend interfaces for AI-powered features using React, Angular, or Vue.js with TypeScript.
  • Write clean, well-tested, production-ready code focused on maintainability and operational excellence.
  • Design and implement MLOps/LLMOps pipelines for reliable model deployment, versioning, and lifecycle management.
  • Configure and manage cloud-native AI infrastructure on AWS or GCP, including model serving, orchestration, and auto-scaling.
  • Implement AI system observability by monitoring model drift, token costs, latency, throughput, and quality metrics.
  • Build and maintain CI/CD pipelines for AI model deployment, automated testing, and continuous evaluation.
  • Design resilience measures, including failover strategies, fallback models, circuit breakers, and graceful degradation.
  • Use AI coding assistants such as GitHub Copilot, Cursor, or Claude to accelerate development workflows.
  • Use AI tools for code generation, refactoring, test writing, documentation, and code review.
  • Develop and maintain custom AI-powered developer tools, automations, and internal platforms.
  • Establish guardrails, security practices, and governance for responsible AI use in engineering.
  • Promote AI-first development practices across engineering teams.
  • Train and upskill team members in effective use of AI tools, large language model integration patterns, and ML best practices.
  • Contribute to internal knowledge bases, technical talks, and communities of practice.
  • Partner with product, design, and data science teams to identify and deliver AI-driven opportunities.
  • Participate in architecture reviews and design discussions to ensure AI solutions are production-ready.

Desired Qualifications

  • Experience building enterprise AI platforms serving multiple product teams.
  • Familiarity with custom model training, fine-tuning methods such as LoRA and QLoRA, and RLHF techniques.
  • Experience with agent-based AI architectures and autonomous multi-step workflows.
  • Knowledge of AI security concerns such as prompt injection, data leakage, and model poisoning, and mitigation strategies.
  • Experience in regulated industries such as insurance, finance, or healthcare, including security and compliance requirements.
  • Contributions to open-source AI/ML projects or published technical content.
  • Cloud certifications such as AWS Solutions Architect or GCP Professional Cloud Architect, or equivalent.
  • Experience with real-time inference, streaming responses, and low-latency AI serving architectures.

About the Company

The Hartford

Sells business insurance and employee benefits

The Hartford sells insurance to businesses and individuals, covering property, liability, workers' compensation and auto risks, along with group disability, life and paid-leave benefits that employers offer their staff. Its business unit insures everything from local shops to large corporations and writes specialty coverage in the United States and abroad, while its personal unit sells car and home policies to individual customers. Agents, brokers and direct channels sell the policies, and the company earns money from premiums and from investing them before claims are paid. Its oldest insurer was founded in 1810, and the company is based in Hartford, Connecticut.

Company size
10,001+
Company stage
IPO
Headquarters
Hartford, CT
Founded
1810

Recently Posted Jobs

Explore more opportunities at The Hartford

See more jobs