Full-Time

Global IT LLM Engineer Manager

Posted on 2/22/2025

Boston Consulting Group

Boston Consulting Group

10,001+ employees

Management consulting for strategic solutions

Consulting
Social Impact

Mid, Senior

Company Does Not Provide H1B Sponsorship

Boston, MA, USA + 1 more

More locations: Atlanta, GA, USA

Category
Applied Machine Learning
Natural Language Processing (NLP)
AI & Machine Learning
Required Skills
LLM
Kubernetes
Python
React.js
Java
TypeScript
AWS
Terraform
Development Operations (DevOps)

You match the following Boston Consulting Group's candidate preferences

Employers are more likely to interview you if you match these preferences:

Degree
Experience
Requirements
  • A bachelor’s degree in Computer Science, Engineering, or a related field. Advanced degrees are a plus.
  • 4-6 years of professional experience in software development or IT operations, with increasing responsibility.
  • Proven experience in implementing AI-driven applications and SaaS solutions.
  • Strong technical proficiency in both frontend and backend development (e.g., React, Python, Java, Typescript).
  • Experience with cloud technologies and infrastructure as code (e.g., AWS, Kubernetes, Terraform).
  • Familiarity with software design patterns, architecture trade-offs, and integration best practices.
  • Knowledge of DevOps practices, CI/CD pipelines, and automated testing frameworks.
Responsibilities
  • Contribute to the implementation and optimization of GenAI applications and IT tools to enhance productivity and operational efficiency.
  • Collaborate with Product Owners, Tribe Leaders, and other stakeholders to align technology solutions with business requirements.
  • Administer and configure AI-powered SaaS tools, ensuring secure deployment and smooth integration across the organization.
  • Identify opportunities for enhancements to enterprise AI tools, focusing on improving efficiency and user satisfaction.
  • Support proof-of-concept (POC) projects to explore and validate innovative technologies and solutions.
  • Continuously assess and optimize software architecture, focusing on scalability, reliability, and alignment with emerging trends.
  • Document designs, development processes, and best practices to promote knowledge sharing and operational efficiency.
  • Stay updated on emerging technologies such as LLMs, APIs, and cloud-based solutions, applying these innovations to drive impactful outcomes.
Desired Qualifications
  • Previous experience building a user-facing GenAI/LLM software application
  • Previous experience with vectors and embeddings (pgvector, chromadb)
  • Knowledge of LLM RAG/Agent core concepts and fundamentals
  • Experience with Helm, Neo4J, GraphQL for efficient data querying for APIs, and CI/CD tools like Jenkins for automating deployments
  • Other AWS Managed Services (RDS, Batch, Lambda, Fargate, Step Functions, SQS/SNS, etc.)
  • FastAPI and NextJS experience (if we’re still using the latter)
  • Websockets, Server-Side Events, Pub/Sub (RabbitMQ, Kafka, etc.)
Boston Consulting Group

Boston Consulting Group

View

Boston Consulting Group (BCG) offers management consulting services to help businesses solve complex problems and improve their operations. They work with a diverse range of clients, providing tailored solutions in strategy development, operational improvements, and digital transformation. BCG stands out from competitors through its focus on talent development and a commitment to social impact, addressing issues like wealth inequality and promoting diversity. The company's goal is to unlock human potential and create transformative results for clients while being a positive force in society.

Company Size

10,001+

Company Stage

N/A

Total Funding

N/A

Headquarters

Boston, Massachusetts

Founded

1963

Simplify Jobs

Simplify's Take

What believers are saying

  • BCG's expansion in Houston indicates growth and increased market presence.
  • Rising demand for digital transformation boosts BCG's consulting opportunities.
  • DeepTech investment growth offers BCG new client engagement opportunities.

What critics are saying

  • Intensifying competition in digital transformation may affect BCG's market share.
  • Focus on cost management could reduce client spending on consulting services.
  • Claudia Schubert's new role may impact BCG's consumer practice division.

What makes Boston Consulting Group unique

  • BCG's innovative approach sets it apart in management consulting since 1963.
  • Focus on talent development and mentorship drives BCG's exceptional client value.
  • BCG's commitment to social impact enhances its reputation and client relationships.

Help us improve and share your feedback! Did you find this helpful?

Benefits

Health Insurance

Dental Insurance

Vision Insurance

Paid Vacation

Paid Parental Leave

Family Planning Benefits

401(k) Retirement Plan

Wellness Program

Company News

Intelligence360
Feb 18th, 2025
Boston Consulting Group To Spend $13 Million To Occupy 38,000 Square Feet Of Space In Houston Texas.

Boston Consulting Group to spend $13 Million to occupy 38,000 square feet of space in Houston Texas. Boston Consulting Group to spend $13 Million to occupy 38,000 square feet of space in Houston Texas.Houston, Texas — According to state and local development sources, Boston Consulting Group plans to invest $13,000,000.00 to build out 38,000 square feet of new space in Houston. The company plans to occupy the new space at 1550 Lamar Floors 11, 12 14 in Houston, on or about December 1, 2025. According to the company website Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we work closely with clients to embrace a transformational approach aimed at benefiting all stakeholders empowering organizations to grow, build sustainable competitive advantage, and drive positive societal impact

GeekWire
Feb 13th, 2025
Meet The Seattle Vc Behind A New $6.6M Fund Focused On Women’S Health Startups

GeekWire’s startup coverage documents the Pacific Northwest entrepreneurial scene. Sign up for our weekly startup newsletter , and check out the GeekWire funding tracker and venture capital directory .Jessica Kamada, founder of Swizzle Ventures, speaks at a B.E.L.L.E entrepreneur event in Seattle. (B.E.L.L.E Photo)Jessica Kamada does not have a traditional startups and venture capital background. And that’s exactly what helped her land $6.6 million for a new Seattle-based fund.Kamada is the founder and managing partner at Swizzle Ventures, which plans to use its inaugural fund to invest in around 30 companies focused on women’s health and wealth.“I didn’t go to an Ivy League school. I’m not coming out of a huge VC firm,” she said. “And so I really had to own the narrative of why different is better.”Kamada raised more than double her initial goal for Swizzle — notable given the difficult fundraising environment, especially for emerging fund managers amid the recent venture capital pullback.Kamada previously spent more than eight years at Bamboo, a Seattle-based marketing agency where she helped consumer tech companies scale their businesses, many of which went public or were acquired.In conversations with potential Swizzle investors, Kamada leaned on her growth-related background as a key differentiator

PR Newswire
Feb 13th, 2025
Bending The Adoption Curve: Next-Gen Materials To Reach 8% Of Fiber Market By 2030

New Report from Fashion for Good and BCG Unveils Executive Guide for Scaling Next-Gen Materials Advising Industry Leaders to Pull Individual and Collective Levers Across Supply ChainBOSTON, Feb. 13, 2025 /PRNewswire/ -- Materials lie at the heart of the fashion industry. They account for 92% of the industry's total emissions through their extraction, processing, and production, and around 30% of cost of goods sold (COGS).1 Next-generation materials present the opportunity to transform the industry's environmental impact. However, many brands lack guidance and are unprepared for a material transition, and how to drive adoption to unlock the benefits of these new materials

PR Newswire
Feb 11th, 2025
Claudia Schubert Appointed To Culinary Institute Of America Board Of Trustees

HYDE PARK, N.Y., Feb. 11, 2025 /PRNewswire/ -- The Culinary Institute of America (CIA) has added global executive Claudia Schubert, senior advisor in the consumer practice division at Boston Consulting Group (BCG), to its board of trustees. At BCG, Schubert counsels clients on global growth strategies and business transformations, including in the beverage, hospitality, tourism, and luxury sectors. Prior to this role, Schubert spent more than two decades in leadership in the consumer goods industry, including holding senior positions across the wine, beer, and spirits categories at Diageo—most recently, serving as president and chief operating officer of Diageo North America. "Claudia's passion for hospitality, and for developing and supporting the next generation of leaders, has been evident during her time as a member of the CIA's Society of Fellows," said CIA President Michiel Bakker. "Her expertise will be vital to helping further the college's reputation, not just as the world's premier culinary college, but also as a global leader in hospitality."

LatamList
Feb 6th, 2025
Kanastra Raises An Undisclosed Amount From Itaú’S Kinea Ventures

Brazilian fintech Kanastra raised an undisclosed amount from Kinea Ventures, Itaú’s CVC fund. Itaú is a customer of Kanastra. The funding comes after their Series A round in June 2024.Kanastra is a tech-enabled capital markets infrastructure provider that offers management and custody of securities, issuance of securitized assets, and ancillary services like escrow accounts.“In our business, market trust is essential, (and Itaú’s entry) strengthens our position in the market,“ said Gustavo Mapeli, Canastra’s Co-Founder and CEO.Founded in 2022 by former Gustavo Mapelo (former employee of BNP Paribas, BCG and Softbank) and Manuel Netto (former employee of ZX Ventures, AB Inbev’s innovation hub), Kanastra serves over 160 customers, including Itaú, XP, Banco BV, and Pátria. In 2024, Kanastra raised a $20M Series A round led by Kaszek.Read more on Brazil Journal