Who We Are
BCG pioneered strategy consulting more than 50 years ago, and we continue to innovate and redefine the industry. We offer multiple career paths for the worlds best talent to have a real impact on business and society. As part of our team, you will benefit from the breadth and diversity of what we are doing today and where we are headed next. We count on your authenticity, exceptional work, and strong integrity. In return we are committed to supporting you in discovering the most fulfilling career journey possible-and unlocking your potential to advance the world. Our team called Global Services (GS) provides corporate support to business areas such as Finance, Legal, HR, Marketing and IT. This diverse team of experts, operators and specialists represent all levels from Partner to entry level staff, operating across the globe in multiple countries. Global Services is in short, the backbone of BCG.
What Youll Do
We are seeking a highly skilled and experienced full-stack Software Engineer Expert Senior Manager with Gen AI /LLM expertise to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. The ideal candidate will have a strong background in reusable software components, frameworks, SDKs, microservices and APIs, cloud infrastructure, and DevOps/MLOps/LLMOps, with a passion for creating scalable, reliable, and efficient systems.
What Youll Bring
* Being a great hands-on engineer passionate about building platform capabilities.
* Performing successfully in a fast-paced, multi-cultural and service-oriented environment.
* Verbal and written communication at a business and technical level.
* High level of initiative, self-motivation, resourcefulness, and collaboration.
* Are passionate, intellectually curious, and enjoy learning new skills and capabilities.
* Building relationships and being a reliable team player, displaying consideration and respect for others.
* Interpreting rules and guidelines flexibly to enhance the business and aligning with BCG’s values and culture.
* Exhibiting ownership and accountability for the squad deliverables.
* Servicing customer teams/platform users with a strong customer centricity.
* Attention to detail, well organized, able to set priorities and take decisions.
* Being flexible to be available outside of normal business hours for international calls as needed.
* Bachelor’s degree in computer science engineering (or equivalent degree or experience).
* Proven experience in Gen AI, Artificial Intelligence, Machine Learning, or Natural Language Processing.
* 12+ years of relevant experience in delivering platform or complex technology solutions with a strong technical background, preferably in a global organization/enterprise.
* 2+ years’ experience in experimenting and developing with LLM.
* 1+ years of experience developing with LLMs for production use cases.
* 8+ years of experience in leading Enterprise scale software engineering/platform engineering teams.
* Passionate expert in Modern Engineering, DevOps practices - Strong understanding of CI/CD, AI/ML pipelines and automation tools.
Experience & Skills (Mandatory)
* Strong knowledge and experience in Generative AI/LLM based development.
* Strong knowledge and experience in building conversational agent-based UX.
* Strong knowledge and experience in building SDKs and libraries used by other developers.
* Strong experience working with key LLM models APIs (e.g. AWS Bedrock, Azure Open AI/OpenAI) and LLM Frameworks (e.g. LangChain, LlamaIndex).
* Experience with multi-agent frameworks and an understanding of multi-agent systems and their applications in complex, multi-step problem-solving scenarios.
* Expertise in building enterprise-grade, secure data ingestion pipelines for unstructured data – including indexing, search, and advanced retrieval patterns.
* Proficiency in generating and working with text embeddings with an understanding of embedding spaces and their applications in semantic search and information retrieval.
* Knowledge and experience in building knowledge graphs in production.
* Experience with RAG concepts and fundamentals (VectorDBs, AWS OpenSearch, semantic search, etc.), expertise in implementing RAG systems that combine knowledge bases with Generative AI models.
* Proficiency in Python, TypeScript, NodeJS, ReactJS (and equivalent) and all associated GenAI libraries and frameworks.
* Experience with containerization and orchestration technologies (Kubernetes, Docker).
Experience & Skills (Nice to have)
* Experience with LLM guardrails.
* Experience with security related to LLM integration.
* Experience in LLM Testing and Evaluation.
* LLM Security.
Who Youll Work With
* Your Gen AI Platform Engineering chapter in Cloud and Platform Engineering Portfolio.
* Product Owners, Chapter Leads and other squad members.
* Agile Coaches and Scrum Leads, who will ensure that you adopt agile principles, mindset and ways of working into your daily routine and who will coach you during the transformation.
Boston Consulting Group is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity/expression, national origin, disability, protected veteran status, or any other characteristic protected under national, provincial, or local law, where applicable, and those with criminal histories will be considered in a manner consistent with applicable state and local laws. BCG is an E-Verify Employer. Click here for more information on E-Verify.
J-18808-Ljbffr