Bloomberg is foremost a data company. Data is at the heart of everything we do; we collect it, standardize it, enrich it, validate it, and make it available to our clients. The Data Technologies Infrastructure group is responsible for the platforms that support Bloomberg engineers in getting data into the company from the outside world, and our impact is multiplied by the hundreds of engineers building systems on our platforms. Data Technologies Pipelines (DTP) is a Kubernetes-based platform specializing in event-driven pipelines that process billions of events per da y: - Our managed connectors allow developers to build event-driven systems out of thousands of simple microservices. - Our unique traffic mirroring and egress control features allow developers to test their code in a production environment, without affecting downstream systems. - And our native observability features support developers in monitoring and adapting systems to ever changing incoming data. We build systems that scale horizontally: operating multi-tenant clusters of hundreds of machines and often pushing storage technologies to their limits. Sometimes this means opting for something more specialised then traditional technology choices (e.g. Cassandra over an RDBMS). Other times it means sticking with something proven but making use of it in creative ways. We are often ahead of the curve with our technology choices: we aim to pick the most appropriate technology for the job. We were early adopters of Kubernetes, our backend codebase is a mixture of Python & Golang, our frontend is transitioning from JavaScript to TypeScript, we store data in Comdb2, Cassandra, S3 & Kafka, and leverage the W3C Trace Context standard for observability. What's in it for you? - An inclusive and supportive work culture that fosters learning and growth. - A unique opportunity to work on large scale systems that have a wide impact across the company. - The opportunity to work on all areas of the stack, from tuning IPVS load balancing strategies, through designing & implementing scalable database schemas & backend APIs, to creating modern, intuitive web UIs. - The opportunity to influence the future of our platform by designing new system-wide features such as transactional promotion workflows or auto-scalable pipelines with first-class support for different message processing semantics. Who are you? - A curious polyglot engineer that enjoys the variety of diving into any and all areas of the stack, and digs deep into details when dealing with specific problems. - Motivated by delivering value to users and autonomous in leveraging any resources at your disposal to unblock yourself and make progress. - Relish the challenges of large scale distributed systems, accept that failures are inevitable, and build systems with automatic redundancy and recovery. - Excited about building on the shoulders of giants by leveraging open source technologies and open standards. - Happiest when working with a diverse team to design, architect and build a full system rather than working alone on a single component. - Recognise the importance of automated testing and reproducible operations. We'll trust you to: - Build systems that are simple and reliable on the outside, while dealing with the inherent complexities of distributed systems on the inside. - Design and take the lead on system enhancements while considering both functional and non-functional requirements. - Collaborate with your immediate team and the wider engineering organization to achieve the team's goals. - Own the entire development lifecycle, from planning to execution to deployment. - Mentor junior members of the team. You'll need to have: - Proficiency in Golang and Python, with hands-on experience building backend services and RESTful APIs. - Experience working with Kubernetes for containerization and orchestration. - Experience designing, building, maintaining, and debugging large scale, distributed systems in production. - Experience leading, planning, executing, and delivering substantial system-wide projects. - Knowledge of event driven architectures based on Kafka or similar. - Knowledge of Linux systems and networking. We'd love to see: - Experience building and maintaining platforms for other software engineers. - Knowledge of deployment automation principles and practices. - Experience with telemetry technologies such as Prometheus, Grafana, and OpenTelemetry. - Experience with scalable storage technologies such as Cassandra, and S3. - Experience with Javascript/Typescript and React for building modern, responsive web applications. Bloomberg is an equal opportunity employer and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law. Bloomberg is a disability inclusive employer. Please let us know if you require any reasonable adjustments to be made for the recruitment process. If you would prefer to discuss this confidentially, please email amer_recruitbloomberg.net