Staff Data Engineer
We are looking for a Staff Data Engineer to join our client. Their mission is to help create seamless shopping experiences through a vast global network, community engagement, and advanced enterprise technology. This role focuses on enabling brands and retailers to gather, analyze, and act on valuable user-generated content at a massive scale.
Key Responsibilities:
* Design, build, and maintain large-scale, distributed data systems that support the company's infrastructure and services.
* Develop data pipelines, optimize data storage and retrieval processes, and ensure the reliability and scalability of the data architecture.
* Collaborate closely with cross-functional teams to understand data needs and provide technical solutions.
* Implement and advocate for software engineering best practices to ensure maintainable and efficient data systems.
* Play a key role in troubleshooting issues, continuously improving processes, and shaping the future of data-driven decision-making.
Who you are:
* Bachelor’s degree in Computer Science or a related field.
* 7+ years of experience building robust, scalable, distributed data systems using open-source and public cloud technologies.
* Expertise with data orchestration tools such as Apache Airflow or Dagster.
* Proficiency in big data storage and processing technologies such as DBT, Spark, SQL, Athena/Trino, Redshift, Snowflake, PostgreSQL/MySQL.
* Strong knowledge of event-driven architectures and streaming technologies such as Apache Kafka, Kafka Streams, or Apache Flink.
* Experience with public cloud platforms like AWS, GCP, or Azure, and infrastructure as code tools like Terraform.
* Solid grasp of software engineering practices including CI/CD, agile development, and version control systems like Git.
* Excellent problem-solving, technical leadership, and analytical skills.
* Ability to communicate effectively and work collaboratively with cross-functional teams.
* Passion for staying up-to-date with emerging data technologies and trends.
Why join us?
* Customer-focused: We view our success through the lens of our customers' outcomes and prioritize their needs.
* Transparency & Integrity: We believe in the power of authentic feedback and always strive to do the right thing.
* Performance-driven: We are passionate, curious, and driven, always seeking to push boundaries.
* Innovative: We embrace agility and experimentation, continuously seeking ways to improve.
* Inclusive & diverse: We value diverse perspectives and believe that fostering an inclusive culture enhances creativity and performance.
Any further questions on the role, please feel free to reach out to Brendan McCrory directly