Senior Data Warehouse Engineer
Job no: 502548
Work type: Permanent Full Time
Location: London - Hybrid
Categories: Data Architecture & Data Engineering
Your New Role
As a Senior Data Warehouse Engineer specializing in Snowflake, you will lead the architecture, design, and implementation of our data warehouse in a multi-tenant environment. Collaborating with Platform Engineers, Technical Architects, Data Engineers, and Analysts at NewDay and with B2B customers, you'll ensure that the platform's performance, reliability, and security meet the needs of multiple teams.
What You'll Deliver in the First 0-12 Months
1. Design and Build: Create and manage a Snowflake data ecosystem to support event and batch workflows, enabling end-user teams to access data, perform transformations, build reports, and leverage automation tools.
2. Process Automation: Ensure processes are automated, observable, and compliant with platform standards.
3. Schema Management: Enhance and maintain a Squitch project for Snowflake schema management.
4. Library Maintenance: Maintain and enhance a Python library for end-user data access in Snowflake and S3.
5. Administration: Manage Snowflake and associated tooling accounts, including user and permission management (IAM, AD).
6. Airflow Support: Collaborate with users to write and support Airflow DAGs hosted in Astronomer Cloud.
7. Streaming Data: Work within a streaming data ecosystem, such as Kafka.
8. Analytics Integration: Integrate visualization and analytics tools like PowerBI and Tableau.
What You'll Bring - Essential Skills
1. Proficient knowledge of Snowflake (Columnar databases), Jupyter notebooks, Airflow, and Docker.
2. Strong Python and SQL coding abilities.
3. Familiarity with distributed systems, APIs, and cloud computing patterns.
4. Understanding of virtualization/containerization.
5. Experience with EKS/Kubernetes and DevOps tools, particularly GitHub Actions.
6. Understanding of AWS infrastructure and services (S3, EKS, IAM, Storage Gateway, Athena).
7. Proficient in Terraform or a solid understanding of Infrastructure as Code (IaC).
Desirable Skills
1. Expertise in Snowflake concepts such as resource monitors, RBAC controls, virtual warehouse setup, query performance tuning, and time travel.
2. Experience with Kafka and DBT.
3. Understanding of Data Vault design patterns and cloud/network configurations (Firewalls, Proxies).
4. Familiarity with AWS networking (VPC, VPN, Direct Connect, Route 53, Auto Scaling, CloudWatch, GuardDuty).
Our Dynamic NewDay Culture
At NewDay, we're dedicated to driving impact and nurturing creativity. We celebrate diversity and are committed to creating an inclusive environment where all voices are heard. If you require any accommodations during the application process, please let us know.
Join us at NewDay to make a meaningful impact, grow your skills, and be part of an innovative team dedicated to driving change in the credit industry.
Advertised: 16 Oct 2024 GMT Daylight Time
Applications close: 01 Nov 2024 GMT Standard Time
#J-18808-Ljbffr