AWS Services: Glue, Lambda, IAM, Service Catalogue, Cloud Formation, Lake Formation, SNS, SQS, Event Bridge
Language & Scripting: Python and Spark
ETL: DBT
Good to have: Airflow, Snowflake, Big Data (Hadoop) and Teradata
Responsibilities:
1. Serve as the primary point of contact for all AWS related data initiatives and projects
2. Responsible for leading a team of data engineers and analysts to design, implement, and maintain data solutions on the AWS platform
3. Gather and analyze business requirements to develop scalable and efficient data solutions on AWS
4. Design and implement data pipelines using various AWS services such as EMR, Glue, Kinesis, and Redshift
5. Develop data models and ETL processes to efficiently transform and load data into AWS data lakes and data warehouses
6. Work closely with cross-functional teams to identify opportunities for data-driven insights and optimize data processes
7. Provide guidance and mentorship to junior team members on best practices for developing and deploying data solutions on AWS
8. Stay up-to-date with the latest AWS data tools and technologies and make recommendations for their integration into existing processes
9. Monitor and maintain data quality across all data systems and investigate any discrepancies or issues
10. Collaborate with IT teams to ensure data security and compliance with relevant regulations and policies
11. Participate in the development and implementation of data governance policies and procedures
Qualifications:
1. Bachelor's or Master's degree in Computer Science, Information Systems, or a similar field
2. Minimum of 8 years of experience in a data engineering or data management role, with at least 7 years of experience specifically in an AWS environment
3. Strong proficiency in SQL and experience with designing and maintaining data warehouses and data lakes
4. In-depth knowledge of AWS services such as EMR, Glue, Kinesis, and Redshift
5. Hands-on experience with data pipeline development, ETL processes, and data modeling on AWS
6. Strong leadership and project management skills with the ability to effectively lead a team and manage multiple projects simultaneously
7. Excellent problem-solving and communication skills with the ability to collaborate with cross-functional teams and present complex technical information to non-technical stakeholders
8. Experience with data visualization tools such as Tableau or Power BI is a plus
9. AWS certifications (e.g. AWS Certified Big Data - Specialty) is a plus
#J-18808-Ljbffr