AWS Data Lead

Role: Data Lead

Location: Knutsford

Contract Role

Job Description:

AWS Services: Glue, Lambda, IAM, Service Catalogue, Cloud Formation, Lake Formation, SNS, SQS, Event Bridge

Language & Scripting: Python and Spark

ETL: DBT

Good to Have: Airflow, Snowflake, Big Data (Hadoop), and Teradata

Responsibilities:

1. Serve as the primary point of contact for all AWS related data initiatives and projects.
2. Responsible for leading a team of data engineers and analysts to design, implement, and maintain data solutions on the AWS platform.
3. Gather and analyze business requirements to develop scalable and efficient data solutions on AWS.
4. Design and implement data pipelines using various AWS services such as EMR, Glue, Kinesis, and Redshift.
5. Develop data models and ETL processes to efficiently transform and load data into AWS data lakes and data warehouses.
6. Work closely with cross-functional teams to identify opportunities for data-driven insights and optimize data processes.
7. Provide guidance and mentorship to junior team members on best practices for developing and deploying data solutions on AWS.
8. Stay up-to-date with the latest AWS data tools and technologies and make recommendations for their integration into existing processes.
9. Monitor and maintain data quality across all data systems and investigate any discrepancies or issues.
10. Collaborate with IT teams to ensure data security and compliance with relevant regulations and policies.
11. Participate in the development and implementation of data governance policies and procedures.

Qualifications:

1. Bachelor's or Master's degree in Computer Science, Information Systems, or a similar field.
2. Minimum of 8 years of experience in a data engineering or data management role, with at least 7 years of experience specifically in an AWS environment.
3. Strong proficiency in SQL and experience with designing and maintaining data warehouses and data lakes.
4. In-depth knowledge of AWS services such as EMR, Glue, Kinesis, and Redshift.
5. Hands-on experience with data pipeline development, ETL processes, and data modeling on AWS.
6. Strong leadership and project management skills with the ability to effectively lead a team and manage multiple projects simultaneously.
7. Excellent problem-solving and communication skills with the ability to collaborate with cross-functional teams and present complex technical information to non-technical stakeholders.
8. Experience with data visualization tools such as Tableau or Power BI is a plus.
9. AWS certifications (e.g. AWS Certified Big Data - Specialty) is a plus.