Pipeline Engineer
Posted 18 hours 3 minutes ago by St. Jamess Place
Posted on: 30/04/2025 - Application Deadline: -
Are you ready to chart your own career path? At SJP, we need talented individuals like yourself to support our evolving culture. If you're seeking an employer that is passionate about excellence, innovation, and autonomy, SJP could be the place for you.
At a glance:
Location: United Kingdom
Workplace Type: Remote
Employment Type: Permanent
Seniority: Mid-Senior Level
Number of roles available: 2
The primary purpose of this role is to design, implement, and maintain scalable, efficient, and cost-effective data solutions using modern data ecosystem tools including Snowflake, AWS, Matillion, and data visualization tools such as PowerBI and Tableau. This role is key in ensuring data is accessible, reliable, and optimized for AI, Machine Learning, analytics, and empowering stakeholders to make data-driven decisions. This includes collaborating with teams across the organization to understand data requirements, designing and building solutions, whilst ensuring compliance with data and AI governance and security protocols.
What you'll be doing:- Clean, transform, and preprocess raw data to make it suitable for Machine Learning and AI algorithms
- Design, develop, and maintain scalable data pipelines to meet project requirements.
- Integrate structured and unstructured data from various sources into a central data platform, ensuring data integrity.
- Establish monitoring systems for AI and ML solutions to ensure performance, reliability, and scalability.
- Facilitate continuous learning pipelines to refine models based on new data and changing business requirements.
- Collaborate with data scientists, analysts, product owners, and other stakeholders to ensure that data pipelines meet modeling requirements and deliver tailored Snowflake-based solutions.
- Work closely with third-party AI and machine learning solution providers to integrate and operationalize their solutions within our infrastructure and/or assess the data solutions offered by external providers, ensuring they align with business needs, technical standards, and regulatory requirements.
- Ensure solutions are built to centrally maintained standards and that data governance and security protocols are followed to safeguard sensitive data.
- This also includes data visualization such as PowerBI and Tableau.
- Monitor, troubleshoot, and improve Snowflake data pipelines for performance and reliability.
- Work with data architects to design critical data models.
A technical individual driven by the future of technology and utilizing its benefits to enhance the company. You will be excited to drive change and innovate solutions to enable better performance.
- Design, develop, and maintain scalable data pipelines and ETL processes using Snowflake
- Build and optimize Snowflake data architecture to ensure efficient data retrieval and processing.
- Strong proficiency in SQL and basic proficiency in Python required.
- Familiarity with AWS services and Matillion relevant to data engineering (e.g., S3, DynamoDB, Glue).
- Basic proficiency in PowerBI preferred,
- Stay current with Snowflake features, tools, and best practices in data engineering.
Maintain an understanding of database systems (SQL) and data modeling concepts.
Special Requirements:N/A
What's in it for you?
We reward you for the work you do, whether through our discretionary annual bonus scheme reflecting personal and company performance, a competitive annual leave allowance (28 days plus bank holidays, with an option to purchase an additional 5 days), or an online rewards platform with various discounts.
We also offer benefits to support different life stages, including:
- Competitive parental leave (28 weeks full pay)
- Private medical insurance (optional taxable benefit)
- 10% non-contributory pension (increasing with length of service)
Reasonable Adjustments
We're an equal opportunities employer committed to accessible and inclusive recruitment. If you require reasonable adjustments at any stage, please contact us at .
Research indicates that applicants, especially from underrepresented groups, may be discouraged if they do not meet all criteria or have had an extended career break. If you believe you're a good fit and can demonstrate transferable experience, please apply, even if you don't meet every requirement.
What's next?
If you're excited about this role and believe you have the skills and experience we're seeking, we want to hear from you! Submit your application by clicking 'apply' below, and our team will contact you.
As a business regulated by the FCA, please familiarize yourself with conduct regulations and consumer duty obligations prior to an interview with SJP.