Responsibilities:

Collaborate with product and engineering teams to influence system design and architecture, ensuring quality is a priority from day one.
Design and implement automated tests for complex data pipelines, ensuring data integrity, accuracy, and performance throughout the ingestion-to-delivery process.
Create and maintain automated tests for high-availability, low-latency APIs, verifying that they meet performance and reliability standards under various conditions.
Ensure the correctness, freshness, and completeness of data transformations and integrations across a variety of data sources such as Redshift, S3, Aurora, Postgres, and DynamoDB.
Lead the development and enhancement of test automation frameworks using tools like PyTest and Jenkins, integrating them into CI/CD pipelines for continuous testing.
Work closely with data engineers, developers, and product owners to understand data flows, business logic, and requirements, ensuring thorough testing before deployment.
Identify and resolve issues within data pipelines and APIs, providing detailed bug reports and collaborating with engineering teams to address them.
Conduct performance testing to identify bottlenecks in data pipelines and APIs, and work with the team to implement solutions.

Requirements:

Proven expertise in software testing, especially in data engineering, data pipeline testing, and API testing in complex environments.
Strong proficiency in Python for writing test scripts and automation. Experience with AWS services such as Redshift, S3, and DynamoDB is required.
Exceptional analytical and problem-solving skills, with the ability to understand and test intricate data flows and integrations.
Demonstrated ability to build and maintain test automation frameworks that integrate with CI/CD pipelines for consistent and repeatable test results.
Strong communication skills, with the ability to explain technical issues, solutions, and recommendations to both technical and non-technical stakeholders.
A team-oriented mindset with a focus on continuous learning and improvement, helping to enhance how we design, architect, and ensure quality.
Experience mentoring junior engineers, leading testing efforts, and sharing best practices on complex projects.

Our client cannot provide sponsorship for this role unfortunately.

If you are interested in this position, then apply below or contact Samuel in Reperio Human Capital for more information.

Reperio Human Capital acts as an Employment Agency and an Employment Business.

Apply Now