Skip to content
config('app.name')

Senior QA Data Engineer

GCS Computer Recruitment Services

n/a - n/a
£550-£590 per day
City of London, London, UK, London
Banking

Role

Job Description


Role- Sn QA Data Engineer

Type- Contract (Outside IR35)
Nature- Hybrid (2/3 days in London per week)

Key Responsibilities:

Pantheon requires an experienced and enthusiastic Senior QA Automation Engineer to design and implement new automation systems and features, as well as modify and maintain existing systems for adaption to business and/or technology changes.

To be successful in the role you will be expected to:

  • Plan, design & execute testing activities for new features being implemented as well as for the changes to existing systems
  • Be hands-on in the creation of test cases and test execution.
  • Be a strong advocate for test automation with extensive experience in delivering working solutions.
  • Create manual and automated test cases to verify functional and non-functional requirements of solutions in various stages of the development life cycle.
  • Find critical bugs and verify reported issues, identifying their underlying cause and seeing them through to resolution and liaising with other teams where appropriate.
  • Producing descriptive and concise bug reports that evidence the functionality of a solution.
  • Communicating status information and issues to a variety of stakeholders, adapting appropriately depending on the audience.

Knowledge & Experience Required:

  • Data Quality & Validation in Azure
    • Verify Data Pipelines in Azure Data Factory (ADF) and Databricks to ensure data accuracy.
    • Test ETL/ELT Processes: Validate transformations, data ingestion, and data movement.
    • Schema Validation: Ensure table structures and constraints match expectations in SQL Server.
    • Data Completeness & Consistency checks between source and destination databases.
    • Data Profiling: Detect anomalies, missing values, or duplicate records.
  • Automated Testing Framework using Python.
    • Develop automated data validation tests using PyTest, PySpark and Pandas
    • Implement Integration Tests for SQL queries and transformations.
    • Build reusable test scripts for data pipeline validation in Azure Data Factory & Databricks.
    • Test Data Lineage & Auditing using logging and monitoring tools.
  • SQL & Database Testing
    • Write complex SQL queries to validate transformations and business rules.
    • Compare source and target tables for data accuracy after transformations.
    • Verify indexes, constraints, and stored procedures in SQL Server.
    • Validate Performance & Query Optimization for large datasets.
  • CI/CD for Data Testing
    • Integrate Automated Tests in CI/CD pipelines using Azure DevOps or GitHub Actions.
    • Schedule Data Quality Checks in Databricks Workflows or ADF Pipelines.
    • Automate Deployment Testing for data models, ETL pipelines, and transformations.

  • Extensive experience in testing software, systems, and data solutions (for example Data Warehouses) with a focus on Test automation.
  • Ability to think creatively, problem-solve and innovate.
  • Extensive experience in testing BI reports, dashboards, datasets, and data models.
  • Experience in agile software development methodologies.
  • Solid understanding of the testing pyramid and experience in implementing it at various levels
  • Experience building an Automation Framework from scratch and creating and maintaining automated tests.
  • Experience in mentoring QAs on automation tools, and frameworks and performing code reviews.
  • Experience working closely with BA and Developer to derive the Acceptance criteria and participating in 3 amigos sessions.

Essential skills:

  • Cloud: Azure Data Factory, Azure Databricks, Azure SQL Server
  • Database/Storage: SQL Server, Azure Synapse, Delta Lake
  • Programming: Python (PySpark, Pandas), SQL, C#, REST APIs
  • Monitoring: Azure Monitor, Log Analytics, Databricks
  • CI/CD: Azure DevOps, GitHub Actions
  • Automation/Frameworks: PyTest, DataDiffPy, GreatExpectation, POSTMAN
  • Advanced SQL

Desired Experience:

The ideal candidate will have financial services experience in the private equity, infrastructure & real assets, or private debt space. However, this is not a stringent requirement.

Desired skills:

  • Experience working on and Testing Traditional ETL tools (SAP Business Objects Data Services, INFORMATICA, SSIS, etc.)
  • Experience testing Business Objects & Crystal Reports
  • Selenium
  • Use of BDD and/or TDD framework
  • Testing Power BI dashboards, reports, and datasets.

GCS is acting as an Employment Business in relation to this vacancy.
Apply