Job Title: Data QA Tester (Azure Data Tester)
Location: Toronto, ON (Hybrid)
Full Time
Experience: 5-10+ Years
Must have
ETL/Data Testing/Azure Databricks + Azure Data Factory: 4 years (Required)
Strong SQL + Python/Py Spark: 3 years (Required)
Job Description (Responsibilities)
Perform ETL testing on large-scale data pipelines built using Azure Databricks and Azure Data Factory
Validate data flow from multiple source systems to target databases
Test complex data transformation and consumer merge business rules
Execute API test scenarios and validate JSON/XML responses
Write and execute complex SQL queries for data validation
Perform data validation using SQL, Python, and PySpark
Validate source, staging, and target tables in Databricks
Design, build, and maintain automated test frameworks using PyTest
Automate recurring data quality and regression test cases
Log, track, and validate defects using Jira
Create and manage test cases in TestRail
Work closely with development teams to recreate and validate defects
Participate in daily agile stand-ups and update task status in Jira
Maintain code quality using Git and SonarQube
Required Skill Sets
5+ years of experience in ETL / Data Testing projects
Strong hands-on experience with Azure Databricks
Working experience with Azure Data Factory
Excellent SQL skills with ability to write complex queries
Strong experience in Python or PySpark for data validation
Experience in test automation for data pipelines
Knowledge of data formats such as JSON, Parquet, Avro
Experience working with Git repositories, branches, and pull requests
Familiar with Jira, TestRail, and Agile methodology
Strong analytical and problem-solving skills
Ability to work independently in a remote, fast-paced environment
Quick learner with strong attention to data quality and accuracy