Data Quality Analyst Azure

Toronto 10 days agoFull-time External
406.0k - 507.4k / yr
Job Title: Data QA Tester (Azure Data Tester) Location: Toronto, ON (Hybrid) Full Time Experience: 5-10+ Years Must have • ETL/Data Testing/Azure Databricks + Azure Data Factory: 4 years (Required) • Strong SQL + Python/Py Spark: 3 years (Required) Job Description (Responsibilities) • Perform ETL testing on large-scale data pipelines built using Azure Databricks and Azure Data Factory • Validate data flow from multiple source systems to target databases • Test complex data transformation and consumer merge business rules • Execute API test scenarios and validate JSON/XML responses • Write and execute complex SQL queries for data validation • Perform data validation using SQL, Python, and PySpark • Validate source, staging, and target tables in Databricks • Design, build, and maintain automated test frameworks using PyTest • Automate recurring data quality and regression test cases • Log, track, and validate defects using Jira • Create and manage test cases in TestRail • Work closely with development teams to recreate and validate defects • Participate in daily agile stand-ups and update task status in Jira • Maintain code quality using Git and SonarQube Required Skill Sets • 5+ years of experience in ETL / Data Testing projects • Strong hands-on experience with Azure Databricks • Working experience with Azure Data Factory • Excellent SQL skills with ability to write complex queries • Strong experience in Python or PySpark for data validation • Experience in test automation for data pipelines • Knowledge of data formats such as JSON, Parquet, Avro • Experience working with Git repositories, branches, and pull requests • Familiar with Jira, TestRail, and Agile methodology • Strong analytical and problem-solving skills • Ability to work independently in a remote, fast-paced environment • Quick learner with strong attention to data quality and accuracy