Job Title:
Technology Lead Big Data (Spark / Databricks)
Location:
Houston, TX Hybrid Onsite; relocation accepted)
Contract Duration: 6 Months
Start Date:
October 22, 2025
Experience Required: 8 10 Years
Visa:
Only Visa-Independent Candidates
POC:
Sam Chavez
Job Summary:
We are seeking an experienced Technology Lead Big Data (Spark/Databricks) to join our client's data engineering team in Houston, TX.
The ideal candidate will have deep expertise in Databricks, Apache Spark,
SQL, and Python, with a proven ability to lead end-to-end data processing solutions.
You'll design, develop, and optimize complex data pipelines to support large-scale data initiatives and business reporting needs.
Key Responsibilities:
Design and lead the development of scalable data processing solutions using Apache Spark (Scala/Python) and Databricks.
Build and optimize ETL/ELT pipelines to manage structured and unstructured data from multiple systems.
Ensure data accuracy, consistency, and reliability through robust data validation and transformation processes.
Implement data quality checks, exception handling, and performance tuning for production-grade pipelines.
Collaborate with cross-functional teams for seamless data integration across cloud and on-prem environments.
Lead and mentor team members, ensuring timely delivery of reporting and analytics solutions.
Develop and execute unit, integration, and end-to-end tests to maintain high application reliability.
Must-Have Skills:
Databricks
Apache Spark (Scala/Python)
SQL
Data pipeline development & performance optimization
Nice-to-Have Skills:
Leadership and team management
Strong accountability and communication skills
Interview Process:
Mode:
Virtual / Face-to-Face as required
Candidates must provide updated contact info (phone, email, Skype ID) and five (5) interview time slots within 72 hours of submission.
Duplicate or incomplete profiles will be rejected.
