Request ID: 40301-1
Bill Rate: $65-70/hr
MSP Owner: Kelly Gosciminski
Location: New York, NY / Hamilton Township, NJ - onsite
Duration: 6 months
GBaMS ReqID: 10373751
Data Engineer / Support Analyst - Databricks
Job Description
We are seeking an experienced Data Engineer / Support Analyst with strong expertise in Databricks, Azure cloud services and batch job support. The ideal candidate will have a background in financial markets or trading systems, with hands-on experience managing data pipelines, FTP file transfers, and real-time/batch processing in a production environment.
Key Responsibilities:
Manage and support batch processes and data pipelines in Azure Databricks and Azure Data Factory.
Integrate and process Bloomberg market data feeds and files into trading or analytics platforms.
Monitor, troubleshoot, and resolve data and system issues related to trading applications and market data ingestion.
Develop, automate, and optimize ETL pipelines using Python, Spark, and SQL.
Manage FTP/SFTP file transfers between internal systems and external vendors.
Ensure data quality, completeness, and timeliness for downstream trading and reporting systems.
Collaborate with operations, application support, and infrastructure teams to resolve incidents and enhance data workflows.
