We're looking for Data Engineer to join a high-impact transformation project focused on building a fully automated, SOX-governed financial reporting pipeline that integrates an Azure Databricks Lakehouse environment with Workday General Ledger.
This is a unique opportunity to work alongside industry experts, gain deep exposure to enterprise-scale Databricks architecture, and contribute to the delivery of a mission-critical financial data platform.
What You'll Be Doing
- Design, develop, and optimize production-grade ETL pipelines using Azure Databricks, PySpark, and Python
- Build and manage Delta Lake structures and Unity Catalog governance frameworks
- Develop Bronze, Silver, and Gold Lakehouse data pipelines with clear lineage and auditability
- Implement financial data transformation logic, KPI-to-GL mappings, and reconciliation processes
- Create automated data quality frameworks including validation, completeness checks, duplicate detection, and threshold controls
- Build REST and SOAP API integrations with robust error handling and monitoring
- Implement SOX-compliant controls, audit trails, approval workflows, and governance processes
- Support testing, UAT, reconciliation activities, and production monitoring
- Develop operational dashboards and reporting layers supporting Finance and business stakeholders
- Produce technical documentation, runbooks, and handover materials for long-term operational success
Required Skills & Experience:
Bachelor's Degree in Computer Science, Data Engineering, Information Technology, Mathematics, or a related field
3+ years of experience in Data Engineering or Analytics Engineering
- Hands-on experience with:
- Azure Databricks
- Databricks Workflows
- Delta Lake
- Unity Catalog
- PySpark
- Python
- SQL
Experience working with:
- Azure Data Lake Storage Gen2 (ADLS)
- Azure Key Vault
- Azure Data Warehouse environments
- API integrations (REST/SOAP)
Strong understanding of Lakehouse architecture and Bronze/Silver/Gold data modeling
Experience building production-ready ETL pipelines and data quality frameworks
Excellent documentation and communication skills
We're looking for professionals who:
?? Take ownership and drive delivery
?? Bridge technical and business conversations effectively
?? Learn quickly in fast-paced environments
?? Have exceptional attention to detail
?? Thrive in collaborative, cross-functional teams
?? Understand governance, compliance, and financial reporting requirements
