Job Summary: We are seeking a skilled Data Architect with 8-10 years of experience to lead the design and implementation of Databricks-based data platforms. The ideal candidate will have a strong background in data modeling and a proven track record of delivering secure, scalable, and efficient data solutions. This role requires a hands-on technical leader who can translate complex architectural designs into actionable engineering plans while ensuring data quality and governance. Responsibilities: Lead the end-to-end architecture and delivery of Databricks-based data platforms, focusing on Hub-and-Spoke architectures for secure migrations. Translate complex solution designs into actionable engineering plans, including DLT pipeline migrations, Unity Catalog table migrations, and ML model promotion workflows. Design and implement Medallion Architecture (Bronze, Silver, Gold) using Delta Lake, Delta Live Tables, and Azure Data Factory (ADF) for scalable data processing. Build high-throughput batch and streaming pipelines using Apache Spark and Structured Streaming, ingesting event data from Azure Event Hub and Google Pub/Sub into cloud Data Lakes. Provide hands-on technical leadership to Data Engineers, supporting Spark job debugging, cluster sizing, and Azure Databricks job optimization. Implement enterprise-grade Data Quality and Lakehouse Monitoring frameworks, applying tests for data drift detection. Develop Data Estate Monitoring dashboards to track data freshness, completeness, drift, and pipeline health with configurable cost and billing controls. Enhance data quality and gold datasets through reusable Apache Spark-based Data Quality frameworks. Lead Data Discovery, Data Governance, and Integrations initiatives aligned with local business unit regulations. Implement Unity governance, fine-grained Identity Management (LCM/RBAC)/Access Control List (ACL), and Right-to-Forget solutions to meet regulatory and privacy requirements. Collaborate with Business Owners and Product Managers to deliver Data Products supporting Procure-to-Pay and Asset Lifecycle processes. Mandatory Skills: Data Modeling Experience with Azure Databricks and Delta Lake Proficiency in Apache Spark and Structured Streaming Strong understanding of Data Quality frameworks Experience with Azure Data Factory (ADF) Knowledge of Data Governance and Compliance Preferred Skills: Experience with cloud data lakes and data warehousing solutions Familiarity with event-driven architectures Knowledge of machine learning model promotion workflows Experience with monitoring and performance tuning in Azure Databricks Qualifications: Bachelor's degree in Computer Science, Information Technology, or a related field 8-10 years of experience in data architecture and engineering Proven track record of delivering complex data solutions in a cloud environment Strong analytical and problem-solving skills Excellent communication and collaboration abilities

About PureSoftware Ltd

PureSoftware, a wholly owned subsidiary of Happiest Minds, is a global software products and digital services company. PureSoftware has been driving transformation for the world’s top organizations across various industry verticals, including banking, financial services, and insurance, life sciences and healthcare, high tech and communications, retail and logistics, and gaming and entertainment. Arttha, from PureSoftware, is a globally trusted financial technology platform.