Databricks Engineer

Architecture & Strategy Define end-to-end migration strategy from Azure Databricks to AWS Databricks.

Design scalable Lakehouse architecture using Medallion principles (Bronze, Silver, Gold).

Develop Day 1 Business Continuity and Day 2 Modernization / AI Enablement migration roadmaps.

Perform application and dependency assessments across upstream and downstream systems.

Establish architecture patterns, standards, and best practices for cloud-native data platforms.

Lead migration of data pipelines, notebooks, Delta tables, workflows, and data products.

Modernize legacy ETL/ELT frameworks using Databricks native capabilities.

Optimize performance, scalability, security, and operational efficiency.

Define migration approaches for CDC, batch, streaming, and real-time workloads.

Drive technology rationalization and tool consolidation initiatives.

Build AI-ready data foundations leveraging Delta Lake and Unity Catalog.

Design data architectures supporting ML, GenAI, RAG, feature stores, and advanced analytics.

Enable governed data access for data scientists and AI applications.

Define semantic models, metadata strategies, lineage, and data discovery frameworks.

Establish frameworks for AI governance and responsible AI adoption.

Architect enterprise-wide governance using Unity Catalog.

Design data lineage, auditing, access controls, masking, and compliance standards.

• 15+ Years of experience
• Azure Databricks
• AWS Databricks
• Lakehouse architecture
• Medallion principles (Bronze, Silver, Gold)
• Delta Lake
• Unity Catalog
• ML
• GenAI
• RAG
• feature stores
• advanced analytics
• Data Governance
• Data lineage
• auditing
• access controls
• masking
• compliance standards
• ETL/ELT frameworks

For applications and inquiries,