Databricks Engineer

We are looking for a highly experienced Senior Data Engineer with 10+ years of experience and strong hands-on expertise in Databricks, Apache Spark, PySpark, Python, SQL, AWS, and Delta Lake . The ideal candidate should have extensive experience designing and developing scalable ETL/ELT data pipelines, working with Lakehouse architecture, Databricks Workflows, Unity Catalog, and AWS services such as S3, Glue, EMR, Lambda, Redshift, and Athena. Strong knowledge of data modeling, data quality, performance tuning, CI/CD, and data governance is required. The candidate must be willing to work onsite in Dallas, TX and be available for two rounds of interviews as part of the selection process.

• Design, develop, and maintain scalable data pipelines using Databricks, PySpark, Python, and SQL .
• Build and optimize Delta Lake tables and Lakehouse architecture.
• Develop and maintain batch and streaming ETL/ELT pipelines.
• Integrate Databricks with AWS S3, Glue, EMR, Lambda, Redshift, and Athena .
• Develop and manage Databricks Jobs and Workflows .
• Implement data quality, validation, monitoring, and error-handling processes.
• Perform Spark/Databricks performance tuning and optimization .
• Work with Unity Catalog for data governance, security, and access control.
• Implement CI/CD processes using Git and related DevOps tools.
• Troubleshoot production data pipeline issues and support deployments.
• Collaborate with Data Architects, Developers, Analysts, and business stakeholders.
• Participate in code reviews, technical discussions, and Agile/Scrum activities.
• Attend two rounds of interviews and work onsite in Dallas, TX .

For applications and inquiries,