Data Engineer

Hiring: Lead Data Engineer – Databricks | Manhattan, NY | HybridWe're looking for an experienced Lead Data Engineer with strong hands-on expertise in Databricks, SQL, Python, and PySpark to design and optimize scalable data pipelines and enterprise data platforms. The ideal candidate will provide technical leadership and implement data engineering best practices to support analytics, digital products, and AI-driven use cases.Location: Manhattan, New York (Hybrid)Experience: 6–12 YearsInterview Process: 3 Rounds, Including One Onsite Round in NY/NJ or at Any Client Office Across the USWork Authorization: USC & GC Candidates OnlyKey Skills:6+ years of data engineering experience with substantial hands-on Databricks expertiseStrong proficiency in SQL, Python, and PySparkExperience designing and developing scalable data pipelines using Medallion ArchitectureStrong understanding of Databricks Lakehouse architecture, Delta Lake, and Unity CatalogExperience with batch and incremental data processing, workflow orchestration, and data transformationExpertise in SQL query optimization, distributed processing, and performance tuningExperience with data quality, observability, lineage, and production troubleshootingFamiliarity with Git, CI/CD, and production deployment practicesExperience with AWS services, particularly S3, is a plusKnowledge of Auto Loader, Structured Streaming, CDC, Databricks Asset Bundles, or Apache Airflow is preferredDatabricks Data Engineer Associate or Professional certification is a plusExperience with streaming, clickstream, or advertising datasets is an added advantageWhat We're Looking For:A technically strong Lead Data Engineer who can build production-grade Databricks solutions, optimize data pipelines for performance and cost efficiency, lead solution design and code reviews, and mentor engineers while delivering scalable and reliable data platforms.Interested? Apply now or DM us to explore this opportunity!You can share resumes at Sanskar@Wiseskulls.com