Data Lead Azure Data Factory Adf Apply
Job Title: Senior Data Lead Azure Data Factory (ADF) / Databricks / Snowflake
Location-
Preferred: Bellevue, WA (HQ) or Overland Park, KS Onsite 4 days/week
We are seeking a Senior Data Lead with strong expertise in Azure Data Factory (ADF), Databricks, and Snowflake to lead the design, development, and optimization of large-scale data ingestion and transformation pipelines. This role requires deep hands-on technical leadership, experience with complex data ecosystems, and the ability to mentor teams while delivering reliable, scalable, and secure data solutions.
Key Responsibilities-
Lead architecture, design, and implementation of scalable, modular, and reusable data pipelines using Azure Data Factory, Databricks, Snowflake, and open-source ingestion platforms
-
Oversee technical teams and provide hands-on guidance, mentorship, and best practices
-
Design and implement platform-agnostic ingestion frameworks supporting multiple input/output sources (100+ data sources)
-
Build and optimize ETL/ELT pipelines to ensure performance, reliability, and data quality
-
Develop custom data transformations, enrichments, filtering, routing, and format conversions (JSON, CSV, XML, Logfmt)
-
Implement schema normalization strategies (e.g., OCSF) including mapping, validation, and transformation templates
-
Ensure end-to-end data lineage, traceability, and audit readiness with metadata tagging and correlation IDs
-
Collaborate with observability, security, analytics, and platform teams for pipeline monitoring and anomaly detection
-
Monitor and troubleshoot pipelines to minimize data loss, duplication, and transformation drift
-
Work closely with stakeholders to gather requirements and deliver data-driven solutions
-
Lead technical evaluations and recommend best-fit tools, technologies, and practices
-
Maintain centralized documentation including ingestion patterns, schemas, governance, and standards
-
Stay current with evolving data engineering and analytics technologies
-
7 9 years overall data engineering experience
-
Strong proficiency in Azure Data Factory (ADF) for orchestration and integration
-
Hands-on experience with Databricks for data engineering and processing
-
Strong expertise in Snowflake (data modeling, querying, performance optimization)
-
Experience designing and managing complex ETL/ELT pipelines
-
Strong scripting skills in Python, JavaScript, or Groovy
-
Solid troubleshooting and performance optimization skills
-
Excellent communication skills to work with technical and non-technical stakeholders
-
Proven leadership experience guiding technical teams
-
Experience working in Agile environments
-
Bachelor of Technology / Engineering or equivalent
-
Snowflake Certification
-
Azure Data Factory (ADF) Certification
-
Databricks Certification
eye

