Lead Data Engineer

job summary: We are seeking an experienced Databricks Data Engineer to join our high-performing Data & AI practice in Phoenix, AZ. In this role, you will be responsible for designing and deploying enterprise-grade Lakehouse solutions on Google Cloud Platform (Google Cloud Platform). You will build robust batch and real-time data pipelines, optimize ETL/ELT processes, and implement data governance using Unity Catalog to power advanced analytics across the enterprise.

location: Phoenix, Arizona

job type: Contract

salary: $40 - 50 per hour

work hours: 8am to 5pm

education: Bachelors

responsibilities: Design, build, and maintain scalable batch and real-time data engineering pipelines using Databricks, PySpark, and SQL. Integrate Databricks seamlessly with Google Cloud Platform services including Google Cloud Storage (GCS), BigQuery, Pub/Sub, and Cloud Composer. Implement metadata-driven ingestion frameworks, incremental load patterns, and structured data models. Configure and manage Databricks Unity Catalog to enforce fine-grained access controls, security, and data lineage. Implement automated orchestrations using Cloud Composer/Apache Airflow and drive CI/CD DataOps best practices.

qualifications: 4+ years of hands-on data engineering experience building enterprise data pipelines with Databricks and PySpark. Strong experience with Google Cloud Platform cloud architecture and native services (GCS, BigQuery, Pub/Sub, Cloud Composer). Proven capability in data modeling, complex SQL development, and pipeline performance optimization. Practical experience configuring Databricks Unity Catalog, Delta Live Tables, and Auto Loader. Solid understanding of CI/CD deployment and DevOps workflows in cloud data environments.

PREFERRED QUALIFICATIONS Proficiency in Scala for Spark processing. Formal Google Cloud Platform or Databricks certifications (e.g., Databricks Certified Data Engineer Professional, Google Cloud Platform Professional Data Engineer). Experience with automated testing and DataOps frameworks.

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status. At OpenKyber, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, OpenKyber offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility). This posting is open for thirty (30) days.

For applications and inquiries,