Skip to main content
Loading
loadingbar
Loading, Please wait..!!

Azure Data Engineer

  • Azure Data Engineer job type Posted on: Nov 18, 2026
  • Azure Data Engineer experience level Envision
  • Azure Data Engineer employment type Indianapolis, Indiana
  • Azure Data Engineer employment type Onsite
  • Azure Data Engineer salary Full-time

Point Apply Here APPLY LATER

Curious about compensation?

Explore the historical salary trends, average pay, and estimated compensation for Azure Data Engineer roles in Indiana.

View Salary Guide →

Job Title :

Azure Data Engineer

Job Type :

Full-Time

Job Location :

Indianapolis Indiana United States

Remote :

No

Jobcon Logo Job Description :

Job Description

Job Title: Lead Azure Data Engineer

\n

Location: Indianapolis, IN (Onsite)

\n

Position Type: Long Term Contract

\n

Required Experience: 12+ Years

\n


\n

Position Overview

\n

We are seeking an experienced Data Engineering Tech Lead to lead the design, development, optimization, and maintenance of scalable enterprise data engineering and Lakehouse solutions on the Azure cloud platform. In this role, you will drive both batch and near-real-time data processing across complex enterprise data sources, enforce robust data governance, and mentor engineering teams to enable data transformation in the Healthcare sector.

\n

Key Tech Stack & Environment

\n
    \n
  • Core Technologies: Azure Databricks, PySpark, Azure Data Factory (ADF), ADLS Gen2, Azure SQL, Python
  • \n
  • Governance & Architecture: Unity Catalog, Delta Lake, Medallion Architecture (Bronze/Silver/Gold)
  • \n
  • Cloud & DevOps: Azure Cloud Platform, CI/CD, Git, Azure DevOps
  • \n
\n

Must-Have Technical Qualifications

\n
    \n
  • 12+ overall years of experience in Data Engineering / IT industry roles.
  • \n
  • 5+ years of hands-on experience across the Azure Cloud platform ecosystem.
  • \n
  • 4+ years of core experience with Azure Databricks and PySpark.
  • \n
  • 3+ years of experience with Azure Data Factory (ADF).
  • \n
  • 3+ years of experience with ADLS Gen2.
  • \n
  • 3+ years of experience with Azure SQL.
  • \n
  • 2+ years of experience in Databricks Workflows and Unity Catalog governance.
  • \n
  • 2+ years of experience in modular Python programming, package builds, and testing (e.g., PyTest/unittest).
  • \n
\n

Key Responsibilities

\n

1. Data Engineering & Lakehouse Architecture

\n
    \n
  • Design, build, and optimize scalable Lakehouse solutions ingesting structured, semi-structured, and unstructured data from ERP platforms, APIs, relational databases, NoSQL stores, and on-premises sources.
  • \n
  • Optimize Spark jobs and handle large-scale data processing using DataFrame and RDD APIs.
  • \n
  • Implement performance tuning, partitioning strategies, file format optimizations (Parquet/Delta), and Spark SQL tuning.
  • \n
\n

2. Governance, Storage & Pipeline Orchestration

\n
    \n
  • Implement data access controls, object lineage, audit trails, and security policies using Unity Catalog integrated with Azure AD.
  • \n
  • Architect multi-layered storage patterns (Bronze-Silver-Gold) on ADLS Gen2 using lifecycle policies, RBAC/ACLs, and folder-level security.
  • \n
  • Build modular, parameterized orchestration workflows using ADF and Databricks Workflows (custom activities, triggers, dynamic expressions, error handling).
  • \n
\n

3. Technical Leadership & DevOps

\n
    \n
  • Author High-Level Design (HLD) and Low-Level Design (LLD) documents, architectural diagrams, and technical specifications.
  • \n
  • Establish coding standards, peer code review processes, and integration with static analysis tools (e.g., SonarQube, PyLint).
  • \n
  • Build automated deployment pipelines using Azure DevOps, Git, and Infrastructure as Code (ARM/Bicep/Terraform).
  • \n
  • Mentor junior and mid-level engineers on technical design, optimization, and best practices.
  • \n
\n

Secondary / Good-to-Have Skills

\n
    \n
  • Identity & CI/CD: Microsoft Entra ID (Azure AD), GitHub Actions.
  • \n
  • Alternative Orchestration: Apache Airflow, Dagster, Azure Logic Apps.
  • \n
  • Streaming & Event-Driven: Apache Kafka, Azure Event Hubs, Google Cloud Pub/Sub.
  • \n
  • CDC & Migration: Debezium CDC implementation; Synapse to Databricks migration experience.
  • \n
  • Multi-Cloud Storage: Exposure to Google Cloud Storage (GCS).
  • \n
\n


Jobcon Logo Position Details

Posted:

Nov 18, 2026

Reference Number:

50f01445858df8b0

Employment:

Full-time

City:

Indianapolis

Job Origin:

ziprecruiter

Share this job:

  • linkedin

Jobcon Logo
A job sourcing event
In Dallas Fort Worth
Aug 19, 2017 9am-6pm
All job seekers welcome!

Azure Data Engineer    Apply

Click on the below icons to share this job to Linkedin, Twitter!

Job Description

Job Title: Lead Azure Data Engineer

\n

Location: Indianapolis, IN (Onsite)

\n

Position Type: Long Term Contract

\n

Required Experience: 12+ Years

\n


\n

Position Overview

\n

We are seeking an experienced Data Engineering Tech Lead to lead the design, development, optimization, and maintenance of scalable enterprise data engineering and Lakehouse solutions on the Azure cloud platform. In this role, you will drive both batch and near-real-time data processing across complex enterprise data sources, enforce robust data governance, and mentor engineering teams to enable data transformation in the Healthcare sector.

\n

Key Tech Stack & Environment

\n
    \n
  • Core Technologies: Azure Databricks, PySpark, Azure Data Factory (ADF), ADLS Gen2, Azure SQL, Python
  • \n
  • Governance & Architecture: Unity Catalog, Delta Lake, Medallion Architecture (Bronze/Silver/Gold)
  • \n
  • Cloud & DevOps: Azure Cloud Platform, CI/CD, Git, Azure DevOps
  • \n
\n

Must-Have Technical Qualifications

\n
    \n
  • 12+ overall years of experience in Data Engineering / IT industry roles.
  • \n
  • 5+ years of hands-on experience across the Azure Cloud platform ecosystem.
  • \n
  • 4+ years of core experience with Azure Databricks and PySpark.
  • \n
  • 3+ years of experience with Azure Data Factory (ADF).
  • \n
  • 3+ years of experience with ADLS Gen2.
  • \n
  • 3+ years of experience with Azure SQL.
  • \n
  • 2+ years of experience in Databricks Workflows and Unity Catalog governance.
  • \n
  • 2+ years of experience in modular Python programming, package builds, and testing (e.g., PyTest/unittest).
  • \n
\n

Key Responsibilities

\n

1. Data Engineering & Lakehouse Architecture

\n
    \n
  • Design, build, and optimize scalable Lakehouse solutions ingesting structured, semi-structured, and unstructured data from ERP platforms, APIs, relational databases, NoSQL stores, and on-premises sources.
  • \n
  • Optimize Spark jobs and handle large-scale data processing using DataFrame and RDD APIs.
  • \n
  • Implement performance tuning, partitioning strategies, file format optimizations (Parquet/Delta), and Spark SQL tuning.
  • \n
\n

2. Governance, Storage & Pipeline Orchestration

\n
    \n
  • Implement data access controls, object lineage, audit trails, and security policies using Unity Catalog integrated with Azure AD.
  • \n
  • Architect multi-layered storage patterns (Bronze-Silver-Gold) on ADLS Gen2 using lifecycle policies, RBAC/ACLs, and folder-level security.
  • \n
  • Build modular, parameterized orchestration workflows using ADF and Databricks Workflows (custom activities, triggers, dynamic expressions, error handling).
  • \n
\n

3. Technical Leadership & DevOps

\n
    \n
  • Author High-Level Design (HLD) and Low-Level Design (LLD) documents, architectural diagrams, and technical specifications.
  • \n
  • Establish coding standards, peer code review processes, and integration with static analysis tools (e.g., SonarQube, PyLint).
  • \n
  • Build automated deployment pipelines using Azure DevOps, Git, and Infrastructure as Code (ARM/Bicep/Terraform).
  • \n
  • Mentor junior and mid-level engineers on technical design, optimization, and best practices.
  • \n
\n

Secondary / Good-to-Have Skills

\n
    \n
  • Identity & CI/CD: Microsoft Entra ID (Azure AD), GitHub Actions.
  • \n
  • Alternative Orchestration: Apache Airflow, Dagster, Azure Logic Apps.
  • \n
  • Streaming & Event-Driven: Apache Kafka, Azure Event Hubs, Google Cloud Pub/Sub.
  • \n
  • CDC & Migration: Debezium CDC implementation; Synapse to Databricks migration experience.
  • \n
  • Multi-Cloud Storage: Exposure to Google Cloud Storage (GCS).
  • \n
\n


Loading
Please wait..!!