Skip to main content
Loading
loadingbar
Loading, Please wait..!!

Lead Full Stack Engineer

  • Lead Full Stack Engineer job type Posted on: Oct 25, 2026
  • Lead Full Stack Engineer experience level InfoBeans
  • Lead Full Stack Engineer employment type Charlotte, North Carolina
  • Lead Full Stack Engineer employment type Onsite
  • Lead Full Stack Engineer salary Full-time

Point Apply Here APPLY LATER

Curious about compensation?

Explore the historical salary trends, average pay, and estimated compensation for Lead Full Stack Engineer roles in North Carolina.

View Salary Guide →

Job Title :

Lead Full Stack Engineer

Job Type :

Full-Time

Job Location :

Charlotte North Carolina United States

Remote :

No

Jobcon Logo Job Description :

Job Description

InfoBeans is hiring an experienced Senior / Lead Data Engineer to design, build, and optimize enterprise‑scale data platforms. The ideal candidate has strong hands‑on expertise with Azure Databricks, PySpark, ADF, Delta Lake, and modern data warehousing. In this role, you will work closely with architects, analysts, and business stakeholders to deliver high‑performance, reliable, and scalable data solutions.

\n


\n

If you thrive in fast‑paced environments and enjoy solving complex data challenges, we’d love to connect.

\n


\n

Title: Senior / Lead Data Engineer (Databricks)

\n

Experience: 10+ years

\n

Contract: C2H / W2 / 1099

\n

Duration: 12 months

\n


\n

Job Description:

\n

Advanced Spark Optimization - Optimizing DataFrame transformations to avoid shuffles and wide dependencies, Adaptive Query Execution (AQE) tuning, Handling skew, Caching & checkpointing strategies, Cluster sizing & autoscaling strategies

\n

Delta Lake Internals & Performance Tuning - Optimizing Delta performance, Understanding Delta logs & transaction protocol, Time travel & schema evolution best practices, CDC (Change Data Capture) patterns, Multi-hop architecture (Bronze/Silver/Gold)

\n

Databricks Workflows & Orchestration - Orchestrating ETL/ELT with Jobs & Workflows, Multi-task job pipelines (with task dependencies), Job clusters vs all-purpose clusters, Error handling & retries, CI/CD deployment using repos

\n

Unity Catalog & Enterprise Data Governance - Fine-grained access control (schemas, tables, columns, views), Data lineage tracking, Secure data sharing across workspaces, Managing tokens, service principals & permissions models

\n

Databricks SQL & Lakehouse Warehouses - Writing high-performance queries on the Lakehouse, Materialized views, SQL dashboards, Understanding Photon execution engine for high-speed queries

\n

Streaming & Real‑Time Pipelines - Structured Streaming internals, Auto Loader for incremental ingest, Trigger types & watermarking, Handling late-arriving data, Stateful stream processing

\n

Advanced Cluster & Compute Management - Spot vs on-demand clusters, Photon runtime vs standard, Cluster policies for cost control, SQL warehouses vs all-purpose compute, Monitoring with Ganglia / metrics dashboards

\n

Best Practices in Lakehouse Architecture - Medallion Architecture patterns, Modular, reusable ETL code patterns, Cost optimization strategies, Data quality frameworks (e.g., expectations, constraints)

\n

DevOps & CI/CD Integration - Git integration via Databricks Repos, Promoting code across dev/test/prod, Using the Databricks CLI, Automated deployments using Azure DevOps/GitHub Actions

\n


\n

Nice to have:

\n

Azure Data Factory - Understanding of Pipelines, Activities, and Datasets, Linked Services configuration, Integration Runtime types (Auto‑IR, Self‑Hosted IR, Azure IR), Source and Sink concepts in ADF

\n

ETL/ELT Data Integration - Building data ingestion pipelines (batch + incremental loads), Designing end‑to‑end data transformation

Jobcon Logo Position Details

Posted:

Oct 25, 2026

Reference Number:

2e4af7f7d0da24e0

Employment:

Full-time

City:

Charlotte

Job Origin:

ziprecruiter

Share this job:

  • linkedin

Jobcon Logo
A job sourcing event
In Dallas Fort Worth
Aug 19, 2017 9am-6pm
All job seekers welcome!

Lead Full Stack Engineer    Apply

Click on the below icons to share this job to Linkedin, Twitter!

Job Description

InfoBeans is hiring an experienced Senior / Lead Data Engineer to design, build, and optimize enterprise‑scale data platforms. The ideal candidate has strong hands‑on expertise with Azure Databricks, PySpark, ADF, Delta Lake, and modern data warehousing. In this role, you will work closely with architects, analysts, and business stakeholders to deliver high‑performance, reliable, and scalable data solutions.

\n


\n

If you thrive in fast‑paced environments and enjoy solving complex data challenges, we’d love to connect.

\n


\n

Title: Senior / Lead Data Engineer (Databricks)

\n

Experience: 10+ years

\n

Contract: C2H / W2 / 1099

\n

Duration: 12 months

\n


\n

Job Description:

\n

Advanced Spark Optimization - Optimizing DataFrame transformations to avoid shuffles and wide dependencies, Adaptive Query Execution (AQE) tuning, Handling skew, Caching & checkpointing strategies, Cluster sizing & autoscaling strategies

\n

Delta Lake Internals & Performance Tuning - Optimizing Delta performance, Understanding Delta logs & transaction protocol, Time travel & schema evolution best practices, CDC (Change Data Capture) patterns, Multi-hop architecture (Bronze/Silver/Gold)

\n

Databricks Workflows & Orchestration - Orchestrating ETL/ELT with Jobs & Workflows, Multi-task job pipelines (with task dependencies), Job clusters vs all-purpose clusters, Error handling & retries, CI/CD deployment using repos

\n

Unity Catalog & Enterprise Data Governance - Fine-grained access control (schemas, tables, columns, views), Data lineage tracking, Secure data sharing across workspaces, Managing tokens, service principals & permissions models

\n

Databricks SQL & Lakehouse Warehouses - Writing high-performance queries on the Lakehouse, Materialized views, SQL dashboards, Understanding Photon execution engine for high-speed queries

\n

Streaming & Real‑Time Pipelines - Structured Streaming internals, Auto Loader for incremental ingest, Trigger types & watermarking, Handling late-arriving data, Stateful stream processing

\n

Advanced Cluster & Compute Management - Spot vs on-demand clusters, Photon runtime vs standard, Cluster policies for cost control, SQL warehouses vs all-purpose compute, Monitoring with Ganglia / metrics dashboards

\n

Best Practices in Lakehouse Architecture - Medallion Architecture patterns, Modular, reusable ETL code patterns, Cost optimization strategies, Data quality frameworks (e.g., expectations, constraints)

\n

DevOps & CI/CD Integration - Git integration via Databricks Repos, Promoting code across dev/test/prod, Using the Databricks CLI, Automated deployments using Azure DevOps/GitHub Actions

\n


\n

Nice to have:

\n

Azure Data Factory - Understanding of Pipelines, Activities, and Datasets, Linked Services configuration, Integration Runtime types (Auto‑IR, Self‑Hosted IR, Azure IR), Source and Sink concepts in ADF

\n

ETL/ELT Data Integration - Building data ingestion pipelines (batch + incremental loads), Designing end‑to‑end data transformation

Loading
Please wait..!!