Skip to main content
Loading
loadingbar
Loading, Please wait..!!

Sr Databricks Engineer

  • Sr Databricks Engineer job type Posted on: Oct 28, 2026
  • Sr Databricks Engineer experience level Transcend IT Solutions
  • Sr Databricks Engineer employment type Malvern, Pennsylvania
  • Sr Databricks Engineer employment type Onsite
  • Sr Databricks Engineer salary CTC

Point Apply Here APPLY LATER

Curious about compensation?

Explore the historical salary trends, average pay, and estimated compensation for Sr Databricks Engineer roles in Pennsylvania.

View Salary Guide →

Job Title :

Sr Databricks Engineer

Job Type :

Contract

Job Location :

Malvern Pennsylvania United States

Remote :

No

Jobcon Logo Job Description :

Job Title: Sr. Databricks Engineer

Location: Malvern, PA

Job Details:

Technical Stack & Requirements:

  • Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker.
  • Infrastructure: CloudFormation/Terraform, CI/CD with GitHub Actions.
  • Core Responsibilities: Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level production support to ensure system reliability.

Qualifications:

  • Bachelor's degree in Computer Science or related field.
  • Strong hands-on experience with Apache Spark and Glue.
  • Proven ability to work with Python-based data pipelines.
  • Experience with Git and GitHub Actions is mandatory. Required Qualifications
  • Bachelor's degree in Computer Science, Engineering, Information Systems, or related discipline.
  • 5-7+ years of enterprise Data Engineering experience.
  • Strong Python development experience.
  • Advanced SQL programming skills.
  • Extensive experience with Apache Spark and PySpark.
  • Strong experience with Databricks application.
  • Hands-on experience with AWS data services including: o S3 o AWS Glue o Athena o Lambda o Step Functions o EventBridge
  • Experience building enterprise ETL and ELT pipelines.
  • Strong understanding of distributed data processing.
  • Experience working with large-scale cloud data platforms.
  • Strong knowledge of dimensional data modeling.
  • Experience implementing CI/CD pipelines.
  • Familiarity with Agile/Scrum methodologies.
  • Excellent communication and stakeholder management skills.

Preferred Qualifications

  • Financial Services or Asset Management industry experience.
  • Knowledge of Apache Iceberg, Delta Lake, or Hudi.
  • Experience with Airflow.
  • Knowledge of Kafka or Kinesis streaming.
  • Experience supporting AI/ML and advanced analytics platforms.
  • AWS Professional or Specialty Certifications.

Job Responsibilities

We are seeking high-caliber Data Engineers to drive data analysis projects, Migrate jobs from EMR to Databricks,create strong job aids and train analysts. In this pivotal role, you will implement and optimize sophisticated data pipelines, partnering with business analysts to guarantee the seamless availability and absolute integrity of data powering our core financial engines and reporting ecosystems.

Hari Krishna Vanga
Senior Technical Recruiter
E: am1@transcendit.io
L: /> A: 25663 Smotherman Rd, Suite 302, Frisco, TX, 75033.
/>

Jobcon Logo Position Details

Posted:

Oct 28, 2026

Reference Number:

19-49161

Employment:

CTC

City:

Malvern

Job Origin:

CIEPAL_ORGANIC_FEED

Share this job:

  • linkedin

Jobcon Logo
A job sourcing event
In Dallas Fort Worth
Aug 19, 2017 9am-6pm
All job seekers welcome!

Sr Databricks Engineer    Apply

Click on the below icons to share this job to Linkedin, Twitter!

Job Title: Sr. Databricks Engineer

Location: Malvern, PA

Job Details:

Technical Stack & Requirements:

  • Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker.
  • Infrastructure: CloudFormation/Terraform, CI/CD with GitHub Actions.
  • Core Responsibilities: Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level production support to ensure system reliability.

Qualifications:

  • Bachelor's degree in Computer Science or related field.
  • Strong hands-on experience with Apache Spark and Glue.
  • Proven ability to work with Python-based data pipelines.
  • Experience with Git and GitHub Actions is mandatory. Required Qualifications
  • Bachelor's degree in Computer Science, Engineering, Information Systems, or related discipline.
  • 5-7+ years of enterprise Data Engineering experience.
  • Strong Python development experience.
  • Advanced SQL programming skills.
  • Extensive experience with Apache Spark and PySpark.
  • Strong experience with Databricks application.
  • Hands-on experience with AWS data services including: o S3 o AWS Glue o Athena o Lambda o Step Functions o EventBridge
  • Experience building enterprise ETL and ELT pipelines.
  • Strong understanding of distributed data processing.
  • Experience working with large-scale cloud data platforms.
  • Strong knowledge of dimensional data modeling.
  • Experience implementing CI/CD pipelines.
  • Familiarity with Agile/Scrum methodologies.
  • Excellent communication and stakeholder management skills.

Preferred Qualifications

  • Financial Services or Asset Management industry experience.
  • Knowledge of Apache Iceberg, Delta Lake, or Hudi.
  • Experience with Airflow.
  • Knowledge of Kafka or Kinesis streaming.
  • Experience supporting AI/ML and advanced analytics platforms.
  • AWS Professional or Specialty Certifications.

Job Responsibilities

We are seeking high-caliber Data Engineers to drive data analysis projects, Migrate jobs from EMR to Databricks,create strong job aids and train analysts. In this pivotal role, you will implement and optimize sophisticated data pipelines, partnering with business analysts to guarantee the seamless availability and absolute integrity of data powering our core financial engines and reporting ecosystems.

Hari Krishna Vanga
Senior Technical Recruiter
E: am1@transcendit.io
L: /> A: 25663 Smotherman Rd, Suite 302, Frisco, TX, 75033.
/>

Loading
Please wait..!!