image
  • Snapboard
  • Activity
  • Reports
  • Campaign
Welcome ,
loadingbar
Loading, Please wait..!!

Senior Databricks Data Engineer

  • ... Posted on: Nov 13, 2024
  • ... Paul May Associates
  • ... Clayton, Missouri
  • ... Salary: Not Available
  • ... Full-time

Senior Databricks Data Engineer   

Job Title :

Senior Databricks Data Engineer

Job Type :

Full-time

Job Location :

Clayton Missouri United States

Remote :

No

Jobcon Logo Job Description :

Job Title: Senior Databricks Data Engineer

Location of role: Greater St. Louis - Able to be in office, Clayton, Hybrid role. Good work/life balance.

Salary total comp base and bonus in the 150K to 160K area - Depending on experience DOE

Qualifications:

Summary:

This person must have solid ETL Databricks experience with full end-to-end programming.

Need to be able to do data standardization, aggregation, data quality, medallion architecture with strong knowledge of Python and SQL.

Someone who works with Delta Lake, Pyspark, Cluster optimization, streaming, workflows / pipelines, (DABS would be nice but not required).

Must be able to do both developing and maintaining of pipelines

  • Bachelor's degree Computer Science, Information Technology or a related field
  • At least 5 years of professional experience in ETL, BI, data integrations engineering.
  • Hands-on experience with Databricks and AWS/Azure
  • Hands-on experience designing and implementing modern data platforms and pipelines
  • Experience with Python, PySpark, C#, or similar high-level language
  • Experience with Microsoft SQL databases and SSIS development preferred
  • Experience with development in public cloud, preferably in AWS
  • Ability to perform complex data analysis and troubleshooting

Preferred Qualifications:

  • Experience with IaaS Development: VS Code, Github, Terraform
  • Hands-on experience designing and implementing modern data platforms and pipelines

Responsibilities

  • This Senior Engineer will be developing and maintaining data pipelines for high impact areas. Emphasis on define, design, develop, unit test, and support ETL solutions to meet complicated critical business requirements.
  • Please have experience with sensitive production incident resolution, performing code reviews, and pipeline testing.
  • Troubleshooting and resolve data integration issues is essential, as is documentation and knowledge sharing as it relates modernizing data engineering practices.


Relocation - At this time, client will NOT relocate for this role

Company sponsorship - At this time, client will NOT sponsor for this role

Travel: This role may require 0% travel

Duration of role: Direct hire Role - Fulltime

If applying for this role - Please take each key point and provide number of years experience and what you would rate yourself, 1 thru 10 (10 being expert) for each key point. Send your resume and notes on the role to expediate our recruiting services.

Jobcon Logo Position Details

Posted:

Nov 13, 2024

Employment:

Full-time

Salary:

Not Available

Snaprecruit ID:

SD-CIE-6e99d6b2d8261b1be2d82cb4b0a94fe57f28937c775614cd028d702f6b87653b

City:

Clayton

Job Origin:

CIEPAL_ORGANIC_FEED

Share this job:

  • linkedin

Jobcon Logo
A job sourcing event
In Dallas Fort Worth
Aug 19, 2017 9am-6pm
All job seekers welcome!

Senior Databricks Data Engineer    Apply

Click on the below icons to share this job to Linkedin, Twitter!

Job Title: Senior Databricks Data Engineer

Location of role: Greater St. Louis - Able to be in office, Clayton, Hybrid role. Good work/life balance.

Salary total comp base and bonus in the 150K to 160K area - Depending on experience DOE

Qualifications:

Summary:

This person must have solid ETL Databricks experience with full end-to-end programming.

Need to be able to do data standardization, aggregation, data quality, medallion architecture with strong knowledge of Python and SQL.

Someone who works with Delta Lake, Pyspark, Cluster optimization, streaming, workflows / pipelines, (DABS would be nice but not required).

Must be able to do both developing and maintaining of pipelines

  • Bachelor's degree Computer Science, Information Technology or a related field
  • At least 5 years of professional experience in ETL, BI, data integrations engineering.
  • Hands-on experience with Databricks and AWS/Azure
  • Hands-on experience designing and implementing modern data platforms and pipelines
  • Experience with Python, PySpark, C#, or similar high-level language
  • Experience with Microsoft SQL databases and SSIS development preferred
  • Experience with development in public cloud, preferably in AWS
  • Ability to perform complex data analysis and troubleshooting

Preferred Qualifications:

  • Experience with IaaS Development: VS Code, Github, Terraform
  • Hands-on experience designing and implementing modern data platforms and pipelines

Responsibilities

  • This Senior Engineer will be developing and maintaining data pipelines for high impact areas. Emphasis on define, design, develop, unit test, and support ETL solutions to meet complicated critical business requirements.
  • Please have experience with sensitive production incident resolution, performing code reviews, and pipeline testing.
  • Troubleshooting and resolve data integration issues is essential, as is documentation and knowledge sharing as it relates modernizing data engineering practices.


Relocation - At this time, client will NOT relocate for this role

Company sponsorship - At this time, client will NOT sponsor for this role

Travel: This role may require 0% travel

Duration of role: Direct hire Role - Fulltime

If applying for this role - Please take each key point and provide number of years experience and what you would rate yourself, 1 thru 10 (10 being expert) for each key point. Send your resume and notes on the role to expediate our recruiting services.

Loading
Please wait..!!