Loading, Please wait..!!
Data Engineer
-
Posted on: Nov 17, 2026
-
Louisville, Kentucky
-
Onsite
-
Full-time
Curious about compensation?
Explore the historical salary trends, average pay, and estimated compensation for Data Engineer roles in Kentucky.
View Salary Guide →Find your match !
Job Title :
Data Engineer
Job Type :
Full-Time
Job Location :
Louisville Kentucky United States
Remote :
No
Job Description :
Job Description
Key Responsibilities
\nData Engineering & Development
\nDesign, develop, and maintain scalable batch and real-time data pipelines using Databricks.
\nBuild robust data solutions using PySpark, Spark SQL, and Delta Lake.
\nImplement data validation, quality checks, and performance tuning processes.
\nDevelop ETL/ELT workflows to support enterprise data integration needs.
\nData Lakehouse Management
\nDesign and manage data architecture within the Databricks Lakehouse Platform.
\nImplement Delta Lake tables, partitioning strategies, optimization techniques, and schema evolution.
\nDevelop data models to support analytics, reporting, and business intelligence requirements.
\nEnsure data reliability, scalability, governance, and availability.
\nPerformance Optimization
\nAnalyze and optimize Spark jobs for performance and cost efficiency.
\nMonitor Databricks cluster utilization and implement best practices for resource management.
\nTroubleshoot bottlenecks in data processing workflows.
\nImprove processing times through caching, partitioning, and query optimization techniques.
\nData Governance & Security
\nImplement role-based access controls (RBAC) and data security standards.
\nSupport data governance initiatives, data lineage tracking, and compliance requirements.
\nEnsure adherence to enterprise data management policies and security frameworks.
\nCollaboration & Delivery
\nWork closely with Data Architects, Data Scientists, Business Analysts, and Application Teams.
\nParticipate in Agile development processes, sprint planning, and scrum ceremonies.
\nPrepare technical design documentation and support knowledge transfer activities.
\nCollaborate with stakeholders to gather requirements and translate them into scalable technical solutions.
\nRequired Qualifications
\nBachelor's degree in Computer Science, Information Technology, or a related field.
\nStrong experience with Databricks, Apache Spark, PySpark, Spark SQL, and Delta Lake.
\nExperience designing and developing large-scale data pipelines and ETL processes.
\nStrong understanding of Data Lakehouse architecture and data modeling concepts.
\nExperience with cloud platforms such as Azure, AWS, or GCP.
\nKnowledge of data governance, security, and enterprise data management practices.
\nExcellent problem-solving, analytical, and communication skills.
\nPreferred Skills
\nAzure Data Factory (ADF)
\nAzure Synapse Analytics
\nKafka or other streaming technologies
\nCI/CD pipelines and DevOps practices
\nPython programming
\nSQL performance tuning
\nUnity Catalog and Databricks governance tools
\nPrimary Skills: Databricks, PySpark, Spark SQL, Delta Lake, Data Lakehouse, Azure/AWS, ETL, Data Engineering.
Similar Jobs You May Be Interested In
Data Engineer Lead
Data Engineer
Data Engineer -- 2/3 days a Week in Dayton, OH -- Only W2
Data Engineer Cyber Security
Snowflake Data Engineer
Data Engineer
Data & ML Engineer
Data Governance Architect (Data Catalog Engineer Role) - Remote
W2 Role :: Snowflake Data Engineer :: Remote within Colorado
Data Center Infrastructure Engineer
Snowflake & Informatica Data Engineer
Snowflake Data Engineer
Position Details
Posted:
Nov 17, 2026
Reference Number:
32c2cdfca4a1b812
Employment:
Full-time
City:
Louisville
Job Origin:
ziprecruiter
Share this job:
Please wait..!!

