Databricks Engineer

Description:

Remote Our client seeks a Mid-Level Databricks/Informatica Data Engineer to support enterprise data modernization, cloud migration, analytics, and integration initiatives. The role involves building scalable data pipelines in Databricks, developing ETL/ELT solutions with Informatica, and supporting cloud-based data platforms that enable business intelligence, reporting, and advanced analytics.

Due to client requirements, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance.

• Design, develop, and maintain enterprise ETL/ELT pipelines using Informatica PowerCenter and/or Informatica Intelligent Cloud Services (IICS).
• Build and optimize Databricks notebooks, workflows, and data pipelines for large-scale data processing.
• Develop and support data ingestion frameworks from structured and unstructured data sources.
• Implement data transformations, cleansing, enrichment, and validation processes.
• Create scalable solutions using PySpark, Spark SQL, and Delta Lake.
• Collaborate with business stakeholders, data architects, analysts, and application teams to define data requirements.
• Troubleshoot and resolve data integration, performance, and data quality issues.
• Support migration from legacy data warehouses and ETL platforms to modern cloud-based architectures.
• Develop and maintain technical documentation, data mappings, and operational runbooks.
• Participate in Agile development activities including sprint planning, code reviews, and deployments.

• 5+ years of experience in data engineering, ETL development, or data warehousing.
• 3+ years of experience with Databricks, Apache Spark, or cloud-based analytics platforms.
• 3+ years of experience with Informatica PowerCenter, Informatica IICS, or Informatica Cloud.
• Strong SQL development and performance tuning experience.
• Experience designing and implementing enterprise-scale data integration solutions.
• Understanding of dimensional modeling, data warehousing, and master data management concepts.
• Strong analytical, troubleshooting, and communication skills.

Preferred: Snowflake, Microsoft Fabric, Azure Synapse, or Redshift.

Preferred: Experience in AWS, Azure, or Google Cloud environments.

Preferred: Knowledge of Delta Lake, Medallion Architecture, and Data Lakehouse concepts.

Preferred: Informatica and/or Databricks certifications.

Preferred: CI/CD pipelines, Git, Azure DevOps, or GitHub.

Preferred: Experience supporting Federal Government, DoD, DHS, or other regulated environments. Active Public Trust or Security Clearance preferred.

Desired: 5-8 years of overall IT experience and experience designing end-to-end enterprise data platforms.

Desired: Experience supporting reporting, analytics, AI/ML, and business intelligence workloads.

Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.

For applications and inquiries,