Job Title: Databricks Architect

Location: Grimes, IA / Remote

Duration: long term

Job ID: 4CI 7030

Required Qualifications:

• Design and develop scalable ETL pipelines using Databricks (PySpark, Delta Lake, Workflows).
• Migrate data from legacy databases, VSAM files, and multiple source systems to PostgreSQL.
• Architect and configure Databricks environments including landing and staging zones.
• Optimize load performance, load balancing, and manage large-volume data cutovers.
• Implement data validation, transformation rules, and data masking.
• Configure job automation, monitoring, and performance tuning.
• Support defect resolution and ensure high data accuracy and reliability.
• Collaborate with cross-functional teams on data mapping, technical design, and testing.