Data Engineer

Job Title : Data Engineer

Location: Dallas/Frisco, TX; Tampa/Fort Lauderdale, FL; New York, NY; Louisville, KY; Chicago, IL; Atlanta, GA; Boston, MA; Nashville, TN; Charlotte, NC
Worksite: Hybrid/Onsite as required by the client
Duration: 12+ Months

We are seeking an experienced Data Engineer to support enterprise data and analytics initiatives. The Data Engineer will design, develop, and maintain scalable data pipelines and data solutions that support reporting, analytics, and business decision-making.

The ideal candidate will have strong experience with SQL, ETL/ELT, cloud data platforms, Python, Spark, and Azure Databricks, along with experience working with large-scale structured and unstructured data.

• Design, develop, and maintain scalable ETL/ELT data pipelines.
• Build and optimize data integration processes from multiple data sources.
• Develop and maintain data warehouses, data lakes, and data models.
• Work extensively with Azure Databricks and large-scale data processing environments.
• Optimize data pipelines, queries, and data processing jobs for performance and scalability.
• Ensure data quality, accuracy, integrity, and consistency.
• Work with business stakeholders, data analysts, data scientists, and technology teams to understand requirements.
• Support reporting, analytics, business intelligence, and machine learning initiatives.
• Monitor, troubleshoot, and resolve data pipeline and production issues.
• Work with structured and unstructured datasets.
• Maintain technical documentation, data lineage, and data engineering processes.
• Follow data governance, security, and compliance standards.
• Participate in Agile activities such as sprint planning, backlog grooming, and daily stand-ups.

• Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
• 5+ years of experience in Data Engineering or related data development roles.
• Strong SQL and relational database experience.
• Hands-on experience developing ETL/ELT pipelines.
• Strong experience with cloud data platforms such as Azure, AWS, or GCP.
• Experience with Python and/or Spark.
• Hands-on experience with large-scale data processing and pipeline optimization.
• Strong understanding of data warehousing and dimensional modeling concepts.
• Experience working with structured and unstructured data.
• Understanding of data governance, security, and compliance practices.
• Strong analytical, troubleshooting, and communication skills.

• Experience in the healthcare or payer industry.
• Experience with Medicare, Medicaid, or healthcare analytics.
• Experience with Azure Data Factory, Azure Databricks, Azure Synapse, Snowflake, or Hadoop.
• Experience with Power BI, Tableau, or other BI tools.
• Exposure to machine learning and advanced analytics environments.
• Experience working in regulated healthcare environments.