Data Engineer

This Data Engineer role is a 9 - Month Contract with a client located in Richmond, VA.Pay Range: $70/hr. - $80/hr. The rate may be negotiable based on experience, education, geographic location, and other factors.Key ResponsibilitiesDesign, develop, and maintain scalable batch data pipelines for transaction data processing and integration.Build, enhance, and support data pipelines using Python, Spark, AWS Glue, and Databricks.Develop complex SQL queries to extract, transform, validate, and analyze data.Work with Snowflake for data storage, transformation, and analytical processing.Use Apache Airflow for workflow orchestration, scheduling, and monitoring of data pipelines.Troubleshoot pipeline failures, investigate data quality issues, and optimize performance.Support the integration of one client's data into current client's existing data ecosystem.Collaborate with engineers across multiple initiatives within a small, agile team structure.For API-focused initiatives, develop and maintain APIs to serve data to downstream applications and systems.Follow established engineering standards, data governance practices, and best practices for reliable data processing.Required Technical SkillsData Engineering: 12 years of hands-on experience building and supporting data pipelines.Programming: Strong Python programming skills.Big Data: Hands-on experience with Apache Spark.ETL, Ab Initio: Hands on experience developing ETL pipelineAWS: Experience with AWS Glue and related data engineering services.SQL: Strong SQL skills, including complex queries, joins, aggregations, and data analysis.Databricks: Experience developing and processing data using Databricks.Snowflake: Experience working with Snowflake for data processing and warehousing.Orchestration: Experience with Apache Airflow for scheduling and managing data workflows.Data Processing: Experience with batch pipelines, ETL/ELT processes, data transformation, and pipeline support.Equal Opportunity Employer/Veterans/DisabledBenefit offerings available for our associates include medical, dental, vision, life insurance, short-term disability, additional voluntary benefits, an EAP program, commuter benefits, and a 401K plan. Our benefit offerings provide employees the flexibility to choose the type of coverage that meets their individual needs. In addition, our associates may be eligible for paid leave including Paid Sick Leave or any other paid leave required by Federal, State, or local law, as well as Holiday pay where applicable. Disclaimer: These benefit offerings do not apply to client-recruited jobs and jobs that are direct hires to a client.To read our Candidate Privacy Information Statement, which explains how we will use your information, please visit Company will consider qualified applicants with arrest and conviction records in accordance with federal, state, and local laws and/or security clearance requirements, including, as applicable:· The California Fair Chance Act· Los Angeles City Fair Chance Ordinance· Los Angeles County Fair Chance Ordinance for Employers· San Francisco Fair Chance Ordinance