Lead Data Engineer

Employment Type: Full-Time Experience: 10+ Years Location: Hybrid NY/NJ Job Overview EXL is looking for a Senior AWS Analytics Engineer with 10+ years of experience in data engineering, ETL, and cloud-based data platforms. The ideal candidate should have hands-on experience building and supporting data pipelines using AWS services, Python, SQL, and Spark/PySpark.

Key Responsibilities

• Develop and maintain data pipelines and ETL processes using AWS services.
• Work with AWS S3, AWS Glue, and Amazon Redshift for data ingestion, transformation, and storage.
• Develop data transformations using Python, SQL, and PySpark/Spark .
• Build and maintain batch data processing workflows.
• Use AWS Step Functions to orchestrate data pipelines and workflows.
• Support AWS infrastructure and deployments using CloudFormation .
• Troubleshoot data pipeline failures and resolve data-quality and performance issues.
• Work with large datasets and optimize data processing jobs.
• Collaborate with senior data engineers, architects, analysts, and business teams.
• Follow data engineering, security, monitoring, and CI/CD best practices.

Required Skills

• 10+ years of experience in Data Engineering / Cloud Data Engineering
• Hands-on experience with AWS Amazon S3 AWS Glue Amazon Redshift Python SQL Apache Spark / PySpark AWS Step Functions AWS CloudFormation
• Strong understanding of ETL/ELT and data pipelines

For applications and inquiries,