Lead Data Engineer at Atlantis IT group Ontario, CA

Lead Data Engineer Location: Toronto, ON - Hybrid Duration: Long Term contract Experience Level: 8+ years Responsibilities Develop and maintain backend systems using Python and PySpark ensuring high performance, scalability, and reliability. Participate in the design and implementation of data engineering and ETL pipelines using PySpark. Collaborate with DevOps and Operations teams to ensure smooth deployment and operation of applications. Expert in DevOps practices and tools for CICD pipelines. Experience with cloud platforms, including Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP). Experience with PySpark for data engineering ETL pipelines. Familiarity with containerization using Docker and orchestration using Kubernetes. Qualifications 8+ years of strong design, development experience using C#, .NET Core, Web API, Angular/React, ASP.NET MVC. 3+ years of strong development experience with SQL Server/Oracle/Sybase, complex procedures, and SSIS/SSRS. Working experience in the financial domain. Experience working with DevOps, source code management tools like Git, SVN, Jira, UCD, Jenkins. Experience working with Agile/Scrum/RAD development methodology. Nice to have: container-based technologies like Docker, Kubernetes, OpenShift, cloud platform familiarity and big‑data and cloud‑based technologies. #J-18808-Ljbffr