Azure Data Engineer

Location : Charlotte, NC (Hybrid)Mode of interview : WebEx / TeamsClient is seeking an experienced Azure Data Engineer to support the design, development, and modernization of enterprise data platforms using Microsoft Azure technologies. The engineer will build scalable data pipelines, data lake and analytics solutions, and support large-volume data processing across structured and unstructured data sources.The role requires strong hands-on experience with Azure Data Factory, Azure Databricks, Azure Data Lake, Synapse/Fabric, Python/PySpark, SQL, ETL/ELT, APIs, and DevOps/CI-CD practices. Experience supporting financial-services, Capital Markets, reference data, securities, pricing, or market-data platforms is highly desirable.Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines using Azure Data Factory and Azure Databricks.Build and optimize ETL/ELT solutions for ingestion, transformation, integration, and processing of large-volume datasets.Develop data solutions using Azure Data Lake Storage Gen2, Azure SQL, Synapse Analytics, Microsoft Fabric, and other Azure data services.Develop reusable data-processing frameworks using Python and PySpark.Build and maintain APIs and data-integration services using FastAPI, Azure Functions, API Gateway/API Management, or similar technologies.Design and maintain data models supporting analytics, reporting, reference data, pricing, and downstream applications.Implement data-quality, validation, security, governance, and compliance controls across Azure data platforms.Optimize pipeline, SQL, Spark, and storage performance for reliability, scalability, and cost efficiency.Support structured and unstructured data processing across enterprise data sources.Implement source control, automated testing, code promotion, and deployment using Git, Jenkins, Azure DevOps, or similar CI/CD tools.Troubleshoot production data-pipeline and platform issues and perform root-cause analysis.Partner with business, architecture, application, analytics, infrastructure, and data-governance teams.Maintain technical documentation, data mappings, architecture diagrams, operating procedures, and support documentation.Follow enterprise development, security, governance, and change-management standards.Required SkillsStrong experience as an Azure Data Engineer.Hands-on experience with Azure Data Factory (ADF).Strong experience with Azure Databricks.Experience with Azure Data Lake Storage Gen2 / Azure Blob Storage.Strong Python and PySpark development skills.Strong SQL skills across relational and/or NoSQL databases.Experience with ETL/ELT pipelines and data integration.Experience with Azure Synapse Analytics and/or Microsoft Fabric.Experience with Azure Functions and API development/integration.Understanding of data modeling, data quality, security, and governance.Experience with Git and CI/CD processes.Strong troubleshooting and production-support capabilities.Preferred SkillsExperience in Financial Services, Capital Markets, Investment Banking, or Securities.Knowledge of financial instruments, asset classes, market data, securities/reference data, and pricing data.Experience with FastAPI or similar Python API frameworks.Experience with Azure API Management.Azure certifications.Experience with data-platform modernization or migration from legacy/on-prem environments to Azure.Knowledge of cloud security, access controls, encryption, and regulated data environments.Key Skills for SourcingAzure Data Factory | Azure Databricks | ADLS Gen2 | Python | PySpark | SQL | ETL/ELT | Azure Synapse | Microsoft Fabric | Azure Functions | FastAPI | API Management | Git | Jenkins | Azure DevOps | CI/CD | Data Modeling | Data Quality | Data Governance | Capital Markets