Senior Azure Databricks Engineer

Job Title: Data Engineer (Microsoft Fabric and Databricks)Duration: 12 months (W2 Contract)Schedule: 5/40 - Mon - FriLocation: Reston, VA*Please note: We are only considering candidates who are U.S. Citizens or Green Card holders for this opportunity.This opportunity offers the chance to design, build, and support enterprise data platforms in a complex environment focused on analytics, AI initiatives, and project delivery. The role combines hands-on data engineering with platform administration across Microsoft Fabric, Databricks, Delta Lake, and OneLake. This position will play a key part in delivering scalable, secure, and reliable data solutions while supporting governance, performance optimisation, and operational excellence.Required Education:Bachelor's degree in Computer Science, Engineering, Information Systems, Data Engineering, or a related discipline, or equivalent relevant experienceRequired Experience:7-10 years of relevant experience in data engineering, data platforms, analytics, and cloud technologiesMinimum 3+ years of hands-on experience with Databricks and 2+ years working in Microsoft Fabric environmentsProven experience designing and supporting production-grade ETL/ELT and data integration solutionsExperience administering enterprise-scale Databricks and Microsoft Fabric platformsStrong experience working with Azure data services and cloud-native architecturesDemonstrated experience in stakeholder engagement, solution ownership, and technical leadershipRequired Skills:Strong expertise in Databricks, Spark, Delta Lake, Microsoft Fabric, OneLake, Lakehouse, and Data Warehouse architecturesAdvanced proficiency in Python, PySpark, SQL, and notebook-based developmentExperience designing and implementing ETL/ELT, data ingestion, and data transformation pipelines for structured and unstructured data sourcesKnowledge of batch processing, near real-time and streaming data ingestion from databases, APIs, files, cloud storage, and enterprise applicationsStrong understanding of dimensional modelling, data warehousing, semantic data structures, and data martsExperience implementing data quality frameworks, validation rules, reconciliation controls, and exception management processesAbility to optimise Spark workloads, SQL queries, storage strategies, partitioning, and distributed data processing performanceKnowledge of Databricks workspace administration and Microsoft Fabric administration, including workspaces, capacities, Lakehouses, Data Warehouses, Dataflows, and PipelinesExperience with Microsoft Entra ID, RBAC, access controls, service principals, identity integrations, secrets management, key vaults, and secure data accessKnowledge of platform monitoring, observability, troubleshooting, incident management, workload performance, and capacity planningExperience with Git, Azure DevOps, CI/CD pipelines, release management, automated testing, and deployment standardsUnderstanding of metadata management, data lineage, cataloguing, governance processes, and compliance controlsAbility to communicate technical solutions, trade-offs, risks, dependencies, and delivery plans to technical and non-technical stakeholdersAbility to balance performance, scalability, reliability, security, and cost considerations in a fast-paced enterprise environmentPreferred Qualifications:Experience mentoring engineers and supporting enterprise platform operationsKnowledge of Infrastructure as Code, automation frameworks, and deployment templatesExperience implementing enterprise data quality and reliability frameworksExperience with Fabric capacity optimisation, Databricks cluster optimisation, workload management, and FinOps practicesMicrosoft Certified: Fabric Analytics Engineer AssociateMicrosoft Certified: Azure Data Engineer AssociateDatabricks Certified Data Engineer ProfessionalDatabricks Certified Data Engineer AssociateAbout Airswift:Airswift is an international workforce solutions provider within the energy, process and infrastructure industries. Airswift serves as a strategic partner to clients, offering a turnkey workforce solution to capture and deliver the top talent needed to complete successful projects by aligning with unique project needs. With over 1000 employees and 9,000 contractors operating in over 60 countries, Airswift's geographical reach and pool of talent available is unmatched in the industry.