Job DescriptionJob DescriptionSenior Data Engineer\nSalary - $125,000 (Chicago)\n\nAbout Retail Insight\n\nAt Retail Insight, we're transforming the way some of the world's biggest retailers and CPG brands use data, analytics and technology to make smarter decisions.\n\nOur people are at the heart of what we do. We bring together talented people with different experiences, perspectives and expertise to solve complex problems, challenge the status quo and make a real impact for our clients.\n\nWe're growing, and we're looking for a Senior Data Engineer to join our Engineering team.\n\n\nAbout the role\n\nWe're looking for an experienced Senior Data Engineer to build and support the reliable, scalable data systems that power our solutions for US retail clients.\n\nAs our US client portfolio grows, you'll work with complex data environments, helping translate business requirements into practical technical solutions. Working closely with our Chicago-based Lead Data Engineer, alongside data scientists, analysts and product teams, you'll build data pipelines and products that help our clients make better decisions.\n\nThis is a hands-on role combining strong technical skills with collaboration and clear communication. You'll contribute to the evolution of our data platform, improve reliability and performance, and help maintain high engineering standards.\n\nYou'll also work with colleagues and client stakeholders to understand their needs and support successful delivery. \n\n\nWhat you'll be doing\n\n\nBuilding and maintaining scalable data pipelines, developing and optimising batch and streaming workflows for reliability and performance.\nContributing to the design and implementation of data architecture.\nImplementing data quality checks, monitoring and observability across pipelines.\nApplying security, access control and governance standards established by our platform team.\nCollaborating with data scientists and analysts to deliver data products that support their work.\nWorking with the Lead Data Engineer to translate business requirements into technical solutions.\nParticipating in code reviews, setting a high bar for engineering quality and contributing to team standards.\nHelping identify opportunities to optimise cloud costs and platform performance.\nContributing to platform documentation, tooling choices and continuous improvement.\n\n\nWhat we’re looking for\n\n\nSolid, demonstrable experience in data engineering, including building and maintaining production-grade Databricks pipelines.\nExperience with Databricks Unity Catalog and Databricks Asset Bundles.\nStrong hands-on knowledge of Apache Spark, Delta Lake and Databricks Workflows.\nProficiency in Python and SQL, with a good understanding of data modelling, ETL/ELT patterns and distributed data processing.\nExperience with Azure data platforms, including Azure Data Factory, ADLS Gen2 and Azure DevOps, or equivalent services on AWS or GCP.\nExperience implementing data quality checks and pipeline monitoring.\nStrong communication skills and the ability to work effectively with technical and non-technical colleagues.\nA collaborative approach, ownership of quality outcomes and a drive to learn and improve.\nA degree in computer science, data engineering or a related field, or equivalent practical experience.\nWillingness to travel as required.\n\n\nBonus points if you also have\n\n\nFamiliarity with infrastructure-as-code tools such as Terraform or Bicep.\nFamiliarity with dbt or similar data transformation frameworks.\nExposure to real-time streaming technologies such as Kafka or Event Hubs.\nExposure to retail or consumer packaged goods (CPG) data, such as point of sale, inventory or supply chain.\nExperience working directly with clients.\n\n\n\nSome of our extras...\n\nWe believe in flexibility, growth, and taking care of our people, both in and out of the office.\n\nHybrid & Flexible Working: Work from anywhere benefits, plus summer hours and extra days off for life’s big moments (including your birthday and wedding).\n\nGenerous Time Off: 26 days PTO (accrued with service), paid volunteer days, and full support for your wellbeing, including mental health resources.\n\nCareer & Learning: Access to a top-tier learning platform, career progression plans, and support to create your ideal home workspace.\n\nHealth & Financial Benefits: Comprehensive medical, dental, and vision coverage, plus a 6% matched retirement plan.\n\nPersonal Perks: Annual phone reimbursement, onsite gym access, and customizable benefits via our online platform.\n\nPlus much more!\n\nOur Interview Process\n\nOur interview process may vary slightly depending on the role. We’ll always let you know what to expect at each stage and give you plenty of opportunities to ask questions along the way.\n\nPeople Team Introduction and Cultural Drivers Interview\nAn initial conversation with a member of our People Team to learn more about you, your experience and what you’re looking for in your next role. We’ll also introduce you to Retail Insight and explain the opportunity and interview process. During the call, we’ll ask interview questions based on our cultural drivers to understand how your values, behaviours and ways of working align with ours.\n\nRole and Technical Interview\nThis stage explores your experience and the skills most relevant to the role, as well as how you approach your work. Depending on the position, it may include a practical task, presentation or technical assessment. We’ll always explain what’s involved in advance.\n\nSenior Leadership Coffee Chat\nThe final stage is an informal coffee chat with a member of our senior leadership team. It’s an opportunity to learn more about our business and culture, ask any remaining questions and make sure Retail Insight feels like the right fit for you.\n\n\nBe your authentic self - Retail Insight is committed to promoting equal opportunities in employment. All employees and any job applicants will receive equal treatment. We actively seek to create an environment where everyone feels respected, supported, and encouraged to contribute their best work.