Api Group Data Engineer Apply
Project Scope:
- Helping with overall data modernization effort, specifically focused on Azure Data Lake - right now they are using Azure Synapse and Azure Data Factory
High-Level Individual Duties:
- Maintaining current Data Lake, using medallion architecture
- Some L2 and L3 Support - mostly related to access and users
- Consuming data from blob storage then maintaining those workbooks within our data environment
Must-Haves (Concepts & Tools):
- 3 years of data engineering experience
- Azure data ecosystem experience
- SQL experience
- Python experience
What will Win:
- Specific Azure Synapse knowledge
- Data visualization experience - PowerBI preferred, open to anything
- Experience with Delta Parquet files
API Group Data Engineer
Hybrid onsite 3x/week new brighton MN
18 month contract
Job Description:
We are currently seeking a Data Engineer to join our team. This role will support our data-driven decision-making processes by analyzing and visualizing complex datasets, implementing modern data management tools, and collaborating with cross-functional teams to derive actionable insights. The individual will work closely with business teams to understand data needs, manage and improve data pipelines, and drive the transformation of our data infrastructure to a modern, scalable platform. Additionally, this role will support our broader efforts in implementing machine learning and advanced analytics capabilities to enhance business decision-making.
Essential Duties & Responsibilities
To include, but not limited to the following:
- Design, implement, and maintain data architecture to support business intelligence and reporting needs.
- Build and manage data pipelines to integrate, clean, and transform data across systems (ETL processes).
- Collaborate with business teams to understand data requirements and deliver scalable data solutions.
- Monitor data quality and optimize data flows to ensure accuracy, integrity, consistency, and compliance with organizational standards.
- Troubleshoot and resolve data-related issues promptly.
- Assist in migrating existing data infrastructure to modern, cloud-based platforms, ensuring scalability and reliability.
- Develop and implement business intelligence solutions, including reports, dashboards, and data visualizations.
- Create and maintain data models and database designs that align with business needs.
- Support machine learning initiatives by preparing data for analysis and modeling.
- Provide actionable recommendations based on data analysis to support executive and operational decision-making.
- Lead and participate in data governance and quality initiatives, adhering to best practices and standards.
- Develop training materials and conduct sessions to ensure effective use of data tools across teams.
- Stay abreast of emerging trends in data analytics and suggest ways to implement innovative solutions.
Qualifications
Required:
- Bachelor's degree in computer science, Data Science, Information Systems, or a related field (or equivalent experience).
- 3+ years of experience in data engineering, or a similar role.
- Strong knowledge of data modeling, database design, and ETL processes.
- Advanced SQL skills for querying and data manipulation.
- Proficiency in the Microsoft Azure ecosystem, including Azure Data Factory, Azure Synapse Analytics, Azure Purview, and Azure SQL Database.
- Strong experience with Power BI for data visualization.
- Experience with data integration tools (e.g., Azure Data Factory, SSIS, or similar).
- Hands-on experience with business intelligence tools.
- Strong problem-solving skills and ability to work on complex technical challenges.
Preferred:
- Familiarity with Databricks for data engineering and analytics.
- Knowledge of data governance, privacy, and cataloging principles.
- Familiarity with machine learning workflows and data preparation for predictive analytics.
- Experience with Python or R for data analysis.
- Knowledge of cloud architecture and modern data platforms.
- Excellent communication skills with the ability to convey technical concepts to non-technical stakeholders.
- Experience in project management and cross-functional collaboration.
Competencies and Skills
- Shows Accountability
- Thinks Systematically and Analytically
- Focuses on Customer Needs
- Learns Continuously
- Plans/Organizes Projects Effectively
- Solves Complex Problems
- Drives Innovation and Process Improvement