Data Engineer

Requirements

• 5 or more years of experience engineering data warehouse solutions with a strong focus on Azure Databricks.

• Proficiency in Python or Scala for programming data transformations, advanced analytics, and ETL pipelines.

• Experience with the broader Azure cloud ecosystem including Azure Synapse, Azure ML, and Power BI.

• Experience in data integration utilizing Informatica PowerCenter, IICS, or Netezza Performance Server architectures.

• Experience with writing optimized SQL queries, data modeling, and performance tuning for high-volume datasets.

• Experience with CI/CD deployment pipelines using Azure DevOps, GitHub, and supporting Property & Casualty (P&C) insurance.

• Excellent communication and collaborative problem-solving skills to partner with enterprise architects and business stakeholders.

Responsibilities

• Design, build, and support scalable data integration pipelines and analytics applications utilizing Azure Databricks.

• Translate high-level data flow architectures into detailed low-level implementation designs and technical data models.

• Conduct peer code reviews, test data applications, and enforce engineering best practices across data pipelines.

• Provide root-cause troubleshooting for production data issues to maintain high platform availability and reliability.

• Maintain detailed architectural documentation, data lineage records, and specifications for downstream integrations.

• Facilitate Agile sprint ceremonies, backlog planning, and delivery execution in the capacity of a team Scrum Master.

• Partner with business underwriters and analysts to evaluate technical requirements and recommend long-term data solutions.

Founded in 1999, Resourcesoft, Inc. is a leading Technology Consulting and Professional Services organization. Headquartered in Marlborough, MA, the company serves the technology needs of its clients nationwide. Resourcesoft has often been recognized by prominent rating agencies for its exemplary growth and stability. With over two decades of industry experience, the Company has evolved as a front runner in enabling project optimization. We partner with leading organizations to provide technology solutions within the financial, insurance, education, government, publishing, healthcare and pharmaceutical domains. We take pride in mentoring a workforce that is well positioned to respond to the emerging IT trends and needs. With the employees at the crux of every business endeavor, our success is driven by our expertise in pairing the right talent with the best jobs in the technology sector. We forge long term, personalized relationships with our employees to advance their career to the next level. We engage them in technology centric client projects that provide opportunities for them to evolve, innovate and deliver world class products and services. Our career opportunities offer challenging assignments and exposure to emerging and cutting edge technologies. We are committed to providing our employees with the tools necessary to accelerate their career progression, while maintaining a healthy, work-life balance. We are deeply committed to providing a workplace ambience that is both challenging and fulfilling.

Resourcesoft is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.

For more information about Resourcesoft and our services, please visit our website.