Data Engineer Ba Apply
Job Title: Data engineer + BA
Job Location : NY/NJ (3 days per week onsite)
Job Duration: full time
Skilled Data Engineer with BA skills:
Job Description
- Design and develop scalable data pipelines using modern data stack technologies for Client's Cloud data platform.
- Write ETL processes, design data applications and develop data pipelines for Operational Business Intelligence Mart
- Role involves analyzing technical metadata, Data Pipeline logs and data lineage for data platform, and providing insights to support data platform operational decisions.
- Collaborate with cross-functional teams to understand and Elucidate Observability requirements for the data platform considering SLA, operational needs, DQ and proactive monitoring.
- Work with other engineers on the team to elevate technology and consistently apply best practices
Desired Skill and Experience
- A minimum of five (5) years of IT experience in data engineering or data management field
- 4 - 5 years of experience in application development using SQL, PLSQL
- Strong working knowledge and min of 2 years' experience in DBT, Snowflake
- Recent experience as a Senior Data Engineer in any public cloud, preferably on Azure as well as on a cloud warehouse like Snowflake is required
- 2+ years of experience in building data pipelines using various ETL and ELT tools
- Hands-on experience with Airflow is highly preferred
- Experience in building cloud native solutions, preferably on Azure including the use of DevOps CI / CD tools and containers.
- Proven experience as a Data Analyst or in a similar role.
- Strong proficiency in Data Modelling, process metadata, observability and monitoring data platforms.
- Familiarity with data modelling tools / techniques is a plus
- Azure or Snowflake training / certification is a plus
- Strong analytical, problem solving, communication, collaborative and organizational skills
- Self-driven, self-directed, passionate analytical and focused on delivering the right results
