Azure DataStage Engineer _Only on our W2_No C2C or Third Parties Apply
- General support and project work.
- Problem solving and analytics with the ability to research information and deduct solutions based on wide array of information they are sourcing.
- An enterprise level understanding of how system interconnect as it applies to BI and data analytics in an Azure Environment.
Project work:
- Prior development experience with ability to integrate with Data Engineering & Azure Cloud Engineering.
- Automate the migrations of Data Engineering workflows/processes.
- Experience in designing pipelines in Azure devops and hands on PowerShell
Databricks:
- An understanding of Clusters, libraries, job clusters, and how databricks is leverage in ETL/ELT.
- Understanding of python and how it is used for data transformation and integration with other systems.
- Understanding of Azure Databricks at the level of managing and configuring the product/workspace, and working knowledge of PySpark code
Azure Data factory:
- Previous experience with Azure Data Factory, and understanding of concepts including linked services, triggers, jobs, monitor, etc.
- Understanding of CICD devops and integrating ADF
- Understanding of how to configure the 60 plus inputs and outputs of ADF.
Datastage:
- Demonstrable experience as a DataStage developer.
- Proficiency in SQL or another relevant coding language.
- Knowledge of data modeling, database design, and the data warehousing ecosystem.
- Skilled at the ideation, design, and deployment of DataStage solutions.
- Excellent analytical and problem-solving skills.
- The ability to work within a multidisciplinary team.
