IT Engineer Data Engineer Apply
Role: Data Engineer
Client: Financial
Location: REMOTE (HQ DC Metro)
Work Auth: W2
Description
To research, evaluate, design, implement, and maintain system and product solutions, applying knowledge of engineering principles. To provide technical direction and engineering support for projects and infrastructure. Develop and maintain expert functional knowledge of evolving IT engineering industry technologies/competition, concepts and trends.
•Data deliverables experience
o Event Streaming
o Near real time data integration solution using data virtualization
o Knowledge on Financial domains including banking and investments
o Familiarity with architecting and designing data analytics solutions in Cloud, Azure or similar
o Data extract and delivery automation
o Performance tuning and optimization
o Data profiling
o Data validation automation
•Hands on data service/programming lang. experience
o Azure Event Hubs, Event Grid, Azure Functions, Azure Logic Apps
o Databricks
o PySpark
o SQL
o NoSQL (Azure Cosmos DB)
o Azure Data Factory
o ADLS
o Delta table
•Agile Delivery - Azure DevOps/Boards, JIRA
•Desired
o Synapse, Synapse data explorer, Delta live table, Delta sharing