Find Data Architect With Medallion Architecture Exp Job in Chicago, Illinois | Snaprecruit

Find Data Architect Medallion Jobs in Chicago
image
  • Snapboard
  • Activity
  • Reports
  • Campaign
Welcome ,
loadingbar
Loading, Please wait..!!

Data Architect With Medallion Architecture Exp

  • ... Posted on: Sep 24, 2024
  • ... Magicforce
  • ... Chicago, Illinois
  • ... Salary: Not Available
  • ... Contract

Data Architect With Medallion Architecture Exp   

Job Title :

Data Architect With Medallion Architecture Exp

Job Type :

Contract

Job Location :

Chicago Illinois United States

Remote :

No

Jobcon Logo Job Description :

As a Data Architect you will be a part of an Agile team to build healthcare applications and implement new features while adhering to the best coding development standards.

 

Responsibilities: -

 

  • • Design and architect scalable, high-performance, and cost-effective cloud-based solutions using Azure services and Databricks. Develop comprehensive architecture blueprints that include data pipelines, data warehousing, and advanced analytics solutions.
    • Architect and implement big data processing solutions using Databricks, leveraging Apache Spark for data transformation, ETL processes, and machine learning workflows. Design data pipelines that handle large-scale data ingestion, processing, and storage.
    • Implement data security, data governance, and compliance measures within the Databricks environment using Unity Catalog.
    • Work closely with Data engineers, DevOps teams, and other stakeholders to ensure seamless integration of solutions. Collaborate with project managers and business analysts to gather and interpret requirements, ensuring technical feasibility and alignment with business objectives.
    • Analyze and optimize system performance, identifying bottlenecks and implementing solutions to enhance processing speed and efficiency. Implement monitoring tools and strategies to proactively manage the health and performance of the Azure and Databricks environments.
    • Ensure that all solutions adhere to security best practices and compliance requirements, including data encryption, access control, and logging. Implement strategies to protect sensitive data and ensure compliance with relevant regulations, such as GDPR, HIPAA, etc.
    • Deep understanding of Azure services, including but not limited to Azure Data Factory, Azure Storage, Azure SQL, Azure Functions, etc. Proficiency in Databricks, Apache Spark, and related big data technologies.
    • Strong scripting skills in Python, SQL, and experience with Terraform or CloudFormation.
    • Excellent problem-solving skills and the ability to work in a fast-paced environment.
    • Experience with Kubernetes, Docker, and containerized applications. Familiarity with data lake architectures, Delta Lake, and advanced analytics solutions. Strong understanding of CI/CD pipelines, DevOps practices, and Infrastructure as Code (IaC).

Jobcon Logo Position Details

Posted:

Sep 24, 2024

Employment:

Contract

Salary:

Not Available

Snaprecruit ID:

SD-OOR-fcf05defa3b18da14e05f9188e09bd97a6193e6adabb7a08bef3599180ac7616

City:

Chicago

Job Origin:

OORWIN_ORGANIC_FEED

Share this job:

  • linkedin

Jobcon Logo
A job sourcing event
In Dallas Fort Worth
Aug 19, 2017 9am-6pm
All job seekers welcome!

Similar Jobs

Data Architect With Medallion Architecture Exp    Apply

Click on the below icons to share this job to Linkedin, Twitter!

As a Data Architect you will be a part of an Agile team to build healthcare applications and implement new features while adhering to the best coding development standards.

 

Responsibilities: -

 

  • • Design and architect scalable, high-performance, and cost-effective cloud-based solutions using Azure services and Databricks. Develop comprehensive architecture blueprints that include data pipelines, data warehousing, and advanced analytics solutions.
    • Architect and implement big data processing solutions using Databricks, leveraging Apache Spark for data transformation, ETL processes, and machine learning workflows. Design data pipelines that handle large-scale data ingestion, processing, and storage.
    • Implement data security, data governance, and compliance measures within the Databricks environment using Unity Catalog.
    • Work closely with Data engineers, DevOps teams, and other stakeholders to ensure seamless integration of solutions. Collaborate with project managers and business analysts to gather and interpret requirements, ensuring technical feasibility and alignment with business objectives.
    • Analyze and optimize system performance, identifying bottlenecks and implementing solutions to enhance processing speed and efficiency. Implement monitoring tools and strategies to proactively manage the health and performance of the Azure and Databricks environments.
    • Ensure that all solutions adhere to security best practices and compliance requirements, including data encryption, access control, and logging. Implement strategies to protect sensitive data and ensure compliance with relevant regulations, such as GDPR, HIPAA, etc.
    • Deep understanding of Azure services, including but not limited to Azure Data Factory, Azure Storage, Azure SQL, Azure Functions, etc. Proficiency in Databricks, Apache Spark, and related big data technologies.
    • Strong scripting skills in Python, SQL, and experience with Terraform or CloudFormation.
    • Excellent problem-solving skills and the ability to work in a fast-paced environment.
    • Experience with Kubernetes, Docker, and containerized applications. Familiarity with data lake architectures, Delta Lake, and advanced analytics solutions. Strong understanding of CI/CD pipelines, DevOps practices, and Infrastructure as Code (IaC).

Loading
Please wait..!!