Aws Data Engineer Snowflake Pyspark Kafka Apply
Who we are:
Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to Customers.
Job Description:
Job Title : AWS Data Engineer Snowflake, PySpark & Kafka
Job Type : W2
Experience : 8 to 10 years
Location : Texas,Dallas
Responsibilities:
- 3+ years of experience in Data Engineering, Big Data, or Cloud Data Solutions
- Experience with Airflow or similar workflow orchestration tools.
- Knowledge of Terraform, CloudFormation, or other IaC tools.
- Familiarity with machine learning pipelines and MLOps is a plus.
- Experience with Apache Kafka for real-time data streaming and event-driven architectures.
- Strong hands-on experience with AWS services such as AWS Glue, S3, Lambda, and Redshift.
- Expertise in SQL and working with relational and NoSQL databases.
- Proficiency in PySpark and Python for data processing and analytics.
- Experience with Apache Kafka for real-time data streaming and event-driven architectures.
- Hands-on experience with Snowflake, including data modeling, query optimization, and performance tuning.
- Understanding of CI/CD pipelines, Infrastructure-as-Code (IaC), and DevOps in cloud environments.
- Strong problem-solving and communication skills.
- Design and implement data models and warehouse solutions in Snowflake for optimized analytics and reporting.
- Integrate streaming and batch data sources using Kafka and other messaging technologies.
- Work with cross-functional teams to ingest, clean, transform, and store structured and unstructured data.
- Optimize performance, scalability, and reliability of data workflows on AWS cloud infrastructure.
- Implement best practices for data security, governance, and compliance.
- Monitor, debug, and improve data pipelines to ensure high availability and consistency.
Qualification:
- Bachelor's degree or equivalent combination of education and experience.