Job Title: Staff Data Engineer

Location: Austin, TX- Hybrid
Duration: 6+ Months Contract
Interview mode: Virtual

LinkedIn must

NOTE:: they must have to complete glider test and need to score 80-85%

Job Description:

Responsibilities:

Data Architecture: Design, develop, and maintain scalable data architectures and pipelines on AWS to support data analytics and business intelligence.

ETL Processes: Build and manage ETL processes to extract, transform, and load data from various sources into data warehouses and data lakes.

Data Integration: Integrate data from multiple sources, ensuring data quality, consistency, and security.

Performance Optimization: Optimize data processing workflows for performance, scalability, and cost-efficiency.

Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.

Monitoring: Implement monitoring and alerting systems to ensure data pipeline reliability and performance.

Documentation: Maintain comprehensive documentation of data architectures, pipelines, and processes.

Qualifications:

Education: Bachelor/Master's degree in computer science, Engineering, or a related field.

Experience:

10+ years of experience in data engineering, with a focus on AWS-based solutions.

Proven experience in designing and implementing data pipelines and architectures.

Technical Skills:

AWS Services: Proficiency in AWS services such as S3, Redshift, Glue, Lambda, EMR, and RDS.

Programming Languages: Strong programming skills in Python.

Big Data Technologies: Experience with big data technologies like Hadoop, Spark, and Kafka.

Database Management: Proficiency in SQL and NoSQL databases.

Data Modeling: Strong understanding of data modeling, data warehousing, and data lake concepts.

DevOps: Familiarity with DevOps practices and tools (e.g., Docker, Kubernetes, Jenkins).

Security: Knowledge of data security best practices and compliance requirements.

Certifications:

AWS Certified Data Engineer - Associate

AWS Certified Data Analytics Specialty

Soft Skills:

Problem-Solving: Strong analytical and problem-solving skills.

Communication: Excellent communication and interpersonal skills to interact with various stakeholders.

Teamwork: Ability to work effectively in a collaborative team environment.

Adaptability: Flexibility to adapt to changing business requirements and technologies.