Data Engineer Python Aws Apply
Job Responsibilities:
∙ Build and maintain batch data pipelines across the advanced analytics platform.
∙ Design, develop, and orchestrate highly robust and scalable ETL/ELT pipelines.
∙ Develop a highly optimal codebase and perform Spark optimizations for Big Data use cases.
∙ Design, develop, and deploy optimal monitoring and testing strategies for the data products.
∙ Collaborate with stakeholders and advanced analytics business partners to understand business needs and translate requirements into scalable data engineering solutions.
∙ Collaborate with data scientists to prepare data for model development and production.
∙ Collaborate with data visualization and reporting application developers to ensure the sustainability of production applications and reports.
REQUIREMENTS:
. Expertise in SQL
∙ Familiarity with GitHub, VS Code, Linux CLI, File formats like CSV, and Parquet.
∙ Familiarity with Data visualization tools, such as Tableau or Power BI.
. Agile methodologies
. Preferable Data bricks, Snowflake, DBT, Python, AWS Certification.