Data Engineer

Include the following details below:

• A writeup from the candidate.
• Full name on the resume
• LinkedIn profile
• location
• maximum 5 page resume
• Education details, including the month and year of graduation

1. Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing.
2. Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of sources for business partners to generate insight and make decisions.
3. Experience building AWS cloud architecture and supporting services and technologies (Eg: ECS, Glue, S3, Glue Crawler, Redshift, Step Functions, Foundational Services like IAM, Cloud Watch, Cloud formation, Lambda, Secrets Manager, Sagemaker).
4. Translates business specifications into design specifications and code. Responsible for writing programs, ad hoc queries, and reports. Ensures that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse.
5. Partners with internal clients to gain a basic understanding of business functions and informational needs. Gains working knowledge in tools, technologies, and applications/databases in specific business areas and company-wide systems.
6. Participates in all phases of solution development. Explains technical considerations at related meetings, including those with business clients.
7. Expert building Spark data processing applications (Python, Pyspark).
8. Expert with SQL development.
9. Experience with test automation and test-driven development practices.
10. Experience with CI/CD pipeline tools like Github.
11. Tests code thoroughly for accuracy of intended purpose. Reviews end product with the client to ensure adequate understanding. Provides data analysis guidance as required.
12. Provides tool and data support to business users and fellow team members.