Api Developer Data Engineer Apply
- Design and Develop web applications using Java EE, Python, Web Services and AWS
- Qualified candidates will be responsible for API design, implementation, testing and prod support.
- They will work on a data modernization project which will utilize multiple AWS Services Tech needs:
- Java
- AWS Services - GlueEMR
- API development
- SpringBoot services
- Integrate AWS Services such as Lambda, DynamoDB, EC2, RDS, S3, Athena, Data pipeline, API gateway, Glue, EMR etc. in reporting application to improve the accessibility/efficiency
- Write scripts and troubleshoot for performance using relevant programming languages like SQL, Spark and Python
- Develop and Implement ETL jobs using AWS Glue to extract, transform, and load data from various sources
- Design and implement scalable data solutions using AWS, PySpark, Python and other related services
- Work closely with Data and Analytics team to build Data Lake using various AWS services like EMR, S3, DynamoDB, Lambda etc., Apache Airflow, PySpark, and HIVE
- Use AWS data pipeline for Data Extraction, Transformation and Loading from homogeneous or heterogeneous data sources
- Work on migration of PySpark framework into AWS Glue for enhanced processing
- They are aws tech experience. dynamo and/or azure db.
- Knowledge of Resilancy patterns and chaos testing. Kafka knowledge
Nice to have:
- Architecture experience in cloud or legacy systems. Building large scale systems. Java 11 understanding. spring boot experience and jersey framework knowledge , micro service architecture , graph ql implementation , Performance tuning of Java rest APIs.
- Design, Model, Develop, Test and Implement using Big Data technologies like Python, Pyspark, Hadoop, UNIX and SQL
Required Skills : Data Warehouse