Find Api Developer Data Engineer Job in Malvern, Pennsylvania | Snaprecruit

Full-time

Malvern Pennsylvania United States

No

• Design and Develop web applications using Java EE, Python, Web Services and AWS
• Qualified candidates will be responsible for API design, implementation, testing and prod support.
• They will work on a data modernization project which will utilize multiple AWS Services Tech needs:
  • Java
  • AWS Services - GlueEMR
  • API development
  • SpringBoot services
• Integrate AWS Services such as Lambda, DynamoDB, EC2, RDS, S3, Athena, Data pipeline, API gateway, Glue, EMR etc. in reporting application to improve the accessibility/efficiency
• Write scripts and troubleshoot for performance using relevant programming languages like SQL, Spark and Python
• Develop and Implement ETL jobs using AWS Glue to extract, transform, and load data from various sources
• Design and implement scalable data solutions using AWS, PySpark, Python and other related services
• Work closely with Data and Analytics team to build Data Lake using various AWS services like EMR, S3, DynamoDB, Lambda etc., Apache Airflow, PySpark, and HIVE
• Use AWS data pipeline for Data Extraction, Transformation and Loading from homogeneous or heterogeneous data sources
• Work on migration of PySpark framework into AWS Glue for enhanced processing
• They are aws tech experience. dynamo and/or azure db.
• Knowledge of Resilancy patterns and chaos testing. Kafka knowledge

Nice to have:

• Architecture experience in cloud or legacy systems. Building large scale systems. Java 11 understanding. spring boot experience and jersey framework knowledge , micro service architecture , graph ql implementation , Performance tuning of Java rest APIs.
• Design, Model, Develop, Test and Implement using Big Data technologies like Python, Pyspark, Hadoop, UNIX and SQL