• Snapboard
  • Activity
  • Reports
  • Campaign
Welcome ,

Chat with the recruiter

...Minimize

Hey I'm Online! Leave me a message.
Let me know if you have any questions.

Apache Spark Engineer, Global Risk Analytics

In United States

Save this job

Apache Spark Engineer, Global Risk Analytics   

Click on the below icons to share this job to Linkedin, Twitter!

JOB TITLE:

Apache Spark Engineer, Global Risk Analytics

JOB TYPE:

JOB SKILLS:

JOB LOCATION:

Charlotte, NC | Jersey City, NJ United States

JOB DESCRIPTION:

Responsible for designing and developing complex requirements to accomplish business goals. Ensures that software is developed to meet functional, non-functional, and compliance requirements. Ensures solutions are well designed with maintainability/ease of integration and testing built-in from the outset. Possess strong proficiency in development and testing practices common to the industry, and have extensive experience of using design and architectural patterns. At this level, specializations start to form in either Architecture, Test Engineering or DevOp. Contributes to story refinement/defining requirements. Participates and guides team in estimating work necessary to realize a story/requirement through the delivery lifecycle. Performs spike/proof of concept as necessary to mitigate risk or implement new ideas. Codes solutions and unit tests to deliver a requirement/story per the defined acceptance criteria and compliance requirements. Utilizes multiple architectural components (across data, application, business) in design and development of client requirements. Assists team with resolving technical complexities involved in realizing story work. Designs/develops/modifies architecture components, application interfaces, and solution enablers while ensuring principal architecture integrity is maintained. Designs/develops/maintains automated test suites (integration, regression, performance). Sets up and develops a continuous integration/continuous delivery pipeline. Automates manual release activities. Mentors other Software Engineers and coaches team on CI-CD practices and automating tool stack. Individual contributor.   Job Summary: Skillset: Hands on Apache Spark expert with experience in implementing complex distributed compute systems with generic capabilities using Apache Spark, having deep knowledge of spark internals and Python expertise. 7+ years of relevant experience.   Job Specific Description: Global Risk Analytics (GRA) technology group within client is looking for a talented Apache Spark programmer Guru to join our growing team. We are building the next generation platform for model development and execution for our business partners. The vision for this platform is to provide generic capabilities to author workflows that will run model execution and related processes at scale on our internal compute grid. The platform is meant to provide a high degree of abstraction where model developers will define the data they want to bring in, the processing of the data, and the results, all via generic constructs provided by the platform. The platform will be built from the ground up with distributed compute designed in as a core concept, such that all workloads will be distributed optimally with minimal input from model developers who will author workflows. This is a hands-on, individual contributor role which will be focused on building and optimizing the distributed compute strategy of the execution DAG. This role will require knowledge of Apache Spark internals, beyond being an expert user of the Spark API. This is an exciting opportunity that will exercise the distributed programming mettle of the most skilled Apache Spark Guru.   Required Skills: 7+ years software engineering 4+ years of relevant experience in implementing Apache Spark based systems Experience in implementing complex distributed compute systems with generic capabilities using Apache Spark Deep knowledge on Apache Spark internals Actively participate in code reviews and provide feedback for effective solution implementation PySpark experience   Desired Skills: Advanced degree in computer science or mathematics Apache Spark committer Experience in building a software product/platform/framework from ground up Strong Problem Solving and trouble shooting skills Being able work under pressure and tight deadlines Being able to take pride in writing elegant code with industry standards Experience in Test Driven Development   Global Risk Analytics: Believes diversity makes us stronger so we can reflect, connect and meet the diverse needs of our clients and employees around the world. Is committed to building a workplace where every employee is welcomed and given the support and resources to perform their jobs successfully. Wants to be a great place for people to work and strives to create an environment where all employees have the opportunity to achieve their goals. Provides continuous training and development opportunities to help employees achieve their career goals, whatever their background or experience. Is committed to advancing our tools, technology, and ways of working to better serve our clients and their evolving business needs. Believes in responsible growth and is dedicated to supporting our communities by connecting them to the lending, investing and giving them what they need to remain vibrant and vital.

Position Details

POSTED:

Sep 25, 2022

EMPLOYMENT:

INDUSTRY:

SNAPRECRUIT ID:

S16522272295293000

LOCATION:

United States

CITY:

Charlotte, NC | Jersey City, NJ

Job Origin:

OORWIN_ORGANIC_FEED

A job sourcing event
In Dallas Fort Worth
Aug 19, 2017 9am-6pm
All job seekers welcome!

Apache Spark Engineer, Global Risk Analytics    Apply

Click on the below icons to share this job to Linkedin, Twitter!

Responsible for designing and developing complex requirements to accomplish business goals. Ensures that software is developed to meet functional, non-functional, and compliance requirements. Ensures solutions are well designed with maintainability/ease of integration and testing built-in from the outset. Possess strong proficiency in development and testing practices common to the industry, and have extensive experience of using design and architectural patterns. At this level, specializations start to form in either Architecture, Test Engineering or DevOp. Contributes to story refinement/defining requirements. Participates and guides team in estimating work necessary to realize a story/requirement through the delivery lifecycle. Performs spike/proof of concept as necessary to mitigate risk or implement new ideas. Codes solutions and unit tests to deliver a requirement/story per the defined acceptance criteria and compliance requirements. Utilizes multiple architectural components (across data, application, business) in design and development of client requirements. Assists team with resolving technical complexities involved in realizing story work. Designs/develops/modifies architecture components, application interfaces, and solution enablers while ensuring principal architecture integrity is maintained. Designs/develops/maintains automated test suites (integration, regression, performance). Sets up and develops a continuous integration/continuous delivery pipeline. Automates manual release activities. Mentors other Software Engineers and coaches team on CI-CD practices and automating tool stack. Individual contributor.   Job Summary: Skillset: Hands on Apache Spark expert with experience in implementing complex distributed compute systems with generic capabilities using Apache Spark, having deep knowledge of spark internals and Python expertise. 7+ years of relevant experience.   Job Specific Description: Global Risk Analytics (GRA) technology group within client is looking for a talented Apache Spark programmer Guru to join our growing team. We are building the next generation platform for model development and execution for our business partners. The vision for this platform is to provide generic capabilities to author workflows that will run model execution and related processes at scale on our internal compute grid. The platform is meant to provide a high degree of abstraction where model developers will define the data they want to bring in, the processing of the data, and the results, all via generic constructs provided by the platform. The platform will be built from the ground up with distributed compute designed in as a core concept, such that all workloads will be distributed optimally with minimal input from model developers who will author workflows. This is a hands-on, individual contributor role which will be focused on building and optimizing the distributed compute strategy of the execution DAG. This role will require knowledge of Apache Spark internals, beyond being an expert user of the Spark API. This is an exciting opportunity that will exercise the distributed programming mettle of the most skilled Apache Spark Guru.   Required Skills: 7+ years software engineering 4+ years of relevant experience in implementing Apache Spark based systems Experience in implementing complex distributed compute systems with generic capabilities using Apache Spark Deep knowledge on Apache Spark internals Actively participate in code reviews and provide feedback for effective solution implementation PySpark experience   Desired Skills: Advanced degree in computer science or mathematics Apache Spark committer Experience in building a software product/platform/framework from ground up Strong Problem Solving and trouble shooting skills Being able work under pressure and tight deadlines Being able to take pride in writing elegant code with industry standards Experience in Test Driven Development   Global Risk Analytics: Believes diversity makes us stronger so we can reflect, connect and meet the diverse needs of our clients and employees around the world. Is committed to building a workplace where every employee is welcomed and given the support and resources to perform their jobs successfully. Wants to be a great place for people to work and strives to create an environment where all employees have the opportunity to achieve their goals. Provides continuous training and development opportunities to help employees achieve their career goals, whatever their background or experience. Is committed to advancing our tools, technology, and ways of working to better serve our clients and their evolving business needs. Believes in responsible growth and is dedicated to supporting our communities by connecting them to the lending, investing and giving them what they need to remain vibrant and vital.


Please wait..!!