Job Summary:
Provide direct support by facilitating data gathering in highly technical situations, providing engineering design and implementation of data triage capabilities, and providing technical expertise to support the development of the Sponsor's overarching data acquisition and exploitation strategy.

Responsibilities and Duties:

• Support data engineering, exploitation, and management processes.
• Provide engineering support for data triage and assessment as directed by the Sponsor.
• Provide direct support to data ingestion in support of requirements.
• Document CONOPS, data workflows, and processes pertaining to data engineering projects as required by the Sponsor.
• Identify new technologies and assess their technical and performance characteristics.
• Identify and provide agile approaches to the automation of manual and inefficient processes.
• Provide insight into industry trends and make recommendations on future direction for the program.

Experience Needed:

• Demonstrated experience with large scale Elasticsearch 7.x cluster implementation, index design, and data ingest.
• Demonstrated experience performing the various aspects of identity resolution at large scale, to include ingest of data, mapping of data, and integration of identity resolution capabilities into data engineer and systems workflows.
• Demonstrated experience with distributed data pipeline/ ETL technologies, including designing data flows and adapting the distributed ETL technology to accommodate new data types.

Optional Skills:

• Demonstrated experience working with technologies in Hadoop ecosystems and integration of Hadoop capabilities into overall ETL flow of data.
• Demonstrated, Sponsor-specific experience working with Apache Tika to extract metadata and text from various document types.
• Demonstrated, Sponsor-specific experience as a Data Layer Architect focused on fusion of hybrid data sources into a common model to meet Sponsor needs.
• Master's Degree or equivalent work experience in Computer Science.