Software Engineer

POSITION TITLE: Software EngineerLOCATION: Chicago, IL  COMPANY OVERVIEW District 4 Labs (“District 4” or “D4”) is a cutting-edge data business dedicated to building the open-source intelligence (OSINT) tools and technologies of tomorrow. Its flagship product, DARKSIDE, is one of the world’s largest repositories of breached data, compromised records, and other person of interest information. DARKSIDE was built by investigators for investigators and is critical for any online investigation or intelligence gathering exercise, especially those involving attribution and online account identification. POSITION SUMMARY Software Engineers play a critical role in designing, building, and maintaining our in-house dark web and open-source data repositories, search applications, and APIs. They will also work closely with a cross-functional team to improve and maintain the reliability, scalability, and performance of these tools and technologies. Expertise in data ingestion and parsing is especially sought after.  ESSENTIAL JOB FUNCTIONSEngineers will generally:Parse new deep and dark web data sets ahead of addition to DARKSIDE.Develop and maintain API endpoints for querying dark web data, ensuring efficient and reliable access to our systems.Identify and integrate optimal database solutions.·       Collaborate with other engineers and DevOps teams to optimize search algorithms and improve search relevance.Work with client-facing team members to understand customer requirements and translate them into technical specifications for enhancements.Stay up to date with industry trends and best practices in search technologies and API management to drive innovation and improvement.Work with internal and external stakeholders to optimize data infrastructure and identify cost savings, where possible. COMPETENCIESProficiency in working with large-scale data processing frameworks, especially Elasticsearch·       Familiarity with open-source intelligence (OSINT) and/or dark web intelligence collection and/or processesExperience with API development and management, including authentication, versioning, and performance optimizationProven experience as an engineer, preferably in the development and management of search engines and APIsDemonstrated knowledge of cloud platforms, especially AWS and AzureExcellent communication and collaboration skills to work effectively in a cross-functional team environmentKnowledge of data privacy and security considerations when working with sensitive dataStrong programming skills in Python EDUCATION & EXPERIENCE REQUIREMENTSTo perform this job successfully, an individual must be able to perform each essential duty satisfactorily. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions. While not required, candidates typically have a Bachelor's or Master's degree in Computer Science, Data Science, or a related field. ----------------------------------------------------------- District 4 provides equal employment opportunities to all employees and applicants. Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice.