Senior Data Engineer Cybersecurity Big Data

Hiring Alert | Senior Data Engineer Cybersecurity & Big Data

Location: Charlotte, NC (Local Candidates Only)
Employment Type: Full-Time
Experience Required: 7 14 Years

Must-Have Skills:

• 8+ Years of Hands-On Data Engineering / Software Development Experience

• Strong SQL and UNIX Experience

• Hadoop Ecosystem Hive, Spark and PySpark

• Big Data Processing Platforms Hadoop / Cloudera

• Python Programming and Modular Python Development

• Data Pipeline Development and Data Transformation

• Data Integration, Cleaning, Validation and Quality Controls

• Data Stores Hive, HBase and Elasticsearch

• Cloud Technologies AWS or Azure

• Version Control Bitbucket or Equivalent

• CI/CD Pipelines and Release Management

• Data Engineering Principles, SDLC and Software Development Best Practices

• Cybersecurity Domain Knowledge, Preferably Vulnerability Data Management

• Technical Leadership, Hands-On Coding and Mentoring

Preferred Experience:

• Cybersecurity Data Analytics and Vulnerability Management

• Complex Data Processing Across Multiple Systems

• Metadata Management, Dependency Management and Workload Optimization

• Data Quality Controls and Internal Control Frameworks

• Integration, Regression and Performance Testing

• Agile / Scrum Delivery Environments

• Guiding Junior Engineers and Coordinating CI/CD Releases

• Strong Stakeholder Communication and Requirements Analysis

Roles & Responsibilities:

• Design, develop and deliver complex data solutions supporting cybersecurity technology and business objectives.

• Build and maintain data pipelines for integration, cleaning, transformation and processing across operational and analytics systems.

• Develop scalable data solutions using Hadoop, Hive, Spark, PySpark, Python and SQL.

• Assemble large, complex datasets that meet functional and non-functional requirements.

• Build data structures, metadata frameworks, data quality controls and workload management processes.

• Collaborate with business stakeholders, product owners, architects, data scientists and development teams to translate requirements into technical solutions.

• Evaluate new technologies, conduct prototypes and validate architectural approaches.

• Identify data management gaps, technical risks and requirement challenges, and communicate them to stakeholders.

• Contribute to integration, regression and performance testing; analyze results and troubleshoot issues.

• Maintain technical documentation for deployment, maintenance, support and business functionality.

• Follow established release processes, CI/CD practices and code deployment standards.

• Mentor junior data engineers and support pull requests, issue triage, merge conflict resolution and release documentation.

• Define key performance indicators and internal controls to improve data quality and operational efficiency.

Education: Bachelor's degree in Computer Science required.

TCS Employee Benefits Include:

• Discretionary Annual Incentive

• Medical, Dental and Vision Coverage

• Disability Planning and Insurance

• Maternal and Parental Leave

• Auto and Home Insurance Options

• Vacation, Sick Leave and Holidays

• 401(k) Plan and Financial Assistance Programs

• Commuter Benefits

• Certification and Training Reimbursement