Loading, Please wait..!!
Data Engineer
-
Posted on: Nov 20, 2026
-
Richmond, Virginia
-
Onsite
-
Full-time
Curious about compensation?
Explore the historical salary trends, average pay, and estimated compensation for Data Engineer roles in Virginia.
View Salary Guide →Find your match !
Job Title :
Data Engineer
Job Type :
Full-Time
Job Location :
Richmond Virginia United States
Remote :
No
Job Description :
Need Capital One Experience
Duration: 6-month contract that may extend
Location: Hybrid onsite 3 days a week Richmond VA
One 30-minute Interview
Manager Notes
Must-Have Requirements
- Spark and Scala: Both must be clearly demonstrated on the resume.
- AWS: Required and must be listed on the resume.
- Senior-level experience: Looking for a strong, hands-on engineer who can start coding immediately.
- Richmond location: Candidates must be local to Richmond.
Role Overview
- Working with customer data.
- Unloading data from other databases and moving it into existing data pipelines.
- Enhancing and improving existing Spark/Scala pipelines rather than building everything from scratch.
- Must be comfortable jumping into an established environment and contributing code immediately.
Nice-to-Have Skills
- Databricks experience (not a major requirement).
- Other relevant data engineering technologies.
- Previous Capital One experience is a significant advantage and will help a candidate stand out.
Ideal Candidate Profile
A senior, hands-on Data Engineer with strong Spark and Scala expertise, AWS experience, and the ability to immediately contribute to existing data pipelines.
Job Description:
Experience: 8+ years in data engineering
Role Summary
We're looking for an experienced data engineer to join our team building and maintaining large-scale ETL pipelines on AWS EMR, primarily in Scala. This person will operate independently on complex, ambiguous problems, contribute to engineering standards across the team, and be equally comfortable in Python and SQL when the job calls for it. Familiarity with Databricks is a strong plus as we continue to evolve our data platform.
What You'll Do
- Design, build, and optimize ETL pipelines on AWS EMR using Scala/Spark, processing data at scale with attention to performance, cost, and reliability
- Write and maintain Python scripts and utilities to support data workflows, automation, and tooling where Scala isn't the right tool for the job
- Develop and troubleshoot complex SQL for data validation, transformation logic, and downstream analytics use cases
- Work with Databricks notebooks/jobs as our data platform usage grows, contributing to migration and modernization efforts where relevant
- Operate with autonomy on tasks with limited detail - scope ambiguous problems, propose solutions, and drive them to completion without heavy oversight
- Identify and implement opportunities for automation, reuse, and simplification across existing pipelines, reducing team toil
- Conduct peer code reviews, flag areas for improvement, and help maintain team coding/design standards and documentation
- Participate in production support - troubleshoot pipeline failures, perform root-cause analysis, and implement fixes that avoid technical debt
- Communicate progress, risks, and blockers proactively to the team and stakeholders
Required Qualifications
- 8+ years of professional experience in data engineering or related software engineering roles
- Strong hands-on experience with Scala and Apache Spark, specifically on AWS EMR
- Working proficiency in Python for scripting, tooling, or pipeline components
- Strong SQL skills - complex queries, performance tuning, and data validation
- Demonstrated experience owning ETL pipelines end-to-end: design, build, test, deploy, monitor
- Ability to work independently in ambiguous situations, exploring multiple approaches before settling on a solution
- Experience with version control (Git), CI/CD practices, and production-grade engineering hygiene
Preferred Qualifications
- Experience with Databricks (notebooks, jobs, Delta Lake, cluster management)
- Experience with workflow orchestration tools (Airflow, Step Functions, or similar)
- Familiarity with AWS data ecosystem beyond EMR (S3, Glue, Redshift, Athena)
- Experience mentoring other engineers or leading technical design discussions
- Background in financial services or another regulated industry
Core Competencies (aligned to Principal Associate expectations)
- Technically Skilled & Versatile: Builds breadth across the stack (Scala/EMR as primary, Python/SQL/Databricks as needed); quickly ramps on new tools
- Independent / Manages Ambiguity: Operates with minimal guidance, scopes ambiguous problems, and drives them to resolution
- Automation Focused: Actively looks for ways to simplify, automate, and reduce repeated manual work
- Results Focus: Delivers quality work on committed timelines, owns outcomes beyond initial delivery
- Problem Solving: Explores multiple design options (e.g., build vs. reuse) before committing to a solution; avoids accruing technical debt
Reminders for Suppliers:
- Please wait to begin recruiting for this position until this call has occurred. Pertinent information will be shared by the manager during this call to assist in finding qualified candidates.
- Please do not reach out directly to the manager regarding this request. Any questions, concerns or feedback should be sent to the FlexForce Advisory Consultant.
- All candidates must be submitted via Beeline. No resumes or candidate names should be shared with the manager directly or outside of the system.
Similar Jobs You May Be Interested In
Data Engineer with AI
AWS Data engineer
Senior Manager Data Engineer (Research)
Lead Data Engineer
Snowflake ETL/ELT Data Engineer (Hybrid - Must be local to Denver CO)
Data Engineer- Rochester NH(Onsite)
Data & ML Engineer
GCP Data Engineer
Lead Data Engineer (People for HR data)
Data Engineer (AI-Ready Data)
Data Engineer Lead/Data Warehouse Architect (Onsite interviews - Hybrid)
Data Engineer - Starburst
Position Details
Posted:
Nov 20, 2026
Reference Number:
34826-20508
Employment:
Full-time
City:
Richmond
Job Origin:
CIEPAL_ORGANIC_FEED
Share this job:
Please wait..!!

