Loading, Please wait..!!
Senior Lead Software Engineer Python Databricks
-
Posted on: Nov 12, 2026
-
Warren, New Jersey
-
Onsite
-
Full-time
Curious about compensation?
Explore the historical salary trends, average pay, and estimated compensation for Senior Lead Software Engineer Python Databricks roles in New Jersey.
View Salary Guide →Find your match !
Job Title :
Senior Lead Software Engineer Python Databricks
Job Type :
Full-Time
Job Location :
Warren New Jersey United States
Remote :
No
Job Description :
- Structure the engine as Python packages, with the pricing logic apart from data access and orchestration.
- Rewrite step by step SQL logic as vectorised computation, on Spark or on one machine, as each workload needs.
- Build the tests: unit, integration, and comparison against the current engine's results.
- Automate deployment with CI / CD and Databricks Asset Bundles.
- Make runs observable, safe to repeat and safe to run side by side.
- Bring AI agents into the team's development process, with checks on what they produce.
- 5 or more years of production Python: object oriented design, packaging, type hints, testing.
- The numerical stack beyond Spark, such as NumPy, pandas or Polars: vectorised and parallel execution, decimal against floating point accuracy.
- Production workloads shipped on Databricks: jobs, Unity Catalog, Delta Lake, Asset Bundles, medallion design.
- How Spark runs work: query plans, shuffles, partitioning, skew, and tuning from measurements.
- CI / CD, Git workflow, infrastructure as code, logging and monitoring.
- Daily use of AI coding agents, and agentic development workflows with checks on their output.
- Takes a design to production with little guidance, and leads a team by example.
- Insurance, reinsurance or other financial risk calculations.
- Reading T-SQL, the reference for the current logic.
- Azure Data Factory and Azure SQL.
- Testing in a regulated setting.
Position Details
Posted:
Nov 12, 2026
Reference Number:
5130-2279
Employment:
Full-time
City:
Warren
Job Origin:
CIEPAL_ORGANIC_FEED
Share this job:
Please wait..!!

