Databricks Engineer

Job Title: Software Engineer / Data Platform Engineer (Cloudera)

Location: Charlotte, NC

Duration: Contract - 12 months

Pay Range: $65.05/hr (W2)

Job ID: 410144

About OpenKyber

OpenKyber is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, OpenKyber has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.

Job Description

We are seeking an experienced Software Engineer / Data Platform Engineer (Cloudera) to join our dynamic team. The ideal candidate will have strong experience in distributed computing ecosystems, cloud and containerized deployments, and Python-based automation, and a proven ability to build secure, scalable APIs and optimize platform performance in alignment with enterprise standards.

Responsibilities:

• Design, implement, and maintain solutions across distributed computing platforms.
• Develop and optimize Python-based automation and API services using modern frameworks.
• Integrate tools and technologies to improve platform reliability, performance, and security.
• Troubleshoot complex issues across data, application, and infrastructure layers.
• Ensure compliance with enterprise security standards and governance practices.
• Collaborate with senior technologists and cross-functional stakeholders to deliver initiatives on schedule.

Required Skills & Qualifications:

• 3-5 years of experience designing, implementing, and maintaining distributed systems.
• Deep expertise with Cloudera Hadoop ecosystem: HDFS, YARN, Spark, Impala, Ranger.
• Knowledge of Apache Iceberg and object storage such as S3 or Ozone.
• Strong Python development for automation and services using FastAPI, GUNICORN, or similar.
• Proficiency with Python libraries: spaCy, NumPy, Pandas, Polars.
• Strong knowledge of Docker, containers, and Kubernetes for deployment and orchestration.
• Intermediate to advanced Linux/Unix skills, including bash and shell scripting.
• Demonstrable troubleshooting and problem-solving skills, including error analysis and root-cause identification.
• Experience with Jupyter environments and integrating ML libraries under enterprise security practices.
• Expertise in Big Data technologies: Hive, HBase, Scala, PySpark, and distributed computing principles.
• Knowledge of cloud services with preference for AWS, Azure, and Databricks.

Preferred Skills:

• Experience building and managing secure APIs at scale in containerized environments.
• Background working in Agile or Scrum teams with strong documentation practices.

Why OpenKyber?

• Competitive compensation and benefits.
• Opportunities for growth with global clients.
• A supportive, inclusive culture that values innovation and people.
• Exposure to cutting-edge technologies and projects.

Additional Details

• Expectation for start: 2-4 weeks after offer.
• This role requires a specific start date and candidates must be able to meet the outlined start date.
• Hours per day: 8.
• Labor type: Technical.

About Our Commitment

OpenKyber is an equal opportunity employer. We value diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, or veteran status.

If this sounds like the right opportunity for you, please apply with your most recent resume.

For applications and inquiries,