Hadoop Developer

Hadoop Developer

Scottsdale AZ - Day1 Onsite

Contract

Note: This role focuses strictly on the core Apache Big Data ecosystem running on bare metal. Please note: This is not a cloud data engineering role. We do not utilize AWS, Azure, or GCP.

Core Responsibilities

• Develop and optimize robust data pipelines using native HDFS, MapReduce, and YARN.

• Write high-performance distributed processing jobs using Apache Spark (Core/SQL) and Hive.

• Manage cluster resource allocation, troubleshoot bottlenecks, and tune query performance at the core infrastructure level.

•Hands-on experience with build tools like Maven and/or Gradle.

•Strong understanding of distributed systems and big data architecture.

•Experience with streaming frameworks such as Spark Streaming and Kafka Streams.

Required Skills & Qualifications

• Proven experience as a dedicated Big Data / Hadoop Developer.

• Mastery of the core Hadoop ecosystem (HDFS, YARN, MapReduce, Hive, Oozie).

• Strong proficiency in Apache Spark using Java, Scala, or Python.

• Deep understanding of distributed storage, cluster performance tuning, and Linux environments.

• Note: Cloud-native engineers (AWS EMR/Glue, Azure Synapse/ADF) will not be considered for this specific on-premise role.