Bigquery Engineer

Must Haves: Shoot between ~4-6 years of experience Python Pyspark Google Cloud Platform Big query Prior Gaps from Interviewees: Not enough Big query Don't need a ton of hadoop Google Cloud Platform big query

The position of Data Engineer II will be on a dynamic and growing team within the Global Risk & Compliance Technology (GRCT) organization at American Express.

Evaluates data requirements and stories, documents them for seamless integration into existing architectures, and maintains data models to support business needs.

Builds and enhances data pipelines and database designs to meet performance, scalability, and security requirements.

Collaborates in design reviews and testing and provides production environment support with guidance from peers and leaders.

Operates data assets according to consistent standards, guidelines, and policies.

Completes work reviews and fosters a collaborative learning environment.

Communicates and collaborates with business and product teams to facilitate changes and implementation.

Completes Big Data requirements by implementing basic partitioning and indexing solutions.

Collaborates and co-creates effectively with teams in product and the business to align technology initiatives with business objectives.

Google Cloud Platform Expertise: Hands-on experience with Google Cloud Platform services like BigQuery, Dataflow, Cloud Storage, Pub/Sub, Cloud Composer, and Cloud Functions.

Programming Languages: Strong proficiency in Python and SQL for data processing and manipulation.

ETL/ELT: Experience with ETL/ELT processes and data warehousing concepts.

Data Modeling: Understanding of data modeling principles and techniques.

Cloud Technologies: Knowledge of cloud computing concepts and standard processes.

For applications and inquiries,