Senior Data Engineer

February 7

Apply Now

Receive Emails with Similar Jobs

Badal.io

WebsiteLinkedInAll Job Openings

High-end GCP consulting: DevSecOps transformation, data strategy, and custom application development.

GCP • DevOps • Data • ML • DevSecOps

11 - 50

Description

• Work closely with technical leads and client teams to fully demonstrate the benefits of GCP technology • Introduce clients to data architecture and analytics best practices • Solve some of the most challenging, high-scale data, and IoT problems (banking, telco, energy, retail, etc.). • Write high-quality and testable batch and real-time data pipelines • Work with Data Scientists to design pipelines that improve their productivity and enable them to implement their ideas • Support clients in troubleshooting issues in their test and/or production environments and identifying root causes and solutions

Requirements

• GCP experience (for junior candidates, or exceptional talent with other cloud experience, we will provide training programs) • Experience in large-scale, secure, and high-availability solutions in a Cloud environment, such as GCP. • Experience with one Dataflow or Spark • Experience with orchestration frameworks such as Airflow, Kubeflow, Azkaban, etc. • Extensive programming experience in Python, Java and/or Scala. • Good understanding of modern data architecture • Good understanding of GCP services such as IAM, and Google Cloud Storage buckets • Experience with business intelligence tools like QuickSight, Looker and Data Studio • Technical writing experience; preparing and presenting technical material to a variety of audiences. • Experience in working in or with, Agile delivery teams. Nice to have • Streaming experience with Dataflow, Spark, Flink, Kafka Streams, etc • Strong understanding of Data Governance principles and experience working with tools such as Collibra or Immuta

Benefits

• Flexible vacation policy. • Three weeks of vacation, plus we are closed over the winter holidays (+ ~1 week) • One team-building event each quarter. • Great health benefits with a $1500-$3000 HSA/WSA. • Certification opportunities. We will pay for your GCP certification as well as other relevant training and certifications. • Learning opportunities. We work across different industries, technologies and roles and will work with you to help you explore your interests. • Blogging, open source, meetups and conference opportunities. We will provide a platform and time for you to pursue your ideas.