Senior Data Engineer

July 30

Apply Now

Receive Emails with Similar Jobs

Keyrus

WebsiteLinkedInAll Job Openings

#MakeDataMatter #HumanizingTheFuture

Management & Transformation • Data Intelligence • Digital Experience

1001 - 5000

Description

• Develop and manage ETL processes to integrate data from various source systems into Databricks. • Ensure data quality, consistency, and reliability across all integrated data sources. • Implement data validation and cleansing routines. • Design and develop workbooks in a medallion structure (Bronze, Silver, and Gold layers) within Databricks. • Optimize data pipelines for performance and scalability. • Implement and maintain robust data transformation processes. • Develop data models and datasets within Databricks to be used in Power BI/Excel connected sheets. • Collaborate with BI developers to ensure seamless data flow for reporting and analytics. • Ensure data availability and performance for Power BI dashboards and reports. • Utilize version control systems (e.g., Git) for code repository management. • Participate in code reviews and manage pull requests to ensure code quality and consistency. • Maintain comprehensive documentation of data processes, workflows, and systems. • Monitor data pipeline performance and troubleshoot issues as they arise. • Implement best practices for optimizing data processing and storage. • Work closely with data scientists, BI developers, and business stakeholders to understand requirements and deliver solutions. • Provide technical guidance and support to junior developers and team members.

Requirements

• Strong experience with Databricks and its ecosystem. • Proficient in SQL, Python, or Spark for data processing and transformation. • Familiarity with Power BI and developing data models for reporting. • Experience with version control systems (e.g., Git). • Strong problem-solving and analytical skills. • Excellent communication and teamwork abilities. • Ability to work independently and manage multiple tasks effectively. • Ability to collect requirements from non-technical resources and translate them to detail specifications for delivery. • Familiarity with Datasul ERP system and its data structures. • Familiarity with SAP Hana/ECC ERP system and its data structures. • Familiarity with Salesforce data structures. • Experience in finance or supply-chain-related data projects.

Benefits

• Group insurance for you and your family members. • RRSP and DPSP participation plan • Monthly well-being allowance • Reimbursement of telecommunication costs • 4 weeks of paid vacation • Language courses (French & English) • Access to continuing education (in-house, conferences, events, courses, certifications, etc.) • Development plan for each employee and coaching.