Senior Data Engineer

We are seeking a highly skilled and experienced Senior Data Engineer to join our Cloud Platform. The ideal candidate will have a deep understanding of modern data engineering practices, including the use of like data lakes, and real-time streaming technologies. You will play a key role in designing and building scalable, efficient, and secure data pipelines to meet our organization’s growing data needs. This role is essential for driving data-driven decision-making and supporting a wide range of analytics and business intelligence initiatives.

Key Responsibilities

• Design and Build Scalable Data Pipelines: Architect and implement robust, scalable ETL/ELT pipelines using tools such as DBT and Snowflake, ensuring high performance, availability, and security.
• Data Lake Management: Develop, maintain, and optimize data lakes for structured and unstructured data, ensuring data is accessible, secure, and efficiently stored.
• Real-time Data Streaming: Work with streaming platforms (e.g., Kafka, Kinesis, or others) to enable real-time data ingestion and processing.
• Data Governance: Lead and enforce data governance frameworks to ensure data quality, consistency, and integrity across the organization. Implement and maintain policies and procedures for data stewardship, data lineage, and data security, data obfuscation, data disposal. Work with stakeholders to create, and maintain policies related to data governance
• Collaboration and Stakeholder Engagement: Collaborate with data scientists, analysts, and other engineers to ensure data pipelines meet business requirements and are aligned with company objectives.
• Performance Optimization: Monitor, troubleshoot, and optimize data processes and pipelines for efficiency and scalability.
• Documentation and Best Practices: Maintain detailed documentation of all processes, data flows, and pipelines. Establish and promote data engineering best practices within the team.

Required Qualifications

• 7+ years of experience in data engineering or related fields.
• Proficiency in SQL and strong experience with dbt for data transformation.
• Expertise with Snowflake or similar cloud data platforms.
• Strong understanding of data lakes, data warehousing, and data modeling concepts.
• Proven experience with data governance processes, including data quality management, data lineage tracking, and compliance with privacy regulations (e.g., GDPR, CCPA).
• Experience with real-time data streaming technologies such as Kafka, Kinesis, or equivalent.
• Familiarity with cloud platforms such as AWS, Azure, or GCP.
• Experience with Python or other programming languages for data engineering tasks.
• Strong understanding of ETL/ELT pipelines and orchestration tools .
• Ability to work independently and collaboratively in a fast-paced environment.
• Excellent problem-solving and communication skills.

Preferred Qualifications

• Experience with machine learning pipelines or supporting data science teams.
• Knowledge of data security and compliance standards such as GDPR or CCPA.
• Experience with CI/CD in the context of data pipelines.

Base salary of CAD $140,000-$160,000 commensurate with experience and qualifications