Data Architect (Databricks)

Data Architect (Databricks)

Title:                                    Data Architect (Databricks)

Location:                            Markham, ON

Reporting to:                    Chief Information Officer

Background:

Miller Waste Systems Inc. has been in operation since 1961. Miller is a leader in waste management and diversion, providing governments and industries with a wide range of services in the province of Ontario, Nova Scotia, New Brunswick, and Manitoba. Miller has over 50 years’ experience in the waste management sector, and currently operates out of more than 30 locations. We are looking for a highly capable Data Architect to join our team, based in Markham, ON. 

Summary:                         

The Data Architect will lead the design, governance, and strategy of the company’s data systems, encompassing the data warehouse, data lake, and integrations between systems. This role ensures the scalability, security, and performance of the data ecosystem, aligning it with business objectives. The ideal candidate combines technical expertise with strategic vision, leveraging tools like Databricks and Azure to build a robust and future-proof architecture.

Responsibilities:

Key responsibilities include, but are not limited to:

• Architecture Design & Strategy
  • Design and oversee the architecture of the company’s data warehouse and lakehouse using Databricks and Azure services.
  • Develop and maintain best practices for data modeling, storage, and system integration.
  • Define the roadmap for enhancing the data ecosystem, focusing on scalability, innovation, and business alignment.
• Strategic Oversight
  • Act as a key advisor to business and IT leaders, ensuring data systems support organizational goals.
  • Lead initiatives to integrate emerging technologies (e.g., MLflow, Unity Catalog) into the company’s data strategy.
  • Ensure compliance with data governance, security, and privacy regulations.
• Data Integration Leadership
  • Provide guidance on the design and optimization of ETL/ELT pipelines using Databricks, Delta Live Tables, and Azure Data Factory.
  • Collaborate with SMEs and analytics teams to streamline data ingestion and enhance reliability.
  • Supervise the integration of data from structured, semi-structured, and unstructured sources.
• Performance & Cost Optimization
  • Oversee resource utilization and performance tuning of Databricks clusters and Spark jobs.
  • Implement strategies to reduce cloud costs while maintaining high performance and scalability.
• Mentorship & Team Collaboration
  • Mentor and guide data engineers, analysts, and developers to implement architectural standards.
  • Foster collaboration between cross-functional teams to align data solutions with business needs.
  • Drive organization-wide adoption of data management best practices.
• Security, Compliance, & Governance
  • Establish and enforce data security frameworks, including RBAC, encryption, and secure key management.
  • Collaborate with IT and compliance teams to maintain audit readiness and adhere to industry standards.

Qualifications & Requirements:

• Advanced experience with Databricks features, such as Unity Catalog, MLflow, and Delta files.
• Familiarity with Apache Spark internals and advanced libraries.
• Knowledge of BI tools and platforms (e.g., Sage, Solver, Trux, DayForce, Dossier).
• Understanding of financial data and reporting requirements.

Flexibility is also required as this position occasionally requires travel, early starts, late finishes and on rare occasions weekend work.  This is an in-office role, but occasional remote work is acceptable when approved.

We realize that you may not feel you have every qualification listed and that working to secure a career can be stressful.  If you feel that you meet most of the company’s needs and that your passion for your work adds value to a growing company, we would still love to hear from you.

Miller Waste Systems is committed to equity, diversity and inclusivity in the workplace, we welcome applications from women, racially visible individuals, people with disabilities, indigenous peoples, and LGBTQ2S+ persons.

Miller Waste Systems strives to be ‘only the best’. As a privately owned and operated Waste Company we have 50 years’ experience of providing quality service to all our customers. We have been successful in achieving this goal by providing a family and employee centric environment at all our locations. By providing an industry leading work environment and compensation, benefits, and pension programs, Miller Waste continues to grow our business.