We are seeking a highly skilled and experienced Senior Integration Engineer to join our dynamic team. This role will be pivotal in designing, developing, and maintaining robust integration solutions, with a strong focus on leveraging Apache Kafka for real-time data streaming and AWS integration services, particularly AWS Glue for ETL and data cataloging. The ideal candidate will have a deep understanding of enterprise integration patterns, event-driven architectures, and cloud-native solutions. You will collaborate closely with various engineering, product, and business teams to ensure seamless and efficient data flow across our diverse system landscape.Key Responsibilities:<ul><li>Design, develop, implement, and maintain scalable and resilient integration solutions using Apache Kafka and its ecosystem (Kafka Connect, Kafka Streams, Schema Registry).</li><li>Monitor, troubleshoot, and optimize Kafka cluster performance, including throughput, latency, and resource utilization, to ensure stability and efficiency.</li><li>Architect and build ETL/ELT pipelines using AWS Glue for data extraction, transformation, and loading from various sources into data lakes, data warehouses, and other target systems.</li><li>Develop and manage AWS Glue Data Catalog and ensure data quality, consistency, and governance across integrated systems.</li><li>Integrate a variety of cloud-based applications, databases, and third-party services using appropriate AWS services (e.g., Lambda, S3, API Gateway, SNS, SQS, EventBridge) and other integration technologies.</li><li>Champion and implement best practices for event-driven architecture, microservices integration, and API development.</li><li>Collaborate with architects, data engineers, software developers, and business stakeholders to understand integration requirements and translate them into technical designs and solutions.</li><li>Optimize and troubleshoot existing integration solutions to improve performance, reliability, and scalability.</li><li>Develop and maintain comprehensive documentation for integration designs, processes, and data flows.</li><li>Implement robust monitoring, alerting, and logging for integration solutions to ensure operational excellence.</li><li>Mentor junior engineers and provide technical leadership within the integration domain.</li><li>Stay current with emerging technologies and industry trends in data integration, Kafka, and AWS services.</li><li>Ensure security best practices are implemented and maintained for all integration solutions.</li></ul>Required Qualifications:<ul><li>Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field (or equivalent practical experience).</li><li>5+ years of hands-on experience in designing and developing enterprise-level integration solutions.</li><li>Proven, in-depth experience with Apache Kafka, including designing and implementing Kafka producers, consumers, topics, connectors, and performance tuning.</li><li>Strong experience with AWS cloud services, particularly AWS Glue for ETL, data cataloging, and job orchestration.</li><li>Proficiency with other AWS integration and data services such as S3, Lambda, API Gateway, Kinesis, Redshift, RDS, DynamoDB.</li><li>Solid understanding of data modeling, data warehousing concepts, and ETL/ELT processes.</li><li>Experience with various data formats (e.g., JSON, Avro, Parquet, XML) and API protocols (e.g., REST, SOAP, gRPC).</li><li>Proficiency in one or more programming languages commonly used in integration development (e.g., Python, Java, Scala).</li><li>Experience with SQL and NoSQL databases.</li><li>Strong understanding of integration patterns, event-driven architecture, and microservices principles.</li><li>Experience with version control systems (e.g., Git) and CI/CD pipelines.</li><li>Excellent analytical, problem-solving, and troubleshooting skills.</li><li>Strong communication and interpersonal skills, with the ability to collaborate effectively with technical and non-technical teams.</li></ul>Preferred Qualifications:<ul><li>Confluent Certified Developer for Apache Kafka (CCDAK) or similar Kafka certification.</li><li>AWS Certifications (e.g., AWS Certified Data Analytics - Specialty, AWS Certified Developer - Associate/Professional, AWS Certified Solutions Architect - Associate/Professional).</li><li>Experience with other ETL tools (e.g., Apache Airflow, Talend, Informatica).</li><li>Familiarity with containerization technologies (e.g., Docker, Kubernetes).</li><li>Experience with Infrastructure as Code (IaC) tools (e.g., Terraform, AWS CloudFormation).</li><li>Knowledge of data governance and data security best practices.</li></ul>  We thank you for your interest. Only those selected for an interview will be contacted. GFL is committed to equal opportunity for all, without regard to race, religion, color, national origin, citizenship, sex, sexual orientation, gender identity, age, veteran status, disability, genetic information, or any other protected characteristic. If you are interested in applying for employment and need special assistance or an accommodation to apply for a posted position, please contact <a href="mailto:myworkdayrecruitment@gflenv.com">myworkdayrecruitment@gflenv.com</a>  This hiring process may utilize machine-based systems to assist in screening and assessing applicants. Final selection decisions are made by our recruitment team.

GFL Environmental is the only major diversified environmental services company in North America offering services in solid waste management, liquid waste management and soil remediation. Through a strategically located network of facilities across Canada the United States, GFL&rsquo;s dedicated, professional team of employees provides local service to more than 4 million households under municipal contracts and to more than 135,000 industrial, commercial and institutional customers. We offer an unparalleled commitment to customer service, reliability and efficiency and maintain an unwavering focus on safety and compliance with environmental and legislative requirements. At GFL, we believe that by providing accessible, cost-effective environmental solutions we will encourage greater environmental responsibility and allow our customers and the communities we serve to be Green For Life.

Senior Integration Engineer

&nbsp;We are seeking a highly skilled and experienced Senior Integration Engineer to join our dynamic team. This role will be pivotal in designing, developing, and maintaining robust integration solutions, with a strong focus on leveraging Apache Kafka for real-time data streaming and AWS integration services, particularly AWS Glue for ETL and data cataloging. The ideal candidate will have a deep understanding of enterprise integration patterns, event-driven architectures, and cloud-native solutions. You will collaborate closely with various engineering, product, and business teams to ensure seamless and efficient data flow across our diverse system landscape.Key Responsibilities:<ul><li>Design, develop, implement, and maintain scalable and resilient integration solutions using Apache Kafka and its ecosystem (Kafka Connect, Kafka Streams, Schema Registry).</li><li>Monitor, troubleshoot, and optimize Kafka cluster performance, including throughput, latency, and resource utilization, to ensure stability and efficiency.</li><li>Architect and build ETL/ELT pipelines using AWS Glue for data extraction, transformation, and loading from various sources into data lakes, data warehouses, and other target systems.</li><li>Develop and manage AWS Glue Data Catalog and ensure data quality, consistency, and governance across integrated systems.</li><li>Integrate a variety of cloud-based applications, databases, and third-party services using appropriate AWS services (e.g., Lambda, S3, API Gateway, SNS, SQS, EventBridge) and other integration technologies.</li><li>Champion and implement best practices for event-driven architecture, microservices integration, and API development.</li><li>Collaborate with architects, data engineers, software developers, and business stakeholders to understand integration requirements and translate them into technical designs and solutions.</li><li>Optimize and troubleshoot existing integration solutions to improve performance, reliability, and scalability.</li><li>Develop and maintain comprehensive documentation for integration designs, processes, and data flows.</li><li>Implement robust monitoring, alerting, and logging for integration solutions to ensure operational excellence.</li><li>Mentor junior engineers and provide technical leadership within the integration domain.</li><li>Stay current with emerging technologies and industry trends in data integration, Kafka, and AWS services.</li><li>Ensure security best practices are implemented and maintained for all integration&nbsp;solutions.</li></ul>Required&nbsp;Qualifications:<ul><li>Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field (or equivalent practical experience).</li><li>5+ years of hands-on experience in designing and developing enterprise-level integration solutions.</li><li>Proven, in-depth experience with Apache Kafka, including designing and implementing Kafka producers, consumers, topics, connectors,&nbsp;and performance tuning.</li><li>Strong experience with AWS cloud services, particularly AWS Glue for ETL, data cataloging, and job orchestration.</li><li>Proficiency with other AWS integration and data services such as S3, Lambda, API Gateway, Kinesis, Redshift, RDS, DynamoDB.</li><li>Solid understanding of data modeling, data warehousing concepts, and ETL/ELT processes.</li><li>Experience with various data formats (e.g., JSON, Avro, Parquet, XML) and API protocols (e.g., REST, SOAP, gRPC).</li><li>Proficiency in one or more programming languages commonly used in integration development (e.g., Python, Java, Scala).</li><li>Experience with SQL and NoSQL databases.</li><li>Strong understanding of integration patterns, event-driven architecture, and microservices principles.</li><li>Experience with version control systems (e.g., Git) and CI/CD pipelines.</li><li>Excellent analytical,&nbsp;problem-solving, and troubleshooting skills.</li><li>Strong communication and interpersonal skills, with the ability to collaborate effectively with&nbsp;technical and non-technical&nbsp;teams.</li></ul>Preferred Qualifications:<ul><li>Confluent Certified Developer for Apache Kafka (CCDAK) or similar Kafka certification.</li><li>AWS Certifications (e.g., AWS Certified Data Analytics - Specialty,&nbsp;AWS Certified Developer - Associate/Professional, AWS Certified Solutions Architect - Associate/Professional).</li><li>Experience with other ETL tools (e.g., Apache Airflow, Talend, Informatica).</li><li>Familiarity&nbsp;with containerization technologies (e.g., Docker, Kubernetes).</li><li>Experience with Infrastructure as Code (IaC) tools (e.g., Terraform,&nbsp;AWS CloudFormation).</li><li>Knowledge of data governance and data security best practices.</li></ul> &nbsp;We thank you for your interest. Only those selected for an interview will be contacted. GFL is committed to equal opportunity for all, without regard to race, religion, color, national origin, citizenship, sex, sexual orientation, gender identity, age, veteran status, disability, genetic information, or any other protected characteristic. If you are interested in applying for employment and need special assistance or an accommodation to apply for a posted position, please contact&nbsp;<a href="mailto:myworkdayrecruitment@gflenv.com">myworkdayrecruitment@gflenv.com</a> &nbsp;This hiring process may utilize machine-based systems to assist in screening and assessing applicants. Final selection decisions are made by our recruitment team.

Senior Integration Engineer

About the Job

About the Company

GFL Environmental

Similar Jobs

Senior DevOps Engineer

Senior DevOps Engineer

Senior Data Integration Engineer, IT and compliance

Senior Data Integration Engineer, IT and compliance

Senior Software Engineer, Data Platform

Senior Software Engineer, Data Platform

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Software Engineer, Data Platform

Senior Software Engineer, Data Platform

Senior DevOps Engineer

Senior DevOps Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Operations Engineer

Senior Data Operations Engineer