Senior AI Infrastructure EngineerInference &amp; Optimization&nbsp; |&nbsp; Montreal (hybrid-friendly)&nbsp; |&nbsp; Full-time&nbsp; |&nbsp; Founding team<h2>About CarbonForge</h2>AI adoption is accelerating, but the infrastructure required to run AI models remains expensive, energy-intensive, and increasingly difficult to scale. Organizations are spending millions on GPU capacity while struggling to maximize the performance of the hardware they already have.CarbonForge exists to solve this problem.Founded by AI researchers and entrepreneurs from Mila, CarbonForge is building technology that helps organizations run AI models faster, more energy-efficient, and at lower cost. Our platform enables AI teams to get more value from their existing GPU infrastructure by increasing performance, reducing latency, and lowering energy consumption-without requiring them to rebuild their AI systems. Backed by VC funding and entering an exciting growth stage, CarbonForge is a team of experts helping shape the future of scalable, cost-effective, and sovereign AI infrastructure.<h2>The role</h2>Reporting to the Chief Technology Officer, we are seeking a Senior AI Infrastructure Engineer to design, build, and operate large‑scale infrastructure that powers AI inference workloads on public cloud and on-prem. As a founding team member and individual contributor, you will carry significant influence combining strong software engineering skills with deep systems and cloud expertise to deliver secure, scalable, reliable and efficient platforms for serving AI models. What you’ll do<ul><li>Build and manage Cloud infrastructure on GCP, AWS, Azure and On-Prem infrastructures for internal and external needs.</li><li>Build and Manage our Infrastructure Lab</li><li>Benchmark AI Inference workloads</li><li>Support customers in the deployment of our solution for their infrastructure</li><li>Build and run infrastructure with Ansible, Terraform, and Kubernetes to enable scaling to a massive number of concurrent users</li><li>Build monitoring systems to ensure the highest quality service for our customers</li></ul><h2>What we’re looking for</h2><ul><li>5+ years of professional experience in AI infrastructure or a related field</li><li>Experience with Ansible, Terraform, and Kubernetes</li><li>Experience with Agentic workflows required</li><li>Experience with Helm</li><li>Experience with Ray, RayClusters, KubeRay</li><li>Proficiency in Python</li><li>Experience shipping LLM serving systems at scale in production environments</li><li>Experience building and supporting APIs</li><li>Experience developing and operating scalable platforms</li><li>Bachelor's degree in Computer Science or a related field, or equivalent practical experience</li></ul><h2>On credentials</h2>No PhD required. We care about what you’ve shipped and what you can prove on a GPU. A pull request closes the loop faster than a CV.<h2>Why join CarbonForge</h2><ul><li>Mission that compounds. Power is the binding constraint for AI deployment this decade. You’ll build the layer that makes every joule count — and every token more useful.</li><li>World-class science bench. Work alongside two Canada CIFAR AI Chairs and core Mila researchers: Pierre-Luc Bacon (UdeM, scientific co-founder) and Christophe Dubach (McGill, scientific advisor). Full support of Mila, Canada’s leading AI research institute, with access to its talent pipeline and research bench.</li><li>Real hardware from day one. H100, H200, AMD MI-series, and design-partner engagements already in motion.</li><li>Resources to match the ambition. Seed-funded by strong operator and institutional investors. We have the resources to hire the best, give them the compute they need, and run the long experiments that matter. Founding-engineer equity, direct ownership, no bureaucracy - your code reaches production in weeks, not quarters.</li><li>Remote-friendly. Montreal preferred for regular in-person work with the founding team.</li></ul><h2>A note on fit</h2>If not every bullet above describes you perfectly, apply anyway. We’re hiring for trajectory and proof of work, not a checklist. What matters is whether you can ship the outcomes we’ve described and push us to be better at the work.CarbonForge is committed to building a team where the best engineers want to work, from any background. We welcome applicants from all origins, identities, and paths into this field. Equal opportunity employer.

Active Impact Investments is a Certified B Corp based in Vancouver, BC, whose mission is to support environmental sustainability through profitable investment. With three limited partnership funds with over $200M in assets under management, we provide funds and talent to accelerate the growth of early-stage climate tech companies with $200K to $3M in revenue and significant growth potential. Our portfolio includes and is seeking some of the most successful startups in North America that are capable of achieving venture scale and becoming extremely profitable while solving the most urgent environmental issues.

Senior AI Infrastructure Engineer

Senior AI Infrastructure EngineerInference &amp; Optimization  |  Montreal (hybrid-friendly)  |  Full-time  |  Founding team<h2>About CarbonForge</h2>AI adoption is accelerating, but the infrastructure required to run AI models remains expensive, energy-intensive, and increasingly difficult to scale. Organizations are spending millions on GPU capacity while struggling to maximize the performance of the hardware they already have.CarbonForge exists to solve this problem.Founded by AI researchers and entrepreneurs from Mila, CarbonForge is building technology that helps organizations run AI models faster, more energy-efficient, and at lower cost. Our platform enables AI teams to get more value from their existing GPU infrastructure by increasing performance, reducing latency, and lowering energy consumption-without requiring them to rebuild their AI systems. Backed by VC funding and entering an exciting growth stage, CarbonForge is a team of experts helping shape the future of scalable, cost-effective, and sovereign AI infrastructure.<h2>The role</h2>Reporting to the Chief Technology Officer, we are seeking a Senior AI Infrastructure Engineer to design, build, and operate large‑scale infrastructure that powers AI inference workloads on public cloud and on-prem. As a founding team member and individual contributor, you will carry significant influence combining strong software engineering skills with deep systems and cloud expertise to deliver secure, scalable, reliable and efficient platforms for serving AI models. What you’ll do<ul><li>Build and manage Cloud infrastructure on GCP, AWS, Azure and On-Prem infrastructures for internal and external needs.</li><li>Build and Manage our Infrastructure Lab</li><li>Benchmark AI Inference workloads</li><li>Support customers in the deployment of our solution for their infrastructure</li><li>Build and run infrastructure with Ansible, Terraform, and Kubernetes to enable scaling to a massive number of concurrent users</li><li>Build monitoring systems to ensure the highest quality service for our customers</li></ul><h2>What we’re looking for</h2><ul><li>5+ years of professional experience in AI infrastructure or a related field</li><li>Experience with Ansible, Terraform, and Kubernetes</li><li>Experience with Agentic workflows required</li><li>Experience with Helm</li><li>Experience with Ray, RayClusters, KubeRay</li><li>Proficiency in Python</li><li>Experience shipping LLM serving systems at scale in production environments</li><li>Experience building and supporting APIs</li><li>Experience developing and operating scalable platforms</li><li>Bachelor's degree in Computer Science or a related field, or equivalent practical experience</li></ul><h2>On credentials</h2>No PhD required. We care about what you’ve shipped and what you can prove on a GPU. A pull request closes the loop faster than a CV.<h2>Why join CarbonForge</h2><ul><li>Mission that compounds. Power is the binding constraint for AI deployment this decade. You’ll build the layer that makes every joule count — and every token more useful.</li><li>World-class science bench. Work alongside two Canada CIFAR AI Chairs and core Mila researchers: Pierre-Luc Bacon (UdeM, scientific co-founder) and Christophe Dubach (McGill, scientific advisor). Full support of Mila, Canada’s leading AI research institute, with access to its talent pipeline and research bench.</li><li>Real hardware from day one. H100, H200, AMD MI-series, and design-partner engagements already in motion.</li><li>Resources to match the ambition. Seed-funded by strong operator and institutional investors. We have the resources to hire the best, give them the compute they need, and run the long experiments that matter. Founding-engineer equity, direct ownership, no bureaucracy - your code reaches production in weeks, not quarters.</li><li>Remote-friendly. Montreal preferred for regular in-person work with the founding team.</li></ul><h2>A note on fit</h2>If not every bullet above describes you perfectly, apply anyway. We’re hiring for trajectory and proof of work, not a checklist. What matters is whether you can ship the outcomes we’ve described and push us to be better at the work.CarbonForge is committed to building a team where the best engineers want to work, from any background. We welcome applicants from all origins, identities, and paths into this field. Equal opportunity employer.

Senior AI Infrastructure Engineer

About the Job

About the Company

Active Impact Investments

Similar Jobs

Senior Fullstack Software Engineer

Senior Fullstack Software Engineer

AI Engineer

AI Engineer

AI Platform Engineer

AI Platform Engineer

AI Engineer

AI Engineer

Staff AI Systems Engineer

Staff AI Systems Engineer

Senior AI Engineer – Enterprise Data & AI

Senior AI Engineer – Enterprise Data & AI

AI Engineer

AI Engineer

DevOps Engineer

DevOps Engineer

AI Infrastructure Engineer

AI Infrastructure Engineer

Software Engineer III, AI Digital & Engineering Software

Software Engineer III, AI Digital & Engineering Software