Full-time

Inference Engineer

San Francisco, California, United States · Hybrid

$200,000 - $300,000

Founding Inference Engineer

Build the inference infrastructure that makes large-scale LLM deployment faster and more cost-efficient.

Most inference platforms are built around GPUs. But what if different stages of LLM inference could run on entirely different hardware, each optimised for the workload?

You'll join a seed-funded AI infrastructure startup building a new inference cloud that combines NVIDIA GPUs with specialised AI accelerators to improve performance, latency and cost per token.

With significant financial backing and a small founding engineering team, you'll have the opportunity to shape the core architecture rather than simply optimise an existing platform.

The opportunity

As a Founding Inference Engineer, you'll work at the intersection of distributed systems, GPU computing and LLM serving.

The technical challenge is substantial. How do you efficiently distribute inference workloads across different accelerator architectures while maintaining low latency, high throughput and optimal hardware utilisation?

You'll help answer that question, designing and building the systems that make heterogeneous inference practical at scale.

Your focus:

  • Design and optimise LLM serving infrastructure across GPUs and specialised AI accelerators.

  • Build disaggregated inference systems, including prefill/decode separation and efficient communication between compute resources.

  • Improve continuous batching, KV-cache management, request scheduling and model placement.

  • Optimise inference frameworks such as vLLM, SGLang or TensorRT-LLM, improving throughput, latency and cost per token.

You'll work closely with compiler, runtime and infrastructure engineers, profiling bottlenecks across compute, memory and networking.

What you'll bring

We're particularly interested in engineers who've personally built or significantly improved core inference systems, rather than solely integrated existing platforms.

Ideally, you'll have:

  • Strong C++ and Python engineering skills, with hands-on experience building production LLM inference systems.

  • Deep understanding of LLM serving architectures, GPU utilisation and performance optimisation.

  • Experience with vLLM, SGLang, TensorRT-LLM, Triton or similar inference frameworks.

  • Knowledge of distributed systems and the challenges of scaling model execution across hardware.

Experience with CUDA, Triton kernels, speculative decoding, tensor parallelism, RDMA or disaggregated inference would be particularly relevant.

You don't need experience across every area. Depth in inference engineering and evidence of building core systems matter most.

Why join?

This is a genuine founding engineering opportunity. You'll influence architectural decisions, work directly on difficult systems problems and help establish the technical foundations before the engineering team scales.

You'll have substantial ownership, strong financial backing and the opportunity to build infrastructure that addresses one of the biggest challenges in deploying large AI models: inference efficiency.

Package & location

Base salary: $250,000–$275,000 (indicative)
Equity: Meaningful founding-stage equity
Location: San Francisco or New York City

If you've been building inference engines, GPU systems or distributed AI infrastructure and want more ownership over the architecture, we'd be interested in speaking with you.

Contact Techire AI for a confidential conversation.

All applicants will receive a response.

Salary

$200,000 - $300,000

Location

San Francisco, California, United States · Hybrid

Contract

Full-time

Your consultant

Fraser Moran

Your consultant

Fraser Moran

Full-time

Inference Engineer

San Francisco, California, United States · Hybrid

$200,000 - $300,000

Founding Inference Engineer

Build the inference infrastructure that makes large-scale LLM deployment faster and more cost-efficient.

Most inference platforms are built around GPUs. But what if different stages of LLM inference could run on entirely different hardware, each optimised for the workload?

You'll join a seed-funded AI infrastructure startup building a new inference cloud that combines NVIDIA GPUs with specialised AI accelerators to improve performance, latency and cost per token.

With significant financial backing and a small founding engineering team, you'll have the opportunity to shape the core architecture rather than simply optimise an existing platform.

The opportunity

As a Founding Inference Engineer, you'll work at the intersection of distributed systems, GPU computing and LLM serving.

The technical challenge is substantial. How do you efficiently distribute inference workloads across different accelerator architectures while maintaining low latency, high throughput and optimal hardware utilisation?

You'll help answer that question, designing and building the systems that make heterogeneous inference practical at scale.

Your focus:

  • Design and optimise LLM serving infrastructure across GPUs and specialised AI accelerators.

  • Build disaggregated inference systems, including prefill/decode separation and efficient communication between compute resources.

  • Improve continuous batching, KV-cache management, request scheduling and model placement.

  • Optimise inference frameworks such as vLLM, SGLang or TensorRT-LLM, improving throughput, latency and cost per token.

You'll work closely with compiler, runtime and infrastructure engineers, profiling bottlenecks across compute, memory and networking.

What you'll bring

We're particularly interested in engineers who've personally built or significantly improved core inference systems, rather than solely integrated existing platforms.

Ideally, you'll have:

  • Strong C++ and Python engineering skills, with hands-on experience building production LLM inference systems.

  • Deep understanding of LLM serving architectures, GPU utilisation and performance optimisation.

  • Experience with vLLM, SGLang, TensorRT-LLM, Triton or similar inference frameworks.

  • Knowledge of distributed systems and the challenges of scaling model execution across hardware.

Experience with CUDA, Triton kernels, speculative decoding, tensor parallelism, RDMA or disaggregated inference would be particularly relevant.

You don't need experience across every area. Depth in inference engineering and evidence of building core systems matter most.

Why join?

This is a genuine founding engineering opportunity. You'll influence architectural decisions, work directly on difficult systems problems and help establish the technical foundations before the engineering team scales.

You'll have substantial ownership, strong financial backing and the opportunity to build infrastructure that addresses one of the biggest challenges in deploying large AI models: inference efficiency.

Package & location

Base salary: $250,000–$275,000 (indicative)
Equity: Meaningful founding-stage equity
Location: San Francisco or New York City

If you've been building inference engines, GPU systems or distributed AI infrastructure and want more ownership over the architecture, we'd be interested in speaking with you.

Contact Techire AI for a confidential conversation.

All applicants will receive a response.

Salary

$200,000 - $300,000

Location

San Francisco, California, United States · Hybrid

Contract

Full-time

Your consultant

Fraser Moran

Your consultant

Fraser Moran

Full-time

Inference Engineer

San Francisco, California, United States · Hybrid

$200,000 - $300,000

Founding Inference Engineer

Build the inference infrastructure that makes large-scale LLM deployment faster and more cost-efficient.

Most inference platforms are built around GPUs. But what if different stages of LLM inference could run on entirely different hardware, each optimised for the workload?

You'll join a seed-funded AI infrastructure startup building a new inference cloud that combines NVIDIA GPUs with specialised AI accelerators to improve performance, latency and cost per token.

With significant financial backing and a small founding engineering team, you'll have the opportunity to shape the core architecture rather than simply optimise an existing platform.

The opportunity

As a Founding Inference Engineer, you'll work at the intersection of distributed systems, GPU computing and LLM serving.

The technical challenge is substantial. How do you efficiently distribute inference workloads across different accelerator architectures while maintaining low latency, high throughput and optimal hardware utilisation?

You'll help answer that question, designing and building the systems that make heterogeneous inference practical at scale.

Your focus:

  • Design and optimise LLM serving infrastructure across GPUs and specialised AI accelerators.

  • Build disaggregated inference systems, including prefill/decode separation and efficient communication between compute resources.

  • Improve continuous batching, KV-cache management, request scheduling and model placement.

  • Optimise inference frameworks such as vLLM, SGLang or TensorRT-LLM, improving throughput, latency and cost per token.

You'll work closely with compiler, runtime and infrastructure engineers, profiling bottlenecks across compute, memory and networking.

What you'll bring

We're particularly interested in engineers who've personally built or significantly improved core inference systems, rather than solely integrated existing platforms.

Ideally, you'll have:

  • Strong C++ and Python engineering skills, with hands-on experience building production LLM inference systems.

  • Deep understanding of LLM serving architectures, GPU utilisation and performance optimisation.

  • Experience with vLLM, SGLang, TensorRT-LLM, Triton or similar inference frameworks.

  • Knowledge of distributed systems and the challenges of scaling model execution across hardware.

Experience with CUDA, Triton kernels, speculative decoding, tensor parallelism, RDMA or disaggregated inference would be particularly relevant.

You don't need experience across every area. Depth in inference engineering and evidence of building core systems matter most.

Why join?

This is a genuine founding engineering opportunity. You'll influence architectural decisions, work directly on difficult systems problems and help establish the technical foundations before the engineering team scales.

You'll have substantial ownership, strong financial backing and the opportunity to build infrastructure that addresses one of the biggest challenges in deploying large AI models: inference efficiency.

Package & location

Base salary: $250,000–$275,000 (indicative)
Equity: Meaningful founding-stage equity
Location: San Francisco or New York City

If you've been building inference engines, GPU systems or distributed AI infrastructure and want more ownership over the architecture, we'd be interested in speaking with you.

Contact Techire AI for a confidential conversation.

All applicants will receive a response.

Salary

$200,000 - $300,000

Location

San Francisco, California, United States · Hybrid

Contract

Full-time

Your consultant

Fraser Moran

Your consultant

Fraser Moran

techire AI website footer image