Careers
/
Infrastructure
Software Engineer, Inference
Serve every Vantir model with steady latency on the hardware we design ourselves.
Infrastructure
Toronto
Full-time
Apply for this role
About the role
Serve every Vantir model with steady latency on the hardware we design ourselves. You will join a small team that ships often and writes things down.
What you'll do
- Build and tune the serving stack behind the API.
- Profile kernels and remove the steps that do not need to be there.
- Own a piece of the on-call rotation and improve it.
What you'll bring
- Strong systems programming in C++ or Rust.
- Experience with accelerators and distributed systems.
- Care for the boring parts that keep a service up.
We work in person in Toronto most days. Pay and benefits are shared in the first call.
Apply
Tell us about your work
A person on the hiring team reads every application. You will hear back within two weeks.