Job Type

Permanent

New York

United States

300000

Per annum
Skill Level

Select Experience Level

Key Skills

  • LLM
  • Machine Learning
  • rust
  • Systems Engineering
Job Posted: December 3, 2025
Share this Job

Lead Software Engineer

  • Permanent
  • New York
  • US$250000 - US$300000 per annum + Equity USD / Year

Searchability

Lead Rust Engineer

  • NYC Start-up changing the way LLM’s are utilized!
  • Up to $300k + Equity
  • On-Site – New York
  • Rust, Machine Learning, Reinforcement Learning, LLM

ABOUT THE CLIENT

A New York based start-up who are changing the way LLMs are utilized and scaled! They’re building a world class ML infrastructure product that is already changing the way businesses incorporate ML.

The product has applications across a multitude of industries to drive their LLM’s to rapidly improve their capabilities.

THE LEAD RUST ENGINEER

We’re hiring a founding engineer with deep systems chops (Rust especially) to help build a fast, flexible model gateway at the heart of our AI infrastructure. Most of your work will be open source, with projects ranging from inference-time optimization to real-time experimentation tools. You’ll have the freedom to dive deep into what you already know or pick up entirely new skills as we scale. If building core ML infrastructure in the open sounds like your kind of challenge, we’d love to talk.

SKILLS:

  • RUST
  • SYSTEMS ENGINEERING
  • PhD Education
  • ML
  • LLM

TO BE CONSIDERED:

Please either apply by clicking online or emailing me directly [email protected]. I can make myself available outside of normal working hours to suit between 7am until 8pm. If unavailable, please leave a message and either myself or one of my colleagues will respond. By applying for this role, you give express consent for us to process and submit (subject to required skills) your application to our client in conjunction with this vacancy only. Also feel free to follow me on twitter @searchablejim or connect with me on LinkedIn! I look forward to hearing from you.

KEY SKILLS

RUST , SYSTEMS ENGINEERING , ML , MACHINE LEARNING / MLOPS / LLM / LARGE LANGUAGE MODELS

Upload your CV or any other relevant file. Max. file size: 256 MB.

Privacy Overview

This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.