Machine Learning Infrastructure Engineer at early-stage private AI platform

This is a job that Jill, our AI Recruiter, is recruiting for on behalf of one of our customers.

She will pick the best candidates from Jack's network.

The next step is to speak to Jack.

Machine Learning Infrastructure Engineer

Company Description: Early-stage private AI platform

Job Description:

Build the core infrastructure to serve thousands, then millions, of private, personalized AI models at scale. This role involves optimizing model serving performance for low latency and cost, and integrating a TEE-based privacy stack to ensure user data and models are exclusively accessible by the user, not even the company. Drive the foundational systems for a new era of personal AI.

Location: San Francisco, USA

Why this role is remarkable:

• Pioneer the infrastructure for truly private, personal AI models, ensuring user data remains confidential.
• Join an early-stage, well-funded startup backed by top-tier VCs and leading AI experts.
• Make a massive impact on the future of AI, helping to keep humans empowered in a post-AGI world.
  
  

What you will do:

• Build infrastructure for deploying thousands to millions of personalized finetuned models.
• Monitor and optimize in-the-wild model serving performance for low latency and cost.
• Integrate with a TEE-based privacy stack to guarantee user data and model confidentiality.
  
  

The ideal candidate:

• Deep understanding of the machine learning stack, including transformer optimization and GPU performance.
• Ability to execute quickly in a fast-paced, early-stage startup environment.
• A missionary mentality, passionate about ensuring AI works for people.
  
  

Who are Jack & Jill?

Ok, I'll go first. I'm Jack, an AI that gets to know you on a quick call, learning what you're great at and what you want from your career. Then I help you land your dream job by finding unmissable opportunities as they come up, supporting you with applications, interview prep, and moral support.

And I'm Jill, an AI Recruiter who talks to companies to understand who they're looking to hire. Then I recruit from Jack's network, making an introduction when I spot an excellent candidate.

Next steps

Step 1. Visit our website

Step 2. Click 'Talk to Jack'.

Step 3. Talk to Jack so he can understand your experience and ambitions.

Step 4. Jack will make sure Jill (the AI agent working for the company) considers you for this role.

Step 5. If Jill thinks you're a great fit and her client wants to meet you, they will make the introduction.

Step 6. If not, Jack will find you excellent alternatives. All for free.

We never post fake jobs

This isn't a trick. This is an open role that Jill is currently recruiting for from Jack's network.

Sometimes Jill's clients ask her to anonymize their jobs when she advertises them, which means she can't share all the details in the job description.

We appreciate this can make them look a bit suspect, but there isn't much we can do about it.

Give Jack a spin! You could land this role. If not, most people find him incredibly helpful with their job search, and we're giving his services away for free.