Venture-backed AI software startup

Senior AI/ML Engineer

Apply
Full-timeNew York CityHybrid$220k-$260k

Company Description

A small, venture-backed startup building enterprise AI software for online platforms. The company is growing quickly and works with large, high-profile technology companies.

The team works in a hybrid setup with regular in-person collaboration, and offers competitive salary and benefits.

Job Description

This role is for a hands-on engineer who wants to put large language models into production. You will help set the direction for AI and machine learning at the company, working alongside data and software engineers to build AI capabilities that are central to the product.

The focus is on building, shipping and maintaining real systems rather than research. You will take models from early experiments through fine-tuning, evaluation and deployment, and build the infrastructure that lets the team iterate quickly without sacrificing reliability.

It suits someone who has dealt with messy real-world data, knows that solid infrastructure matters as much as model quality, and is comfortable making technical tradeoffs without waiting for perfect requirements.

You will:

  • Own LLM work end to end, including data preparation, fine-tuning, evaluation and production deployment
  • Build automated evaluation tooling to measure model quality, surface edge cases and track improvement over time
  • Design and run low-latency, high-throughput AI services in the cloud
  • Lay down the foundational platform the team uses to ship, run and keep watch over models in production, with quality checks built in
  • Partner with product managers and engineers to make AI a core part of the product
  • Track new techniques in the field and make practical calls on what to adopt

Job Requirements:

  • 5+ years of engineering experience, including hands-on work applying LLMs and agents in industry
  • Track record of taking models from experimentation to production at scale
  • Experience building ML infrastructure from scratch at a high-growth startup
  • Strong Python skills and experience with ML frameworks such as PyTorch or TensorFlow
  • Practical experience with RAG, embeddings, vector databases, prompt engineering and fine-tuning
  • Hands-on MLOps experience, such as automating model releases, tracking model artifacts and keeping production models visible and healthy
  • Strong AWS experience and infrastructure as code with Terraform
  • Independent, systematic and execution-focused
  • Experience with agentic frameworks such as LangChain (nice to have)

Apply for this Position