🧑💻 We're hiring AI Engineer at TestSprite! (Hybrid in Seattle)

TestSprite is an AI-powered software testing platform that helps teams plan, generate, run, and debug tests automatically—speeding up releases and improving reliability. Our AI engine is the core of everything we do, and we're looking for an AI engineer to push it further—smarter test generation, better debugging, and more reliable automation.

✨ About the Role

Title: AI Engineer
Location: Hybrid in Seattle (in-person collaboration each week)
Type: Full-time

🛠 What You'll Do

Design, build, and operate AI-powered services for test generation, execution, and intelligent debugging
Develop and refine LLM-based pipelines—prompt engineering, agent orchestration, tool use, and evaluation
Build and improve context systems, vector search, and retrieval pipelines that power TestSprite's AI understanding of user applications
Own projects end-to-end: research, prototyping, architecture, implementation, and iterative improvements
Optimize AI pipeline performance, latency, cost, and reliability at scale
Collaborate closely with founders and product to translate customer pain points into AI-driven solutions
Evaluate and integrate new models, frameworks, and techniques as the AI landscape evolves

👀 We're Looking For Someone Who

Has 3+ years of professional software engineering experience with a strong AI/ML focus
Has hands-on experience building applications with LLMs (prompt/context engineering, agent frameworks, model evaluation)
Is proficient in Python and familiar with TypeScript/Node
Has cloud experience (required) — AWS preferred (e.g., Lambda/ECS, S3, CloudWatch)
Understands modern AI application patterns (RAG, vector search, tool use, fine-tuning, evaluation frameworks)
Has experience with embedding models, vector databases (Pinecone, Weaviate, pgvector, etc.), and retrieval strategies
Communicates clearly, ships pragmatically, and enjoys fast iteration with real users

🌟 Nice to Have

Background in developer tools, testing frameworks (e.g., Playwright), or code analysis
Experience with distributed systems, reliability, and observability
Contributions to open-source AI/ML projects
Familiarity with model fine-tuning, RLHF, or custom training pipelines
Experience with agent orchestration frameworks (LangChain, LlamaIndex, CrewAI, etc.)

🧩 Our Tech Stack (Representative)

Python + TypeScript/Node
AWS (Lambda/ECS, API Gateway, DynamoDB/Postgres, S3, CloudWatch)
LLM APIs (OpenAI, Anthropic, open-source models)
Vector databases, RAG pipelines, prompt management
Docker, IaC, CI/CD
Playwright, modern observability tooling

💚 Why TestSprite

Work at the intersection of AI and developer tools—your AI work directly impacts how software gets tested
Meaningful ownership: you'll shape the AI engine, not just maintain it
Tight-knit, high-agency culture with fast feedback loops
Competitive compensation with equity, benefits, and hardware support
Hybrid rhythm that balances focus time with in-person collaboration

📮 Interested?

Send your resume (and links to GitHub/portfolio if available) with a short intro to hiring@testsprite.com.

TestSprite

Get jobs from employers like TestSprite delivered to your inbox

Latest Jobs

AI Engineer