About The Role Featherless.ai is building the world’s most reliable and comprehensive open-model inference platform — the infrastructure powering the next generation of AI creators, startups, and enterprises. Our serverless approach to inference unlocks the best GPU utilization in AI infrastructure. What You'll Do The API gateway is managed by the Platform Team, who aim to make Featherless the best place to find and use models. As a member of the platform team, you will undertake feature development and bug fixes to keep up with clients, resolve user issues, and onboard new models improve the reliability of the existing API (increasing instrumentation and monitoring, right-sizing infrastructure) respond to availability incidents triage and resolve issues of inference quality and reliability manage the infrastructure on which our gateway runs What You'll Bring first-hand experience of the user’s we’re building for (familiarity with popular open LLMs, common clients, and experience building with LLM) experience with the technologies and paradigms of the web (REST, websockets, DNS, networking, opentelemetry) experience with significant components of our stack (k8s, node, mikro-orm, fastify, redis, mongodb, python, elastic cloud, cloudflare, sentry, otel) ability to debug complex issues across a wide stack and build instrumentation as necessary desire to work collaboratively as part of a skilled team Alignment with team and company values, including bias to action responsiveness to users (bug-fixes over features) instinct to iterate subscribing to that done means proven by usage data Other This team operates on Eastern Time. We are remote, but with a preference to hire in Toronto, Canada. #J-18808-Ljbffr
Senior Software Engineer - Api Gateway
FEATHERLESS AI
toronto, toronto
Published 27 days ago
Report job