Sr Engineer (Backend) at Second Talent

About the role

We are looking for a mid to senior level API Platform Engineer. In this role, youll architect and scale the foundation that powers delightful developer experiences and production-grade AI systems. You'll work at the intersection of high-performance APIs, scalable infrastructure, and cutting-edge machine learningdelivering tools that enable developers and partners to build on top of Menlos intelligent platform. Responsibilities Design and build the Menlo API Platform, focusing on high reliability, performance, and a world-class developer experience Develop intuitive APIs and SDKs that make it easy for developers to access and integrate multimodal AI capabilities Deploy and optimize AI/ML models into scalable, production environments, working closely with research and applied ML teams Manage and evolve a modern, cloud-native infrastructure stack, using Kubernetes, Docker, and infrastructure-as-code (IaC) tools Ensure platform reliability, including designing and implementing telemetry, monitoring, alerting, autoscaling, failover, and disaster recovery mechanisms Contribute to developer and operations workflows, including CI/CD pipelines, release management, and on-call rotations Collaborate across teams to implement secure APIs with fine-grained access control, usage metering, and billing integration Continuously improve platform performance, cost-efficiency, and observability as we scale to serve millions of users worldwide Requirements 3+ years of experience building and operating large-scale, production systems with real-world usage and uptime expectations Strong experience with containerization and orchestration: Kubernetes, Docker, Helm, and service mesh technologies (e.g., Istio or Linkerd) Proficiency with cloud platforms: AWS, GCP, or Azure including experience with IAM, networking, and serverless tooling Hands-on coding skills in Python and JavaScript/TypeScript, with familiarity in backend frameworks (e.g., FastAPI, Express) Deep knowledge of API architecture and design patterns: WebRTC/Websockets, REST, gRPC, OpenAPI/Swagger, authentication (OAuth2, API keys), and versioning Experience with databases: PostgreSQL, Redis, and modern vector databases (e.g., Pinecone, Weaviate, FAISS) Familiarity with CI/CD pipelines, GitOps practices, and tools like GitHub Actions, Argo CD, or Jenkins Comfortable with monitoring and observability tools such as Prometheus, Grafana, Datadog, or OpenTelemetry Bonus Experience Experience with MLOps tools and AI workflows: model versioning, inference pipelines, model registries, etc. Understanding of access control systems: ACLs, RBAC, multi-tenant security and isolation Knowledge of billing systems, rate limiting, chargeback models, quota enforcement, and usage metering Prior experience working on developer platforms or API products with a strong focus on UX and documentation Originally posted on Himalayas