Job Description
Overview
We are seeking a skilled AI Gateway Engineer to join our team. The ideal candidate will have hands-on experience with AI or API gateways, a strong background in backend development, and expertise in deploying and optimizing AI/ML models in a production environment. You will be instrumental in building and scaling our AI infrastructure within an enterprise-grade setting.
Key Responsibilities:
- Design and manage AI/API gateways like Kong, Mosaic, or Portkey.
- Develop and maintain backend services, primarily using Go , with Python as a valuable secondary skill.
- Optimize and productize AI/ML models for production use, ensuring performance, scalability, and reliability.
- Leverage AWS to build and manage our cloud infrastructure.
- Implement and manage observability tools, including OpenTelemetry (OTel) , Grafana , and Prometheus , to monitor system health and performance. ...