Co-creator of Mantis (https://mantis-llm-gateway.github.io), an open-source, self-hosted Large Language Model (LLM) gateway that provides a single interface for interacting with multiple LLMs. I was particularly involved with building out the end-to-end asynchronous token streaming pipeline, writing and publishing the SDK on PyPi and automating the deployment workflow using Terraform.
Co-creator of Mantis (https://mantis-llm-gateway.github.io/case-study/introduction...), an open-source, self-hosted Large Language Model (LLM) gateway that provides a single interface for interacting with multiple LLMs. I was particularly involved with building out the end-to-end asynchronous token streaming pipeline, writing and publishing the SDK on PyPi and automating the deployment
workflow using Terraform.
I really dislike how politicized it feels, or rather, how multipartisan the HN community is. It's like Hacker News, but the audience is from BlueSky. Thanks, but no thanks.
I think taking a supplement every day is a good idea. I used to suffer from low vitamin D levels constantly until I started taking a daily vitamin D tablet.
Remote: Yes - but am open to both hybrid and in-office too.
Willing to relocate: Yes
Technologies: Python, FastAPI, Node.js, Express, PostgreSQL, MongoDB, REST APIs, JavaScript, TypeScript, React, HTML/CSS, Pytest, AWS, Terraform, Docker, Nginx, DigitalOcean, Linux, Git/GitHub, Postman, PyPI
Résumé/CV: https://www.linkedin.com/in/riz-s/
Email: rizwansyed876@gmail.com
Co-creator of Mantis (https://mantis-llm-gateway.github.io), an open-source, self-hosted Large Language Model (LLM) gateway that provides a single interface for interacting with multiple LLMs. I was particularly involved with building out the end-to-end asynchronous token streaming pipeline, writing and publishing the SDK on PyPi and automating the deployment workflow using Terraform.