I have been thinking about a similar concept for a while and you guys did a fantastic job by putting this together.
I see that the models can be hosted and a distributed API can be easily managed in distributed fashion, but have concerns about the distributed faiss/ vector databases. A bit more details would be helpful.
Excellent project.