Multi-Tenancy
A software architecture where a single instance of a model or database serves multiple distinct customers while securely isolating their data and usage.
Think of It Like This
Like an apartment building where everyone shares the same plumbing and foundation, but each family has a secure, private room.
In AI, multi-tenancy is critical for SaaS efficiency. It allows providers to serve a large language model to thousands of users simultaneously using continuous batching, without spinning up separate GPUs for each user. Robust access controls and prompt isolation are mandatory to prevent accidental data leakage between tenants.