GPU Acceleration
As of Typesense Server v0.25.0, Typesense can generate embeddings natively, with data in your JSON documents, using any of the built-in ML models listed here (or using OpenAI API or PaLM API).
When you use one of the built-in ML models, you can improve performance of the embedding generation significantly, during indexing and at search time (for eg, when doing semantic / hybrid search) by having Typesense utilize a GPU.
GPU Acceleration is available in the following RAM / vCPU configuration in select regions:
Region | Memory | vCPUs |
Bahrain | 16 GB | 4 vCPUs |
Bahrain | 32 GB | 8 vCPUs |
Bahrain | 64 GB | 16 vCPUs |
Bahrain | 128 GB | 32 vCPUs |
Bahrain | 192 GB | 48 vCPUs |
Bahrain | 256 GB | 64 vCPUs |
Bahrain | 384 GB | 96 vCPUs |
Canada | 16 GB | 4 vCPUs |
Canada | 32 GB | 8 vCPUs |
Canada | 64 GB | 16 vCPUs |
Canada | 128 GB | 32 vCPUs |
Canada | 192 GB | 48 vCPUs |
Canada | 256 GB | 64 vCPUs |
Canada | 384 GB | 96 vCPUs |
Cape Town | 16 GB | 4 vCPUs |
Cape Town | 32 GB | 8 vCPUs |
Cape Town | 64 GB | 16 vCPUs |
Cape Town | 128 GB | 32 vCPUs |
Cape Town | 192 GB | 48 vCPUs |
Cape Town | 256 GB | 64 vCPUs |
Cape Town | 384 GB | 96 vCPUs |
Frankfurt | 8 GB | 4 vCPUs |
Frankfurt | 16 GB | 4 vCPUs |
Frankfurt | 16 GB | 8 vCPUs |
Frankfurt | 32 GB | 8 vCPUs |
Frankfurt | 32 GB | 16 vCPUs |
Frankfurt | 64 GB | 16 vCPUs |
Frankfurt | 64 GB | 32 vCPUs |
Frankfurt | 128 GB | 32 vCPUs |
Frankfurt | 128 GB | 64 vCPUs |
Frankfurt | 192 GB | 48 vCPUs |
Frankfurt | 256 GB | 64 vCPUs |
Frankfurt | 384 GB | 96 vCPUs |
Ireland | 16 GB | 4 vCPUs |
Ireland | 32 GB | 8 vCPUs |
Ireland | 64 GB | 16 vCPUs |
Ireland | 128 GB | 32 vCPUs |
Ireland | 192 GB | 48 vCPUs |
Ireland | 256 GB | 64 vCPUs |
Ireland | 384 GB | 96 vCPUs |
London | 16 GB | 4 vCPUs |
London | 32 GB | 8 vCPUs |
London | 64 GB | 16 vCPUs |
London | 128 GB | 32 vCPUs |
London | 192 GB | 48 vCPUs |
London | 256 GB | 64 vCPUs |
London | 384 GB | 96 vCPUs |
Milan | 16 GB | 4 vCPUs |
Milan | 32 GB | 8 vCPUs |
Milan | 64 GB | 16 vCPUs |
Milan | 128 GB | 32 vCPUs |
Milan | 192 GB | 48 vCPUs |
Milan | 256 GB | 64 vCPUs |
Milan | 384 GB | 96 vCPUs |
Mumbai | 16 GB | 4 vCPUs |
Mumbai | 32 GB | 8 vCPUs |
Mumbai | 64 GB | 16 vCPUs |
Mumbai | 128 GB | 32 vCPUs |
Mumbai | 192 GB | 48 vCPUs |
Mumbai | 256 GB | 64 vCPUs |
Mumbai | 384 GB | 96 vCPUs |
N California | 16 GB | 4 vCPUs |
N California | 32 GB | 8 vCPUs |
N California | 64 GB | 16 vCPUs |
N California | 128 GB | 32 vCPUs |
N California | 192 GB | 48 vCPUs |
N California | 256 GB | 64 vCPUs |
N California | 384 GB | 96 vCPUs |
N Virginia | 8 GB | 4 vCPUs |
N Virginia | 16 GB | 4 vCPUs |
N Virginia | 16 GB | 8 vCPUs |
N Virginia | 32 GB | 8 vCPUs |
N Virginia | 32 GB | 16 vCPUs |
N Virginia | 64 GB | 16 vCPUs |
N Virginia | 64 GB | 32 vCPUs |
N Virginia | 128 GB | 32 vCPUs |
N Virginia | 128 GB | 64 vCPUs |
N Virginia | 192 GB | 48 vCPUs |
N Virginia | 256 GB | 64 vCPUs |
N Virginia | 384 GB | 96 vCPUs |
Ohio | 16 GB | 4 vCPUs |
Ohio | 32 GB | 8 vCPUs |
Ohio | 64 GB | 16 vCPUs |
Ohio | 128 GB | 32 vCPUs |
Ohio | 192 GB | 48 vCPUs |
Ohio | 256 GB | 64 vCPUs |
Ohio | 384 GB | 96 vCPUs |
Oregon | 8 GB | 4 vCPUs |
Oregon | 16 GB | 4 vCPUs |
Oregon | 16 GB | 8 vCPUs |
Oregon | 32 GB | 8 vCPUs |
Oregon | 32 GB | 16 vCPUs |
Oregon | 64 GB | 16 vCPUs |
Oregon | 64 GB | 32 vCPUs |
Oregon | 128 GB | 32 vCPUs |
Oregon | 128 GB | 64 vCPUs |
Oregon | 192 GB | 48 vCPUs |
Oregon | 256 GB | 64 vCPUs |
Oregon | 384 GB | 96 vCPUs |
Osaka | 16 GB | 4 vCPUs |
Osaka | 32 GB | 8 vCPUs |
Osaka | 64 GB | 16 vCPUs |
Osaka | 128 GB | 32 vCPUs |
Osaka | 192 GB | 48 vCPUs |
Osaka | 256 GB | 64 vCPUs |
Osaka | 384 GB | 96 vCPUs |
Paris | 16 GB | 4 vCPUs |
Paris | 32 GB | 8 vCPUs |
Paris | 64 GB | 16 vCPUs |
Paris | 128 GB | 32 vCPUs |
Paris | 192 GB | 48 vCPUs |
Paris | 256 GB | 64 vCPUs |
Paris | 384 GB | 96 vCPUs |
Sao Paulo | 16 GB | 4 vCPUs |
Sao Paulo | 32 GB | 8 vCPUs |
Sao Paulo | 64 GB | 16 vCPUs |
Sao Paulo | 128 GB | 32 vCPUs |
Sao Paulo | 192 GB | 48 vCPUs |
Sao Paulo | 256 GB | 64 vCPUs |
Sao Paulo | 384 GB | 96 vCPUs |
Seoul | 8 GB | 4 vCPUs |
Seoul | 16 GB | 4 vCPUs |
Seoul | 16 GB | 8 vCPUs |
Seoul | 32 GB | 8 vCPUs |
Seoul | 32 GB | 16 vCPUs |
Seoul | 64 GB | 16 vCPUs |
Seoul | 64 GB | 32 vCPUs |
Seoul | 128 GB | 32 vCPUs |
Seoul | 128 GB | 64 vCPUs |
Seoul | 192 GB | 48 vCPUs |
Seoul | 256 GB | 64 vCPUs |
Seoul | 384 GB | 96 vCPUs |
Singapore | 8 GB | 4 vCPUs |
Singapore | 16 GB | 4 vCPUs |
Singapore | 16 GB | 8 vCPUs |
Singapore | 32 GB | 8 vCPUs |
Singapore | 32 GB | 16 vCPUs |
Singapore | 64 GB | 16 vCPUs |
Singapore | 64 GB | 32 vCPUs |
Singapore | 128 GB | 32 vCPUs |
Singapore | 128 GB | 64 vCPUs |
Singapore | 192 GB | 48 vCPUs |
Singapore | 256 GB | 64 vCPUs |
Singapore | 384 GB | 96 vCPUs |
Spain | 8 GB | 4 vCPUs |
Spain | 16 GB | 8 vCPUs |
Spain | 32 GB | 16 vCPUs |
Spain | 64 GB | 32 vCPUs |
Spain | 128 GB | 64 vCPUs |
Stockholm | 16 GB | 4 vCPUs |
Stockholm | 32 GB | 8 vCPUs |
Stockholm | 64 GB | 16 vCPUs |
Stockholm | 128 GB | 32 vCPUs |
Stockholm | 192 GB | 48 vCPUs |
Stockholm | 256 GB | 64 vCPUs |
Stockholm | 384 GB | 96 vCPUs |
Sydney | 16 GB | 4 vCPUs |
Sydney | 32 GB | 8 vCPUs |
Sydney | 64 GB | 16 vCPUs |
Sydney | 128 GB | 32 vCPUs |
Sydney | 192 GB | 48 vCPUs |
Sydney | 256 GB | 64 vCPUs |
Sydney | 384 GB | 96 vCPUs |
Tokyo | 8 GB | 4 vCPUs |
Tokyo | 16 GB | 4 vCPUs |
Tokyo | 16 GB | 8 vCPUs |
Tokyo | 32 GB | 8 vCPUs |
Tokyo | 32 GB | 16 vCPUs |
Tokyo | 64 GB | 16 vCPUs |
Tokyo | 64 GB | 32 vCPUs |
Tokyo | 128 GB | 32 vCPUs |
Tokyo | 128 GB | 64 vCPUs |
Tokyo | 192 GB | 48 vCPUs |
Tokyo | 256 GB | 64 vCPUs |
Tokyo | 384 GB | 96 vCPUs |