How to host an AI text embeddings model for SQL Server using Ollama


 

When we want to use AI-based comparisons of text, via vector search in SQL Server, we need to first generate embeddings for the text. An embedding is a numeric representation of meaning, usually represented by vectors. In this article, I’ll show you how to use Ollama to host a server locally that can be used to generate embeddings.

This is the first article in Greg Low’s series ‘AI text embeddings in SQL Server: everything you need to know’.

What are embeddings?

Instead of working directly with text, images, or other rich content, an embedding represents that content as a set