Qdrant Model Migration
GitHubOfficialFirst committed by anush008Distributed by GitHub
- Skill
- Guidelines
- Data and AI
- MIT
- No issues found
AutoGineer summary
Written by AutoGineer from the skill’s own files, not by the author
This skill provides structured strategies for updating embedding models within Qdrant collections. Because vector spaces are model-specific and named vector fields must be defined at collection creation, migration typically requires creating a new collection. The guide covers zero-downtime alias swapping, side-by-side model testing, and hybrid search transitions, while highlighting common pitfalls such as payload migration requirements and the performance impact of co-locating large vector types.
What it does
- Explains the necessity of creating new collections for model changes
- Outlines zero-downtime migration using collection aliases
- Provides patterns for running multiple models simultaneously for A/B testing
- Details the process for transitioning from dense-only to hybrid search
- Offers techniques for optimizing large-scale re-embedding tasks
- Lists critical mistakes to avoid during the migration lifecycle
When to use it
- When switching embedding models or providers
- When upgrading vector dimensions or changing distance metrics
- When adding sparse vectors to an existing dense collection
- When performing A/B testing between different embedding models
- When production availability must be maintained during a model update
Advantages
- Ensures data integrity by preventing incompatible vector mixing
- Enables seamless transitions using alias swapping
- Provides clear paths for multi-model evaluation
- Offers actionable advice for managing large dataset re-indexing
Usage examples
- “How can I switch my embedding model in Qdrant without downtime?”
- The agent explains the alias swap strategy, detailing how to create a new collection, re-embed data, and atomically switch the alias to maintain production availability.
- “Can I run two different embedding models in the same collection?”
- The agent clarifies that you must define both named vector fields at collection creation and provides steps for backfilling the new model while keeping the old one active.
- “How do I add sparse vectors to my existing dense-only collection?”
- The agent explains that you must recreate the collection with both dense and sparse configurations and provides guidance on testing retrieval quality after the migration.
Install
Download the skill as a ZIP:
https://mp-staging.autogineer.com/agent-skills/github/qdrant-model-migration/downloadUnzip it into the cross-client skills folder of your project:
mkdir -p .agents/skills && unzip qdrant-model-migration.zip -d .agents/skills
Documentation by anush008
What to Do When Changing Embedding Models
Vectors from different models are incompatible. You cannot mix old and new embeddings in the same vector space. You also cannot add new named vector fields to an existing collection. All named vectors must be defined at collection creation time. Both migration strategies below require creating a new collection.
Understand collection aliases before choosing a strategy Collection aliases
Can I Avoid Re-embedding?
Use when: looking for shortcuts before committing to full migration.
You MUST re-embed if: changing model provider (OpenAI to Cohere), changing architecture (CLIP to BGE), incompatible dimension counts across different models, or adding sparse vectors to dense-only collection.
You CAN avoid re-embedding if: using Matryoshka models (use dimensions parameter to output lower-dimensional embeddings, learn linear transformation from sample data, some recall loss, good for 100M+ datasets). Or changing quantization (binary to scalar): Qdrant re-quantizes automatically. Quantization
Need Zero Downtime (Alias Swap)
Use when: production must stay available. Recommended for model replacement at scale.
Create a new collection with the new model's dimensions and distance metric
Re-embed all data into the new collection in the background
Point your application at a collection alias instead of a direct collection name
Atomically swap the alias to the new collection Switch collection
Verify search quality, then delete the old collection
Careful, the alias swap only redirects queries. Payloads must be re-uploaded separately.
Need Both Models Live (Side-by-Side)
Use when: A/B testing models, multi-modal (dense + sparse), or evaluating a new model before committing.
You cannot add a named vector to an existing collection. Create a new collection with both vector fields defined upfront:
Create new collection with old and new named vectors both defined Collection with multiple vectors
Migrate data from old collection, preserving existing vectors in the old named field
Backfill new model embeddings incrementally using
UpdateVectorsUpdate vectorsCompare quality by querying with
using: "old_model"vsusing: "new_model"Swap alias to new collection once satisfied
Co-locating large multi-vectors (especially ColBERT) with dense vectors degrades ALL queries, even those only using dense. At millions of points, users report 13s latency dropping to 2s after removing ColBERT. Put large vectors on disk during side-by-side migration.
If you anticipate future model migrations, define both vector fields upfront at collection creation.
Dense to Hybrid Search Migration
Use when: adding sparse/BM25 vectors to an existing dense-only collection. Most common migration pattern.
You cannot add sparse vectors to an existing dense-only collection. Must recreate:
Create new collection with both dense and sparse vector configs defined
Re-embed all data with both dense and sparse models
Migrate payloads, swap alias
Sparse vectors at chunk level have different TF-IDF characteristics than document level. Test retrieval quality after migration, especially for non-English text without stop-word removal.
Re-embedding Is Too Slow
Use when: dataset is large and re-embedding is the bottleneck.
Use
update_mode: insert(v1.17+) for safe idempotent migration Update modeScroll the old collection with
with_vectors=False, re-embed in batches, upsert into new collectionUpload in parallel batches (64-256 points per request, 2-4 parallel streams) Bulk upload
Disable HNSW during bulk load (set
indexing_threshold_kbvery high, restore after)For Qdrant Cloud inference, switching models is a config change, not a pipeline change Inference docs
For 400GB+ datasets, expect days. For small datasets (<25MB), re-indexing from source is faster than using the migration tool.
What NOT to Do
Assume you can add named vectors to an existing collection (must be defined at creation time)
Delete the old collection before verifying the new one
Forget to update the query embedding model in your application code
Skip payload migration when using alias swap (aliases redirect queries, they do not copy data)
Keep ColBERT vectors co-located with dense vectors during a long migration (I/O cost degrades all queries)
Migrate to hybrid search without testing BM25 quality at chunk level
Files
- ATTRIBUTION.mdAdded by AutoGineer877 B
- LICENSELicence file added by AutoGineer1.0 KiB
- SKILL.md5.4 KiB
Requirements and compatibility
Written for: GitHub Copilot
Works with: Claude Code, Claude apps, OpenAI Codex, GitHub Copilot, Cursor, Gemini CLI, Kiro, OpenCode, Goose, Amp, Roo Code, JetBrains Junie, Factory Droid, Devin (ex-Windsurf), Mistral Vibe, OpenHands, Letta
“Works with” means the tool reads the open Agent Skills format; a skill written for one tool may use features others lack.
Security
No issues found by our static scan· No issues found
A static scan is not a guarantee. Skills are third-party content: review a skill before you let an agent use it.
Attribution and licence
- First committed by
anush008
- Publisher
- GitHub (Official)
- Distributed by
- GitHub
- Source
- github/awesome-copilot · skills/qdrant-model-migration · commit 797337f
- Licence
- MIT License (redistribution allowed)
- LICENSE (added by AutoGineer from LICENSE)
- ATTRIBUTION.md (written by AutoGineer)
- Synced
- Contributors
- anush008
AutoGineer is not affiliated with or endorsed by anush008 or GitHub.
Download ZIP
The ZIP holds the skill’s files, its licence files and an ATTRIBUTION.md. Download qdrant-model-migration.zip