Design a vision-native document RAG using ColPali / ColQwen2 / VisRAG, with storage estimate and generator-pick. Use when you need help with vision rag designer.
Installs into .claude/skills of the current project.
Are you the author of Vision Rag Designer?
Add the live security badge to your README. It updates with every re-scan.
[](https://www.skillsdirectory.com/skills/anubhavg-icpl-vision-rag-designer)
---
name: vision-rag-designer
description: Design a vision-native document RAG using ColPali / ColQwen2 / VisRAG, with storage estimate and generator-pick. Use when you need help with vision rag designer.
license: CC-BY-NC-SA-4.0
phase: 12
lesson: 23
metadata:
version: 1.0.0
tags: [colpali, colqwen2, visrag, late-interaction, vidore]
---
Given a document RAG project (corpus size, query latency target, storage budget, per-query cost), emit a vision-native RAG config.
Produce:
1. Retriever pick. ColPali (PaliGemma base), ColQwen2 (Qwen2-VL base, better quality), ColSmol (1B for edge), or VisRAG (bi-encoder, cheaper storage).
2. Storage estimate. N_docs * N_p_per_doc * D * 4 bytes raw; divide by 8 for PQ.
3. Latency estimate.
- Retrieval SLA: ~10ms query embed + top-k retrieval (MaxSim or ANN), index-size dependent.
- Full-answer SLA: retrieval latency + 200-500ms generator (model and hardware dependent).
4. Generator pick. Qwen2.5-VL-72B for open, Claude Opus 4.7 for frontier.
5. Compression plan. PQ / OPQ ratio target 8-16x; HNSW index for fast ANN.
6. Migration path from text-RAG. How to A/B, when to fully cutover.
Hard rejects:
- Using ColPali without PQ compression on corpora >10k pages. Storage explodes.
- Claiming bi-encoder retrieval matches ColBERT MaxSim on document recall. It does not on ViDoRe.
- Recommending text-RAG for charts + tables workloads. Text-RAG loses most of the signal.
Refusal rules:
- If corpus is pure-text (wiki, chat logs), refuse vision-native RAG and recommend standard text-RAG.
- If retrieval SLA <100ms, prefer VisRAG (bi-encoder) over ColPali MaxSim.
- If full-answer SLA <100ms, refuse generative RAG entirely and recommend retrieval-only UX or cached answers.
- If storage budget is <1 GB and corpus is >100k pages, refuse full-fidelity ColPali; propose aggressive PQ or VisRAG.
Output: one-page RAG design with retriever pick, storage estimate, latency, generator, compression, migration. End with arXiv 2407.01449 (ColPali), 2410.10594 (VisRAG).
