🚀 Best configuration for YOUR system
Given your pipeline (Redis + Prometheus + scraping):
âś… Use this model:
SentenceTransformer('all-MiniLM-L6-v2')
Why:
small (~90MB)
fast on CPU
good semantic quality
⚙️ Micro-optimization (do this)
Initialize model once globally, not per article:
model = SentenceTransformer('all-MiniLM-L6-v2')
NOT inside loops.
🧠Smart usage pattern (important)
Don’t e...