mathiasandClaude Opus 4.8 a961a3c064 fix(vectorstore): hard-split oversized heading-less chunks ...

A doc with no headings and no blank-line paragraphs (JSON-lines, e.g.
wiki/telos/decisions/human-intent-column.md) survived both chunk passes whole
and was sent to nomic-embed over its context window → 'input length exceeds
the context length' (400, the steady embed errors=1). Add a final hard-split
pass (line then UTF-8 rune boundaries) so no chunk exceeds maxBytes. TDD.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

2026-06-17 00:19:42 +02:00

..

chunk_test.go

fix(vectorstore): hard-split oversized heading-less chunks

2026-06-17 00:19:42 +02:00

chunk.go

fix(vectorstore): hard-split oversized heading-less chunks

2026-06-17 00:19:42 +02:00

pg_test.go

feat(vectorstore): re-embed on file mtime > store updated_at (#23)

2026-05-20 09:50:45 +02:00

pg.go

feat(vectorstore): re-embed on file mtime > store updated_at (#23)

2026-05-20 09:50:45 +02:00

sync_test.go

feat(vectorstore): re-embed on file mtime > store updated_at (#23)

2026-05-20 09:50:45 +02:00

sync.go

feat(vectorstore): re-embed on file mtime > store updated_at (#23)

2026-05-20 09:50:45 +02:00