Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
102 commits
Select commit Hold shift + click to select a range
9e5ccb5
Renaming and added CLI
ma3oun Jul 29, 2025
e682f26
Fixed index method for existing index
ma3oun Jul 30, 2025
a662e69
Fixed import
ma3oun Jul 30, 2025
5e7e190
Documentation and proper typing. Result is now Pydantic
ma3oun Jul 31, 2025
d61d709
Bug fix
ma3oun Aug 1, 2025
05f46db
Added page image retrieval
ma3oun Aug 1, 2025
0a64610
pointer based retrieval
ma3oun Aug 1, 2025
eca253b
Added support for pointer based retrieval
ma3oun Aug 4, 2025
e2f7b99
Retrieval returns objects instead of encoded images
ma3oun Aug 7, 2025
5cc3351
support for colqwen2.5
ma3oun Aug 8, 2025
0f55027
support for batched indexing
ma3oun Aug 14, 2025
f44e1e7
Handle corrupted and malformed pdfs
ma3oun Sep 24, 2025
c88db57
Readme update and cleanup
ma3oun Sep 24, 2025
e2eae8f
device bug fix
ma3oun Sep 30, 2025
8a9dccc
Windows modification
AdrienThirion Sep 30, 2025
c8f23d1
Merge branch 'main' of https://github.com/FOR-sight-ai/FORetrieval
AdrienThirion Sep 30, 2025
3ae86a7
Update colpali.py
AdrienThirion Sep 30, 2025
0288127
removed debug messages
ma3oun Sep 30, 2025
1c9eef3
Add various extension
AdrienThirion Oct 2, 2025
3013493
Add metadata
AdrienThirion Oct 3, 2025
1d63b27
merged
ma3oun Oct 8, 2025
348b7ac
Fix bad merge
ma3oun Oct 21, 2025
96ee56e
removed deprecated decorator
ma3oun Oct 22, 2025
7b064cb
added missing packages
ma3oun Oct 24, 2025
7658f3e
Added missing method and import
ma3oun Oct 24, 2025
d29d0c8
clean up
ma3oun Oct 24, 2025
4d28865
bug fix and cleanup
ma3oun Oct 24, 2025
591be42
more cleanup
ma3oun Oct 24, 2025
4a81be0
Removed obselete sample files and added new ones
ma3oun Oct 31, 2025
b1db2bf
cleanup and better cross platform handling
ma3oun Oct 31, 2025
f3ec4c4
tests update
ma3oun Oct 31, 2025
c363662
dependencies update
ma3oun Oct 31, 2025
1f92291
Handled faulty pdfs during indexing
ma3oun Jan 23, 2026
775d1de
Ajout de l'affichage des heatmaps
ThomasGoudemantIRT Feb 19, 2026
8b1a3a2
la heatmap est retournée par le retriever pour affichage dans la GUI
ThomasGoudemantIRT Feb 20, 2026
40a91ff
ajout des différentes heatmaps (max/mean + interp near/bilinear). TOD…
ThomasGoudemantIRT Feb 23, 2026
472913b
Ajout du cercle
ThomasGoudemantIRT Mar 2, 2026
0e2b38f
Ajout activer/désactiver la visu heatmap/cercle
ThomasGoudemantIRT Mar 2, 2026
34e979a
Filtrage de certains token de la query inutiles (endoftext, Query, :)
ThomasGoudemantIRT Mar 4, 2026
08759d8
Ajout du mode d'ingestion (docling ou default) dans colpali + Docling…
ThomasGoudemantIRT Mar 4, 2026
5b418f6
Version intégrant l'HybridChunker de docling, avec les modes mask et …
ThomasGoudemantIRT Mar 4, 2026
c616b9c
Docling chunker (masked + fusion des BBOX) incluant les images et les…
ThomasGoudemantIRT Mar 4, 2026
1476cc8
Ajout de l'ingestion docling dans l'indexation. Avec gestion du chunk_id
ThomasGoudemantIRT Mar 4, 2026
4aa9bbc
fix: sort iterdir() for stable metadata alignment between build_metad…
ma3oun Mar 18, 2026
861162c
fix: remove debug print and fix Mistral base_url double-path bug in m…
ma3oun Mar 18, 2026
4f8df4b
feat: add metadata generation tests (no-AI and AI-backed, all providers)
ma3oun Mar 18, 2026
2fe87af
merge: metadata_test into main (task_3)
ma3oun Mar 18, 2026
03eaf8e
README.md clean-up
ma3oun Mar 18, 2026
fcb65f4
refactoring colpali + qdrant ingestion
ThomasGoudemantIRT Mar 17, 2026
151dba0
feat: add regex matching to MetadataFilter, fix empty-filter crash, a…
ma3oun Mar 20, 2026
91cc2d5
merge: integrate origin/qdrant into metadata_with_qdrant
ma3oun Mar 24, 2026
f09b69d
docs: rewrite README to reflect current capabilities
ma3oun Mar 24, 2026
e4b7516
removed server stuff (will be implemented later
ma3oun Mar 25, 2026
b3b51be
update and cleanup
ma3oun Mar 25, 2026
272f890
merge: metadata_with_qdrant into main (tasks 3-5)
ma3oun Apr 15, 2026
30af9e4
feat: add remote vLLM embedding server + ColQwen3.5 support
ma3oun Apr 15, 2026
369da6c
fix: adapt client and manager for vLLM 0.19.0 API changes
ma3oun Apr 17, 2026
7e007bc
docs: update task_0 report with vLLM 0.19.0 findings and live test re…
ma3oun Apr 17, 2026
f6ad007
feat: merged embedding server — httpx, auth, SSL, quantization, model…
ma3oun Apr 21, 2026
11370dc
merge: embedding_server_merged into main
ma3oun Apr 21, 2026
6dd0cc9
cleanup
ma3oun Apr 21, 2026
d57e90a
docs: add remote embedding server and quantization sections to README
ma3oun Apr 21, 2026
80853d2
adding a general description of all the file present in the index
ThomasGoudemantIRT Apr 22, 2026
6c5c7a0
fix: metadata handling (self.doc_id_to_metadata) while building index
ThomasGoudemantIRT Apr 22, 2026
42a3760
fix: ajout index description en mode qdrant
ThomasGoudemantIRT Apr 22, 2026
edaffc3
Merge branch 'feature/index_global_description' + "agentique"
ThomasGoudemantIRT Apr 22, 2026
7d872f2
Removal uv.lock et mise à jour de pyproject
ThomasGoudemantIRT Apr 23, 2026
b123dab
fix: specify device map to use the first GPU for model loading
ThomasGoudemantIRT Apr 24, 2026
6779c8a
feat: generic VectorStore interface — local, Qdrant, Milvus backends
May 18, 2026
2b7cba1
merge: generic VectorStore interface (local/Qdrant/Milvus) — task 3
May 18, 2026
7dc55e8
feat: remote vector-DB server (task 4)
May 18, 2026
add6d30
fix: remove hardcoded hostnames; clarify host vs container port split
May 18, 2026
d692129
Merge feature/remote-db-server into main (task 4)
May 18, 2026
008c7c4
chore: prepare 2026.5.0 release (README, version, release workflow)
May 21, 2026
d4c750a
ci: extract pyproject version via grep/sed (tomllib needs py3.11+)
May 21, 2026
e54f5a5
ci: only attach .whl and .tar.gz to releases (exclude dist/.gitignore)
May 21, 2026
feb68b2
ci: modernise release workflow action versions (Node.js 24)
May 21, 2026
bb5364c
feat: admin endpoints, /health device info, on_progress callback
May 25, 2026
4b4e8a0
feat: redeploy() helpers + on_line progress streaming on remote managers
May 25, 2026
c250a83
fix(ssh): honour ~/.ssh/config in remote deployment managers
May 25, 2026
677d7b8
fix(deploy): resolve remote home via SFTP for build context + metadat…
May 25, 2026
d761277
fix(deploy): run vector-DB container as the SSH user (--user uid:gid)
May 25, 2026
c42f9f6
fix: lazy-import foretrieval.__init__ to unblock the vector-DB server
May 25, 2026
2109fd6
fix(admin): use index.json as server-side index sentinel in _is_index…
May 25, 2026
121062d
refactor: remove EmbeddingServerManager.device_info()
Jun 1, 2026
4e58028
feat(vector_db_server): store index bookkeeping server-side
Jun 4, 2026
30af9e3
fix(colpali): skip local index-dir guard in remote bookkeeping mode
Jun 5, 2026
7513371
chore: bump version to 2026.6.0
Jun 5, 2026
11a81ad
Merge task 8: server-side index bookkeeping (v2026.6.0)
Jun 5, 2026
8e5a939
feat(indexing): recursive directory traversal via rglob
Jun 9, 2026
d45f83e
fix(tests): restore sys.modules after each lazy-import test
Jun 9, 2026
48197a9
Merge task 9: recursive indexing + test cleanup (v2026.6.1)
Jun 9, 2026
97412a6
chore: bump version to 2026.6.1
Jun 9, 2026
29e4ec3
fix: recursive metadata alignment, index cleanup, no-metadata load, c…
Jun 17, 2026
0a8fffb
chore: bump version to 2026.6.2
Jun 17, 2026
eb137dc
Merge task 10: bugfixes — recursive metadata, index cleanup, no-metad…
Jun 17, 2026
753326b
feat: align circle center with heatmap by applying patch growth befor…
Jun 24, 2026
f286d9c
chore: bump version to 2026.6.3
Jun 24, 2026
d8553ee
Merge task 11: circle center alignment with heatmap (v2026.6.3)
Jun 24, 2026
321f17a
[Bug] Forced float conversion for score
Jun 26, 2026
3f14957
fix pydantic_ai version
Jun 26, 2026
e6a9340
Use explicit CUDA device for ColPali model loading
NLP-traveller Sep 10, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
50 changes: 50 additions & 0 deletions .github/workflows/release.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,50 @@
name: Release

on:
push:
tags:
- 'v*'

permissions:
contents: write

jobs:
release:
runs-on: ubuntu-latest
steps:
- name: Checkout
uses: actions/checkout@v5

- name: Install uv
uses: astral-sh/setup-uv@v8.1.0
with:
version: "latest"

- name: Verify tag matches pyproject version
run: |
set -euo pipefail
TAG="${GITHUB_REF_NAME#v}"
PYV=$(grep -E '^version[[:space:]]*=' pyproject.toml | head -n1 | sed -E 's/^version[[:space:]]*=[[:space:]]*"([^"]+)".*/\1/')
echo "Tag version: $TAG"
echo "pyproject version: $PYV"
if [ "$TAG" != "$PYV" ]; then
echo "::error::Tag v$TAG does not match pyproject.toml version $PYV"
exit 1
fi

- name: Build sdist and wheel
run: uv build

- name: List build artefacts
run: ls -lah dist/

- name: Create GitHub Release
uses: softprops/action-gh-release@v3
with:
files: |
dist/*.whl
dist/*.tar.gz
generate_release_notes: true
fail_on_unmatched_files: true
draft: false
prerelease: false
Loading