From 891fa1fd8050c01a62137c30acf342fa1b49d3f3 Mon Sep 17 00:00:00 2001 From: Neil Lawrence Date: Sun, 25 Oct 2026 07:17:10 +0000 Subject: [PATCH 1/2] docs: Ready backlog task to sync dataset URLs with pods (#1214). --- .../2026-10-11_example-datasets-links.md | 16 +++- .../2026-10-25_sync-dataset-resource-urls.md | 83 +++++++++++++++++++ backlog/index.md | 4 +- 3 files changed, 98 insertions(+), 5 deletions(-) create mode 100644 backlog/documentation/2026-10-25_sync-dataset-resource-urls.md diff --git a/backlog/documentation/2026-10-11_example-datasets-links.md b/backlog/documentation/2026-10-11_example-datasets-links.md index 6112ecb7f..27a2f20db 100644 --- a/backlog/documentation/2026-10-11_example-datasets-links.md +++ b/backlog/documentation/2026-10-11_example-datasets-links.md @@ -1,10 +1,10 @@ --- id: 2026-10-11_example-datasets-links title: Fix or soft-fail example dataset downloads -status: Proposed +status: Superseded priority: Low created: '2026-10-11' -last_updated: '2026-10-11' +last_updated: '2026-10-25' category: documentation related_cips: - '0007' @@ -32,3 +32,15 @@ example datasets, `#671` Olympic Sprints link. - Issue: #1214 - CIP: 0007 +- Superseded by: `2026-10-25_sync-dataset-resource-urls` + +## Progress Updates + +### 2026-10-11 + +Task created Proposed as the CIP-0007 tracker stub for #1214. + +### 2026-10-25 + +Superseded. The remaining work is a JSON URL sync against pods 0.1.19 / +`datasets_mirror`, captured in `2026-10-25_sync-dataset-resource-urls`. diff --git a/backlog/documentation/2026-10-25_sync-dataset-resource-urls.md b/backlog/documentation/2026-10-25_sync-dataset-resource-urls.md new file mode 100644 index 000000000..ffad21b15 --- /dev/null +++ b/backlog/documentation/2026-10-25_sync-dataset-resource-urls.md @@ -0,0 +1,83 @@ +--- +id: 2026-10-25_sync-dataset-resource-urls +title: Sync GPy dataset resource URLs with pods / datasets_mirror +status: Ready +priority: Low +created: "2026-10-25" +last_updated: "2026-10-25" +category: documentation +related_cips: +- "0007" +owner: Neil Lawrence +dependencies: [] +tags: +- backlog +- datasets +- examples +- urls +--- + +# Task: Sync dataset resource URLs with pods + +## Description + +Close [#1214](https://github.com/SheffieldML/GPy/issues/1214) by updating +`GPy/util/data_resources.json` to the URLs pods 0.1.19 already uses. + +GPy **examples** load data through `pods.datasets`, not `GPy.util.datasets`. +pods already has working hosts for both child tickets (`#671` Olympic / +Rogers–Girolami, `#841` ACCAD `run1TXT.ZIP`). GPy's JSON copy is still on +Dropbox, `accad.osu.edu`, and `staffwww.dcs.shef.ac.uk/.../dataset_mirror/` +(403; about 18 other GPy entries still use that host). + +Live checks (2026-10-24), recorded on #1214: + +- Dropbox Olympic tarball returns HTML, not a gzip. +- Glasgow `https://www.dcs.gla.ac.uk/~srogers/firstcourseml/firstcoursemldata.tar.gz` + is a live gzip (~10.7 MB). +- `accad.osu.edu/research/mocap/data/run1TXT.ZIP` is 404. +- `https://github.com/lawrennd/datasets_mirror` serves `osu_accad/run1TXT.ZIP` + and `stick/connections.txt` (both 200). + +Do this on `main` after CIP-0008 rename work, not on the release-pipeline +branch. + +## Acceptance Criteria + +- [ ] `rogers_girolami_data` URL is Glasgow (not Dropbox) +- [ ] `osu_accad` / `osu_run1` URLs are `datasets_mirror` (not ACCAD / staffwww) +- [ ] Remaining `staffwww.dcs.shef.ac.uk/.../dataset_mirror/` entries in + `GPy/util/data_resources.json` point at + `https://github.com/lawrennd/datasets_mirror/raw/main/...` to match pods +- [ ] Spot-check the two #1214 downloads (HEAD/GET, real gzip/zip, not HTML) +- [ ] Close #1214 + +## Implementation Notes + +Copy URL fields from +[pods `data_resources.json`](https://github.com/lawrennd/ods/blob/main/pods/data_resources.json) +for the overlapping keys. Keep GPy's file-name lists; only the hosts change. + +Optional in the same PR: bump the dev extra `pods>=0.1.14` to `>=0.1.19` so +example runs pick up the pods-side fix. Soft-fail-when-missing is not needed +if the links work. + +Tests that mock `download_data` will not notice. `GPy.util.datasets` is the +consumer of this JSON (`scripts/repro_param_array_save_load.py`, one example +fallback, benchmarks). + +## Related + +- Issue: [#1214](https://github.com/SheffieldML/GPy/issues/1214) +- Child issues: #671, #841 (already closed into the tracker) +- CIP: 0007 +- Supersedes: `2026-10-11_example-datasets-links` +- pods: https://github.com/lawrennd/ods +- Mirror: https://github.com/lawrennd/datasets_mirror + +## Progress Updates + +### 2026-10-25 + +Task created Ready from the #1214 URL survey. GitHub default branch is already +`main`; implement there, not on `cip0008-rename-main`. diff --git a/backlog/index.md b/backlog/index.md index 2e3e9e8a7..e538850b7 100644 --- a/backlog/index.md +++ b/backlog/index.md @@ -6,7 +6,7 @@ This file provides an overview of all current backlog items organized by categor ### Ready -*No tasks currently ready.* +- [Sync GPy dataset resource URLs with pods / datasets_mirror](documentation/2026-10-25_sync-dataset-resource-urls.md) ### In Progress @@ -16,8 +16,6 @@ This file provides an overview of all current backlog items organized by categor ### Proposed -- [Fix or soft-fail example dataset downloads](documentation/2026-10-11_example-datasets-links.md) - - [Optional demos for the October 2026 maintenance batch](documentation/2026-10-07_october-2026-demos.md) From b34740f8f23852d84161205ba995423a3e2c63bd Mon Sep 17 00:00:00 2001 From: Neil Lawrence Date: Sun, 25 Oct 2026 07:21:41 +0000 Subject: [PATCH 2/2] Apply batched suggestions from code review Co-authored-by: Neil Lawrence --- backlog/documentation/2026-10-25_sync-dataset-resource-urls.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/backlog/documentation/2026-10-25_sync-dataset-resource-urls.md b/backlog/documentation/2026-10-25_sync-dataset-resource-urls.md index ffad21b15..06ce76f3b 100644 --- a/backlog/documentation/2026-10-25_sync-dataset-resource-urls.md +++ b/backlog/documentation/2026-10-25_sync-dataset-resource-urls.md @@ -54,7 +54,7 @@ branch. ## Implementation Notes -Copy URL fields from +Copy URL fields (consider automatic copy too) from [pods `data_resources.json`](https://github.com/lawrennd/ods/blob/main/pods/data_resources.json) for the overlapping keys. Keep GPy's file-name lists; only the hosts change.