Feature/add project management with git#524
Draft
Edwardvaneechoud wants to merge 31 commits into
Draft
Conversation
✅ Deploy Preview for flowfile-wasm canceled.
|
![github-advanced-security[bot]](https://avatars.githubusercontent.com/in/57789?s=60&v=4){kind=small}
Contributor
There was a problem hiding this comment.
CodeQL found more than 20 potential problems in the proposed changes. Check the Files changed tab for more details.
…ed in path expression' Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
| base = project_root_base(owner_id) | ||
| if base is None: | ||
| validated = validate_path_under_cwd(folder_path) | ||
| return Path(validated).expanduser().resolve() |
…Edwardvaneechoud/Flowfile into feature/add-project-management-with-git
…ed in path expression' Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
| root = (base / candidate).resolve() | ||
| else: | ||
| validated_candidate = validate_path_under_cwd(candidate) | ||
| root = Path(validated_candidate).expanduser().resolve() |
…Edwardvaneechoud/Flowfile into feature/add-project-management-with-git
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This pull request introduces the Git-enabled Flowfile Project feature, providing a robust backend and CLI foundation for versioning pipeline environments using deterministic, secret-free YAML synced to a git repository. It includes new project lifecycle commands, database migrations for project and visualization/dashboard tracking, and integrates project synchronization hooks for data artifacts. The frontend implementation is not yet included, but the PR provides detailed documentation and API contracts for future frontend work.
Major features and changes:
Git-Enabled Project Versioning (Backend & CLI)
PROJECT_VERSIONING_HANDOFF.md) outlining the product model, backend/CLI features, REST API contract, frontend handoff, and future work.flowfile project {init,open,save}) inflowfile/__main__.pyto initialize, open, and save project versions, enabling headless usage and testing of the git-backed workflow. [1] [2] [3]Database Migrations for Project and Visualization Tracking
022_workspace_projects.pyto create theworkspace_projectstable, mapping a local install to a git-friendly project folder and tracking its state.023_visualization_dashboard_uuids.pyto introduce stable UUID columns for visualizations and dashboards, ensuring portable identity for git-backed projections.024_project_track_data_artifacts.pyto add a per-projecttrack_data_artifactstoggle, allowing projects to opt out of versioning catalog tables and global artifacts.Project Synchronization Hooks for Data Artifacts
artifacts/service.pyto ensure artifact finalize and delete operations trigger project sync, updating the project'smodels.yamlas needed. [1] [2] [3] [4] [5]References:
[1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12]