A unified research framework for reproducible experiments on multilayer network link prediction using Community Geometry Transfer.
CLC-NMF is a lightweight, training-free framework for improving intra-layer link prediction in heterogeneous multilayer networks.
Instead of transferring node embeddings or requiring node correspondence across layers, CLC-NMF transfers community geometry, represented by the Gram Matrix of Non-negative Matrix Factorization (NMF) latent factors.
The framework introduces:
- Reliability-weighted knowledge transfer
- Community geometry alignment
- Validation-gated transfer to minimize negative transfer
- A reproducible experimental pipeline for benchmarking multilayer link prediction methods
This project aims to answer the following research questions:
- Can cross-layer community geometry improve link prediction?
- Which network layers benefit most from knowledge transfer?
- Can reconstruction reliability identify trustworthy source layers?
- How can negative transfer be reduced?
- How robust is community geometry transfer across different datasets?
CLC-NMF/
│
├── datasets/ # Benchmark multilayer datasets
│
├── methods/ # Link prediction algorithms
│ ├── standard_nmf.py
│ ├── clc_nmf.py
│ ├── common_neighbors.py
│ ├── adamic_adar.py
│ ├── jaccard.py
│ ├── node2vec.py
│ └── deepwalk.py
│
├── experiments/
│ ├── configs/
│ ├── run_experiment.py
│ ├── evaluator.py
│ ├── statistics.py
│ ├── logger.py
│ └── plots.py
│
├── outputs/
│ ├── raw/
│ ├── processed/
│ ├── figures/
│ └── tables/
│
├── paper/
│
└── README.md
The entire project is built around a single configurable experiment pipeline.
Every experiment is defined by:
- Dataset
- Method
- Hyperparameters
- Random Seed
- Evaluation Metrics
The pipeline automatically:
- Loads datasets
- Performs train/validation/test splitting
- Trains the selected method
- Generates link prediction scores
- Computes evaluation metrics
- Performs statistical analysis
- Logs results
- Generates publication-ready figures and tables
- Standard NMF
- CLC-NMF
- Common Neighbours
- Adamic-Adar
- Jaccard Coefficient
- Node2Vec
- DeepWalk
- Variational Graph Autoencoder (VGAE)
- Graph Autoencoder (GAE)
- Additional graph embedding baselines
Current benchmark datasets include:
- London Transport
- Drosophila
- C. elegans
- CKM Physicians
- Kapferer Tailor Shop
- Vickers Classroom Network
The framework is designed to allow easy integration of additional multilayer datasets.
- ROC-AUC
- Average Precision (AP)
- Precision@K
- Recall@K
- F1 Score
- PR-AUC
- Runtime
- Memory Usage
The framework supports reproducible statistical evaluation.
Current analyses:
- Mean
- Standard Deviation
- 95% Confidence Interval
- Wilcoxon Signed-Rank Test
Planned analyses:
- Cohen's d
- Cliff's Delta
- Bootstrap Confidence Intervals
- Implement stronger baselines
- Add additional evaluation metrics
- Statistical significance testing
- Benchmark comparison
- Hyperparameter sensitivity
- Runtime scaling
- Memory profiling
- Reliability analysis
- Correlation studies
- Remove reliability weighting
- Remove validation gate
- Remove Gram normalization
- Remove community alignment
- Random transfer
- Density-based weighting
- Equal weighting
- Adaptive coupling coefficient
- Similarity-aware transfer
- Improved reliability estimation
- Structural compatibility modeling
Every experiment is tracked using a unique identifier.
| ID | Research Question | Status |
|---|---|---|
| E1 | Baseline comparison | Planned |
| E2 | Alpha sensitivity | Planned |
| E3 | Latent dimension sensitivity | Planned |
| E4 | Runtime analysis | Planned |
| E5 | Reliability correlation | Planned |
| E6 | Ablation study | Planned |
| E7 | Modern baseline comparison | Planned |
Every experiment automatically records:
- Dataset
- Method
- Hyperparameters
- Random Seed
- Metrics
- Runtime
- Memory Usage
This enables complete regeneration of every figure, table, and statistical result presented in the accompanying paper.
The project is currently focused on:
- Building a unified experimental pipeline
- Strengthening empirical evaluation
- Adding modern baseline methods
- Improving statistical validation
- Extending ablation studies
- Enhancing reproducibility
Contributions are welcome.
If you would like to improve the framework, implement additional methods, or add new datasets, feel free to open an issue or submit a pull request.
This project is intended for academic and research purposes.
A formal open-source license will be added upon public release.
If you use this repository in your research, please cite the accompanying publication (citation will be added after publication).