kitab-metadata-automation

KITAB metadata automation

Shell Script

Delete any local changes made to the corpus (just in case) ls | xargs -P10 -I{} git -C {} reset --hard
Fetch all the repos to make sure that metadata is generated based on the lastest version of the corpus ls | xargs -P10 -I{} git -C {} fetch origin
Generate metadata python script python3 generate-OpenITI-metadata.py
Push the file generated (output) to repo (e.g. maintenance)

git commit -a -m 'output generated' git push

* 4 * * 0 ./run.sh >> output.log

Name		Name	Last commit message	Last commit date
output		output
releases		releases
test		test
utility		utility
.gitignore		.gitignore
.run_wNoor.sh.swp		.run_wNoor.sh.swp
README.md		README.md
RELEASE_2021_w_Noorlib_log.txt		RELEASE_2021_w_Noorlib_log.txt
RELEASE_2021_wo_Noorlib_log.txt		RELEASE_2021_wo_Noorlib_log.txt
ar_char_count.py		ar_char_count.py
check_yml.py		check_yml.py
check_yml_log.txt		check_yml_log.txt
generate-metadata.py		generate-metadata.py
generate-metadata_old.py		generate-metadata_old.py
kitab_metadata_for_DLME_latest_release.tsv		kitab_metadata_for_DLME_latest_release.tsv
metadata_for_DLME.py		metadata_for_DLME.py
output.log		output.log
remove_counts_from_book_yml_files.py		remove_counts_from_book_yml_files.py
run.sh		run.sh
test_log.txt		test_log.txt