Skip to main content

DVC (Data Version Control)

We use DVC to version-control large data files (models, input datasets) without storing them in Git. Git only stores small fingerprints of the data, in dvc.lock and .dvc files; the data itself lives on MinIO storage.

DVC also describes how the data is made: the pipeline in dvc.yaml is a list of stages, each a Python script with its input and output files. Most stages build the model of one water authority, and later stages combine them into the nationwide model.

In short

You only need a few commands, always run through Pixi so your access key from .env is used (see Add your access key):

Goal Command
Download a file or folder pixi run dvc pull <path>
Download the inputs of a stage, e.g. rwzi pixi run dvc pull rwzi --with-deps
Rerun a stage after changing its script pixi run dvc repro --pull rwzi
See which stages are out of date pixi run dvc status

The sections below explain these in more detail.

Note

Existing clones may still have remote credentials in .dvc/config.local. Remove those credential fields after migrating .env from MINIO_ACCESS_KEY and MINIO_SECRET_KEY to AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY.

Pull data

Prefer pulling only the data needed for the stage you are working on. To fetch a stage and its dependencies without reproducing it, use dvc pull:

pixi run dvc pull rwzi --with-deps

To fetch the cached coupled LHM model with its results, without --with-deps, which would pull all regional models:

pixi run dvc pull run_lhm_coupled

The final cached outputs for (for example) Aa en Maas and Amstel, Gooi en Vecht can likewise be pulled directly:

pixi run dvc pull data/AaenMaas/modellen/AaenMaas_dynamic_model/
pixi run dvc pull data/AmstelGooienVecht/modellen/AmstelGooienVecht_forcing/

Only pull all tracked data when you have enough disk space (currently ~100GB), time, and just want all data local:

pixi run dvc pull

If you have local changes that you want to overwrite, add --force.

Remotes

The MinIO remote is configured in .dvc/config:

Remote URL Purpose
minio (default) s3://ribasim-nl/dvc Primary DVC cache on MinIO

Pipeline

The DVC pipeline is defined in dvc.yaml. Each stage depends on its scripts, its input data, and the src/ribasim_nl/ribasim_nl package as a whole. Every stage imports most of this package, so a change to it marks all stages as changed. That sometimes reruns a stage that did not need it, but never skips one whose code changed.

Dependencies determine the order in which stages run. Model derivation has an overview by group, and this is the full graph:

flowchart LR
    node1["bathymetry"]
    node2["bergend_aa_en_maas"]
    node3["bergend_brabantse_delta"]
    node4["bergend_de_dommel"]
    node5["bergend_drents_overijsselse_delta"]
    node6["bergend_hunze_en_aas"]
    node7["bergend_limburg"]
    node8["bergend_noorderzijlvest"]
    node9["bergend_rijn_en_ijssel"]
    node10["bergend_stichtse_rijnlanden"]
    node11["bergend_vallei_en_veluwe"]
    node12["bergend_vechtstromen"]
    node13["boezemmodel@amstel_gooi_en_vecht"]
    node14["boezemmodel@delfland"]
    node15["boezemmodel@hollands_noorderkwartier"]
    node16["boezemmodel@hollandse_delta"]
    node17["boezemmodel@rijnland"]
    node18["boezemmodel@rivierenland"]
    node19["boezemmodel@scheldestromen"]
    node20["boezemmodel@schieland_en_de_krimpenerwaard"]
    node21["boezemmodel@wetterskip_fryslan"]
    node22["boezemmodel@zuiderzeeland"]
    node23["crossings@amstel_gooi_en_vecht"]
    node24["crossings@delfland"]
    node25["crossings@hollands_noorderkwartier"]
    node26["crossings@hollandse_delta"]
    node27["crossings@rijnland"]
    node28["crossings@rivierenland"]
    node29["crossings@scheldestromen"]
    node30["crossings@schieland_en_de_krimpenerwaard"]
    node31["crossings@wetterskip_fryslan"]
    node32["crossings@zuiderzeeland"]
    node33["data/AaenMaas/verwerkt/1_ontvangen_data/Na_levering_20240418.dvc"]
    node34["data/AaenMaas/verwerkt/1_ontvangen_data/wateraanvoer-10-4-2026/Inlaten_verdelen.gdb.dvc"]
    node35["data/AaenMaas/verwerkt/2_voorbewerking/AanpassinghWh/20230530AaEnMaasData.gpkg.dvc"]
    node36["data/AaenMaas/verwerkt/3_input/areas.gpkg.dvc"]
    node37["data/AaenMaas/verwerkt/3_input/ribasim_input.gpkg.dvc"]
    node38["data/AaenMaas/verwerkt/4_ribasim/hydamo.gpkg.dvc"]
    node39["data/AaenMaas/verwerkt/4_ribasim/krw.gpkg.dvc"]
    node40["data/AaenMaas/verwerkt/downloads.dvc"]
    node41["data/AaenMaas/verwerkt/model_edits.gpkg.dvc"]
    node42["data/AaenMaas/verwerkt/parameters/static_data.xlsx.dvc"]
    node43["data/AaenMaas/verwerkt/sturing/aanvoergebieden.gpkg.dvc"]
    node44["data/AmstelGooienVecht/aangeleverd/Na_levering/Wateraanvoer/afvoergebiedaanvoergebied.gpkg.dvc"]
    node45["data/AmstelGooienVecht/aangeleverd/Na_levering/vigerende_peilgebieden.gpkg.dvc"]
    node46["data/AmstelGooienVecht/aangeleverd/aanlevering_6maart24/data dump 6 maart LHM AGV.zip.dvc"]
    node47["data/AmstelGooienVecht/aangeleverd/verbeterde_LHM_gebieden_geactualiseerd.dvc"]
    node48["data/AmstelGooienVecht/verwerkt/Feedback Formulier/feedback_formulier_AmstelGooienVecht.xlsx.dvc"]
    node49["data/AmstelGooienVecht/verwerkt/Parametrisatie_data/AmstelGooienVecht.gpkg.dvc"]
    node50["data/Basisgegevens/BGT/bgt_water.parquet.dvc"]
    node51["data/Basisgegevens/Baseline/baseline-nl_land-j23_6-v1/baseline.gdb.dvc"]
    node52["data/Basisgegevens/BuitenlandseAanvoer.dvc"]
    node53["data/Basisgegevens/Delwaq/ANIMO/aangeleverd/LGN250.IDF.dvc"]
    node54["data/Basisgegevens/Delwaq/ANIMO/aangeleverd/Uitspoelconcentraties_4opties/Concs_per_6Afvoerklassen_1991_2020/Afvoerklassen_per_landbouw_natuur_zone__6Afvoerklassen1991_2020_23062026.tif.dvc"]
    node55["data/Basisgegevens/Delwaq/ANIMO/aangeleverd/Uitspoelconcentraties_4opties/Concs_per_6Afvoerklassen_1991_2020/uitpoelconcentraties_decade_landbouw__6Afvoerklassen1991_2020_23062026.csv.dvc"]
    node56["data/Basisgegevens/Delwaq/ANIMO/aangeleverd/Uitspoelconcentraties_4opties/Concs_per_6Afvoerklassen_1991_2020/uitpoelconcentraties_decade_natuur__6Afvoerklassen1991_2020_23062026.csv.dvc"]
    node57["data/Basisgegevens/Delwaq/ANIMO/aangeleverd/residuals.leg.dvc"]
    node58["data/Basisgegevens/Delwaq/ANIMO/aangeleverd/shapes/B1_Provinciale_indeling_van_NederlandPolygon.dbf.dvc"]
    node59["data/Basisgegevens/Delwaq/ANIMO/aangeleverd/shapes/B1_Provinciale_indeling_van_NederlandPolygon.prj.dvc"]
    node60["data/Basisgegevens/Delwaq/ANIMO/aangeleverd/shapes/B1_Provinciale_indeling_van_NederlandPolygon.shp.dvc"]
    node61["data/Basisgegevens/Delwaq/ANIMO/aangeleverd/shapes/B1_Provinciale_indeling_van_NederlandPolygon.shx.dvc"]
    node62["data/Basisgegevens/Delwaq/ANIMO/interim/LHM_fluxen/LHM_433.dvc"]
    node63["data/Basisgegevens/Delwaq/Emissieregistratie/aangeleverd/ER_DataExport-2026-09-16-103931.xlsx.dvc"]
    node64["data/Basisgegevens/Delwaq/Emissieregistratie/aangeleverd/Emissies_per_jaar_buiten_ER.csv.dvc"]
    node65["data/Basisgegevens/Delwaq/Emissieregistratie/aangeleverd/OverigeEmissies_bedrijven__2024_01_24.csv.dvc"]
    node66["data/Basisgegevens/Delwaq/Emissieregistratie/aangeleverd/gaf_90.dbf.dvc"]
    node67["data/Basisgegevens/Delwaq/Emissieregistratie/aangeleverd/gaf_90.prj.dvc"]
    node68["data/Basisgegevens/Delwaq/Emissieregistratie/aangeleverd/gaf_90.shp.dvc"]
    node69["data/Basisgegevens/Delwaq/Emissieregistratie/aangeleverd/gaf_90.shx.dvc"]
    node70["data/Basisgegevens/Delwaq/IM/aangeleverd.dvc"]
    node71["data/Basisgegevens/Delwaq/Zinfo/aangeleverd.dvc"]
    node72["data/Basisgegevens/GSK3E/gsk3e.gpkg.dvc"]
    node73["data/Basisgegevens/Hydrotypen.dvc"]
    node74["data/Basisgegevens/KRW/krw_oppervlaktewaterlichamen_nederland_vlakken.gpkg.dvc"]
    node75["data/Basisgegevens/LHM/4.3/input/LHM_data.tif.dvc"]
    node76["data/Basisgegevens/LHM/4.3/results/LHM_433_budgets_update_makkink.dvc"]
    node77["data/Basisgegevens/OSM/lock_belgium.gpkg.dvc"]
    node78["data/Basisgegevens/OSM/osm_scheeresluis.gpkg.dvc"]
    node79["data/Basisgegevens/OSM/waterway_canal.gpkg.dvc"]
    node80["data/Basisgegevens/OSM/waterway_fairway.gpkg.dvc"]
    node81["data/Basisgegevens/OSM/waterway_river.gpkg.dvc"]
    node82["data/Basisgegevens/OSM/waterway_weir_belgium.gpkg.dvc"]
    node83["data/Basisgegevens/Onttrekkingen/onttrekkingen.gpkg.dvc"]
    node84["data/Basisgegevens/QGIS_qlr/output_controle_cc.qlr.dvc"]
    node85["data/Basisgegevens/QGIS_qlr/output_controle_vaw_aanvoer.qlr.dvc"]
    node86["data/Basisgegevens/QGIS_qlr/output_controle_vaw_afvoer.qlr.dvc"]
    node87["data/Basisgegevens/RWS_waterschaps_grenzen/Rijkswaterstaat.gpkg.dvc"]
    node88["data/Basisgegevens/RWS_waterschaps_grenzen/noordzee.gpkg.dvc"]
    node89["data/Basisgegevens/RWS_waterschaps_grenzen/waterschap.gpkg.dvc"]
    node90["data/Basisgegevens/RWZI/aangeleverd/RwziBase/Belasting.xlsx.dvc"]
    node91["data/Basisgegevens/RWZI/aangeleverd/Z-info/metingen/zinfo_20160101_20231231_influentdebieten.csv.dvc"]
    node92["data/Basisgegevens/RWZI/aangeleverd/locaties/RWZI_coordinates.geojson.dvc"]
    node93["data/Basisgegevens/Top10NL/top10nl_Compleet.gpkg.dvc"]
    node94["data/Basisgegevens/VanDerGaast_QH/spafvoer1.tif.dvc"]
    node95["data/Basisgegevens/profielen.dvc"]
    node96["data/Basisgegevens/resultaatvergelijking/koppeltabel_2026/Specifiek_bewerking_versierapportage_26062026.xlsx.dvc"]
    node97["data/Basisgegevens/resultaatvergelijking/koppeltabel_2026/Transformed_koppeltabel_versie_rapportage_26062026_Feedback_Verwerkt_HydroLogic.xlsx.dvc"]
    node98["data/Basisgegevens/resultaatvergelijking/meetreeksen_2026/Metingen_aanvoer_dag_totaal.csv.dvc"]
    node99["data/Basisgegevens/resultaatvergelijking/meetreeksen_2026/Metingen_afvoer_dag_totaal.csv.dvc"]
    node100["data/BrabantseDelta/verwerkt/1_ontvangen_data/GML/dwarsprofiel.gml.dvc"]
    node101["data/BrabantseDelta/verwerkt/1_ontvangen_data/sturing_gemalen_stuwen_22-5-2022/sturingGemalenStuwen_v2.xlsx.dvc"]
    node102["data/BrabantseDelta/verwerkt/2_voorbewerking/hydamo.gpkg.dvc"]
    node103["data/BrabantseDelta/verwerkt/3_input/areas.gpkg.dvc"]
    node104["data/BrabantseDelta/verwerkt/3_input/hydamo_toevoegen.gpkg.dvc"]
    node105["data/BrabantseDelta/verwerkt/3_input/hydamo_verwijderen.gpkg.dvc"]
    node106["data/BrabantseDelta/verwerkt/3_input/ribasim_input.gpkg.dvc"]
    node107["data/BrabantseDelta/verwerkt/4_ribasim/krw.gpkg.dvc"]
    node108["data/BrabantseDelta/verwerkt/model_edits.gpkg.dvc"]
    node109["data/BrabantseDelta/verwerkt/parameters/static_data.xlsx.dvc"]
    node110["data/BrabantseDelta/verwerkt/sturing/aanvoergebieden.gpkg.dvc"]
    node111["data/DeDommel/verwerkt/1_ontvangen_data/Geodata/data_Q42018.gpkg.dvc"]
    node112["data/DeDommel/verwerkt/3_input/areas.gpkg.dvc"]
    node113["data/DeDommel/verwerkt/3_input/ribasim_input.gpkg.dvc"]
    node114["data/DeDommel/verwerkt/4_ribasim/hydamo.gpkg.dvc"]
    node115["data/DeDommel/verwerkt/4_ribasim/krw.gpkg.dvc"]
    node116["data/DeDommel/verwerkt/model_edits.gpkg.dvc"]
    node117["data/DeDommel/verwerkt/parameters/static_data.xlsx.dvc"]
    node118["data/DeDommel/verwerkt/sturing/aanvoergebieden.gpkg.dvc"]
    node119["data/Delfland/aangeleverd/Na_levering/Wateraanvoer/Aanvoergebied_Afvoergebied_polders.gpkg.dvc"]
    node120["data/Delfland/aangeleverd/Na_levering/Watersysteem.gdb.dvc"]
    node121["data/Delfland/verwerkt/Feedback Formulier/feedback_formulier_Delfland.xlsx.dvc"]
    node122["data/Delfland/verwerkt/Parametrisatie_data/Delfland.gpkg.dvc"]
    node123["data/Delfland/verwerkt/Splitting_basins/Opgeknipte_basin_10.gpkg.dvc"]
    node124["data/Delfland/verwerkt/Splitting_basins/Opgeknipte_basin_2.gpkg.dvc"]
    node125["data/Delfland/verwerkt/Splitting_basins/Opgeknipte_basin_9.gpkg.dvc"]
    node126["data/Delfland/verwerkt/aggregation_area.gpkg.dvc"]
    node127["data/DrentsOverijsselseDelta/aangeleverd/Aanlevering_202311/HyDAMO_WM_20231117.gpkg.dvc"]
    node128["data/DrentsOverijsselseDelta/verwerkt/1_ontvangen_data/HyDAMO_WM_20230720.gpkg.dvc"]
    node129["data/DrentsOverijsselseDelta/verwerkt/1_ontvangen_data/extra data/Duiker_inlaat_lijn.dvc"]
    node130["data/DrentsOverijsselseDelta/verwerkt/1_ontvangen_data/extra data/Peilgebieden.dvc"]
    node131["data/DrentsOverijsselseDelta/verwerkt/2_voorbewerking/hydamo.gpkg.dvc"]
    node132["data/DrentsOverijsselseDelta/verwerkt/2_voorbewerking/meppelerdiep.gpkg.dvc"]
    node133["data/DrentsOverijsselseDelta/verwerkt/3_input/areas.gpkg.dvc"]
    node134["data/DrentsOverijsselseDelta/verwerkt/3_input/hydamo_toevoegen.gpkg.dvc"]
    node135["data/DrentsOverijsselseDelta/verwerkt/3_input/hydamo_verwijderen.gpkg.dvc"]
    node136["data/DrentsOverijsselseDelta/verwerkt/3_input/ribasim_input.gpkg.dvc"]
    node137["data/DrentsOverijsselseDelta/verwerkt/4_ribasim/krw.gpkg.dvc"]
    node138["data/DrentsOverijsselseDelta/verwerkt/fix_user_data.gpkg.dvc"]
    node139["data/DrentsOverijsselseDelta/verwerkt/model_edits.gpkg.dvc"]
    node140["data/DrentsOverijsselseDelta/verwerkt/parameters/static_data.xlsx.dvc"]
    node141["data/DrentsOverijsselseDelta/verwerkt/sturing/aanvoergebieden.gpkg.dvc"]
    node142["data/DrentsOverijsselseDelta/verwerkt/sturing/kunstwerk_in.gpkg.dvc"]
    node143["data/DrentsOverijsselseDelta/verwerkt/sturing/kunstwerk_uit.gpkg.dvc"]
    node144["data/HollandsNoorderkwartier/aangeleverd/Eerste_levering/20230413_aanlevering_hyDAMO_HHNK.zip.dvc"]
    node145["data/HollandsNoorderkwartier/aangeleverd/Na_levering/20240618_peilgebieden_en_polders.dvc"]
    node146["data/HollandsNoorderkwartier/aangeleverd/Na_levering/Na_levering_HHNK_gemalen_stuwen_20240321.gdb - Copy.dvc"]
    node147["data/HollandsNoorderkwartier/verwerkt/Feedback Formulier/feedback_formulier_HollandsNoorderkwartier.xlsx.dvc"]
    node148["data/HollandsNoorderkwartier/verwerkt/Parametrisatie_data/Noorderkwartier.gpkg.dvc"]
    node149["data/HollandsNoorderkwartier/verwerkt/Splitting_basins/Opgeknipte_basin_3.gpkg.dvc"]
    node150["data/HollandseDelta/aangeleverd/Eerste_levering/watergangen.dvc"]
    node151["data/HollandseDelta/aangeleverd/Na_levering/Nalvering_tweede/Shapefiles.dvc"]
    node152["data/HollandseDelta/aangeleverd/Na_levering/Peilgebieden_HD_nalevering.dvc"]
    node153["data/HollandseDelta/aangeleverd/Na_levering/Wateraanvoer.dvc"]
    node154["data/HollandseDelta/verwerkt/Feedback Formulier/feedback_formulier_HollandseDelta.xlsx.dvc"]
    node155["data/HollandseDelta/verwerkt/Parametrisatie_data/HollandseDelta.gpkg.dvc"]
    node156["data/HollandseDelta/verwerkt/corrections.gpkg.dvc"]
    node157["data/HunzeenAas/verwerkt/1_ontvangen_data/20230606_HyDAMO_Onze-PROF-Tabs-Definitief.gpkg.dvc"]
    node158["data/HunzeenAas/verwerkt/1_ontvangen_data/peilgebieden.gpkg.dvc"]
    node159["data/HunzeenAas/verwerkt/2_voorbewerking/hydamo.gpkg.dvc"]
    node160["data/HunzeenAas/verwerkt/3_input/areas.gpkg.dvc"]
    node161["data/HunzeenAas/verwerkt/3_input/hydamo_toevoegen.gpkg.dvc"]
    node162["data/HunzeenAas/verwerkt/3_input/hydamo_verwijderen.gpkg.dvc"]
    node163["data/HunzeenAas/verwerkt/3_input/ribasim_input.gpkg.dvc"]
    node164["data/HunzeenAas/verwerkt/4_ribasim/krw.gpkg.dvc"]
    node165["data/HunzeenAas/verwerkt/model_edits.gpkg.dvc"]
    node166["data/HunzeenAas/verwerkt/parameters/static_data.xlsx.dvc"]
    node167["data/HunzeenAas/verwerkt/sturing/aanvoergebieden.gpkg.dvc"]
    node168["data/Limburg/verwerkt/1_ontvangen_data/20250613.dvc"]
    node169["data/Limburg/verwerkt/1_ontvangen_data/HyDAMO_2_2_Limburg_met_wasmachine_levering20230406.gpkg.dvc"]
    node170["data/Limburg/verwerkt/2_voorbewerking/hydamo.gpkg.dvc"]
    node171["data/Limburg/verwerkt/3_input/areas.gpkg.dvc"]
    node172["data/Limburg/verwerkt/3_input/hydamo_toevoegen.gpkg.dvc"]
    node173["data/Limburg/verwerkt/3_input/hydamo_verwijderen.gpkg.dvc"]
    node174["data/Limburg/verwerkt/3_input/ribasim_input.gpkg.dvc"]
    node175["data/Limburg/verwerkt/4_ribasim/krw.gpkg.dvc"]
    node176["data/Limburg/verwerkt/model_edits.gpkg.dvc"]
    node177["data/Limburg/verwerkt/parameters/static_data.xlsx.dvc"]
    node178["data/Limburg/verwerkt/sturing/aanvoergebieden.gpkg.dvc"]
    node179["data/Noorderzijlvest/verwerkt/1_ontvangen_data/20241113.dvc"]
    node180["data/Noorderzijlvest/verwerkt/2_voorbewerking/1_areas.dvc"]
    node181["data/Noorderzijlvest/verwerkt/2_voorbewerking/2_dhydro/basis/winter/nzv_boezemmodel/dflowfm.dvc"]
    node182["data/Noorderzijlvest/verwerkt/3_input/openwater.gpkg.dvc"]
    node183["data/Noorderzijlvest/verwerkt/4_ribasim/krw.gpkg.dvc"]
    node184["data/Noorderzijlvest/verwerkt/5_D_HYDRO_export/hydroobjecten.dvc"]
    node185["data/Noorderzijlvest/verwerkt/5_D_HYDRO_export/peilgebieden.dvc"]
    node186["data/Noorderzijlvest/verwerkt/model_edits.gpkg.dvc"]
    node187["data/Noorderzijlvest/verwerkt/parameters/static_data.xlsx.dvc"]
    node188["data/Noorderzijlvest/verwerkt/sturing/aanvoergebieden.gpkg.dvc"]
    node189["data/Rijkswaterstaat/aangeleverd/Matroos_debieten_2017_2022_Lobith_Monsin.xlsx.dvc"]
    node190["data/Rijkswaterstaat/aangeleverd/NIS/nis_all_kunstwerken_hws_2019.gpkg.dvc"]
    node191["data/Rijkswaterstaat/aangeleverd/NIS/nis_alle_kunstwerken_hwvn_2019.gpkg.dvc"]
    node192["data/Rijkswaterstaat/aangeleverd/bathymetrie-mask/water-mask.gpkg.dvc"]
    node193["data/Rijkswaterstaat/aangeleverd/bathymetrie.dvc"]
    node194["data/Rijkswaterstaat/aangeleverd/kunstwerken_primaire_waterkeringen.gpkg.dvc"]
    node195["data/Rijkswaterstaat/modellen/hws_2025_10_1.dvc"]
    node196["data/Rijkswaterstaat/verwerkt/basins_user_data.gpkg.dvc"]
    node197["data/Rijkswaterstaat/verwerkt/categorie_oppervlaktewater.gpkg.dvc"]
    node198["data/Rijkswaterstaat/verwerkt/krw_basins_vlakken.gpkg.dvc"]
    node199["data/Rijkswaterstaat/verwerkt/kunstwerken.dvc"]
    node200["data/Rijkswaterstaat/verwerkt/kwk_media.csv.dvc"]
    node201["data/Rijkswaterstaat/verwerkt/model_user_data.gpkg.dvc"]
    node202["data/Rijkswaterstaat/verwerkt/oppervlaktewater_belgie.gpkg.dvc"]
    node203["data/Rijkswaterstaat/verwerkt/outlets.gpkg.dvc"]
    node204["data/RijnenIJssel/verwerkt/1_ontvangen_data/RegelmiddelZpWp.csv.dvc"]
    node205["data/RijnenIJssel/verwerkt/1_ontvangen_data/wrij_profielen.gpkg.dvc"]
    node206["data/RijnenIJssel/verwerkt/2_voorbewerking/hydamo.gpkg.dvc"]
    node207["data/RijnenIJssel/verwerkt/3_input/areas.gpkg.dvc"]
    node208["data/RijnenIJssel/verwerkt/3_input/hydamo_toevoegen.gpkg.dvc"]
    node209["data/RijnenIJssel/verwerkt/3_input/hydamo_verwijderen.gpkg.dvc"]
    node210["data/RijnenIJssel/verwerkt/3_input/ribasim_input.gpkg.dvc"]
    node211["data/RijnenIJssel/verwerkt/4_ribasim/krw.gpkg.dvc"]
    node212["data/RijnenIJssel/verwerkt/model_edits.gpkg.dvc"]
    node213["data/RijnenIJssel/verwerkt/parameters/static_data.xlsx.dvc"]
    node214["data/RijnenIJssel/verwerkt/sturing/aanvoergebieden.gpkg.dvc"]
    node215["data/Rijnland/aangeleverd/Eerste_levering/DataRijnland.zip.dvc"]
    node216["data/Rijnland/aangeleverd/Na_levering/20240402_gegevensRL_nalevering.gdb.dvc"]
    node217["data/Rijnland/aangeleverd/Na_levering/20260422_MerenPlassen/Rijnland_meren_plassen_diepte.geojson.dvc"]
    node218["data/Rijnland/aangeleverd/Na_levering/20260422_MerenPlassen/verbindingen_inlaat_boezem.geojson.dvc"]
    node219["data/Rijnland/aangeleverd/Na_levering/Wateraanvoer.dvc"]
    node220["data/Rijnland/aangeleverd/PeilgebiedPraktijk Afwatering.dvc"]
    node221["data/Rijnland/verwerkt/Feedback Formulier/feedback_formulier_Rijnland.xlsx.dvc"]
    node222["data/Rijnland/verwerkt/Parametrisatie_data/Rijnland.gpkg.dvc"]
    node223["data/Rijnland/verwerkt/Splitting_basins/Opgeknipte_basin_1.gpkg.dvc"]
    node224["data/Rijnland/verwerkt/Splitting_basins/Opgeknipte_basin_15.gpkg.dvc"]
    node225["data/Rijnland/verwerkt/Splitting_basins/Opgeknipte_basin_22.gpkg.dvc"]
    node226["data/Rijnland/verwerkt/corrections.gpkg.dvc"]
    node227["data/Rivierenland/aangeleverd/Eerste_levering/OverigeGegevens.zip.dvc"]
    node228["data/Rivierenland/aangeleverd/Eerste_levering/WSRL_HyDAMO.zip.dvc"]
    node229["data/Rivierenland/aangeleverd/Na_levering/Wateraanvoer.dvc"]
    node230["data/Rivierenland/aangeleverd/Na_levering/gaten.gpkg.dvc"]
    node231["data/Rivierenland/verwerkt/Feedback Formulier/feedback_formulier_Rivierenland.xlsx.dvc"]
    node232["data/Rivierenland/verwerkt/Parametrisatie_data/Rivierenland.gpkg.dvc"]
    node233["data/Rivierenland/verwerkt/corrections.gpkg.dvc"]
    node234["data/Scheldestromen/aangeleverd/Eerste_levering/Levering_20230323.zip.dvc"]
    node235["data/Scheldestromen/aangeleverd/Na_levering/Oplevering_Scheldestromen_20240328/Oplevering_20240328.gdb.dvc"]
    node236["data/Scheldestromen/aangeleverd/Na_levering/Oplevering_Scheldestromen_20240328/Oplevering_20240328.gpkg.dvc"]
    node237["data/Scheldestromen/aangeleverd/Na_levering/Praktijkpeilgebieden_20231204.dvc"]
    node238["data/Scheldestromen/aangeleverd/Na_levering/Wateraanvoer.dvc"]
    node239["data/Scheldestromen/verwerkt/Feedback Formulier/feedback_formulier_Scheldestromen.xlsx.dvc"]
    node240["data/Scheldestromen/verwerkt/Parametrisatie_data/Scheldestromen.gpkg.dvc"]
    node241["data/SchielandendeKrimpenerwaard/aangeleverd/Na_levering/20240701_losseshapes.dvc"]
    node242["data/SchielandendeKrimpenerwaard/aangeleverd/Na_levering/Wateraanvoer/HyDamo_metWasverzachter_20230905.gpkg.dvc"]
    node243["data/SchielandendeKrimpenerwaard/aangeleverd/Na_levering/hhsklevering_07032024.gpkg.dvc"]
    node244["data/SchielandendeKrimpenerwaard/aangeleverd/Na_levering/poldergebieden_en_duikersifonhevels_persleidingen/LHM_06052024_hhsk.gpkg.dvc"]
    node245["data/SchielandendeKrimpenerwaard/verwerkt/Feedback Formulier/feedback_formulier_SchielandendeKrimpenerwaard.xlsx.dvc"]
    node246["data/SchielandendeKrimpenerwaard/verwerkt/Parametrisatie_data/HHSK.gpkg.dvc"]
    node247["data/StichtseRijnlanden/verwerkt/2_voorbewerking/hydamo.gpkg.dvc"]
    node248["data/StichtseRijnlanden/verwerkt/3_input/areas.gpkg.dvc"]
    node249["data/StichtseRijnlanden/verwerkt/3_input/hydamo_toevoegen.gpkg.dvc"]
    node250["data/StichtseRijnlanden/verwerkt/3_input/hydamo_verwijderen.gpkg.dvc"]
    node251["data/StichtseRijnlanden/verwerkt/3_input/ribasim_input.gpkg.dvc"]
    node252["data/StichtseRijnlanden/verwerkt/4_ribasim/hydroobject.gpkg.dvc"]
    node253["data/StichtseRijnlanden/verwerkt/4_ribasim/krw.gpkg.dvc"]
    node254["data/StichtseRijnlanden/verwerkt/4_ribasim/peilgebieden.gpkg.dvc"]
    node255["data/StichtseRijnlanden/verwerkt/4_ribasim/peilgebieden_vigerend.gpkg.dvc"]
    node256["data/StichtseRijnlanden/verwerkt/model_edits.gpkg.dvc"]
    node257["data/StichtseRijnlanden/verwerkt/modelfouten_met_verbeter_acties_BD_311024.gpkg.dvc"]
    node258["data/StichtseRijnlanden/verwerkt/parameters/static_data.xlsx.dvc"]
    node259["data/StichtseRijnlanden/verwerkt/sturing/aanvoergebieden.gpkg.dvc"]
    node260["data/ValleienVeluwe/verwerkt/1_ontvangen_data/20250425_HarmenVandeWerfhorst/Inlaatwerken en gebieden.gdb.dvc"]
    node261["data/ValleienVeluwe/verwerkt/1_ontvangen_data/20250428.dvc"]
    node262["data/ValleienVeluwe/verwerkt/2_voorbewerking/hydamo.gpkg.dvc"]
    node263["data/ValleienVeluwe/verwerkt/3_input/areas.gpkg.dvc"]
    node264["data/ValleienVeluwe/verwerkt/3_input/ribasim_input.gpkg.dvc"]
    node265["data/ValleienVeluwe/verwerkt/4_ribasim/hydamo.gpkg.dvc"]
    node266["data/ValleienVeluwe/verwerkt/4_ribasim/krw.gpkg.dvc"]
    node267["data/ValleienVeluwe/verwerkt/fix_user_data.gpkg.dvc"]
    node268["data/ValleienVeluwe/verwerkt/model_edits.gpkg.dvc"]
    node269["data/ValleienVeluwe/verwerkt/model_edits_aanvoer.gpkg.dvc"]
    node270["data/ValleienVeluwe/verwerkt/parameters/static_data.xlsx.dvc"]
    node271["data/ValleienVeluwe/verwerkt/sturing/aanvoergebieden.gpkg.dvc"]
    node272["data/Vechtstromen/verwerkt/1_ontvangen_data/Feedbackform_20250428/20250428_Feedback Formulier.xlsx.dvc"]
    node273["data/Vechtstromen/verwerkt/1_ontvangen_data/LHM20230418.gdb.dvc"]
    node274["data/Vechtstromen/verwerkt/1_ontvangen_data/aanvulling feb 24.dvc"]
    node275["data/Vechtstromen/verwerkt/1_ontvangen_data/downloads/peilgebieden_voormalig_velt_en_vecht.gpkg.dvc"]
    node276["data/Vechtstromen/verwerkt/1_ontvangen_data/nalevering_20240920.dvc"]
    node277["data/Vechtstromen/verwerkt/1_ontvangen_data/wateraanvoergebieden_20250416.dvc"]
    node278["data/Vechtstromen/verwerkt/2_voorbewerking/hydamo.gpkg.dvc"]
    node279["data/Vechtstromen/verwerkt/3_input/areas.gpkg.dvc"]
    node280["data/Vechtstromen/verwerkt/3_input/hydamo_toevoegen.gpkg.dvc"]
    node281["data/Vechtstromen/verwerkt/3_input/hydamo_verwijderen.gpkg.dvc"]
    node282["data/Vechtstromen/verwerkt/3_input/ribasim_input.gpkg.dvc"]
    node283["data/Vechtstromen/verwerkt/4_ribasim/krw.gpkg.dvc"]
    node284["data/Vechtstromen/verwerkt/fix_user_data.gpkg.dvc"]
    node285["data/Vechtstromen/verwerkt/model_edits.gpkg.dvc"]
    node286["data/Vechtstromen/verwerkt/parameters/static_data.xlsx.dvc"]
    node287["data/Vechtstromen/verwerkt/sturing/aanvoergebieden.gpkg.dvc"]
    node288["data/WetterskipFryslan/aangeleverd/Na_levering/20241205_verwerkte_peilgebieden_en_boezem.dvc"]
    node289["data/WetterskipFryslan/aangeleverd/Na_levering/20250404_nieuwe_schematisatie.dvc"]
    node290["data/WetterskipFryslan/aangeleverd/Na_levering/Wateraanvoer/aanvoer.gpkg.dvc"]
    node291["data/WetterskipFryslan/aangeleverd/Na_levering/gaarkeuken.gpkg.dvc"]
    node292["data/WetterskipFryslan/verwerkt/Feedback Formulier/feedback_formulier_WetterskipFryslan.xlsx.dvc"]
    node293["data/WetterskipFryslan/verwerkt/Parametrisatie_data/WetterskipFryslan.gpkg.dvc"]
    node294["data/WetterskipFryslan/verwerkt/Splitting_basins/Opgeknipte_basin_16.gpkg.dvc"]
    node295["data/WetterskipFryslan/verwerkt/Splitting_basins/Opgeknipte_basin_21.gpkg.dvc"]
    node296["data/WetterskipFryslan/verwerkt/Splitting_basins/Opgeknipte_basin_6.gpkg.dvc"]
    node297["data/Zuiderzeeland/aangeleverd/Na_levering/Duikers.gpkg.dvc"]
    node298["data/Zuiderzeeland/aangeleverd/Na_levering/gemalen.gpkg.dvc"]
    node299["data/Zuiderzeeland/aangeleverd/Na_levering/overigekunstwerken.gpkg.dvc"]
    node300["data/Zuiderzeeland/aangeleverd/Na_levering/peilgebieden.gpkg.dvc"]
    node301["data/Zuiderzeeland/aangeleverd/Na_levering/peilvakken_nalevering.gpkg.dvc"]
    node302["data/Zuiderzeeland/aangeleverd/Na_levering/zzl_watergangen_nalevering.dvc"]
    node303["data/Zuiderzeeland/verwerkt/Feedback Formulier/feedback_formulier_Zuiderzeeland.xlsx.dvc"]
    node304["data/Zuiderzeeland/verwerkt/Parametrisatie_data/Zuiderzeeland.gpkg.dvc"]
    node305["data/Zuiderzeeland/verwerkt/Splitting_basins/Opgeknipte_basin_16.gpkg.dvc"]
    node306["data/Zuiderzeeland/verwerkt/Splitting_basins/Opgeknipte_basin_31.gpkg.dvc"]
    node307["data/Zuiderzeeland/verwerkt/Splitting_basins/Opgeknipte_basin_73.gpkg.dvc"]
    node308["data/Zuiderzeeland/verwerkt/corrections.gpkg.dvc"]
    node309["delwaq"]
    node310["dynamic@aa_en_maas"]
    node311["dynamic@brabantse_delta"]
    node312["dynamic@de_dommel"]
    node313["dynamic@drents_overijsselse_delta"]
    node314["dynamic@hunze_en_aas"]
    node315["dynamic@limburg"]
    node316["dynamic@noorderzijlvest"]
    node317["dynamic@rijn_en_ijssel"]
    node318["dynamic@stichtse_rijnlanden"]
    node319["dynamic@vallei_en_veluwe"]
    node320["dynamic@vechtstromen"]
    node321["export_webmap"]
    node322["feedback_amstel_gooi_en_vecht"]
    node323["feedback_delfland"]
    node324["feedback_hollands_noorderkwartier"]
    node325["feedback_hollandse_delta"]
    node326["feedback_rijnland"]
    node327["feedback_rivierenland"]
    node328["feedback_scheldestromen"]
    node329["feedback_schieland_en_de_krimpenerwaard"]
    node330["feedback_wetterskip_fryslan"]
    node331["feedback_zuiderzeeland"]
    node332["forcing_amstel_gooi_en_vecht"]
    node333["forcing_delfland"]
    node334["forcing_hollands_noorderkwartier"]
    node335["forcing_hollandse_delta"]
    node336["forcing_rijnland"]
    node337["forcing_rivierenland"]
    node338["forcing_scheldestromen"]
    node339["forcing_schieland_en_de_krimpenerwaard"]
    node340["forcing_wetterskip_fryslan"]
    node341["forcing_zuiderzeeland"]
    node342["hws_demand"]
    node343["hws_plus"]
    node344["hws_transient"]
    node345["hydamo@brabantse_delta"]
    node346["hydamo@drents_overijsselse_delta"]
    node347["hydamo@hunze_en_aas"]
    node348["hydamo@limburg"]
    node349["hydamo@rijn_en_ijssel"]
    node350["hydamo@stichtse_rijnlanden"]
    node351["hydamo@vechtstromen"]
    node352["koppelen"]
    node353["lhm_allocation"]
    node354["lumped@aa_en_maas"]
    node355["lumped@brabantse_delta"]
    node356["lumped@de_dommel"]
    node357["lumped@drents_overijsselse_delta"]
    node358["lumped@hunze_en_aas"]
    node359["lumped@limburg"]
    node360["lumped@rijn_en_ijssel"]
    node361["lumped@stichtse_rijnlanden"]
    node362["lumped@vallei_en_veluwe"]
    node363["lumped@vechtstromen"]
    node364["lumped_noorderzijlvest"]
    node365["parameterized_aa_en_maas"]
    node366["parameterized_brabantse_delta"]
    node367["parameterized_de_dommel"]
    node368["parameterized_drents_overijsselse_delta"]
    node369["parameterized_hunze_en_aas"]
    node370["parameterized_limburg"]
    node371["parameterized_noorderzijlvest"]
    node372["parameterized_rijn_en_ijssel"]
    node373["parameterized_stichtse_rijnlanden"]
    node374["parameterized_vallei_en_veluwe"]
    node375["parameterized_vechtstromen"]
    node376["peilbeheer"]
    node377["postprocessed_amstel_gooi_en_vecht"]
    node378["postprocessed_delfland"]
    node379["postprocessed_hollands_noorderkwartier"]
    node380["postprocessed_hollandse_delta"]
    node381["postprocessed_rijnland"]
    node382["postprocessed_rivierenland"]
    node383["postprocessed_scheldestromen"]
    node384["postprocessed_schieland_en_de_krimpenerwaard"]
    node385["postprocessed_wetterskip_fryslan"]
    node386["postprocessed_zuiderzeeland"]
    node387["profiles_amstel_gooi_en_vecht"]
    node388["profiles_delfland"]
    node389["profiles_hollands_noorderkwartier"]
    node390["profiles_hollandse_delta"]
    node391["profiles_rijnland"]
    node392["profiles_rivierenland"]
    node393["profiles_scheldestromen"]
    node394["profiles_schieland_en_de_krimpenerwaard"]
    node395["profiles_wetterskip_fryslan"]
    node396["profiles_zuiderzeeland"]
    node397["run_lhm_allocation"]
    node398["run_lhm_coupled"]
    node399["rwzi"]
    node400["samenvoegen"]
    node401["shortest_paths@amstel_gooi_en_vecht"]
    node402["shortest_paths@delfland"]
    node403["shortest_paths@hollands_noorderkwartier"]
    node404["shortest_paths@hollandse_delta"]
    node405["shortest_paths@rijnland"]
    node406["shortest_paths@rivierenland"]
    node407["shortest_paths@scheldestromen"]
    node408["shortest_paths@schieland_en_de_krimpenerwaard"]
    node409["shortest_paths@wetterskip_fryslan"]
    node410["shortest_paths@zuiderzeeland"]
    node411["validate_lhm_coupled"]
    node1-->node342
    node2-->node310
    node3-->node311
    node4-->node312
    node5-->node313
    node6-->node314
    node7-->node315
    node8-->node316
    node9-->node317
    node10-->node318
    node11-->node319
    node12-->node320
    node13-->node322
    node13-->node332
    node14-->node323
    node14-->node333
    node15-->node324
    node15-->node334
    node16-->node325
    node16-->node335
    node17-->node326
    node17-->node336
    node18-->node327
    node18-->node337
    node19-->node328
    node19-->node338
    node20-->node329
    node20-->node339
    node21-->node330
    node21-->node340
    node22-->node331
    node22-->node341
    node23-->node13
    node23-->node332
    node23-->node387
    node23-->node401
    node24-->node14
    node24-->node333
    node24-->node388
    node24-->node402
    node25-->node15
    node25-->node334
    node25-->node389
    node25-->node403
    node26-->node16
    node26-->node335
    node26-->node390
    node26-->node404
    node27-->node17
    node27-->node336
    node27-->node391
    node27-->node405
    node28-->node18
    node28-->node337
    node28-->node392
    node28-->node406
    node29-->node19
    node29-->node338
    node29-->node393
    node29-->node407
    node30-->node20
    node30-->node339
    node30-->node394
    node30-->node408
    node31-->node21
    node31-->node340
    node31-->node395
    node31-->node409
    node32-->node22
    node32-->node341
    node32-->node396
    node32-->node410
    node33-->node365
    node34-->node2
    node35-->node365
    node36-->node354
    node36-->node365
    node37-->node354
    node38-->node354
    node38-->node365
    node39-->node354
    node40-->node365
    node40-->node376
    node41-->node365
    node42-->node365
    node43-->node2
    node44-->node332
    node45-->node376
    node46-->node377
    node47-->node377
    node48-->node322
    node48-->node332
    node49-->node332
    node50-->node310
    node50-->node311
    node50-->node312
    node50-->node313
    node50-->node314
    node50-->node315
    node50-->node316
    node50-->node317
    node50-->node318
    node50-->node319
    node50-->node320
    node50-->node332
    node50-->node333
    node50-->node334
    node50-->node335
    node50-->node336
    node50-->node337
    node50-->node338
    node50-->node339
    node50-->node340
    node50-->node341
    node50-->node365
    node50-->node366
    node50-->node367
    node50-->node368
    node50-->node369
    node50-->node370
    node50-->node371
    node50-->node372
    node50-->node373
    node50-->node374
    node50-->node375
    node50-->node387
    node50-->node388
    node50-->node389
    node50-->node390
    node50-->node391
    node50-->node392
    node50-->node393
    node50-->node394
    node50-->node395
    node50-->node396
    node51-->node1
    node51-->node342
    node52-->node310
    node52-->node311
    node52-->node312
    node52-->node313
    node52-->node314
    node52-->node315
    node52-->node316
    node52-->node317
    node52-->node318
    node52-->node319
    node52-->node320
    node52-->node332
    node52-->node333
    node52-->node334
    node52-->node335
    node52-->node336
    node52-->node337
    node52-->node338
    node52-->node339
    node52-->node340
    node52-->node341
    node53-->node309
    node54-->node309
    node55-->node309
    node56-->node309
    node57-->node309
    node58-->node309
    node59-->node309
    node60-->node309
    node61-->node309
    node62-->node309
    node63-->node309
    node64-->node309
    node65-->node309
    node66-->node309
    node67-->node309
    node68-->node309
    node69-->node309
    node70-->node309
    node71-->node309
    node72-->node337
    node72-->node372
    node73-->node387
    node73-->node388
    node73-->node389
    node73-->node390
    node73-->node391
    node73-->node392
    node73-->node393
    node73-->node394
    node73-->node395
    node73-->node396
    node74-->node1
    node74-->node342
    node75-->node2
    node75-->node3
    node75-->node4
    node75-->node5
    node75-->node6
    node75-->node7
    node75-->node8
    node75-->node9
    node75-->node10
    node75-->node11
    node75-->node12
    node75-->node365
    node75-->node366
    node75-->node367
    node75-->node368
    node75-->node369
    node75-->node370
    node75-->node371
    node75-->node372
    node75-->node373
    node75-->node374
    node75-->node375
    node76-->node310
    node76-->node311
    node76-->node312
    node76-->node313
    node76-->node314
    node76-->node315
    node76-->node316
    node76-->node317
    node76-->node318
    node76-->node319
    node76-->node320
    node76-->node332
    node76-->node333
    node76-->node334
    node76-->node335
    node76-->node336
    node76-->node337
    node76-->node338
    node76-->node339
    node76-->node340
    node76-->node341
    node76-->node344
    node77-->node342
    node78-->node342
    node79-->node342
    node80-->node342
    node80-->node344
    node80-->node352
    node81-->node342
    node82-->node342
    node83-->node342
    node84-->node310
    node84-->node311
    node84-->node312
    node84-->node313
    node84-->node314
    node84-->node315
    node84-->node316
    node84-->node317
    node84-->node318
    node84-->node319
    node84-->node320
    node84-->node332
    node84-->node333
    node84-->node334
    node84-->node335
    node84-->node336
    node84-->node337
    node84-->node338
    node84-->node339
    node84-->node340
    node84-->node341
    node85-->node2
    node85-->node3
    node85-->node4
    node85-->node5
    node85-->node6
    node85-->node7
    node85-->node8
    node85-->node9
    node85-->node10
    node85-->node11
    node85-->node12
    node86-->node365
    node86-->node366
    node86-->node367
    node86-->node368
    node86-->node369
    node86-->node370
    node86-->node371
    node86-->node372
    node86-->node373
    node86-->node374
    node86-->node375
    node87-->node332
    node87-->node333
    node87-->node334
    node87-->node335
    node87-->node336
    node87-->node337
    node87-->node338
    node87-->node339
    node87-->node340
    node87-->node341
    node87-->node365
    node87-->node366
    node87-->node367
    node87-->node368
    node87-->node369
    node87-->node370
    node87-->node371
    node87-->node372
    node87-->node373
    node87-->node374
    node87-->node375
    node88-->node369
    node88-->node371
    node89-->node321
    node89-->node332
    node89-->node333
    node89-->node334
    node89-->node335
    node89-->node336
    node89-->node337
    node89-->node338
    node89-->node339
    node89-->node340
    node89-->node341
    node89-->node365
    node89-->node366
    node89-->node367
    node89-->node368
    node89-->node369
    node89-->node370
    node89-->node371
    node89-->node372
    node89-->node373
    node89-->node374
    node89-->node375
    node89-->node377
    node89-->node378
    node89-->node379
    node89-->node380
    node89-->node381
    node89-->node382
    node89-->node383
    node89-->node386
    node90-->node399
    node91-->node399
    node92-->node399
    node93-->node310
    node93-->node311
    node93-->node312
    node93-->node313
    node93-->node314
    node93-->node315
    node93-->node316
    node93-->node317
    node93-->node318
    node93-->node319
    node93-->node320
    node93-->node332
    node93-->node333
    node93-->node334
    node93-->node335
    node93-->node336
    node93-->node337
    node93-->node338
    node93-->node339
    node93-->node340
    node93-->node341
    node93-->node344
    node93-->node352
    node93-->node365
    node93-->node366
    node93-->node367
    node93-->node368
    node93-->node369
    node93-->node370
    node93-->node371
    node93-->node372
    node93-->node373
    node93-->node374
    node93-->node375
    node94-->node2
    node94-->node3
    node94-->node4
    node94-->node5
    node94-->node6
    node94-->node7
    node94-->node8
    node94-->node9
    node94-->node10
    node94-->node11
    node94-->node12
    node95-->node387
    node95-->node388
    node95-->node389
    node95-->node390
    node95-->node391
    node95-->node392
    node95-->node393
    node95-->node394
    node95-->node395
    node95-->node396
    node96-->node310
    node96-->node311
    node96-->node312
    node96-->node313
    node96-->node314
    node96-->node315
    node96-->node316
    node96-->node317
    node96-->node318
    node96-->node319
    node96-->node320
    node96-->node332
    node96-->node333
    node96-->node334
    node96-->node335
    node96-->node336
    node96-->node337
    node96-->node338
    node96-->node339
    node96-->node340
    node96-->node341
    node96-->node344
    node96-->node352
    node97-->node310
    node97-->node311
    node97-->node312
    node97-->node313
    node97-->node314
    node97-->node315
    node97-->node316
    node97-->node317
    node97-->node318
    node97-->node319
    node97-->node320
    node97-->node332
    node97-->node333
    node97-->node334
    node97-->node335
    node97-->node336
    node97-->node337
    node97-->node338
    node97-->node339
    node97-->node340
    node97-->node341
    node97-->node344
    node97-->node352
    node98-->node310
    node98-->node311
    node98-->node312
    node98-->node313
    node98-->node314
    node98-->node315
    node98-->node316
    node98-->node317
    node98-->node318
    node98-->node319
    node98-->node320
    node98-->node332
    node98-->node333
    node98-->node334
    node98-->node335
    node98-->node336
    node98-->node337
    node98-->node338
    node98-->node339
    node98-->node340
    node98-->node341
    node98-->node344
    node99-->node310
    node99-->node311
    node99-->node312
    node99-->node313
    node99-->node314
    node99-->node315
    node99-->node316
    node99-->node317
    node99-->node318
    node99-->node319
    node99-->node320
    node99-->node332
    node99-->node333
    node99-->node334
    node99-->node335
    node99-->node336
    node99-->node337
    node99-->node338
    node99-->node339
    node99-->node340
    node99-->node341
    node99-->node344
    node100-->node366
    node101-->node366
    node102-->node345
    node103-->node355
    node103-->node366
    node104-->node345
    node105-->node345
    node106-->node355
    node107-->node355
    node108-->node366
    node109-->node366
    node110-->node3
    node110-->node366
    node111-->node367
    node112-->node356
    node112-->node367
    node113-->node356
    node114-->node356
    node114-->node367
    node114-->node376
    node115-->node356
    node116-->node367
    node117-->node367
    node118-->node4
    node119-->node333
    node119-->node378
    node120-->node376
    node120-->node378
    node121-->node323
    node121-->node333
    node122-->node333
    node123-->node323
    node124-->node323
    node125-->node323
    node126-->node378
    node127-->node368
    node128-->node368
    node129-->node368
    node130-->node368
    node131-->node346
    node132-->node368
    node133-->node357
    node133-->node368
    node134-->node346
    node135-->node346
    node136-->node357
    node137-->node357
    node138-->node368
    node139-->node368
    node140-->node368
    node141-->node5
    node141-->node368
    node142-->node5
    node143-->node5
    node144-->node379
    node145-->node334
    node145-->node376
    node145-->node379
    node146-->node379
    node147-->node324
    node147-->node334
    node148-->node334
    node149-->node324
    node150-->node390
    node151-->node380
    node152-->node376
    node152-->node380
    node153-->node335
    node154-->node325
    node154-->node335
    node155-->node335
    node156-->node380
    node157-->node369
    node158-->node369
    node158-->node376
    node159-->node347
    node160-->node358
    node160-->node369
    node161-->node347
    node162-->node347
    node163-->node358
    node164-->node358
    node165-->node369
    node166-->node369
    node167-->node6
    node167-->node369
    node168-->node370
    node169-->node370
    node170-->node348
    node171-->node359
    node171-->node370
    node172-->node348
    node173-->node348
    node174-->node359
    node175-->node359
    node176-->node370
    node177-->node370
    node178-->node7
    node179-->node371
    node180-->node364
    node181-->node364
    node182-->node364
    node183-->node364
    node184-->node371
    node185-->node376
    node186-->node371
    node187-->node371
    node188-->node8
    node189-->node344
    node190-->node342
    node191-->node342
    node192-->node1
    node193-->node1
    node194-->node342
    node195-->node375
    node196-->node342
    node197-->node342
    node198-->node377
    node198-->node378
    node198-->node379
    node198-->node380
    node198-->node381
    node198-->node382
    node198-->node383
    node198-->node386
    node199-->node342
    node200-->node342
    node201-->node342
    node202-->node342
    node203-->node342
    node204-->node372
    node205-->node372
    node206-->node349
    node207-->node360
    node207-->node372
    node208-->node349
    node209-->node349
    node210-->node360
    node211-->node360
    node212-->node372
    node213-->node372
    node214-->node9
    node214-->node372
    node215-->node381
    node216-->node381
    node217-->node391
    node218-->node391
    node219-->node336
    node220-->node376
    node221-->node326
    node221-->node336
    node222-->node336
    node223-->node326
    node224-->node326
    node225-->node326
    node226-->node381
    node227-->node376
    node227-->node382
    node228-->node382
    node229-->node337
    node229-->node382
    node230-->node327
    node231-->node327
    node231-->node337
    node232-->node337
    node233-->node382
    node234-->node383
    node235-->node383
    node236-->node393
    node237-->node376
    node237-->node383
    node238-->node338
    node239-->node328
    node239-->node338
    node240-->node338
    node241-->node384
    node242-->node339
    node242-->node384
    node243-->node384
    node244-->node384
    node245-->node329
    node245-->node339
    node246-->node339
    node246-->node394
    node247-->node350
    node248-->node361
    node248-->node373
    node249-->node350
    node250-->node350
    node251-->node361
    node252-->node373
    node253-->node361
    node254-->node373
    node254-->node376
    node255-->node373
    node256-->node373
    node257-->node373
    node258-->node373
    node259-->node10
    node259-->node373
    node260-->node11
    node261-->node374
    node262-->node374
    node263-->node362
    node263-->node374
    node264-->node362
    node265-->node362
    node266-->node362
    node267-->node374
    node268-->node374
    node269-->node374
    node270-->node374
    node271-->node11
    node272-->node375
    node273-->node12
    node274-->node375
    node274-->node376
    node275-->node375
    node276-->node375
    node277-->node375
    node278-->node351
    node279-->node363
    node279-->node375
    node280-->node351
    node281-->node351
    node282-->node363
    node283-->node363
    node284-->node375
    node285-->node375
    node286-->node375
    node287-->node12
    node287-->node375
    node288-->node376
    node289-->node385
    node290-->node340
    node291-->node330
    node292-->node330
    node292-->node340
    node293-->node340
    node294-->node330
    node295-->node330
    node296-->node330
    node297-->node386
    node298-->node386
    node299-->node386
    node300-->node341
    node300-->node376
    node301-->node386
    node302-->node386
    node303-->node331
    node303-->node341
    node304-->node341
    node305-->node331
    node306-->node331
    node307-->node331
    node308-->node386
    node309-->node321
    node310-->node400
    node311-->node400
    node312-->node400
    node313-->node400
    node314-->node400
    node315-->node400
    node316-->node400
    node317-->node400
    node318-->node400
    node319-->node400
    node320-->node400
    node322-->node387
    node323-->node388
    node324-->node389
    node325-->node390
    node326-->node391
    node327-->node392
    node328-->node393
    node329-->node394
    node330-->node395
    node331-->node396
    node332-->node400
    node333-->node400
    node334-->node400
    node335-->node400
    node336-->node400
    node337-->node400
    node338-->node400
    node339-->node400
    node340-->node400
    node341-->node400
    node342-->node344
    node342-->node352
    node344-->node400
    node345-->node355
    node345-->node366
    node345-->node376
    node346-->node357
    node346-->node368
    node346-->node376
    node347-->node358
    node347-->node369
    node348-->node359
    node348-->node370
    node349-->node360
    node349-->node372
    node350-->node361
    node350-->node373
    node351-->node363
    node351-->node375
    node352-->node353
    node352-->node398
    node353-->node397
    node354-->node365
    node355-->node366
    node356-->node367
    node357-->node368
    node358-->node369
    node359-->node370
    node360-->node372
    node361-->node373
    node362-->node374
    node363-->node375
    node364-->node371
    node365-->node2
    node366-->node3
    node367-->node4
    node368-->node5
    node369-->node6
    node370-->node7
    node371-->node8
    node372-->node9
    node373-->node10
    node374-->node11
    node375-->node12
    node376-->node310
    node376-->node311
    node376-->node312
    node376-->node313
    node376-->node314
    node376-->node315
    node376-->node316
    node376-->node317
    node376-->node318
    node376-->node319
    node376-->node320
    node376-->node332
    node376-->node333
    node376-->node334
    node376-->node335
    node376-->node336
    node376-->node337
    node376-->node338
    node376-->node339
    node376-->node340
    node376-->node341
    node376-->node352
    node377-->node13
    node377-->node23
    node378-->node14
    node378-->node24
    node379-->node15
    node379-->node25
    node380-->node16
    node380-->node26
    node381-->node17
    node381-->node27
    node382-->node18
    node382-->node28
    node383-->node19
    node383-->node29
    node384-->node20
    node384-->node30
    node385-->node21
    node385-->node31
    node386-->node22
    node386-->node32
    node387-->node332
    node388-->node333
    node389-->node334
    node390-->node335
    node391-->node336
    node392-->node337
    node393-->node338
    node394-->node339
    node395-->node340
    node396-->node341
    node398-->node309
    node398-->node343
    node398-->node411
    node399-->node310
    node399-->node311
    node399-->node312
    node399-->node313
    node399-->node314
    node399-->node315
    node399-->node316
    node399-->node317
    node399-->node318
    node399-->node319
    node399-->node320
    node399-->node332
    node399-->node333
    node399-->node334
    node399-->node335
    node399-->node336
    node399-->node337
    node399-->node338
    node399-->node339
    node399-->node340
    node399-->node341
    node399-->node344
    node400-->node352
    node401-->node13
    node402-->node14
    node403-->node15
    node404-->node16
    node405-->node17
    node406-->node18
    node407-->node19
    node408-->node20
    node409-->node21
    node410-->node22
    node412["data/AaenMaas/aangeleverd/Eerste_levering.dvc"]
    node413["data/AaenMaas/verwerkt/1_ontvangen_data/Na_levering_202404/afwateringseenheden_WAM.dvc"]
Figure 1: DVC pipeline DAG (click to zoom)

Reproduce stages

During development, reproduce only the stage you are working on. The --pull option asks DVC to fetch missing dependencies before running the stage with dvc repro:

pixi run dvc repro --pull rwzi

Without --pull, dvc repro only uses data already present in the workspace or local DVC cache. Other useful options are --force to run a stage even when DVC considers it unchanged and --single-item to run only the named stage without reproducing its upstream dependencies.

Warning

A full pixi run dvc repro runs all stages one by one and takes several days. Run full reproductions in parallel instead, on a workstation with pixi run repro-local, see Running locally, or on the SLURM cluster with repro.sh, see Running on SLURM.

Pushing changes

After producing new outputs (running pipeline stages or adding new data), push to the remote:

pixi run dvc push

Do this before pushing the updated dvc.lock file to Git, so the data hashes referenced therein are available to everyone.

Most MinIO access keys handed out are read-only. Reach out if you need help uploading data.

Outputs that a stage rebuilds in minutes from data that is on the remote are not pushed, with cache: false in dvc.yaml: lhm_parts, hws_plus and the export for the model viewer. dvc pull does not get them, and dvc repro --pull counts them as up to date. To get one, pull the inputs of its stage and run it with pixi run dvc repro --single-item --force <stage>, like rebuild in scripts/docs_figures.py does.

Clean up the remote

Every run pushes its outputs, so the remote fills up. To delete the data that no kept commit uses:

pixi run prune-remote           # list what it would delete in logs/prune-remote
pixi run prune-remote --delete  # delete it

It keeps the data of:

  • the last 30 runs of main, its last commits that changed dvc.lock;
  • every version of the source data, the .dvc files of all commits of main;
  • all commits of open pull requests, and the tips of branches that are not merged;
  • everything uploaded in the last 3 days, such as a run that is pushed but not committed yet.

Previews in the model viewer are kept for the runs it keeps, for the last 30 pull requests that have one, and for the first model with keys, with which older node IDs are looked up. An older commit of main can no longer pull its outputs, but they can be reproduced from its source data. Do not use dvc gc: git worktrees share the cache of the main checkout, which it would also clean, and it has no grace period. See Reproducing pull requests for how the full runs of pull requests and of main are recorded.