Visualising Australasia’s Soils Background Technical Build CeRDI Observations System Upload/Validation

Upload/Validation

Upload

The VAS Upload Architecture defines how soil data submitted by partners moves through the system from Excel-template submission, preprocessing, validation, and mapping into CeRDI’s Observation System, to publication through the VAS API. It ensures that all datasets conform to the ISO 19156 / OGC O&M model, enabling consistent ingestion and FAIR-compliant publication

System Flow

  1. Data Submission Interface

    • Contributors (grower groups, labs, CMA partners) upload soil-test workbooks through the VAS portal data-upload interface.

    • Each workbook follows the six-sheet structure: Dataset Info → Results → Spatial Data → Dropdowns.

    • On upload, the file enters a staging layer for format and metadata verification.

Validation

After upload, the Validation Process ensures that datasets meet technical and scientific quality standards before entering the live VAS Observation System. It combines automated checks, schema enforcement, and manual curation to guarantee interoperability, FAIR data compliance, and accuracy.

System Flow

  1. Pre-Processing & Validation

    • Metadata (project, organisation, licence, sampling method) are parsed from workbook.

    • The system cross-checks mandatory fields (*), validates coordinate pairs, date formats, and units of measure.

    • Invalid or incomplete rows trigger feedback via the interface; successful records advance to transformation.

  2. Transformation & Mapping

    • Data is mapped to the CeRDI Observation System, where: 'ObservedProperty', 'Procedure', 'Feature of Interest', and 'Unit of Measure' tables mirror the SOSA/O&M schema.

    • Spatial and sample relationships are defined through 'SpatialSamplingFeature' and 'Specimen' entities.

    • Manual review ensures alignment with controlled vocabularies and dataset licences.