Pipeline documentation

Pipeline is used with Extractors, Transformers, Loaders and Hooks. They are written in xml and can be all in a single file or spread out in multiple files.

Pipeline files are located by default in the app/config/Zed/springbok directory. You can change the directory by setting the SpringbokConfig::PIPELINE_FOLDER in your project’s config_xxx.php file.

<?php

$config[SpringbokConfig::PIPELINE_FOLDER] = APPLICATION_ROOT_DIR . '/config/Zed/springbok';

Pipeline file example:

<springbok>
    <pipeline name="pipeline_name">
        <extractor>
            <csv-file filename="path/to/file.csv" rowEntryName="rowEntryName" bulkSize="100" />
        </extractor>
        <transformers>
            <copy from="currentName" to="transformedName" />
        </transformers>
        <loaders>
            <glossary keyField="glossary_key" />
        </loaders>
    </pipeline>
</springbok>

To include more pipelines in one file, add more “pipeline” elements. Pipelines across all files must have different names.

Each pipeline can include one extractor and multiple transformers and loaders. It can use the same transformer multiple times.

Pipeline is executed using: console springbok:run *pipeline_name*