Preprocessor - Datris

Location: examples/preprocessor/ A Flask REST API that demonstrates the pipeline’s preprocessor capability. The preprocessor is called before data quality and transformation, allowing you to modify, enrich, or filter data before the pipeline processes it. Supports both synchronous and asynchronous modes.

Endpoints

POST http://localhost:5500/preprocess/sync — Process data synchronously and return the result
POST http://localhost:5500/preprocess/async — Process data asynchronously and POST results back via callback

Setup

cd examples/preprocessor
pip install flask requests

Run

python app.py    # runs on port 5500

Usage

Configure a pipeline’s source.preprocessor with the endpoint URL. The pipeline sends data to your preprocessor before ingestion, allowing custom transformations. See Preprocessor for the full preprocessor protocol and configuration reference.