Skip to main content
POST
/
api
/
v1
/
pipeline
Create or update a pipeline configuration
curl --request POST \
  --url http://localhost:8080/api/v1/pipeline \
  --header 'Content-Type: application/json' \
  --header 'x-api-key: <api-key>' \
  --data '
{
  "name": "<string>",
  "source": {},
  "preprocessor": {},
  "dataQuality": {},
  "transformation": {},
  "destination": {}
}
'

Authorizations

​
x-api-key
string
header
required

Optional API key for authentication (enabled via application.yaml)

Body

application/json
​
name
string
required

Pipeline name

​
source
object

Source configuration (fileAttributes, schemaProperties)

​
preprocessor
object

Optional REST endpoint preprocessor

​
dataQuality
object

Data quality rules (AI rules, header validation, schema validation)

​
transformation
object

Transformation rules (AI transformation, deduplication, trimming)

​
destination
object

Destination configuration (database, objectStore, kafka, activeMQ, restEndpoint, qdrant, weaviate, milvus, chroma, pgvector).

objectStore supports two providers via the provider field: minio (default, uses the built-in MinIO credentials) and s3 (AWS S3). For provider: s3, set destinationBucketOverride (required), credentialsSecret (Vault secret with accessKey/secretKey/region and optional sessionToken), and optionally endpoint (must be https://). Region lives in the credentials secret, not on the objectStore config.

Response

Pipeline created/updated