Optional API key for authentication (enabled via application.yaml)
Pipeline name
Source configuration (fileAttributes, schemaProperties)
Optional REST endpoint preprocessor
Data quality rules (AI rules, header validation, schema validation)
Transformation rules (AI transformation, deduplication, trimming)
Destination configuration (database, objectStore, kafka, activeMQ, restEndpoint, qdrant, weaviate, milvus, chroma, pgvector)
Pipeline created/updated