POST
/
pipelines
{
  "workloads": [
    {
      "raw_data": "base64_encoded_content",
      "schemas": ["schema1", "schema2"],
      "data_source": "pdf",
      "documents_location": "local",
      "file_name": "document.pdf",
      "destination": "default"
    }
  ],
  "provider_type": "openai",
  "provider_model_name": "gpt-4",
  "api_key": "sk-...",
  "markdown_mode": false,
  "additional_params": {
    "temperature": 0.5
  }
}

{
  "task_id": "b6781f5b-022b-485e-b93c-6a958e51b992",
  "message": "Pipeline processing started"
}

This endpoint allows you to run a data processing pipeline. It accepts a JSON payload with the pipeline configuration and returns a task ID for tracking the pipeline’s progress.

{
  "workloads": [
    {
      "raw_data": "base64_encoded_content",
      "schemas": ["schema1", "schema2"],
      "data_source": "pdf",
      "documents_location": "local",
      "file_name": "document.pdf",
      "destination": "default"
    }
  ],
  "provider_type": "openai",
  "provider_model_name": "gpt-4",
  "api_key": "sk-...",
  "markdown_mode": false,
  "additional_params": {
    "temperature": 0.5
  }
}

{
  "task_id": "b6781f5b-022b-485e-b93c-6a958e51b992",
  "message": "Pipeline processing started"
}

Body

application/json
​
workloads
object[]
required
​
provider_type
string
required
​
provider_model_name
string
required
​
api_key
string
required
​
markdown_mode
boolean
default:false
​
additional_params
object

Response

202
application/json
Pipeline processing started
​
task_id
string
required

Unique identifier for the pipeline task

​
message
string
required

Status message