DataHub
CertifiedTasks that run DataHub CLI ingestions and interact with DataHub metadata.
Use this plugin to execute the DataHub ingestion CLI (default image acryldata/datahub-ingestion:head) against a provided recipe. Supply recipe as a map or Kestra storage URI; optionally set containerImage, env, and taskRunner for execution, plus namespaceFiles, inputFiles, and outputFiles to bundle dependencies and capture generated artifacts.
DataHub
Tasks that run DataHub CLI ingestions and interact with DataHub metadata.
Use this plugin to execute the DataHub ingestion CLI (default image acryldata/datahub-ingestion:head) against a provided recipe. Supply recipe as a map or Kestra storage URI; optionally set containerImage, env, and taskRunner for execution, plus namespaceFiles, inputFiles, and outputFiles to bundle dependencies and capture generated artifacts.
How to use the DataHub plugin
Run DataHub ingestion recipes from Kestra flows to push metadata into your DataHub catalog.
Authentication
Authentication is configured inside the recipe itself — set the GMS server URL and token in the recipe's sink section (e.g. under sink.config.server and sink.config.token). You can also pass credentials via the env map. Store secrets in secrets and apply connection properties globally with plugin defaults.
Tasks
Ingestion runs a DataHub ingestion recipe using the datahub ingest CLI in a container (default image acryldata/datahub-ingestion: head) — set recipe (required, either an inline Map with the full recipe YAML structure, or a kestra:// URI pointing to a recipe file). Use env for environment variables, namespaceFiles to reference namespace files, inputFiles to stage files into the container, and outputFiles to retrieve results.
