gpkafka history

gpkafka history

Check the progress of a load operation from Kafka to Greenplum Database.

Synopsis

gpkafka history config.yaml 
    [--show-commit-history {all | latest}]
    [-l | --log-dir directory] [--verbose]

gpkafka history {-h | --help}

Description

Note: gpkafka history is deprecated and will be removed in a future release.

The gpkafka history utility is a wrapper around the Greenplum Streaming Server gpsscli history command. It displays the commit history of the Kafka to Greenplum Database load operation defined in config.yaml.

You can request the complete commit history or the history for the last batch of data written to Greenplum Database. gpkafka history displays the commit history of the latest data load operation by default.

Options

config.yaml
The Version 1 (deprecated) or Version 2 YAML-formatted configuration file that defines the load operation parameters. If the filename provided is not an absolute path, Greenplum Database assumes the file system location is relative to the current working directory.
--show-commit-history { all | latest }
Specify all to display the complete commit history of the data load operation defined in config.yaml. latest, the default, prints the commit history of the last batch of Kafka data written to Greenplum Database.
-l | --log-dir directory
Specify the directory to which gpkafka writes client command log files. gpkafka must have write permission to the directory. gpkafka creates the log directory if it does not exist.
If you do not provide this option, gpkafka writes client log files to the $HOME/gpAdminLogs directory.
--verbose
The default behaviour of the command utility is to display information and error messages to stdout. When you specify the --verbose option, gpkafka also outputs debug-level messages about the operation.
-h | --help
Show command utility help, and then exit.

Examples

Display the complete commit history of the data load operation defined in the gpkafka load configuration file named loadcfg.yaml:

gpkafka history --show-commit-history all loadcfg.yaml