Documentation
Downloads
Support
Contact Us
Sign In
Register
Documentation
Downloads
Support
Contact Us
Sign In
Register
Doc Index
Pivotal Greenplum® 5.14 Documentation
Administrator Guide
Greenplum Database Concepts
About the Greenplum Architecture
About Management and Monitoring Utilities
About Concurrency Control in Greenplum Database
Example of Managing Transaction IDs
About Parallel Data Loading
About Redundancy and Failover in Greenplum Database
About Database Statistics in Greenplum Database
Managing a Greenplum System
About the Greenplum Database Release Version Number
Starting and Stopping Greenplum Database
Accessing the Database
Establishing a Database Session
Supported Client Applications
Greenplum Database Client Applications
Connecting with psql
Using the PgBouncer Connection Pooler
Database Application Interfaces
Troubleshooting Connection Problems
Configuring the Greenplum Database System
About Greenplum Database Master and Local Parameters
Setting Configuration Parameters
Setting a Local Configuration Parameter
Setting a Master Configuration Parameter
Setting Parameters at the System Level
Setting Parameters at the Database Level
Setting Parameters at the Role Level
Setting Parameters in a Session
Viewing Server Configuration Parameter Settings
Configuration Parameter Categories
Connection and Authentication Parameters
Connection Parameters
Security and Authentication Parameters
System Resource Consumption Parameters
Memory Consumption Parameters
Free Space Map Parameters
OS Resource Parameters
Cost-Based Vacuum Delay Parameters
Transaction ID Management Parameters
Query Tuning Parameters
GPORCA Configuration Parameters
Query Plan Operator Control Parameters
Legacy Query Optimizer Costing Parameters
Database Statistics Sampling Parameters
Sort Operator Configuration Parameters
Aggregate Operator Configuration Parameters
Join Operator Configuration Parameters
Other Legacy Query Optimizer Configuration Parameters
Error Reporting and Logging Parameters
Log Rotation
When to Log
What to Log
System Monitoring Parameters
SNMP Alerts
Email Alerts
Greenplum Command Center Agent
Runtime Statistics Collection Parameters
Automatic Statistics Collection Parameters
Client Connection Default Parameters
Statement Behavior Parameters
Locale and Formatting Parameters
Other Client Default Parameters
Lock Management Parameters
Resource Management Parameters
External Table Parameters
Database Table Parameters
Database and Tablespace/Filespace Parameters
Past Version Compatibility Parameters
Greenplum Array Configuration Parameters
Interconnect Configuration Parameters
Dispatch Configuration Parameters
Fault Operation Parameters
Distributed Transaction Management Parameters
Read-Only Parameters
Greenplum Master and Segment Mirroring Parameters
Greenplum Database Extension Parameters
Enabling High Availability and Data Consistency Features
Overview of Greenplum Database High Availability
Overview of Segment Mirroring
Overview of Master Mirroring
Overview of Fault Detection and Recovery
Enabling Mirroring in Greenplum Database
Enabling Segment Mirroring
Enabling Master Mirroring
Detecting a Failed Segment
Enabling Alerts and Notifications
Checking for Failed Segments
Checking the Log Files for Failed Segments
Recovering a Failed Segment
Recovering From Segment Failures
When a segment host is not recoverable
About the Segment Recovery Process
Recovering a Failed Master
Restoring Master Mirroring After a Recovery
Backing Up and Restoring Databases
Backup and Restore Overview
Parallel Backup with gpcrondump and gpdbrestore
Backup and Restore Options
Backing Up with gpcrondump
Backing Up a Set of Tables
Creating Incremental Backups
Backup Process and Locks
Using Direct I/O
Using Named Pipes
Backing Up Databases with Data Domain Boost
Backing Up Databases with Veritas NetBackup
Restoring Greenplum Databases
Restoring a Database Using gpdbrestore
Restoring to a Different Greenplum System Configuration
Parallel Backup with gpbackup and gprestore
Requirements and Limitations
Objects Included in a Backup or Restore
Performing Basic Backup and Restore Operations
Filtering the Contents of a Backup or Restore
Configuring Email Notifications
Understanding Backup Files
Creating Incremental Backups with gpbackup and gprestore
About Incremental Backup Sets
Using Incremental Backups
Using gpbackup and gprestore with BoostFS
Installing BoostFS
Backing Up and Restoring with BoostFS
Using gpbackup Storage Plugins
Using the S3 Storage Plugin with gpbackup and gprestore
Using the DD Boost Storage Plugin with gpbackup and gprestore
Backup/Restore Storage Plugin API
backup_data
backup_file
cleanup_plugin_for_backup
cleanup_plugin_for_restore
plugin_api_version
restore_data
restore_file
setup_plugin_for_backup
setup_plugin_for_restore
Expanding a Greenplum System
System Expansion Overview
Planning Greenplum System Expansion
Preparing and Adding Nodes
Initializing New Segments
Redistributing Tables
Removing the Expansion Schema
Migrating Data
Migrating Data with gpcopy
Migrating Data with gptransfer
Monitoring a Greenplum System
Routine System Maintenance Tasks
Recommended Monitoring and Maintenance Tasks
Managing Greenplum Database Access
Configuring Client Authentication
Using LDAP Authentication with TLS/SSL
Using Kerberos Authentication
Configuring Kerberos for Linux Clients
Configuring Kerberos For Windows Clients
Managing Roles and Privileges
Defining Database Objects
Creating and Managing Databases
Creating and Managing Tablespaces
Creating and Managing Schemas
Creating and Managing Tables
Choosing the Table Storage Model
Partitioning Large Tables
Creating and Using Sequences
Using Indexes in Greenplum Database
Creating and Managing Views
Distribution and Skew
Inserting, Updating, and Deleting Data
Querying Data
About Greenplum Query Processing
About GPORCA
Overview of GPORCA
Enabling and Disabling GPORCA
Collecting Root Partition Statistics
Considerations when Using GPORCA
GPORCA Features and Enhancements
Changed Behavior with the GPORCA
GPORCA Limitations
Determining the Query Optimizer that is Used
About Uniform Multi-level Partitioned Tables
Defining Queries
WITH Queries (Common Table Expressions)
Using Functions and Operators
Working with JSON Data
Working with XML Data
Query Performance
Managing Spill Files Generated by Queries
Query Profiling
Working with External Data
Defining External Tables
file:// Protocol
gpfdist:// Protocol
gpfdists:// Protocol
gphdfs:// Protocol
pxf:// Protocol
s3:// Protocol
Using a Custom Protocol
Handling Errors in External Table Data
Creating and Using External Web Tables
Examples for Creating External Tables
Example 1—Single gpfdist instance on single-NIC machine
Example 2—Multiple gpfdist instances
Example 3—Multiple gpfdists instances
Example 4—Single gpfdist instance with error logging
Example 5—TEXT Format on a Hadoop Distributed File Server
Example 6—Multiple files in CSV format with header rows
Example 7—Readable External Web Table with Script
Example 8—Writable External Table with gpfdist
Example 9—Writable External Web Table with Script
Example 10—Readable and Writable External Tables with XML Transformations
Accessing External Data with PXF
Accessing HDFS Data with gphdfs
One-time gphdfs Protocol Installation
Grant Privileges for the gphdfs Protocol
Specify gphdfs Protocol in an External Table Definition
Support for Avro Files
Support for Parquet Files
HDFS Readable and Writable External Table Examples
Reading and Writing Custom-Formatted HDFS Data
Using Amazon EMR with Greenplum Database installed on AWS
Using the Greenplum Parallel File Server (gpfdist)
Loading and Unloading Data
Loading Data Using an External Table
Loading and Writing Non-HDFS Custom Data
Using a Custom Format
Importing and Exporting Fixed Width Data
Examples: Read Fixed-Width Data
Using a Custom Protocol
Handling Load Errors
Define an External Table with Single Row Error Isolation
Capture Row Formatting Errors and Declare a Reject Limit
Viewing Bad Rows in the Error Log
Identifying Invalid CSV Files in Error Table Data
Moving Data between Tables
Loading Data with gpload
Loading Kafka Data with the Greenplum-Kafka Integration
Transforming External Data with gpfdist and gpload
Loading Data with COPY
Running COPY in Single Row Error Isolation Mode
Optimizing Data Load and Query Performance
Unloading Data from Greenplum Database
Defining a File-Based Writable External Table
Example 1—Greenplum file server (gpfdist)
Example 2—Hadoop file server (gphdfs)
Defining a Command-Based Writable External Web Table
Disabling EXECUTE for Web or Writable External Tables
Unloading Data Using a Writable External Table
Unloading Data Using COPY
Formatting Data Files
Formatting Rows
Formatting Columns
Representing NULL Values
Escaping
Escaping in Text Formatted Files
Escaping in CSV Formatted Files
Character Encoding
Example Custom Data Access Protocol
Installing the External Table Protocol
gpextprotocal.c
Managing Performance
Defining Database Performance
Common Causes of Performance Issues
Greenplum Database Memory Overview
Managing Resources
Using Resource Groups
Using Resource Queues
Investigating a Performance Problem
LATEST VERSION: 5.15 -
RELEASE NOTES
Pivotal Greenplum
v5.14
v5.15
v5.14
v5.13
v5.12
v5.11
v5.10
v5.9
v5.8
v5.7
v5.6
v5.5
v5.4
v5.3
v5.2
v5.1
v5.0
v4.3.x
Download
Ask for Help
Knowledge Base
PDF
OS Resource Parameters
OS Resource Parameters
max_files_per_process
shared_preload_libraries
Parent topic:
System Resource Consumption Parameters
