Collect
Tables H
Use this page to:
- Assign Schedule Groups to Table
- Manually Register Tables to Source
- Schedule Table Refresh
- Set up Download with CranPort Package
- Set up Download with ManualCranPort Package
- Assign Schedule Group to Table
- Download sdb Tables in Collect
- Download dgSAP Tables in Collect
NOTE: Bulk Execution has been enabled on this page. Refer to Use Bulk Execution for more information.
NOTE: To receive a workflow email that a table download has failed in Collect, a user must be assigned to a security role that has the Collect WebApp group WorkFlowFailureAll or WorkFlowFaiureByTargetAccess assigned. Refer to Set Security in System Administration for more information.
To access this page:
- Click Collect > Targets in the Navigation pane.
- Click the Sources icon for atarget.
- Click the Tables icon for a source.
Field |
Description |
Build And Refresh |
Click to build the package and download active tables from the source. If the package already exists, the table is refreshed (i.e., data is downloaded from the source database). If the package does not exist, a package is immediately scheduled to be built and the table is refreshed.
NOTE: If the data in the table has been purged manually, or the retention expiration date for that object has passed, it cannot be refreshed and this icon is inactive. Refer to Purge Data for more information. |
Reset |
Click to reset a running refresh. This process activates the Refresh icon and triggers batch job schedule to calculate new run dates for next scheduled refresh. Reset source if the download process backs up due to network problems. |
Build Package |
Click to build a package to download active tables from the source. NOTE: If the data in the table has been purged manually, or the retention expiration date for that object has passed, it cannot be refreshed and this icon is inactive. Refer to Purge Data for more information. |
Refresh |
Click to manually extract a copy of data from the source and load into the target. NOTE: If the Target Source uses an IG Universal Connect data source, clicking Refresh executes the Boomi Process. NOTE: If the data in the table has been purged manually, or the retention expiration date for that object has passed, it cannot be refreshed and this icon is inactive. Refer to Purge Data for more information. |
TARGET |
Displays the database where tables are refreshed with source data. |
SOURCE |
Displays the database where data is refreshed from and stored in the target. |
TABLE |
Displays table name in the source database. |
PACKAGE TYPE |
Displays package type to refresh target table with source data. Default value is CranPort. Refer to Package Types for a description of each package type available. NOTE: When the package type is CranPort package, the package name is hyperlinked to the CranPort package in Assemble in the view. NOTE: If source has an SAPAPPSERVER connection type, only the following RFC package types are available in the Package Type list box:
|
ACTIVE |
If enabled, table is active. Only active tables are downloaded from the source during refresh. Default value is Active. |
BUILT |
If enabled, package for table has been built. This setting cannot be updated from within Collect. |
DURATION |
Displays amount of time (in seconds) it took for the table to download from the source. This field is protected and updated by Collect when the table refresh process completes. |
UOM |
Displays the Unit of Measure used for measure the duration. |
RECORD COUNT |
Displays number of records in the table. This field is protected and updated by Collect when the table refresh process completes. |
PRIORITY |
Displays order that tables are refreshed with source data and sorted on the page. Default value is 99999. |
COMPLETED |
Displays date and time when the manual refresh completed. |
NEXTRUN |
Displays next scheduled date and time when the refresh process is scheduled to run. |
Rules |
Click to open the Table (Rule) page to register rules to table. |
Indices |
Click to open the Table (Indices) page to register indices to table. |
View Data |
Click to open the Tables page to view table data downloaded from source. |
Tables V (All Tabs)
Use this page to:
- Assign Schedule Groups to Table
- Manually Register Tables to Source
- Schedule Table Refresh
- Set up Download with CranPort Package
- Set up Download with ManualCranPort Package
- Assign Schedule Group to Table
This page contains the following tabs:
General tab
Field |
Description |
Build Package |
Click to build a package to download active tables from the source. NOTE: If the data in the table has been purged manually, or the retention expiration date for that object has passed, it cannot be refreshed and this icon is inactive. Refer to Purge Data for more information. |
Reset |
Click to reset a running refresh. This process activates the Refresh icon and triggers batch job schedule to calculate new run dates for next scheduled refresh. Reset source if the download process backs up due to network problems. |
Refresh |
Click to manually extract a copy of data from the source and load into the target. NOTE: If the Target Source uses an IG Universal Connect data source, clicking Refresh executes the Boomi Process. NOTE: If the data in the table has been purged manually, or the retention expiration date for that object has passed, it cannot be refreshed and this icon is inactive. Refer to Purge Data for more information. |
Target |
Displays the target database where tables are refreshed with source data. |
Source |
Displays the database where data is refreshed from and stored in the target. |
Table |
Displays table in the source database. |
Active |
If enabled, table is active. Only active tables are downloaded from the source during refresh. Default value is Active. |
Description |
Displays information about table, for example, data contained within table. |
Advanced Settings tab
Field |
Description |
Table Rename |
Displays the table name of the renamed table in target database. New table name must contain [TableName]. At run time, [TableName] is replaced with processing table name. |
Where Clause Override |
Displays a Where Clause that is used to limit data downloaded during a refresh process. |
Table Schema Owner |
Displays the database’s schema for the table. |
NextRun |
Displays next date and time when the refresh process is scheduled to run. |
Package Type |
Displays package type to refresh the target table with source data. Default value is CranPort. |
Package Name |
Displays name of package that refreshes target table with source data. NOTE: The package name is set automatically and displays after the package is built for the package types CranPort, SSIS, or Data Services. The package must be manually built and the package name must be entered into Collect for package types ManualCranPort, ManualSSIS or Manual Data Services. NOTE: The package name must follow the naming convention #Database#%#Source#%. Refer to Create Packages for more information. NOTE: For Manual Data Services package types, select from the list of available jobs in the Data Services Repository assigned to the target on the Targets page’s Vertical View. |
Schedule ID |
Displays schedule for when target tables are refreshed with source data. Options are controlled in Common > Configuration > Schedules. Default value is Use Source Schedule setting. No Table Override Requested. |
Schedule Group |
Displays schedule to build packages, refresh or filter on tables in a group. Schedule Groups are managed in Configuration > Schedule Groups. Default value is No Group. NOTE: If building a group with a DBMoto®
package the following applies: NOTE: The Replication Mode must be consistent with the Replication Group Mode (e.g a download package cannot be grouped with a mirror package). |
Synchronous |
If enabled, packages for Data Services jobs execute synchronously. If disabled, packages for Data Services jobs execute asynchronously. With synchronous execution, the build package jobs respect the queue and wait until jobs are finished before starting another job. This option applies to the Data Services Package Types. |
Schedule Single Thread |
If enabled, table is downloaded from the source in a queue with all other single-threaded tables. Default value is Disabled. |
Pooled Table Name |
Displays name of SAP pooled table. Collect automatically changes the download RFC for pooled tables (i.e., SAP tables that store a list of tables, for example, ATAB stores 200 tables within a single table). Refer to SAP documentation for more information about pooled tables. |
Rfc Records Per Call |
Displays number of records returned in a single block for Collect background process to parse and insert into database. Default value is 5000. |
Encrypted Columns |
Click to open the Target Source Table Column Encryption page to edit column encryption for the table. |
Boomi |
|
Boomi Process |
Displays the name of the Boomi Process that runs when the Target Source is refreshed. NOTE: A Boomi Process must be selected for each table. NOTE: This field only displays if the source is an IG Universal Connect data source. |
General Information tab
Field |
Description |
Job ID |
Displays unique identifier of with the Platform job that ran the package. |
Completed |
Displays date and time when manual refresh completed. |
Record Count |
Displays number of records in the table. This field is protected and updated by Collect when the table refresh process completes. If the number of sources registered exceeds the Max Record Sources For Union View parameter threshold set on the Parameters – Collect page, no Record Count is calculated and the field is set to 0. |
Table Record Count |
Displays number of records currently in the table. Ideally, this count is the same as Record Count. If there is no primary key or unique index, this count may display zero but the table could have data. |
Duration |
Displays amount of time (in seconds) the table took to download from the source during the refresh process. |
Refresh Message |
Displays last process that ran against table, e.g., build package, download or reset. |
View Design |
Click to open the Data Source Tables page to view, edit and delete details about the table. |
View Metrics |
Click to open the Download Metrics page to view and download metrics for table. |
View Job Tasks |
Click to open the Table Download Task List page to view job tasks used to download table. |
Action tab
Use this tab to purge data for tables.
Field |
Description |
Truncate Table |
Click to delete all data in the table. Table can then be deactivated if it is no longer required. |
Options |
Click to open the Table (Rfc Options)page to configure RFC options used by RFC download process. The icon is only active if Package Type = BOA RFC using Options. |
Data Protection tab
Use this tab to:
Field |
Description |
Data Controller |
Displays the user responsible for the processing of personal data in the table Any user or group who is assigned the Data Controller role must have a user account in the DSP. Data Controller must have access to the target based on their assigned security role and security key. NOTE: The Collect Administrator must check the WORK FLOW SUMMARY check box for the target and Data Controller on the Workflow Summary User Settings page. The Data Controller is added to this page automatically. If the check box is not checked, the Data Controller will not receive a warning email that data is going to be purged. |
Data Classification |
Displays the nature of the data in the table, identifying whether it contains personal data and so must be purged for regulatory compliance. Options included with the DSP are:
NOTE: These options are delivered with the DSP and cannot be updated; however, a Common Administrator can create custom classifications on the Data Classification page in Common. Refer to Add Custom Data Classifications and Information Types for more information. |
Retention Expiration Date |
Displays the date when the data in the table will be automatically purged when a Service page runs. A Collect Administrator must enter a date for a table with a data classification of Personal or for any custom classification with the Retention Period Warning feature enabled. A different retention expiration date can be set at the target and target source level. If no date is set for the object, the data is not purged. NOTE: Updates to this field are audited. An e-signature is required. NOTE: Once this data has passed, the Refresh and Build and Refresh icons on the Targets, Target Sources, and this page are inactive. The table can no longer be refreshed either manually or automatically. |
Data Collection Reason |
Displays reason for extracting the data. Any time the table is processed, the data should only be used for the reason identified in this field. |