SNP Outboard™ Datafridge Settings
You can access the settings in SNP Outboard™ Datafridge via transaction /DVD/RMX_EXPERT. They are also available in the data ingestion function. The settings serve to modify the behavior of SNP Outboard™ Datafridge in the desired way.
There are two types of settings in SNP Outboard™ Datafridge:
-
Global settings: Global settings for all users.
-
Run-specific settings: Specific settings used to adjust processes during data ingestion runs and legal hold runs. During data ingestion via RFC, there are also some settings saved on the source system.
Settings
Name | Description | Purpose |
---|---|---|
ATT_COMMIT_LIMIT |
The threshold for the attribute commit during the load |
Prevents a full table lock on the attribute table. This can cause a serious issue, especially when multiple processes need to insert data into the table. |
ATT_CONTAINER_SIZE | Maximum count of attachments in one container | Count of attachments to be stored in one container. According to the selected storage, the container can be a folder or database table. For each package, a new container is created. For database storages, you should use this to prevent huge tables. |
ATT_LOAD_PACK_OWRITE |
Attachment load: Overwrites the existing package (file) |
Overwrites attachments in the target folder. This is useful when re-executing a load without the possibility to clean up the previous load. |
ATT_LOAD_PACK_PORTIO |
Attachment load: Number of files per job |
Specifies how many files must be ingested by one job. This is useful when parallelization of the attachment ingestion is required. |
BROWSER_MAX_ROWS |
Maximum rows fetched for browser |
Specifies the maximum number of rows that can be fetched from the database when displaying an ALV grid with header entries. This is useful to prevent the ALV display from dumping. |
BUCKET_DATE_FORMAT |
Year in which the posting was made |
Specifies whether data is partitioned based on years (YYYY) or months (YYYYMM). |
CLUSTER_CLEANUP_DAYS |
Period in days after which data is deleted from the cluster |
Cleans up the buffer. Because the data browser buffers data that is retrieved from the target storage, it is required to clean up the buffer regularly. |
CONVERSION_EXIT | Conversion exit within HTML browser on/off - (X/'') | Use the conversion exit function before displaying data within the HTML browser. |
CSV_DELIMITER |
Delimiter for CSV data files |
Delimiter that is used in the bulk data. |
CSV_EXPORT_DELIMITER |
Delimiter for exported CSV data from SNP Outboard™ Datafridge tables |
Delimiter of the exported data via the mass download. |
CSV_EXPORT_QUALIFIER |
Qualifier for exported CSV data from SNP Outboard™ Datafridge tables |
Text qualifier of the exported data via the mass download. |
CSV_EXPORT_ROOT_DIR |
Directory for exported CSV data from SNP Outboard™ Datafridge tables |
The root directory of the mass download (for CSV files). |
CSV_QUALIFIER |
Qualifier for CSV data files |
Text qualifier used in the bulk data. |
CURR_ADJUST_DTYPE | Currency adjustment data types (for example 'DEC,CURR') | Adjust currency only for mentioned data types. Other data types are ignored in this adjustment. Fill in a list of values delimited with ,e.g.DEC,CURR. |
DART_DIRECTORY_SET |
DART directory set |
Corresponds to the directory set, which is maintained via transaction FTWP. This must be configured if you want to browse DART extract files directly from the HTML view. It uses transaction FTWF. The first line of the directory set must store the absolute path to the folder where DART extract files are stored. |
DECOMM_XVALID_DATA_ONLY | Consider only XVALID data during decommissioning |
If this setting is turned on, during decommissioning process, for each record in the object list table and object attachment table XVALID flag is checked. If a record with an empty XVALID flag is found either in object list table or attachment table, the corresponding bucket is NOT deleted. Turned on: X Turned off: empty Default value: empty |
DEFAULT_DATA_BROWSER |
Default data browser. Possible values: HTML; WRITE |
This parameter is obsolete. Only the HTML browser is supported now. |
DEVCLASS |
Development package |
Specifies the default development package for SNP Glue™ metaobjects. |
DYNAMIC_CURR_ADJUST |
Dynamic currency adjustment. Possible values: <X> = enabled; <empty> = disabled |
Specifies whether dynamic currency adjustment is enabled or disabled. This determines whether figures are adjusted before displaying them on the screen. |
ENR_LOAD_LOGSYS | Logical system name | Name of a logical system, for which the default content should be loaded. Enter a single name of a logical system, which was already fully ingested. |
ENR_LOAD_OVERWRITE | Overwrite already loaded enrichment? | Overwrite value is turned on/off (X/empty). The value should be either empty or set to X if overwrite is required. |
EXTR_FILE_PORTIONS |
Number of CSV files added to a variant. The value 0 means that all the CSV files are added to a single variant |
Parallelizes the bulk data load. |
EXT_SKIP_LINES_CSV |
Number of header lines to be skipped in the CSV extraction |
Skips the header line of the CSV file when ingesting the data. |
FILE_PACKAGE_SIZE |
File package size for the file extraction (MB) |
Specifies the package size for the attachment load. This is useful when loading large files into the target storage. |
FILE_READER_MODE |
Mode that defines whether files are local or remote |
This parameter is obsolete. Only use remote files. |
GLFEX_ATT_ADD_MANDT | Add MANDT as key field to attachments (X/''). | Insert MANDT (Client) field value to attachment object ID. The attachment object ID needs to fit generated object ID. Check /DVD/RMX_OBJKEY table and if MANDT is part of the object key, set this parameter to X. |
GLFEX_HR_OBJID | Object identifier for HR Cluster data | Business object name for HR cluster ingestion. Default value is R3_PAY. |
GLFEX_HR_PACK_SIZE | Personnel number count to read from HR Cluster | Personnel number count to read from HR Cluster in one task. |
GLFEX_KEEP_DATA | Keeps data in the SNP Glue Queue after the load finishes. | Keeps data in SNP Glue FIFO Queue after it is loaded to the target table. Data is automatically deleted after all subscribers have read them. If this parameter is set to X, a dummy SNP Glue Fetcher for each queue is created. |
GLFEX_MAX_PCK_LOAD | Maximum package count per one task (RFC load). | Count of data packages to load through RFC in one task. One data package has a default size of 100 MB. |
GLFEX_OWN_OBJLIST_LIMIT | Bigger tables will have own OBJLIST table (row count) | Limit to have own object list table. If there is at least “limit“ rows in the business object header table, the object list is put into separate table. Small object lists are stored together in one table specific to the logical system. |
GLFEX_OWN_SARA_OBJ | Create special business objects for SARA data? - (X/'') | If the value is X, SNP Outboard™ Datafridge creates a new business object to store data from SARA. |
GLFEX_SARA_PREFIX | Prefix for SARA structure generation. | Prefix for generated objects in SARA ingestion (structures, reports, etc.). |
HASH_VALIDATION |
Validate data using hash values. Possible values: <X> = enabled; <empty> = disabled |
Specifies whether the data is validated using hash values during the object list validation. |
HR_CHECK_DATA | Check data existence in HR transactions on/off - (X/'') | When displaying HR data, there are many different structures with data. Many structures can be empty for selected persons. If this parameter has the value X, the system checks which structures are empty after the person is selected and indicates this on the overview screen. On one hand, you will have information about structures with the data, on the other hand, you need to wait until this calculation is done after each person’s selection. |
INCREM_OBJATT_LOAD |
Incremental object attachment list load. Possible values: <X> = enabled; <empty> = disabled |
In some cases, it is not possible to export and import all attachments at once. For this scenario, SNP Outboard™ Datafridge offers a way to load them incrementally. To do so, perform the following steps for all packages/batches:
Once these steps are complete, execute the step Run post-validation task. |
INITIAL_VALUES_TAGGING |
Tag initial or empty values too during data tagging. Possible values: <X> = enabled; <empty> = disabled |
Specifies parameters for the data tagging process:
|
LOGGING_OF_ACTIONS |
Option for enabling or disabling action logging |
Determines whether various actions are logged in SNP Outboard™ Datafridge. |
MASS_DL_DEF_BUTTON |
Default value of a radio button in the mass download |
Defines a default radio button value in Data Discover. |
MASS_DL_MAX_INNER_JOINS |
Maximum number of INNER JOINs in the mass download. The maximum value is 5 |
Specifies the maximum number of INNER JOINs between an attribute table and an object list table. |
MAX_ATTACHMENTS_IN_ZIP |
Maximum number of attachments in a ZIP file in the mass download |
When the mass download is executed with the option to include all the relevant attachments, these attachments are stored in one or more ZIP files. This parameter adjusts the maximum number of attachments in one ZIP file to prevent memory problems during the mass download. |
OBJLIST_UPD_PACKAGE |
Package size for the object list update |
Specifies the number of lines after which a commit is executed. |
OBJLIST_VAL_PACKAGE |
Package size for the object list validation |
Specifies how many lines are pulled from a target database during the object list validation. |
OBJNO_DELIMITER |
Object number delimiter in the table /DVD/RMX_OBJLIST |
Specifies the delimiter of key fields in the object list. |
ROOT_DIR |
Mounted directory with CSV data files |
Specifies the root directory with bulk data. |
TABLE_PACKAGE_SIZE |
Package size for table extraction (number of rows) |
Specifies the package size for the transparent data load. This is useful if a bulk data file is too large. |
TABLE_WITH_ARCHIV_KEY_FLD | Create a target table with the ARCHIV_KEY field | Should the target table be created with the ARCHIV_KEY field? This will allow ingestion of archived data by SARA. |
VALIDATE_LINE_ITEMS |
Line item validation during the object list validation |
Determines whether to also validate line items during the object list validation. |
WEB_GUI_LINK |
Alternative WebGUI link. Possible values: <user-defined link> = enabled; <empty> = disabled/default link |
Specifies the WebGUI link if SNP Outboard™ Datafridge cannot generate it correctly from the system parameters. If the parameter is set, this user-defined link is always used instead of the default one. |
WEB_GUI_VERSION |
WebGUI version |
Specifies the version of the WebGUI. The default value is v2. If v2 does not work, you can change the version to v1. |
WHERECLAUSE_SIZE |
Number of records in WHERE clause for legal hold |
Specifies the maximum length of the WHERE clause. This depends on how many WHERE clauses the target storage supports. |
XML_EXPORT_ROOT_DIR |
Directory for exported XML data from SNP Outboard™ Datafridge tables |
Specifies the root directory of the mass download for XML files. |
XML_MAX_LINES |
Maximum number of lines in XML files |
Specifies the maximum number of lines per XML file. This is useful to prevent XML files from becoming too large. |
DIR_DELIMITER | Directory delimiter for binary storage (‘/’ or ‘\’) | According to your operating system you need to set up the right directory delimiter, usually '/' or '\'. |
GLFEX_HASH_INGEST | Compute hashes during data ingestion (X/'') | Do you want to compute validation hashes during data ingestion? In this case you probably want to disable the hash calculation while extracting data into the queue. Check the parameter HASH_VALIDATION for the source system. |
GLFEX_SARA_TECH_OBJ | Own technical objects for SARA ingestion | Create new technical objects and Glue tables for SARA data. |
VALIDATION_ITEMS_CHECK | Validation: check if a main record exists for the line item (X/'') | To validate item tables, check if each record has a corresponding record in the object list table, i.e. in the main table of the business object. |
NO_OBJLIST_UPDATE | Do not update the object list during the validation. Possible values: X or <empty> | Expert setting for data ingestion. If the value is X, the object list will not be updated during the header table validation. This can prevent performance issues. You can update the object list later via transaction /DVD/RMX_OBJLIST_UPD. |
OBJLIST_DDIC_MOD | Modification mode for the object list in the DDIC |
Direct data read - parameters on the source system
Name | Description | Purpose |
---|---|---|
ATTACHMENT_RELINK | Allow attachment relink (X/'') | Attachments can be saved in SAP cluster or in an external content server. Files stored in the content server can stay there and in SNP Outboard™ Datafridge stay only their links. To enable this approach, you need to set this parameter to X. |
COUNT_ROWS | Should we count all table rows? | If not checked (value empty and not X), Datafridge checks only if the tables are not empty - count up to 1 row. |
DEVCLASS | Package for generated code (source system) | Default development package for SNP Glue meta-objects. |
GLFEX_HR_PACK_SIZE | Personnel number count to read from HR Cluster | How many personnel numbers should be read from cluster in one task. |
GLFEX_KEY_SO | Create select options for table key fields | If checked (value X), SNP Outboard™ Datafridge generates SNP Glue extraction processes with a select-option for each table key field. |
GLFEX_SARA_PREFIX | Prefix for SARA structure generation | Prefix for generated objects in SARA ingestion (structures, reports, etc.). |
HASH_VALIDATION | Hash validation (""/"X") | Computes hashes for later validation. |
JOBCOUNT | Count of jobs to use in parallel tasks | Count of jobs to be used in parallel tasks. |
TABANL_MAXCNT | Count table rows up to N rows | Limit for table row count. It is useful, especially for large cluster tables (e.g. BSEG). |
TABANL_PACKSIZE | Package size for table analysis | This parameter says how many tables should be analyzed in one task. |
PCKG_SIZE | Package size in MB for RUNID | Adjust the package size in MB for a specific run ID. |
ANALYZE_CLIENTS | Analyze tables per client value, if applicable (X, '') | Do you want to analyze tables for all clients? Relevant only for client-specific tables. |
ANALYZE_COUNT_PER_CLIENT | Count table rows per client, if applicable (X, '') | Do you want to count records in client-specific tables per clients? |
ANALYZE_USE_EXISTING | Use data collected in previous analysis, if existing (X, '') | The ‘X’ analysis tries to get data from Datafridge tables using data from a previous analysis. If data is found, it is copied. Otherwise, the analysis runs as usual. |
HASH_SWITCH_ENDIAN | Switch endian in calculated hash (X/'') | This setting is needed if the control system uses other endian settings as the source system. |
PARALLEL_ATT_PROCESSING | Process attachment ingestion in parallel mode (X/'') | Obtain a list of attachments in parallel. This option can speed up the processing of attachments. |
PCKG_SIZE | Package size in MB for data extraction. | Package size for extracting data from SAP tables into Glue queues on the source system. |