SNP Outboard™ Datafridge Settings

You can access the settings in SNP Outboard™ Datafridge via transaction /DVD/RMX_EXPERT. They are also available in the data ingestion function. The settings serve to modify the behavior of SNP Outboard™ Datafridge in the desired way.

There are two types of settings in SNP Outboard™ Datafridge:

  • Global settings: Global settings for all users.

  • Run-specific settings: Specific settings used to adjust processes during data ingestion runs and legal hold runs. During data ingestion via RFC, there are also some settings saved on the source system.

 

Settings

Name Description Purpose

ATT_COMMIT_LIMIT

The threshold for the attribute commit during the load

Prevents a full table lock on the attribute table. This can cause a serious issue, especially when multiple processes need to insert data into the table.

ATT_CONTAINER_SIZE Maximum count of attachments in one container Count of attachments to be stored in one container. According to the selected storage, the container can be a folder or database table. For each package, a new container is created. For database storages, you should use this to prevent huge tables.

ATT_LOAD_PACK_OWRITE

Attachment load: Overwrites the existing package (file)

Overwrites attachments in the target folder. This is useful when re-executing a load without the possibility to clean up the previous load.

ATT_LOAD_PACK_PORTIO

Attachment load: Number of files per job

Specifies how many files must be ingested by one job. This is useful when parallelization of the attachment ingestion is required.

BROWSER_MAX_ROWS

Maximum rows fetched for browser

Specifies the maximum number of rows that can be fetched from the database when displaying an ALV grid with header entries. This is useful to prevent the ALV display from dumping.

BUCKET_DATE_FORMAT

Year in which the posting was made

Specifies whether data is partitioned based on years (YYYY) or months (YYYYMM).

CLUSTER_CLEANUP_DAYS

Period in days after which data is deleted from the cluster

Cleans up the buffer. Because the data browser buffers data that is retrieved from the target storage, it is required to clean up the buffer regularly.

CONVERSION_EXIT Conversion exit within HTML browser on/off - (X/'') Use the conversion exit function before displaying data within the HTML browser.

CSV_DELIMITER

Delimiter for CSV data files

Delimiter that is used in the bulk data.

CSV_EXPORT_DELIMITER

Delimiter for exported CSV data from SNP Outboard™ Datafridge tables

Delimiter of the exported data via the mass download.

CSV_EXPORT_QUALIFIER

Qualifier for exported CSV data from SNP Outboard™ Datafridge tables

Text qualifier of the exported data via the mass download.

CSV_EXPORT_ROOT_DIR

Directory for exported CSV data from SNP Outboard™ Datafridge tables

The root directory of the mass download (for CSV files).

CSV_QUALIFIER

Qualifier for CSV data files

Text qualifier used in the bulk data.

CURR_ADJUST_DTYPE Currency adjustment data types (for example 'DEC,CURR') Adjust currency only for mentioned data types. Other data types are ignored in this adjustment. Fill in a list of values delimited with ,e.g.DEC,CURR.

DART_DIRECTORY_SET

DART directory set

Corresponds to the directory set, which is maintained via transaction FTWP. This must be configured if you want to browse DART extract files directly from the HTML view. It uses transaction FTWF. The first line of the directory set must store the absolute path to the folder where DART extract files are stored.

DECOMM_XVALID_DATA_ONLY Consider only XVALID data during decommissioning

If this setting is turned on, during decommissioning process, for each record in the object list table and object attachment table XVALID flag is checked. If a record with an empty XVALID flag is found either in object list table or attachment table, the corresponding bucket is NOT deleted.

Turned on: X

Turned off: empty

Default value: empty

DEFAULT_DATA_BROWSER

Default data browser. Possible values: HTML; WRITE

This parameter is obsolete. Only the HTML browser is supported now.

DEVCLASS

Development package

Specifies the default development package for SNP Glue™ metaobjects.

DYNAMIC_CURR_ADJUST

Dynamic currency adjustment. Possible values: <X> = enabled; <empty> = disabled

Specifies whether dynamic currency adjustment is enabled or disabled. This determines whether figures are adjusted before displaying them on the screen.

ENR_LOAD_LOGSYS Logical system name Name of a logical system, for which the default content should be loaded. Enter a single name of a logical system, which was already fully ingested.
ENR_LOAD_OVERWRITE Overwrite already loaded enrichment? Overwrite value is turned on/off (X/empty). The value should be either empty or set to X if overwrite is required.

EXTR_FILE_PORTIONS

Number of CSV files added to a variant. The value 0 means that all the CSV files are added to a single variant

Parallelizes the bulk data load.

EXT_SKIP_LINES_CSV

Number of header lines to be skipped in the CSV extraction

Skips the header line of the CSV file when ingesting the data.

FILE_PACKAGE_SIZE

File package size for the file extraction (MB)

Specifies the package size for the attachment load. This is useful when loading large files into the target storage.

FILE_READER_MODE

Mode that defines whether files are local or remote

This parameter is obsolete. Only use remote files.

GLFEX_ATT_ADD_MANDT Add MANDT as key field to attachments (X/''). Insert MANDT (Client) field value to attachment object ID. The attachment object ID needs to fit generated object ID. Check /DVD/RMX_OBJKEY table and if MANDT is part of the object key, set this parameter to X.
GLFEX_HR_OBJID Object identifier for HR Cluster data Business object name for HR cluster ingestion. Default value is R3_PAY.
GLFEX_HR_PACK_SIZE Personnel number count to read from HR Cluster Personnel number count to read from HR Cluster in one task.
GLFEX_KEEP_DATA Keeps data in the SNP Glue Queue after the load finishes. Keeps data in SNP Glue FIFO Queue after it is loaded to the target table. Data is automatically deleted after all subscribers have read them. If this parameter is set to X, a dummy SNP Glue Fetcher for each queue is created.
GLFEX_MAX_PCK_LOAD Maximum package count per one task (RFC load). Count of data packages to load through RFC in one task. One data package has a default size of 100 MB.
GLFEX_OWN_OBJLIST_LIMIT Bigger tables will have own OBJLIST table (row count) Limit to have own object list table. If there is at least “limit“ rows in the business object header table, the object list is put into separate table. Small object lists are stored together in one table specific to the logical system.
GLFEX_OWN_SARA_OBJ Create special business objects for SARA data? - (X/'') If the value is X, SNP Outboard™ Datafridge creates a new business object to store data from SARA.
GLFEX_SARA_PREFIX Prefix for SARA structure generation. Prefix for generated objects in SARA ingestion (structures, reports, etc.).

HASH_VALIDATION

Validate data using hash values. Possible values: <X> = enabled; <empty> = disabled

Specifies whether the data is validated using hash values during the object list validation.

HR_CHECK_DATA Check data existence in HR transactions on/off - (X/'') When displaying HR data, there are many different structures with data. Many structures can be empty for selected persons. If this parameter has the value X, the system checks which structures are empty after the person is selected and indicates this on the overview screen. On one hand, you will have information about structures with the data, on the other hand, you need to wait until this calculation is done after each person’s selection.

INCREM_OBJATT_LOAD

Incremental object attachment list load. Possible values: <X> = enabled; <empty> = disabled

In some cases, it is not possible to export and import all attachments at once. For this scenario, SNP Outboard™ Datafridge offers a way to load them incrementally. To do so, perform the following steps for all packages/batches:

  1. Load object attachment list

  2. Generate attachment load tasks and Run attachment load tasks

  3. Generate validation tasks and Run validation tasks

Once these steps are complete, execute the step Run post-validation task.

INITIAL_VALUES_TAGGING

Tag initial or empty values too during data tagging. Possible values: <X> = enabled; <empty> = disabled

Specifies parameters for the data tagging process:

  • The value <X> includes empty or initial fields in the tagging.

  • The value <empty> skips empty or initial fields in the tagging.

LOGGING_OF_ACTIONS

Option for enabling or disabling action logging

Determines whether various actions are logged in SNP Outboard™ Datafridge.

MASS_DL_DEF_BUTTON

Default value of a radio button in the mass download

Defines a default radio button value in Data Discover.

MASS_DL_MAX_INNER_JOINS

Maximum number of INNER JOINs in the mass download. The maximum value is 5

Specifies the maximum number of INNER JOINs between an attribute table and an object list table.

MAX_ATTACHMENTS_IN_ZIP

Maximum number of attachments in a ZIP file in the mass download

When the mass download is executed with the option to include all the relevant attachments, these attachments are stored in one or more ZIP files. This parameter adjusts the maximum number of attachments in one ZIP file to prevent memory problems during the mass download.

OBJLIST_UPD_PACKAGE

Package size for the object list update

Specifies the number of lines after which a commit is executed.

OBJLIST_VAL_PACKAGE

Package size for the object list validation

Specifies how many lines are pulled from a target database during the object list validation.

OBJNO_DELIMITER

Object number delimiter in the table /DVD/RMX_OBJLIST

Specifies the delimiter of key fields in the object list.

ROOT_DIR

Mounted directory with CSV data files

Specifies the root directory with bulk data.

TABLE_PACKAGE_SIZE

Package size for table extraction (number of rows)

Specifies the package size for the transparent data load. This is useful if a bulk data file is too large.

TABLE_WITH_ARCHIV_KEY_FLD Create a target table with the ARCHIV_KEY field Should the target table be created with the ARCHIV_KEY field? This will allow ingestion of archived data by SARA.

VALIDATE_LINE_ITEMS

Line item validation during the object list validation

Determines whether to also validate line items during the object list validation.

WEB_GUI_LINK

Alternative WebGUI link. Possible values: <user-defined link> = enabled; <empty> = disabled/default link

Specifies the WebGUI link if SNP Outboard™ Datafridge cannot generate it correctly from the system parameters. If the parameter is set, this user-defined link is always used instead of the default one.

WEB_GUI_VERSION

WebGUI version

Specifies the version of the WebGUI. The default value is v2. If v2 does not work, you can change the version to v1.

WHERECLAUSE_SIZE

Number of records in WHERE clause for legal hold

Specifies the maximum length of the WHERE clause. This depends on how many WHERE clauses the target storage supports.

XML_EXPORT_ROOT_DIR

Directory for exported XML data from SNP Outboard™ Datafridge tables

Specifies the root directory of the mass download for XML files.

XML_MAX_LINES

Maximum number of lines in XML files

Specifies the maximum number of lines per XML file. This is useful to prevent XML files from becoming too large.

DIR_DELIMITER Directory delimiter for binary storage (‘/’ or ‘\’) According to your operating system you need to set up the right directory delimiter, usually '/' or '\'.
GLFEX_HASH_INGEST Compute hashes during data ingestion (X/'') Do you want to compute validation hashes during data ingestion? In this case you probably want to disable the hash calculation while extracting data into the queue. Check the parameter HASH_VALIDATION for the source system.
GLFEX_SARA_TECH_OBJ Own technical objects for SARA ingestion Create new technical objects and Glue tables for SARA data.
VALIDATION_ITEMS_CHECK Validation: check if a main record exists for the line item (X/'') To validate item tables, check if each record has a corresponding record in the object list table, i.e. in the main table of the business object.
NO_OBJLIST_UPDATE Do not update the object list during the validation. Possible values: X or <empty> Expert setting for data ingestion. If the value is X, the object list will not be updated during the header table validation. This can prevent performance issues. You can update the object list later via transaction /DVD/RMX_OBJLIST_UPD.
OBJLIST_DDIC_MOD Modification mode for the object list in the DDIC  

Direct data read - parameters on the source system

Name Description Purpose
ATTACHMENT_RELINK Allow attachment relink (X/'') Attachments can be saved in SAP cluster or in an external content server. Files stored in the content server can stay there and in SNP Outboard™ Datafridge stay only their links. To enable this approach, you need to set this parameter to X.
COUNT_ROWS Should we count all table rows? If not checked (value empty and not X), Datafridge checks only if the tables are not empty - count up to 1 row.
DEVCLASS Package for generated code (source system) Default development package for SNP Glue meta-objects.
GLFEX_HR_PACK_SIZE Personnel number count to read from HR Cluster How many personnel numbers should be read from cluster in one task.
GLFEX_KEY_SO Create select options for table key fields If checked (value X), SNP Outboard™ Datafridge generates SNP Glue extraction processes with a select-option for each table key field.
GLFEX_SARA_PREFIX Prefix for SARA structure generation Prefix for generated objects in SARA ingestion (structures, reports, etc.).
HASH_VALIDATION Hash validation (""/"X") Computes hashes for later validation.
JOBCOUNT Count of jobs to use in parallel tasks Count of jobs to be used in parallel tasks.
TABANL_MAXCNT Count table rows up to N rows Limit for table row count. It is useful, especially for large cluster tables (e.g. BSEG).
TABANL_PACKSIZE Package size for table analysis This parameter says how many tables should be analyzed in one task.
PCKG_SIZE Package size in MB for RUNID Adjust the package size in MB for a specific run ID.
ANALYZE_CLIENTS Analyze tables per client value, if applicable (X, '') Do you want to analyze tables for all clients? Relevant only for client-specific tables.
ANALYZE_COUNT_PER_CLIENT Count table rows per client, if applicable (X, '') Do you want to count records in client-specific tables per clients?
ANALYZE_USE_EXISTING Use data collected in previous analysis, if existing (X, '') The ‘X’ analysis tries to get data from Datafridge tables using data from a previous analysis. If data is found, it is copied. Otherwise, the analysis runs as usual.
HASH_SWITCH_ENDIAN Switch endian in calculated hash (X/'') This setting is needed if the control system uses other endian settings as the source system.
PARALLEL_ATT_PROCESSING Process attachment ingestion in parallel mode (X/'') Obtain a list of attachments in parallel. This option can speed up the processing of attachments.
PCKG_SIZE Package size in MB for data extraction. Package size for extracting data from SAP tables into Glue queues on the source system.