---
title: Dataset Conversion
slug: ryze/dataset-conversion
description: Learn about dataset conversion in Formedix, including uploading datasets in different formats, running conversion tasks, and downloading datasets. Discover the data cleaning operations available to replace characters in your data sources.
createdAt: 2023-08-31T12:09:28.070Z
---

Dataset Conversions can be run for datasets or asset groups. You can upload a dataset to be used in a dataset conversion or choose source and target datasets from your existing content.&#x20;

To run a dataset conversion you must define a mapping specification using the Dataset Mapper plugin, and run a conversion task. Data conversion API resources are available with the Formedix Web Services API and can be used to automate conversions. For more information, see the API Documentation.

:::Iframe{code="<div style=&#x22;padding:57.02% 0 0 0;position:relative;&#x22;><iframe src=&#x22;https://player.vimeo.com/video/693546776?h=3a9a32da93&#x26;amp;badge=0&#x26;amp;autopause=0&#x26;amp;player_id=0&#x26;amp;app_id=58479&#x22; frameborder=&#x22;0&#x22; allow=&#x22;autoplay; fullscreen; picture-in-picture&#x22; style=&#x22;position:absolute;top:0;left:0;width:100%;height:100%;&#x22; title=&#x22;Dataset Conversion&#x22;></iframe></div><script src=&#x22;https://player.vimeo.com/api/player.js&#x22;></script>"}

:::

### Upload Datasets

Allows you to upload a dataset in a specific file format. Supported file formats include

- SAS Transport XPT
- Dataset-XML
- Delimited text format CSV 
- ZIP file containing any of the above.

You can also view the data associated with uploaded datasets.

### Run Conversion

Conversions can be run at the asset group level or at the dataset level. You must have the Dataset Mapper Plugin enabled and specify a mapping source in Plugin Properties. See the [Dataset Mapper Guide](https://docs.formedix.com/ryze/overview-and-quickstart) for more information on mapping.

### Download Datasets

Allows you to download the current dataset view as a SAS Transport XPT, Dataset-XML, or Delimited text format CSV File.

### Data Cleaning

Data Cleaning can be used to replace characters in data sources. Data Cleaning operations are applied to data that is pulled from an integration or data that is uploaded directly to ryze. For example, if your source data has invalid characters that you need to change on import. 

Characters must be entered in hexadecimal format. If a replacement character isn’t specified in the target input, then it is replaced with 20 (blank space).

## P21E Validations

You can run P21 Enterprise Validations on SDTM and SEND datasets. These validations run automatically after a dataset conversion task. By combining ryze APIs and P21 ECLI, you can automate the flow of data and streamline processes.

![](https://api.archbee.com/api/optimize/aRGXD44FysHcCUICvfsxc/QaBBgtZ-UmSnTrxaECjum_2e36468d-bc83-4c1c-9eab-d7ffbc8cfb66.gif)

To enable a ryze - P21E connection, contact your Certara customer success or support representative. Once you have the connection enabled, you can convert and validate datasets directly from your repository. The option to validate your datasets in P21E appears as a checkbox before you run the conversion task. This checkbox is checked by default for new conversion tasks.

After running a successful conversion task, the P21E validation results URL is displayed. You may need to refresh ryze after running the conversion. Click the URL to open the Validation Overview in P21E.

ryze passes the Study Program, Study Label and Asset Group Label to P21E. If these don't exist in P21E, a new Data Package is created.

### External Standards

If an External Standard is set, then the validation is run against the specified standard and version. If no External Standard is set, it defaults to the latest version. For example, SDTM IG 3.4 or SEND IG 3.1.

### Define.XML

When you run P21 validations, a Define-XML file is generated in ryze and passed to P21E. Depending on the version, one of the following define.xml files is generated:

- Define-XML 2.1 with CDISC Stylesheet
- Define-XML 2.0 with CDISC Stylesheet

:::hint{type="info"}
The Define-XML version is specified in Standard/Study properties.
:::

### aCRF

Annotated CRFs (aCRFs) can be passed to P21E. When you run the conversion task, the annotated “Blank CRFs - PDF" visualization is automatically generated by default and passed to P21E.

:::hint{type="info"}
To include aCRFs, the CRF Plugin must be enabled and **Plugin Properties > CRF Properties > Annotations** set to "Show".
:::

**Which Data Acquisition Asset Group is used?**

The following logic is used to generate the annotated CRF. If this is not suitable, generate the aCRF manually:

- If no asset groups have the CRF plugin enabled, the aCRF is not passed to P21E.
- If one asset group has the CRF plugin enabled, the visualization is generated from that asset group.
- If multiple asset groups have the CRF plugin enabled:
  - Select the one that has the most forms.
  - If there are still multiple possibilities, select the first one.

### Errors

If a Conversion or Validation task fails, an error code is displayed. A negative number indicates a ryze error. A positive number indicates a P21E error was encountered.&#x20;

In P21E, validations that are sent from ryze appear in the **Validation log**.

The following errors may be displayed by ryze:

- -255: "Validation failed: with an unexpected error"
- -101: "Validation failed: failed to prepare the shared file locations"
- -102: "Validation failed: the company is missing the P21E configuration"
- -103: "Validation failed: the asset group is missing the data package entry"
- -104: "Validation failed: no dataset data was found to validate"
- -105: "Validation failed: the asset group type is invalid"
- -106: "Validation failed: no valid external standard defined"
- -107: "Data package URL has an incorrect format"

## Troubleshooting Dataset Conversions

Dataset Conversions work with the Dataset Mapper plugin, See also [Dataset Mapper Troubleshooting Guide](https://docs.formedix.com/ryze/troubleshooting-guide)
