Chapter 9. List View

List View is a read-only, spreadsheet-like presentation of study data. List View provides functionality to export data in various formats including Excel. List View also provides two ways of looking at your data - by Plates & Metadata or by Modules. List View is the only view that presents data in a module-based view.

As in all other views, what you see and what you can do depends on your user role and permissions for the current study.

Plates & Metadata.  In Data View only one data record is displayed at a time. In List View all data records for a selected plate can be displayed at once. Each row is a data record and each column is a data field. This view is useful for comparing data records, searching for particular values, or scanning for data problems. Outlier values can be identified by sorting the spreadsheet on any column - click the field name at the top of a column to sort.

Modules.  In Module List View, all data associated with a module is displayed in a single spreadsheet view. Key information is provided in the first six columns followed by three module reference fields, then the user-defined data fields within the module. If there are fields that are not referenced on a particular plate, the unreferenced field cells are shown in grey. Modules that have not been used on any plate are ignored.

As in Data View, the cells in the spreadsheet can be color-coded to identify: illegal values (red), rejected reasons and outstanding queries (blue), pending reasons and query replies (orange) and approved reasons and query replies (green). Queries, reason and missing value code are displayed in the metadata panels when a cell is selected that has these attributes, and any images associated with a data record can be reviewed when a record with images is selected.

List View does not support data editing. Double-clicking any cell in the table switches to that data field in Data View where edits can be made (and saved). Clicking Return to List View in Data View takes you back to the original cell in List View. Any changes that are made to the data record, or to its queries and reasons, while in Data View are displayed when you return to that record in List View.

All data records are retrieved from the DFdiscover server when you select a new page in List View, so the spreadsheet is up-to-date each time you select a new page. Also, DFexplore retrieves the current version of each data record when you select it in the spreadsheet, again the record is up-to-date at that instant. However, changes made since the records were retrieved, arising from other users or batch edit checks, are not automatically displayed; some or all rows in the table may become out of date while you are viewing them. As needed, update all records in List View at any time using Select > Refresh.

The List View section of the Preferences dialog, available from File > Preferences can be used to customize the appearance of List View. Preferences can be used to enable/disable field color-coding and text expansion, determine whether field codes or code labels are displayed, select column labels (field Name, field Alias and prepend with field number), and select the display format for date fields. All selections made in the preferences dialog are study specific and are retained across DFexplore sessions.

To display the data records stored in the study database for a particular CRF page or module, select it from the list in the left panel. Within the data table you can select any cell with a mouse click, use the left/right keys to move across the fields in a data record, and use the up/down keys to move across data records.

The default record sort order is ascending by subject ID and within subject ascending by visit number. The rows of the data table can be sorted on any column by clicking the column label. Each click toggles the sort order between ascending and descending. Use shift-click to sort on a second column, in the current sort order within the currently sorted column.

The keys (subject ID, visit, page) of the current record and the number of data records in the table are always visible in the upper-left corner. The workflow level at which the current record was last saved appears along with the date and time at the bottom. If a Help message has been defined for the current data field it is shown in the help message window, also at the bottom.

If a set of task records was assembled in Data View it remains in effect on switching to List View; only those CRF pages or modules and data records that met the task criteria are displayed. To see all CRF plates in the page list and all data records in the data table select Show > All Pages and Show > All Records respectively. To see all modules and all data records, select Show > All Records.

This does not cancel the task set. Task records can still be identified by the T icon that appears on each task record in the data table.

To cancel a task and see all data records choose Select > All Records in List View or Data View.

To select a subset of the data fields, or to include metadata fields, on the current plate or module, select Select > Field Selection. The field selection dialog has 3 main sections:

Fields can be selected for inclusion by clicking the plus icon ( ) beside each field or by using drag and drop to add them to the Display Fields list. Click the plus icon at the top of the Data Fields list to select all fields of the selected plate or module, in their default order. Fields can be reordered using drag and drop within the Display Fields list.

Once added, individual fields can be removed from the Display Fields list by clicking the minus icon ( ) beside each field. All fields can be removed from the Display Fields list by clicking the minus icon at the top of the Display Fields list.

The Search dialog, available from Select, can be used to find records within the current plate or module that meet specified criteria. If the Filter option is selected the record list is reduced to those records that meet the search criteria when selecting Filter at the bottom of the dialog, otherwise this button is replaced by a Find button, and the focus simply traverses those fields that meet the search criteria each time the button is pressed.

Clicking ... next to the Subject ID field opens another dialog for Selecting Subjects based on Criteria, which implements subject selection based on multiple criteria across multiple plates.

The Search dialog can also be used to add data records from the current plate or module into a Task set. After entering the record selection criteria, click New Task to display a task confirmation dialog (for Mode and Edit checks options) after which the selected records are flagged with the task icon to show that they belong to a new task set. Add to Task becomes active and can be used, after entering a new set of record selection criteria, to add more records to the current task set. This can be repeated as necessary to build a task set.

In this example, the current record list is filtered to show only those records for which: fields 8-24 are illegal or blank but required, site is 35 and workflow level is 2-7.

After specifying the search criteria, click Filter to start the search. A dialog appears showing the number of records that meet the search criteria and asking for confirmation before filtering the record list to display only these records.

To be selected records must meet one or more of the criteria specified in the Data Fields section and all of the criteria specified in the Data Records section.

To undo a Filter and display all data records for the current plate or module, select Show > All Records. To undo a Task and remove the 't' icon from all records select Search > All Records.

The Search dialog includes an expression editor that can be used to create simple algebraic statements describing the desired data records. Expressions can be entered directly in the text widget or by clicking the Fields, Symbols, Codes and Functions in the appropriate order.

This example selects subjects with a first systolic blood pressure reading above 120 and a first diastolic blood pressure above 80. Click OK to add this expression to the Search dialog.

	Numeric Codes and Code Labels
	Expressions must be created using code labels, when labels are being displayed in List View. If numeric codes are being displayed, expressions must test for codes, not labels.

Several functions are available for use in constructing expressions.

 concat($(Mtype),$(Mnum)) == "A1234" 

 day($(S1DATE)) >= 15 

 decimal($(WEIGHT)) > 0 

 field($(DRUGNAME),2) == "ACID" 

 number X = index("A56GH9","6GH") ; 

 number age = int((VDATE-BDATE)/365.25) ; 

 $(S1DATE) > julian("2017/11/15") 

 length($(PINIT)) < 3 

 month($(DFCREATE)) == 6 

 substr($(PINIT),2,1) == "X" 

 time($(DFCREATE)) > time("18:00:00") 

 julian($(DFCREATE)) == today() 

 tolower($(RACEOTH) == "inuit" 

 toupper($(RACEOTH) == "INUIT" 

 year($(DFMODIFY)) == 2017 

If the expression builder does not have the capabilities you require, searching can also be performed using a custom program specified in the last option at the bottom of the Search dialog. Custom programs must be stored in the study ecbin directory and must generate a data retrieval file as output. DFdiscover includes 2 standard programs, and (described in Section A.5, “Selecting Subjects based on Criteria”), which can also be used for this purpose.

When searching 'By Program' the Filter option must be enabled. When Filter is clicked the record list is reduced to show only those records identified by the program. If in addition to the 'By Program' option the 'Expression' builder or any of the other options in the 'Data Records' section are used, records are selected only if they meet all of criteria specified by all of these options. If any of the 'Data Fields' options are used the set of records selected is further reduced to include only those records that meet at least one of the field level criteria.

List views consisting of specified data fields, field order and record selection criteria can be defined for use by specified users and/or roles using Select > Define Views to display the Define Views dialog. List views can also be accessed via the list action buttons available at the bottom of the Plates & Metadata, Modules or Custom panels.

The actions, in left-to-right order, are define, edit, and delete a view.

The steps to define a view are:

	Note
	This dialog is available to users who have 'List - create Views' permission and can only be used by one person at a time.

Once views have been defined, users can select a view by clicking Open View or using Select > By Views. This displays a dialog showing the predefined view names and descriptions. The current view, if any, is canceled when a new view is selected.

If no records meet the selection criteria for a selected view, the dialog reports that no records were found, the view is canceled, and the spreadsheet returns to its base state, showing all data fields and data records. The current view can be canceled at any time to return to the base state by selecting Select > Cancel View.

Canceling the current view does not cancel the current task set (if any). The spreadsheet returns to the base state showing all data fields and data records but any task records remain flagged. Clearing the current task set is a separate operation which is performed using Select > All Records.

If you have permission to save data, the records currently displayed in List View can be written to a local file by selecting File > Export Data.

To export the data records displayed in the current List View specify:

Any data fields that have been hidden using Select > Field Selection are not exported. The message Warning: Data will be saved with reduced fields appears at the bottom of the dialog when this is the case.

A Data Retrieval File (DRF) containing the key fields of the records currently displayed in List View can be written to a file on your local disk by selecting File > Save Data Retrieval File and using the dialog.

On entering an output directory/folder and pressing Return any existing DRFs in that location are listed.

Output can be written to a new DRF or an existing DRF can be selected and overwritten.

To export the records displayed in List View to a DRF specify:

An existing DRF can be selected and deleted using Delete.

Users with permission can create and export data sets in SAS format to a file location on their local disk by selecting File > DFsas and using the dialog.

For instructions on creating and running DFsas jobs, refer to Programmer Guide, DFsas: DFdiscover to SAS.

DFexplore works with DFsas job files located in the study dfsas directory on the DFdiscover study server. All existing DFsas job files are listed when the DFsas window is opened and the list is updated if any new jobs are added.

Selecting a job file loads it into the text window where it can be edited and saved back to the study server.

Selecting Run executes DFsas for the current job, which creates SAS job and data files and returns them to the local computer in a .zip file which is stored in the specified RUNDIR.

New DFsas job files can be created by clicking Add and using the dialog. The new job file appears in the text window and can be edited (as described in Programmer Guide, DFsas: DFdiscover to SAS) to create the desired DFsas job file.

The following can be specified when adding a DFsas job:

If no plates are specified or 'ALL' is specified, all user defined plates in the range 1-500 plus DFdiscover plates 510 (reasons) and 511 (queries) are included in the DFsas job.

If no date format options are specified, dates are exported using the format and imputation specifications in the study setup. Alternatively, one or more of the following specifications can be selected:

Date imputation can be turned off for all dates, regardless of study setup specifications and regardless of which date formats are selected, by specifying 'IMPUTE no' in the global statements.

After saving a DFsas job file it can be executed at any time by selecting Run. A confirmation dialog appears with one option: Force DFsas to include all specified plates. Select this option if you want to include all of the plates specified in the DFsas job file, even if they do not currently contain any data records. If this option is not selected, a SAS data statement is only created for plates with data records.

After confirming that you wish to execute the selected DFsas job, DFdiscover runs DFsas on the study server and returns a .zip file, containing a SAS job file and a data file for each plate, to the specified RUNDIR on your local computer.

Data from labs and other sources can be imported to a DFdiscover plate by selecting File > Import Data in List View and following the steps listed below. Permission to use this feature must be granted in your study role.

Each imported data record may either create a new data record in the study database or replace an existing data record, having the same keys (ID, visit, plate). If a replacement record is imported all of the data fields on that record are replaced; it is not possible to replace only some fields while leaving others unchanged. If a replacement record is imported with status=7(delete) the database record is deleted.

Import options may be set to add the reason 'Set by DFexplore Import' to any field that is changed, and to add automatic queries for missing and illegal values. All imported data records, plus any reasons and queries generated during import, are logged in the study audit trail by date, time and the username performing the import.

In addition to displaying subject data records List View also displays queries, reasons, returned Query Reports and records that have been classified as 'missed'. Users who have permission to see a data record automatically have permission to see queries and reasons attached to fields on that record. Permissions for Query Reports must be granted explicitly through plate 501, otherwise Query Reports do not appear in List View. Missed data records follow the same permissions as regular data records.

Changes can only be made in Data View. Double-clicking anywhere on a metadata record in List View switches the view to Data View with the focus on the field that was double-clicked. Click Return to List View in Data View returns you to the field that was double-clicked in List View.

For roles without "Show Hidden Fields" permissions and fields with Hidden/Masked property, no query or reason is displayed in List View.

Queries can be searched using Select > Search. This dialog shows the number of queries that meet all of the current search criteria. The ... next to the Subject ID field opens another dialog for Selecting Subjects based on Criteria which implements subject selection based on multiple criteria across multiple plates. After entering new criteria click Refresh to update the counts.

In this example 2 queries match all of the specified criteria.

Click Save or Print to output the criteria and counts shown in this dialog.

Click Filter to select these 2 queries and remove all others from the current list view.

Click New Task to put the data records with these queries into a new task set.

After clicking Filter, new criteria can be specified to narrow the search further within the previously filtered set.

Records matching new search criteria can be added to a current task list by clicking Add to Task.

If you submit Query Reports to the sites they may respond by writing directly on a printed copy of a report and submitting it back to DFdiscover. Returned Query Reports are not subject CRFs and thus are not displayed in a subject binder. They can however be processed in Image View, just like data records, and saved in the study database with key fields: ID equal to the Query Report number (composed of the site number and Query Report creation date), and Sequence equal to the Query Report page number. Any Query Reports that have been saved in this way can be reviewed in List View.

If you have permission to modify returned Query Reports you are able to correct any errors that might have been made when the key fields were entered. To make corrections, select Select > Change Mode & Level to set mode to anything except View, and then select Plate > Change Keys to display the Change Keys dialog.

Like subject data records, Query Report pages can be filtered using the Search dialog, and the current set of pages can be printed or saved in a PDF file by selecting these options from the File menu.

Workflow tasks can also be performed on Query Reports in List View. For example, new Query Reports are typically saved at level 1 when they arrive in Image View. Someone may then have the task of reviewing them and moving them to level 2 to indicate that they have been reviewed. To perform this task select Select > Change Mode & Level to set Mode to Validate and Level to 2. Next selecct Select > Search to find the Query Report pages that are currently at level 1. After reviewing each page, save it by selecting Final or Incomplete. This moves the page to level 2. Use the search dialog again at any time to find the pages that currently have incomplete status.

This section describes the List view options available under the File, Select, and Show menus in the application menubar. The options available under the remaining menus have already been described for the Data view.