The Filters tab contains the settings that Turbo Import uses for filtering documents prior to importing into LAW.  This includes Deduplication, NIST, and File Type filtering settings.  All filters have one of two options once enabled: Include or Exclude.

 

ac_caution_icon

Settings can be viewed, but not changed once a turbo import has been started for the case except for the Passwords and File Type Management database.

 

 

Configuring Turbo Import Filters settings.

1.On the File menu, click Import, and then select Turbo Import.  The CloudNine LAW Turbo Import utility opens directly to the settings (Content tab) for new databases.

2.Select the Filters tab.

3.Then select the filters that you desire to enable for all imports in this database: Deduplication, NIST, and/or File Type Filtering.

 

ac_caution_icon

You must select OK to proceed to the import section of Turbo Import. You can change the settings again prior to importing records by selecting the Settings button.  If you select the Settings button to change the import settings then the option to cancel without making changes to the current setting changes is available.

 

ac_tip_icon

For a newly created database, the Import Settings will open first for configuring the database settings.

For databases that have already started a Turbo Import or configured the import settings, the Import tab will be displayed.  Settings can be selected by choosing the Settings button from the Turbo Import.

hmtoggle_plus1Deduplication

Deduplication is a process that checks the records imported into a database for duplicates of the records either globally or within a custodian.  Deduplication in LAW is based upon family relationships and individual records will not be deduped against components of a family.

 

ac_note_icon

The _DupID field for Turbo Import records will use the EDA ID of the parent record not the LAW ID as in Electronic Discovery enabled cases.

 

hmtoggle_plus1        Enable duplicate document detection

Configuring Turbo Import Deduplication settings.

1.On the File menu, click Import, and then select Turbo Import.  The CloudNine LAW Turbo Import utility opens directly to the settings (Content tab) for new databases.

2.Select the Filters tab.

tisettingsfiltersnist_zoom15

3.Select Enable duplicate document detection.

 

ac_note_icon

If deduplication is not enabled during Turbo Import then you would need to dedupe through the Deduplication Utility of LAW if you need to dedupe later.

 

In most cases, either the MD5 or SHA1 mode provide sufficient deduplication integrity. However, if there is a question about which to use, consult applicable policies for your organization.

The two modes with Custodian in the name indicate that deduplication will compare sources only within each custodian and not across custodians.

•MD5. Uses 128-bit string; used to deduplicate files across all sources.

•SHA1. Uses a 160-bit string; used to deduplicate files across sources.

•MD5Custodian. Uses a 128-bit string; used to deduplicate files within a source.

•SHA1Custodian. Uses a 160-bit string; used to deduplicate files within a source.

This setting determines the action to take once a duplicate is located. Two options are available:

•Include. Creates a record for the duplicate in the database and copies the native file into the case folder.

•Exclude. Does not create a record, no text is extracted, and the native file is not copied to the case folder.
hmtoggle_plus1NIST(NSRL)

The chief purpose of NIST filtering is to focus investigation on user-generated data by removing from consideration files that are of types that are unlikely to be responsive. Examples of such file types include system files and executable files. The National Institute of Standards and Technology (NIST) is an agency of the U.S. Department of Commerce that maintains and publishes a database of known computer file profiles. This database is referred to as a reference data set (RDS) and is compiled by NIST's National Software Reference Library (NSRL).

The NIST filter uses the RDS database to compare files against a known set of software applications. The NIST filter is typically employed in forensics cases to scan for and remove system files and application logic files from consideration as case documents.

lg_show_me_ac

Before case files can be filtered by the NIST Items filter, a NIST database must be downloaded and configured through the LAW Configuration Utility under environment settings.  A NIST database within SQL is required for Turbo Import LAW cases for which you want to use the NIST Items filter.

Once a NIST database is downloaded and attached to SQL through the LAW configuration utilty, the Enable NIST (NSRL) detection is enabled by default.

If a NIST database has not been downloaded and configured in the LAW configuration utility - environment settings, the Warning icon, Warning icon, is displayed in the NIST section of the Filters tab next to Enable NIST (NSRL) detection.

In order to configure the NIST database for use with LAW's Turbo Import please see Environment settings NIST configuration. Once a NIST database is downloaded and attached to SQL through the LAW configuration utility, the warning icon is not displayed.

 

NIST (NSRL)

 

Enable NIST(NSRL) detection - This option is enabled by default if the NIST database has been configured in the LAW Configuration Utility.

If hashes match, then:  When you enable the NIST(NSRL) filter, you can select one of the following actions for the import to take when a NIST(NSRL) record is detected: include or exclude the NIST files.

•To allow NIST items to be included in the database, leave the Include selected for the drop down.

•To exclude NIST items from database, select Exclude from the drop down.

ac_note_icon

If a NIST database is not configured in the LAW Configuration Utility and enabled in the settings, then the NIST Items filter will not function.

hmtoggle_plus1File Type

File type settings allow users to identify specific files for processing. CloudNine™ LAW supports import of all file types. Even if a file type is not supported for printing or conversion, metadata and text may still be extracted. After importing a file, if an application is installed on the computer that is capable of opening and printing it, then the file can be processed to TIFF, PDF, or paper.

Files that could not be converted to TIFF can still be exported and delivered in native file format. Provided the reviewer has the native file application, the file can be opened and reviewed. For this reason, loading all file types into LAW is recommended. However, it is understandable that users may not wish to import certain file types, such as common system files.

File type management database

In CloudNine™ LAW, the file type management database is used to populate the SourceApp field in LAW. The SourceApp field assigns a source application to native files based on the file type and source application mappings in the file type management database. The source application assigned to a native file is used for e-printing and TIFF conversions in LAW.  

The File Type Managment database is configured in the LAW Configuration Utility.

 

ac_caution_icon

Filtering will only apply to family parent records.  Child documents will respect the include/exclude value of their parent. If a Parent file type is excluded then the child record will be excluded. If  a Parent file type is included then the child record will be included

 

Enable file type filtering - This allows filtering during import to include only selected types of documents for processing.

1.To enable select Enable file type filtering.

tisettingsfiltersfiletypeenabled_zoom25

File Type Manager- Once the file type filtering has been enabled the File Type Manager will have a warning beside it.  The warning states, "File Type Manager changes are global and apply to all cases that use the same FTM database and enable file type filtering.  FTM changes also apply to previously imported documents whose type changed from exclude to include.".

 

 

1.Select Enable file type filtering.

2.Select File Type Manager.

ac_caution_icon

Changes in the File Type Manager are global and will apply to new imports in other cases.  Both Turbo Import and Electronic Discovery cases are affected.

 

3.The Manage File Types opens in a new window.

manage_file_types_dialog_zoom15

4.Configure file inclusion and exclusion lists, and other options:

oInc. selected - all documents and database records with Inc. will be written to the LAW database.

oExc. selected - the file, its metadata, and its associated text are not written to the LAW database.

oBoth Inc. and Exc. selected - exclude takes precedence over the include option and the file, its metadata, and its associated text are not written to the LAW database.

oNeither Inc. nor Exc. are selected - the status is determined by the setting selected in Treat file types not specifically included or excluded as

oAssign default source applications for each file type.

Treat file types not specifically included or excluded as: Choose how to process files in the File Type Manager that are unmarked for include and exclude.

 

This setting is enabled case by case and is not a universal change that affects other databases.

 

 

tisettingsfiltersfiletypeexpanded_zoom25

When Enable file type filtering is selected, then Include is the default setting.

•Include - any file type that does not have a specific include\exclude setting in the File Type Manager is included for processing.

•Exclude - any file type that does not have a specific include\exclude setting in the File Type Manager is not included for processing.

To change to the Exclude setting, select the drop down and then select Exclude.

 

 
hmtoggle_plus0Date Range Filtering

Date range filtering allows you to save time by not processing files that don't meet your case criteria.  The date range you provide is inclusive, meaning that files within the date range you provide will be imported.  You can provide multiple date ranges if you need to specify non-continuous date ranges.

Date range filtering is overly inclusive.  If you have a family (parent document with attachments), and only one document within the family has a date within the range you specify, the entire family will be included.

 

tisettingsfiltersdaterangeexpanded_zoom40

To specify a date range filter:

1.Click in the From date field.  Use the date picker to select the lower inclusive bound for your date range.

2.Click in the To date field.  Use the date picker to select the upper inclusive bound for your date range.

3.If you need an additional date range, click the plus button to see an additional From and To box.

4.If you need to remove a date range, click the minus button next to the range you want to delete.

 

Need additional help? E-mail the CloudNine™ LAW Technical Support team at: lawsupport@cloudnine.com, or contact a support representative at 713-462-6464 for CloudNine™ LAW Ext. 12 or CloudNine™ Explore Support Ext. 13. The Technical Support team is available between the hours of 9:00 A.M to 7:00 P.M. Eastern Time, Monday - Friday.

Copyright © 2024 CloudNine™. All rights reserved.