Software solutions for legal world.

Message Crawler - Export RSMF

Message Crawler Manual

Exporting Data as RSMF

RSMF files generated from Message Crawler can be customized to meet client’s needs. User of the tool is responsible in assigning correct field from the grid to RSMF fields. Read more about RSMF required fields on Relativity’s website at following link.

Relativity Short Message Format

 

Sorting

Important information about sorting

Once data is loaded to grid, it will be sorted in correct order for RSMF file to be created. Data load from DAT file will not be sorted automatically. If you perform data manipulation, change sort order or create custom conversations you have resort data before starting export.

Data MUST be sorted by Conversation Identifier field first, then by Sort Date/Time (including seconds), then Control Number field. Sort date should be formatted in a “text sortable” format for example: 2021-04-10T17:32:15 and applied to attachments. You can use Date Format tool to generate sort date or format it as required.

 


Required Fields

These fields are required for conversion and if left blank can result in malformed or not usable RSMF file.

Control Number: Unique number used to keep track of records in the grid.

Group Identifier: Fields that is the same for all members of the family. This is similar to Begin Attach field.

Conversation Identifier: Fields that is the same for the entire conversation. This will decide which records will be exported to same RSMF file.

Sender/From: Person sending a message.

Time Stamp: Date/Time when message is being sent.

Message Body: Content of the message

Messaging Platform: You can specify messaging platform from a field or you can select single platform for all messages by selecting an option in triangular brackets <>. Supported platforms by Relativity (slack, sms, mms, bloomberg, skype, imessage, googlechat)

Type of Conversation: Select direct or channel. If you have channel members joining or leaving the channel, it must be a channel or you will get validation errors during export.


Optional Fields

Optional fields should be specified if available. While not required, they greatly enhance review experience.

Message Type: Type of the message. Following values are supported (message, disclaimer, join, leave, history, unknown)

Recipients: While not required it is highly recommended that this will be provided in order to know who has seen message sent.

Names Delimiter: Select or enter delimiter that is used to separate recipient names.

Is Deleted: Indicate if message was deleted: Allowed values (y, yes, 1, true, deleted)

Importance: Indicates importance of the message. Allowed values (normal, high)

Reactions: This field is generated by Message Crawler when it is able to read reactions to a message. This is not supported for all messaging platforms. Select appropriate field if available.

Custodian: Select custodian of a document. Enter name in triangular brackets to apply same custodian to all messages.

Direction: Direction of the message. Allowed values (incoming, outgoing)

EventCollectionID: This field can be used to group RSMF message together in Relativity to from single conversation.


Attachment Information

Attachment specific information is required if attachments present. If there are no attachments, path and name can be left blank.

Attachment Path: Tells Message Crawler where to look for attachment. This can be full or relativity path. If you get attachment not found error during export, use this field to see if attachment is present in directory or not.

Attachment Name: Specify field that contains name of the attachment.

Path Prefix: If you are using relativity path specify initial part of the path in order for Message Crawler to locate attachments. This will be automatically populated most of the time.

Include Missing Attachments: In some situations attachments maybe missing. During normal conversion Message Crawler will indicate that attachment is missing and skip it from RSMF file as required by file format specifications. However if you would like reviewer to know that file was there at some point you can select this option. RSMF file will fail validation process and when data is loaded to Relativity, there will be a red box indicating attachment is missing. Even though file fails validation, it will fine in Relativity.


Additional Metadata

There are multiple ways of adding supplemental metadata to improve review experience. Select additional fields you would like to load to Relativity.

Write to Cross Reference File: A cross reference file will be generated during export that contain file name and additional metadata selected. Once files are loaded to Relativity, cross reference file can be loaded using Relativity Desktop Client. You will need to use File Name as overlay identifier.

Write fields to RSMF Header: RSMF file is an EML file format and custom fields can be added to the header of the file. Once RSMF file is processed, those field will be visible in Email Header field in Relativity.

Add to Body: Metadata added here will be visible when user hovers mouse over question mark next to actual message.

When saving attachments as separate files: A cross reference will be generated if you chose to save attachments as separate files and not to embed them into RSMF file. You will need to overlay new group identifier and Relativity AttachemntID fields using RDC after importing those RSMF files into Relativity. See section about attachment handling.


Export Section

Destination Folder: Specify where to write RSMF files to. Files will be split into subfolders in order to keep number of files per folder down.

High Performance Mode: This option tells Message Crawler that you are using high performance station with plenty of ram and cpu. Software will run much faster using all resources it allocate. This is recommended for most conversions however you may want to turn this off for very large jobs or if you want to keep cpu utilization low.

Conform to RSMF version: If you are on RelativityOne, you can take advantage of additional RSMF 2.0 functionality but specifying 2 in version number. These file will be compatible with Relativity Server.

External Attachments: Large RSMF files (over 500mb) may fail to build in Message Crawler or fail to process in Relativity. If you encounter such problem you can have Message Crawler store attachments separate from RSMF files. If you do so, you will have to load new value for Group Identifier and Relativity AttachmentID from cross reference file that will be generated. Additionally you can specify not to embed attachments only if total attachment size is over certain gigabyte size.

Note that attachment size of 250mb can generate RSMF files a little over 300mb due to EML encoding which makes files large. If you have a specific RSMF file size in mind, you can target attachment size be 50-100mb less.

 Three step export: User can generate RSMF files in memory (not writing to disk), preview information about files such as expected attachment size and message counts and only once satisfied, perform export to disk. This can help you decide if you need to store attachment as separate files.

 Error log: Error log tracks all messages, warning and errors during conversion. It is important to review error log to make sure no unexpected errors happened.

Presets: You can save and load settings used for conversion for reuse on another job.