Challenges of Records Management

Records management is very important for companies. There are many electronic records management systems that can optimize the process of records management. However, the huge amount of data is raising new challenges about how records management should be handled. 

A few of the ongoing issues include big data, master data management (MDM) and how to deal with unstructured data and records in unusual formats such as graph databases.

Records are kept for e-discovery, compliance purposes, for their business value, and sometimes because no process has been implemented for systematically removing them. This might be a double-edged sword: getting rid of data makes IT nervous, but there are times when records should be dispositioned.

Data stored in data lakes is largely uncontrolled and typically has not had data clean up processes applied to it. Data quality for big data repositories is usually not applied until someone actually wants to use the data.

Quality assurance might include making sure that duplicate records are dealt with appropriately, that inaccurate information is excluded or annotated and that data from multiple sources is being mapped accurately to the destination database or record. In traditional data warehouses, data is typically extracted, transformed and loaded (ETL). With a data lake, data is extracted (or acquired), loaded and then not transformed until required for a specific need (ELT).

MDM is a method for improving data quality by reconciling inconsistencies across multiple data sources to create a single, consistent and comprehensive view of critical business data. The master file is recognized as the best that is available and ideally is used enterprise-wide for analytics and decision making. But from records management perspective, questions arise, such as what would happen if the original source data reached the end of its retention schedule.

As a practical matter, a record is information that is used to make a business decision, and it can be either an original set of data or a derivative record based on master data.  Therefore the “golden record” that constitutes the best and most accurate information can become a persistent piece of data within records management system.

Unstructured data challenge

A large percentage of records management efforts are oriented toward being ready for e-discovery. 

There is the more of a problem in the case of unstructured data than in MDM. MDM has gone well beyond the narrow structure of relational databases and is entering the realm of big data, but its roots are still in the world of structured databases with well-defined metadata classifications, which makes records management for such records a more straightforward process.

The challenge with unstructured data is to build out the semantics so that the content management or records management and data management components can work together. In the case of a contract, for example, the document might have many pieces of master data. It contains transactional data with certain values, such as product or customer information, and a specialist data steward or data librarian might be needed to tag and classify what data values are represented within that contract. 

With both the content and the data classified using a consistent semantic, it would be much simpler bringing intelligent parsing into the picture to bridge the gap between unstructured and structured data. Auto-classification of records can assist, although human intervention remains an essential element.

Redundant, obsolete and trivial information constitutes a large portion of stored information in many organizations, up to 80%.  The information generated by organizations needs to be under control whether it consists of official records or non-record documents with business value. Otherwise, it will accumulate and become completely unmanageable. On the other hand, if organizations aggressively delete documents, they run the risk of employees creating underground archives of information they don’t want to relinquish, which can pose significant risks. Companies need to approach this with a well thought out strategy.

The system should allow employees to easily save documents using built-in classification instead of a lot of manual tagging. It is important to make the system intuitive enough for any employee to use with just a few seconds of time and a few clicks of the mouse. 

The value of good records management needs to be communicated in such a way so that employees understand that it can actually help them with their work rather than being a burden. A well-designed system hides the complexity from users and puts it in the back end. 

Studies of records management consistently show that only a minority of organizations have a retention schedule in place that would be considered legally acceptable and that some organizations have no retention schedule at all. Even if a schedule is in place, compliance is often poor.

A strategy should be developed to reconcile dilemma between keeping everything forever in order to extract business value from it and using records and information management to effectively get rid of as much information as soon as possible.

From a business perspective, the potential upside of retaining corporate records so they can be used to gain insights into customer behavior, for example, may outweigh the apparent risks that result from non-compliance. 

The highest value is within records management framework for understanding and classifying information so that its business value can be utilized. 

If organizations view records management as a resource rather than a burden, it can contribute to their success. In many respects, the management of enterprise information is already becoming more integrated and less siloed. For example, most enterprise content management (ECM) systems now have records management functionality. The same classification technology used for e-discovery is also used for classification of enterprise content. Seeing records management as part of that environment and recognizing its ability to enrich the understanding of business content as well as ensuring compliance can support that combination.

Governance can be a unifying technique that provides a framework to encompass any type of information as it is created and managed. Governance is a set of multidisciplinary structures, policies and procedures to manage enterprise information in a way that supports an organization’s short term and long term operational and legal requirements. It is important to consider the impact of all forms of information, from big data to graph data. Within a comprehensive strategy of governance, records management is successful.

Records Management Challenges

Records Management (RM) is supported by mature records management systems. However, the data explosion is raising new concerns about how RM should be handled. 

A few ongoing issues include big data, master data management (MDM), and how to deal with unstructured data and records in unusual formats such as those contained in graph databases.

Records are kept for compliance purposes and for their business value and sometimes because no process has been implemented for systematically removing them. 

There are continuing struggles with the massive volume of big data. IT and legal have different priorities about what to keep and getting rid of data makes IT nervous, but there are times when records should be dispositioned.

Data stored in data lakes is mainly uncontrolled and typically has not had data retention processes applied to it. Data quality for big data repositories is usually not applied until someone actually needs to use the data. 

Quality assurance might include making sure that duplicate records are dealt with appropriately, that inaccurate information is excluded or annotated and that data from multiple sources is being mapped accurately to the destination database or record. In traditional data warehouses, data is typically extracted, transformed and loaded. With a data lake, data is extracted (or acquired), loaded and then not transformed until required for a specific need.

MDM is a method for improving data quality by reconciling inconsistencies across multiple data sources to create a single, consistent and comprehensive view of critical business data. The master file is recognized as the best that is available and ideally is used enterprise wide for analytics and decision making. But from an RM perspective, questions arise, such as what would happen if the original source data reached the end of its retention schedule.

A record is information that is used to make a business decision, and it can be either an original set of data or a derivative record based on master data. The record is a snapshot that becomes an unalterable document and is stored in a system. Even if the original information is destroyed or transformed, the record lives on as a captured image or artifact. Therefore the “golden record” that constitutes the best and most accurate information can become a persistent piece of data within an RM system.

Unstructured data challenge

A large percentage of records management efforts are oriented toward being ready for e-discovery, This is much more of a problem in the case of unstructured data than for MDM. MDM has gone well beyond the narrow structure of relational databases and is entering the realm of big data, but its roots are still in the world of structured databases with well-defined metadata classifications, which makes RM for such records a more straight forward process.

The challenge with unstructured data is to build out the semantics so that the content management or RM and the data management components can work together. In the case of a contract, for example, the document might have many pieces of master data. It contains transactional data with certain values, such as product or customer information, and a specialist data steward or data librarian might be needed to tag and classify what data values are represented within that contract. With both the content and the data classified using a consistent semantic, it would be much simpler bringing intelligent parsing into the picture to bridge the gap between unstructured and structured data. Auto-classification of records can assist, although human intervention remains an essential element.

Redundant, obsolete and trivial information constitutes a large portion of stored information in many organizations. The information generated by organizations needs to be under control whether it consists of official records or non-record documents with business value. Otherwise, it will accumulate and become completely unmanageable. On the other hand, if organizations aggressively delete documents, they run the risk of employees creating underground archives of information they don’t want to relinquish, which can pose significant risks. Companies need to approach this with a well defined strategy.

The system should follow a “five-second rule,” allowing employees to easily save documents using built-in classification instead of a lot of manual tagging. The key is to make the system intuitive enough for any employee to use with just a few seconds of time and a few clicks of the mouse. In addition, the value of good records management needs to be communicated and the value "sold" so employees understand that it can actually help them with their work rather than being a burden. A well-designed system hides the complexity from users and puts it in the back end. It is more difficult to set up this type of system initially, but as more information is created, the importance of managing it also increases, in order to reduce costs and risk.

Graph databases - a different kind of record

Graph databases store information in a way that focuses on the relationships among data elements. Those representations could include networks and hierarchies as well as other relationships among nodes. 

Graph databases are designed to persist data in a format that highlights relationships among data elements. A graph might include customers, orders, products and promotions. The network itself as represented in the graph database might be a useful record. A network could show relationships that indicate fraudulent activities, and those networks could be saved as records.

Graph databases are used in several other ways to aid records management. Many organizations today are creating their own internal knowledge graphs that represent records as a connected data model to aid search and discovery. This knowledge graph speeds up risk analysis and compliance determination. Graph databases are also used within the legal industry to speed up legal research associated with a case. A graph of case files, opinions and other documents makes it easy for researchers to identify information that may be material to a case.

The RM Struggle

Studies of records management consistently show that only a minority of organizations have a retention schedule in place that would be considered legally credible and that some have no schedule at all. 

Even if a retention schedule is in place, compliance with it is often poor. Some go so far as to say that RM is facing a crisis. There is a battle shaping up between those who essentially want to keep everything forever because they might be able to extract business value from it and those who want to use records and information management to effectively get rid of as much information as soon as possible. It is very important to reconcile these differences.

From a business perspective, the potential upside of retaining corporate records so they can be used to gain insights into customer behavior, for example, may outweigh the apparent risks that result from non-compliance. Storage costs have drastically decreased and are often bundled into other paid services such as messaging, collaboration and large-scale analytics services in the cloud. The cost of combing through and removing unnecessary information can be high. I have seen a number of scenarios in which companies have undertaken projects to get rid of data, and they have found it more expensive than just keeping it.

Organizations need to ensure legal compliance function with its highest measurable value coming from getting rid of outdated and useless records. However, the highest value is actually within its framework for understanding and classifying information so that its business value can be exploited. RM professionals who realize this will not only survive, but also thrive in a world of increasing information complexity and volume.

If organizations view RM as a resource rather than a burden, it can contribute to enterprise success. In many respects, the management of enterprise information is already becoming more integrated and less siloed. For example, most enterprise content management (CMS) systems now have RM functionality. The same classification technology used for e-discovery is also used for classification of enterprise content. Seeing RM as part of that environment and recognizing its ability to enrich the understanding of business content as well as ensuring compliance can support that convergence.

Governance can be a unifying technique that provides a framework to encompass any type of information as it is created and managed. Governance is a set of multidisciplinary structures, policies and procedures to manage enterprise information in a way that supports an organization’s near-term and long-term operational and legal requirements. It is important to consider the impact of all forms of information, from big data to graph data, but within a comprehensive strategy of governance, the changing environment for RM becomes more tractable.

Galaxy Consulting has over 20 years experience in records management. Please contact us today for a free consultation.

Records Management Necessary for Organizations Small and Large

Records Management (RM) or Electronic Records Management (ERM) has become a more important system and solution for companies of all sizes, small and large, non-profits and other organizations. In the world of big data and the cloud, many small and midsize businesses are now facing the same kind of struggle that, at one time, only large enterprises faced: trying to wrangle entangled web of records. 

Record-keeping can be a nightmare, especially if it involves a lot of paper documentation. Document scanners have been introduced within the market to make the process of digitizing those documents easier, but a robust system of keeping digital records is still necessary to provide security, efficiency and consistency throughout the organization.

Business Objectives and Records Management

Records management objectives are related to achieving something the organization has set out to do or to save money and time. It could be both. Effective and efficient service is an integral part of this formula for RM objectives most of the time. Organizations should be working to make processes better for their customers or clients, but also for their internal members or staff. 

Avoiding heavy costs is always a goal for any organization, and cost avoidance is necessary to making a profit or staying in business. Social responsibility is one of the most important of objectives related to RM and includes moral, ethical and legal responsibility to maintain secure, confidential, and accessible records. Hospitals, government agencies, and other organizations must have good operating records management in order to serve the public interest.

Programs used for management of records should manage the information in a highly organized and easy to understand fashion so it can be timely, accurate, affordable, complete, usable and accessible. Business will run much smoother this way and less time and energy will be expended on searching for an important record or related documents.

The Growth of Data and Records

The growth in data these days is purely amazing and exponential. Because the amount of information and records will keep growing at all organizations, particularly successful ones, it will be necessary to manage the records effectively as well as efficiently.

Controlling the amount of paperwork is one thing, but managing the ability to generate more is another. This also includes digital forms. Effective ERM attempts to control creation of documents that may not add value to information or are duplicate. Retaining the records is important, however, so whatever program or method used must not be faulty or ineffective, otherwise there could be trouble with lost records and so forth.

The Preservation Effort is Continuous

Keeping records, like doing your taxes, is an ongoing process and one that can be continuously improved over time, either through internal processes or new program implementation (software).

Safeguarding vital data is important for nearly any organization, public or private. Comprehensive programs for protecting these important records from danger or disaster is essential because every organization is vulnerable to losses like this. Functioning as part of the records management program, vital records programs preserve integrity and confidentiality of the most sensitive data. They also keep these information assets safe according to a record protection plan.

Preserving the corporate memory or organization’s history is also important. An organization's data contains its institutional record, an asset important to the integrity of the institution but often overlooked by its various members. Each business day, records are created that could become templates or catalysts for future decisions or important plans. The records document the activities of your organization and may provide insight for future teams. They may also lead to other innovations.

Compliance and Legal Safeguards

Much of the records retention efforts made by companies or organizations have to do with compliance or avoiding lawsuits. Legal teams are often heavily involved in making recommendations on records management.

The United States is the most regulated country in terms of record keeping requirements across various industries in the private sector and agencies in the public sector. To ensure compliance, organizations need to follow a well-defined legal and organizational framework. Compliance laws can create major issues since they can be quite difficult to implement without a proper program or procedure. All members of the organization need to be kept in the loop, too. Failing to comply with these requirements and regulations could result in expensive costs for the organization such as fines and penalties.

Organizations also need to minimize risks of litigation. Implementing ERM program to deal specifically with records can reduce much of the liability associated with record keeping and document disposal or destruction. Routine and regular disposal at intervals in the cycle of doing business is vital to ensuring legal protection. Policies should be drafted to ensure these demands are met as well.

Better Business Performance Through Record Keeping

Business efforts that are streamlined are always better and lead organizations of all sizes and types to success if implementing the proper programs, policies and procedures. The same is true for documentation and record keeping.

Good ERM will certainly help reduce operating costs, even though that may seem like the opposite of the truth. It is likely that records management will save time and money, however, in the long run. Searching for lost records, including staff labor and other costs, can quickly damage the ability to efficiently run the operation. Organizations can save a lot of time and money by both investing in ERM and setting forth information policies that make sense. Staff time will also be spent more productively and staff stress will also be reduced by such efforts. An effective and usable index and filing system can make all the difference in the world to productivity.

Assimilating new RM technologies with existing processes can also streamline the organization’s information handling needs. The current technology should be audited to analyze its usefulness before implementing any new automated systems. Also, you may need to take a look at the manual way of doing it before automating to ensure reliability and proper functionality of the system. The manual procedure might even need improvement, so look there first. 

Role of Automatic Classification in Information Governance

Defensible disposal of unstructured content is a key outcome of sound information governance programs. A sound approach to records management as part of the organization’s information governance strategy is rife with challenges.

Some of the challenges are explosive content volumes, difficulty with accurately determining what content is a business record comparing to transient or non-business related content, eroding IT budgets due to mounting storage costs, and the need to incorporate content from legacy systems or merger and acquisition activity.

Managing the retention and disposition of information reduces litigation risk, it reduces discovery and storage costs, and it ensures organizations maintain regulatory compliance. In order for content to be understood and determined why it must be retained, for how long it must be retained, and when it can be dispositioned, it needs to be classified.

However, users see the process of sorting records from transient content as intrusive, complex, and counterproductive. On top of this, the popularity of mobile devices and social media applications has effectively fragmented the content authoring and has eliminated any chance of building consistent classification tools into end-user applications.

If classification is not being carried out, there are serious implications when asked by regulators or auditors to provide reports to defend the organization’s records and retention management program.

Records managers also struggle with enforcing policies that rely on manual, human-based classification. Accuracy and consistency in applying classification is often inadequate when left up to users, the costs in terms of productivity loss are high, and these issues, in turn, result in increased business and legal risk as well as the potential for the entire records management program to quickly become unsustainable in terms of its ability to scale.

A solution to overcome this challenge is automatic classification. It eliminates the need for users to manually identify records and apply necessary classifications. By taking the burden of classification off the end-user, records managers can improve consistency of classification and better enforce rules and policies.

Auto-Classification makes it possible for records managers to easily demonstrate a defensible approach to classification based on statistically relevant sampling and quality control. Consequently, this minimizes the risk of regulatory fines and eDiscovery sanctions.

In short, it provides a non-intrusive solution that eliminates the need for business users to sort and classify a growing volume of low-touch content, such as email and social media, while offering records managers and the organization as a whole the ability to establish a highly defensible, completely transparent records management program as part of their broader information governance strategy.

Benefits of Automatic Classification for Information Governance

Apply records management classifications as part of a consistent, programmatic component of a sound information governance program to:

Reduce

• Litigation risk
• Storage costs
• eDiscovery costs

Improve

• Compliance
• Security
• Responsiveness
• User productivity and satisfaction

Address

• The fundamental difficulties in applying classifications to high volume, low touch content such as legacy content, email and social media content.
• Records manager and compliance officer concerns about defensibility and transparency.

Features

• Automated Classification: automate the classification of content in line with existing records management classifications.
• Advanced Techniques: classification process based on a hybrid approach that combines machine learning, rules, and content analytics.
• Flexible Classification: ability to define classification rules using keywords or metadata.
• Policy-Driven Configuration: ability to configure and optimize the classification process with an easy "step-by-step" tuning guide.
• Advanced Optimization Tools: reports make it easy to examine classification results, identify potential accuracy issues, and then fix those issues by leveraging the provided "optimization" hints.
• Sophisticated Relevancy and Accuracy Assurance: automatic sampling and bench marking with a complete set of metrics to assess the quality of the classification process.
• Quality Assurance : advanced reports on a statistically relevant sample to review and code documents that have been automatically classified to manually assess the quality of the classification results when desired.

New Trends in Records Management

Records management has changed from what it was before and there are new trends in it.

Records management professionals should adapt to it and be open to collaboration and working cross-functionally with business users to develop their road-map for the identification and exploration of new sources of corporate records.

Technology has evolved since the first wave of records management tools entered the market. Regulations changed and they now cover the broader spectrum of electronically stored information, for example, video, social media or instant messaging, not just the images or office documents that have traditionally been called "records." Information governance is emerging as a term that describes and supports a holistic, life cycle view of the creation, use, and protection of digital information.

Let's look more closely at these new trends.

Records management shifts to information governance.

Work-in-progress documents, structured or semi-structured information require governance, including protection from unauthorized access, use, deletion or disclosure across their life cycle. In other words, the frequently changing data in your system reflects your business activities. Holds and discovery to meet litigation or audit need to be available regardless of the item's record status or storage location, i.e. on-premises or in a cloud service.

Many businesses continue to lack confidence in the progress of their electronic records management programs, compliance initiatives, and e-discovery preparedness. The shift to a more comprehensive and proactive management of information across its entire life cycle has begun.

The concepts of file plans, folders, file parts and cutoffs have imposed constraints on how electronic information is organized and managed. The vocabulary of the paper records center is no longer relevant in a digital-first organization. Today, an information worker can compose an agreement in a cloud application, such as Google Docs, share it with a colleague, edit it on a tablet device and push revisions to a customer collaboration site even while on an airplane. But, business records continue to be generated outside traditional desktop applications.

New vendors are taking fresh approach to addressing compliance, categorization and retention requirements. The shift to a more comprehensive and proactive management of information across its entire business life cycle rather than just its end has begun. They approach governance of information beyond the "record." Technologies with strong roots in search, archiving and retention management offer the capabilities to manage many forms of electronically stored information, such as social activity or rich media, even when such information is not formally flagged as a record.

Cloud and social platforms render "file and declare" ineffective.

Traditional records management tools are slow to make the leap to the cloud. Records managers may be at risk of holding obsolete assumptions about importing or filing content into an on-premises records repository.

Records and compliance managers remain wary of cloud and social platforms. Enterprise architectures and their peers in records management practice groups are not aligned on cloud computing benefits. Cloud providers are increasingly supporting content segregation, security, privacy and data sovereignty requirements to attract regulated industries, and they are offering service-level agreements designed to reduce risks. In spite of that, records managers still cite security, legal and privacy risks as the top three reasons to stall adoption of cloud services and SaaS.

Current records management systems are already missing many forms of electronically stored information. Older types of electronically stored information, such as images, e-mail or office documents, are often captured into traditional records management applications. Newer content types are less likely to have policy-driven life cycle or retention rules applied. Mobile messages, social media posts or websites are important sources of discoverable information, but application of legal holds to that content can be difficult.

Digital preservation forces itself onto the governance agenda.

Digital records that have a long-term retention schedule are at risk when hardware devices, software applications and file formats become obsolete. Obsolete software file format is also a concern. Many first generation business and personal productivity tools are retired, and the inability to retrieve or view older digital records is becoming a reality.

Organizations are slowly waking up to digital preservation concerns. Migration, conversion and adoption of open standards are accepted approaches to solve the problem of accessibility over time. Those approaches, however, are not widely adopted at this time.

Decisions to retire older enterprise applications raise content preservation concerns. As organizations begin infrastructure renewal projects, particularly as new SaaS and cloud-based applications become viable alternatives, IT and records professionals must assess the risk of losing information in those older systems. Decisions to maintain older systems in read-only mode, to migrate data into newer systems or to dispose of older systems all together must be made in accordance with business, legal and compliance needs.

Open standards and open source change the sourcing landscape.

Companies drive significant change in the software acquisition landscape by calling for deliberate adoption of open standards and open source. Governments are hedging against the potential loss of electronic information, software obsolescence and increased costs, as well as demanding more portable data. Between 2011 and 2012, several national governments published directives to help their IT, records and procurement managers to understand, investigate and select more open technology platforms.

Open standards help to address preservation, accessibility and interoperability needs. Open source helps to reduce cost and minimize vendor and platform lock-in. Programs developed by governments around the world have raised the profile and acceptance of open source software. Government in the United Kingdom, United States, and Europe have taken proactive approach for using software systems and file formats based on open standards.

Auto-categorization becomes viable and approachable.

Transactional, regulated and semi-structured content is ready for automated capture, categorization and application of retention policies. The electronic information that uses a consistent structure and embedded metadata, or includes predictable patterns of numbers or text lends itself to content analytics, entity extraction and categorization tools for ingestion and application of retention, disposition and security or privacy access controls. Opportunities to use auto-classification technologies for routine, high-volume, predictable electronic content are increasing as technology matures, more vendors provide integrated offerings, and use cases are identified.

Auto-classification joins compliance needs and business priorities. High-volume, transactional information is a pain point when storage costs escalate and discovery requests are made. Capture, categorization and retention schedule are functions that reduce costs, streamline customer service, and increase digitization of processes. Consistent organization creates a foundation upon which are based content analytics and predictive technology use. Consistent disposal of obsolete information reduces the need for more storage resources, facilitates faster retrieval of data, and lowers the cost of e-discovery.

Big content is as important as big data and requires well-thought governance. Big data gets a lot of attention, but organizations must also cope with information stored in semi-structured or unstructured forms. Tabular data often sits unnoticed and unanalyzed in files created by individuals or small teams. E-mail, spreadsheets and ad hoc databases are used for critical business decisions and often sit under the radar of compliance or audit managers on file shares, collaboration sites or personal computers. 70% of companies use spreadsheets for critical business decisions, but fewer than 34% apply governance or controls to them.

Technology enforces and automates defensible approaches to disposition. Organizations that demonstrate consistent and predictable approaches to information handling, including its final deletion, are more successful when e-discovery orders compel extensive search, retrieval, review and production activities. Automation of routine processes, including scheduled disposal, lends weight to retention programs when challenged by legal counsel or auditors. Auto-classification tools ensure that retention and disposition rules are applied within specific parameters and are supported by documented policy rationale and citations.

E-Discovery and Records Management

Discovery is the pre-trial phase in a lawsuit in which each party can request documents and other evidence from opposing parties. E-discovery deals with discovery of electronically stored information (ESI), including documents and e-mails.

E-Discovery preparedness makes it imperative for organizations to develop an enterprise wide strategy to manage the volume of electronic information. The discovery process affects many individuals in an organization, not just lawyers and others involved in discovery, but also IT professionals and records managers, who have to be prepared to produce electronic content for discovery and litigation.

For legal counsel, it means having a review process to determine what discovered content is relevant to the case. For an IT person, it means restoring backup tapes to show evidence on file shares, content management systems, e-mail systems, or other applications. But for records managers, this work will have begun long before any lawsuit with managing records for retention, placing legal holds, and finalizing disposition.

ESI presents special issues for discovery:

• ESI can be replicated at a very low cost, resulting in tremendous volume;
• Electronic content can be easily changed and deleted;
• ESI can be backed up, creating more volume as content is copied;
• Electronic content may require certain software to access and read;
• ESI can reflect relationships based upon how it is distributed;
• ESI may have associated metadata;
• ESI can be searched.

Ediscovery could be costly because it requires organizations to retrieve content from servers, archives, backup tapes, and other media.

In some cases, an organization is unable to execute a discovery order because it is unable to locate all content in a timely manner, or it is unable to place holds on all content and some of it is deleted during the lawsuit. The inability to do this correctly also has a cost, and it can be considerable.

To address these costs, many organizations are looking at e-discovery solutions that will enable them to review the found content and take it through litigation.

But organizations can also lower costs for archiving and restoring, legal review, and sanctions by simply cutting down how much content it retains. Less stored content means less content on which to perform discovery.

On the other hand, because all ESI is now discoverable, organizations may be tempted to destroy that information as soon as possible to reduce the cost of discovery. But, some information must be kept for regulatory and compliance reasons. For example, many organizations are governed by regulatory bodies that require business information to be retained for a specific period of time. Some of that information might also be important to support the organization in case of litigation. Destroying the wrong information can lead to fines and unfavorable judicial decisions.

Some organizations may randomly pick through content to remove content that is deemed most risky. But in litigation, it will be necessary to prove that the deletion of this content was consistent with a policy that has been applied rigorously. Without audit trails and certificates of destruction, it can be difficult to prove compliance with an organization’s policies.

To avoid this situation, many organizations are simply choosing to keep everything. But this experience proves that the cost of restoring backup and archive tapes, as well as the cost of discovery and the inability to identify content and place immediate holds, can make this policy economically disastrous in the event of litigation.

Developing a strategy and a plan of action for handling e-discovery will help organizations mitigate their risk and save them a significant amount of money in the event of litigation. Organizations need to have a retention policy to determine which content can be destroyed and at what time and which content should be kept and for how long. The key is to have a retention program that is flexible enough to keep content for the right retention period.

Retention periods are historically thought of in terms of calendar events. A document that was created in 2000 may no longer be required in 2012, and so it may be destroyed. Retention periods for content are driven by events, such as the length of a project, the duration of a contract, or the termination of an employee. And the retention policies that match up to these content types must reflect the lifecycle of the content.

Organizations may choose to keep project information for x number of years after the end of the project. A workflow event that signals the end of a project, such as the publishing of a report, may commence the retention period for the associated e-mails and files. An organization may create a retention policy that a contract will be retained for x number of years after the end of the contract period. The end of the contract, then, could then trigger a lifecycle action for that document.

There are many types of events that could trigger a retention policy: content expired (e.g. a contract), usage statistics (e.g., document has not been accessed in six months), business event (e.g., environmental impact filing), content lifecycle event (e.g., new revision checked in).

There are many actions an organization can take based upon the retention policy: delete, notify author, archive, move, delete revisions, revise. These different actions can be applied to retained content over the course of its lifecycle as it moves from its active use to inactive status to its deletion.

The best approach to records management is where authors create content using their familiar tools and systems, and retention management is enforced on that content where it lives, from a centralized place. This approach has a number of benefits:

• retention policies are centrally administered through a single interface;
• a catalog of discoverable content is created;
• holds can be placed instantly across these different systems, ensuring that evidence is not deleted during litigation;
• disposition can be performed from a central place.

By categorizing content, creating a catalog of the content, creating a retention plan, implementing a hold methodology, and having disposition procedures, an organization will benefit in many ways. They include:

• Decreased Risk – by keeping less content, an organization decreases the risk of adverse evidence being found;
• Higher Productivity – by organizing content through a file plan, key information, such as regulatory filings, tax information, business licenses, invoices, and other content, can be more easily found;
• Lower Discovery Costs – with less information available for discovery, an organization will reduce the cost of restoration of content and the cost of legal review;
• Increased Flexibility – an organization will be prepared to present a catalog of discoverable content, which is a requirement in a case of a litigation;
• Stronger Legal Action – By knowing the evidence that an organization possesses, legal counsel can more quickly assess strategy and pursue a settlement, which can be a huge money savings;
• Less Vulnerability – organizations that are unable to comply with electronic discovery requirements are beginning to see nuisance lawsuits. When an organization cannot comply with discovery requirements, it may set a cost threshold – stating, for instance, that any lawsuit under $100,000 is not worth the discovery effort and should be settled. This exposes the organization to nuisance lawsuits that are brought at just under the threshold.

If you have not already done so, now is the time to develop ESI retention programs. Now is the time to create committees within your organizations and to bring their expertise together with legal counsel and IT to prepare for e-discovery and litigation. And, now is the time to focus on one of any organization’s greatest assets, its information.

Content Management Systems Reviews - Documentum - Records Management

EMC Documentum Record Management Solution helps organizations to comply with legal and regulatory requirements for documents retention. This solution allows to capture and manage records generated in the company allowing for its automation. It also expands classic records management with features that track and dispose of non-records in order to reduce discovery costs and mitigate legal risks.

Records management solution is fully unified with Documentum content management platform.

Key Benefits

Risk Mitigation – reduce your content liability by disposing of records and non-records once they fulfilled all legal and regulatory and compliance obligations.

Automation – automate the capture and classification of records.

Comprehensive Management – manage all records regardless of file type or content type.

Centralized Management – allows to manage all records in one place regardless of disparate repositories and regardless of type or location.

Flexibility – it can be aligned with your needs as necessary.

Seamless Integration – integrate with your systems infrastructure including SharePoint.

Features

File Plan Administration – organize recordkeeping requirements across the enterprise with corporate and departmental taxonomies.

Platform Unification – simplify user retrieval with files that remain in place and preserve audit trail integrity for documents creation.

Physical Records Support – manage paper, microfiche, and other types of hard copy records.

Classification – organize records manually or automatically to specify authorities and disposition instructions.

Management of Compound Records – manage multiple documents as single record.

Records Disposal – ensure timely disposal with automation tools for identifying eligible records, requesting authorizations, and scheduling deletions.

Microsoft Integration – declare records within Microsoft Office products including SharePoint.

Automated Capture – integrate Line-of-Business (LOB) systems with little or no customization.

The solution provides: document expiration dates, superseding or prior versions, notifications and reminders, reports, disposition console, automation, digital shredding.

Content Management Systems Review - Open Text - ECM Suite - Records Management and Archiving

In my last post on Open Text ECM Suite Content Lifecycle Management group of products, I mentioned that this group consists of document management, imaging, records management, and archiving. I described document management in my previous post and I described imaging solution yesterday.

Today, I am going to describe records management and archiving solutions of Content Lifecycle Management group of products.

Records Management

OpenText Records Management (formerly Livelink ECM - Records Management) delivers records management functions and capabilities to provide full lifecycle document and records management for the entire organization. This product allows your organization to file all corporate holdings according to the organizational policies, thereby ensuring regulatory compliance and reducing the risks associated with audit and litigation. Records management can manage content in a number of different repositories.

Record management product provides services to core ECM Suite components. Its features are embedded in the interface of respective applications enabling users to access records management functions in the interface they are most familiar with.

Users can access records management solution from a standard Web browser. It provides a common interface to access all forms of information, such as images, paper, word processing documents, spreadsheets and email. Users can apply metadata to submitted documents to enhance search capabilities. Metadata is indexed and can be used to more easily find, retrieve and generate reports on documents based on your custom criteria.

Metadata, retention and disposition rules can be applied immediately upon the classification of a record to all content regardless of type. The product supports the application of multiple file classifications, holds, and retention schedules to individual records. Content can hold two or more record classifications and be retained according to multiple retention schedules. You can combine classifications and schedules to meet the unique retention and disposition needs of content.

Users are able to create Record Series Identifiers (RSI) to define a disposition schedule for each RSI. RSI Apply rules can be created that define which records belong with what RSI. Rule searches can be applied to return documents that are marked with an RSI value. File Plan can be created with which an RSI or a Records Management object can be associated.

The product includes the ability to manage physical items such as paper records, equipment, and more, adding representative object graphics to electronic storage repositories. In addition, it supports the use of XML-based color labels and barcode labels for physical records such as folders, boxes and shelves directly from within the Records Management interface.

There are few options for classifying records. You can classify records interactively with a single click or automatically inherit retention schedules and classifications by moving many records at the same time into folders. You can automatically import retention policies and other data. Records management maps records classifications to retention schedules.

All Records Management objects have Access Control Lists. In addition, security settings can be modified globally. Administrators can periodically review vital records to ensure appropriate classification and disposition.

All activities can be fully audited. You can track which records were purged from the system and generate high-level views of all system activity.

Disposition of records can be automated according to organization requirements. You can create list of records that are ready for review or final disposition, and route them to individuals for review and approval.

You can perform disposition searching against items. Searching calculates the disposition date of the items based on RSI schedule and returns the records ready for deletion, archiving or moving on to the next stage in their lifecycle.

You can support vital records identification and the cycling of vital records based on pre-set periods, such as monthly, quarterly, and annually.

You can make records official to prevent users from modifying them. You can also apply legal holds: you can suspend retention schedules and protect content from deletion with legal holds. You can apply multiple legal holds to documents at the same time.

You can also manage physical records:

• barcode label management supports the use of XML-based color labels and barcode labels for physical records such as folders, boxes, and shelves;
• warehouse management - box items and send them to off-site storage;
• circulation management - allow users to borrow items, request for future borrowing, and pass single or multiple records in a single steps. Users can box items and send them to off-site storage.

You can extract records into a secured centralized repository and manage records in them as "in place" or physically extract and automatically replace records with shortcuts, enabling secure content archiving in a centralized, compliant storage environment while still allowing user access directly from application.

Archiving

An OpenText archiving solution is powered by records and retention management.

The following products deliver the archiving component of the OpenText ECM Suite:

OpenText Archiving for SAP Solutions - links document content to the SAP business context. Archiving for SAP Solutions enables you to create, access, manage, and securely archive all SAP content. Archiving for SAP Solutions is a highly scalable and secure repository for business-critical SAP business documents and data. It is designed for the complete range of business documents such as incoming/outgoing invoices, orders, delivery notes, quality certificates, HR employee documents, archived SAP data, and more.

OpenText File System Archiving (formerly Livelink ECM - File System Archiving) provides secure, long-term storage of content from file system drives, while ensuring content integrity, avoiding redundancy, reducing storage costs, and enabling records management. Physical files are managed by a secure document archive.

All contextual metadata information, including auditing, version control, security permissions, and more, is handled by a dedicated metadata management layer. You can configure storage rules according to relevant criteria, such as file size, date, or folder, to control what file system content is archived and to which storage media.

You can migrate content out of file systems and replace items with hyperlinked shortcuts to archived content. Clicking a shortcut retrieves the corresponding archived document, creating a seamless end-user experience.

Alternatively, you can copy files into the OpenText managed repository. This scenario accommodates organizations who want to consolidate access to content stored in file systems, but do not want to disturb the physical files stored therein. You also can move files into the secure storage repository entirely. This scenario accommodates organizations who want to discontinue usage of file systems altogether.

Archive content to secure storage media such as WORM, DVD, UDO, or write-once hard disks. Time stamps and system signatures ensure the integrity of documents. Furthermore, you can quickly review activity logs around archived content, including who viewed or edited documents, when, and why.

File System Archiving enables you to automate the process of storing content safely in multiple physical locations or on hot stand-by devices. In addition, you can automatically render content into standardized formats, such as PDF and TIFF, to ensure future readability.

You can detect multiple instances of content and eliminate redundancies. Content can be compressed automatically to minimize wasted space. You can execute powerful full-text searches across archived file systems, consolidating content from multiple file systems into a single result set.

Multiple archived documents can be restored to the original file system (or to a new, specified location) with a single click from the search results. If appropriate, shortcuts are replaced with original files, and content can be optionally left in or removed from the OpenText managed repository.

OpenText Email Management products are characterized by a centralized foundation of compliant archiving and records management, enabling you to securely store, manage and retrieve email content and ensure regulatory compliance. This is done

through the archiving, control, and monitoring of Lotus Notes and Microsoft Exchange email to reduce the size of the email database, improve server performance, and control the lifecycle of email content.

OpenText Application Governance and Archiving for Microsoft SharePoint provides integrated, end-to-end management of SharePoint sites and documents across an entire enterprise.

OpenText Storage Services for Microsoft SharePoint stores Microsoft SharePoint content in external storage devices and reduces wasted space by automatically detecting multiple instances of the same content. This ensures the scalability and performance of SharePoint, reduces the costs accorded to having it reside on the very costly production environments that host SharePoint. Also, by redirecting content storage can increase efficiencies, enabling the storage and management of a larger number of documents, simplifying backup and restore processes, and allowing customers to house SharePoint content on less expensive storage devices.

The content metadata attached to documents is still stored and maintained within SharePoint. No stubbing or linking is used in this method of externalization, so end-users can create and edit content within the SharePoint environment seamlessly with no knowledge of the storage management going on behind the scenes.

In addition to lowering overall storage costs, Storage Services for SharePoint can help businesses to meet requirements for information retention. Storage Services for SharePoint ensures that business-critical content is secured in multiple physical locations, and enables the housing of information on a number of different storage devices to meet business and compliance requirements.

The product detects multiple file instances to ensure that only a single instance of every file is stored, provides optional content compression before storage configurable for each individual logical archive, monitors archive server through events and notifications. It uses secure encryption to ensure content is always protected.

OpenText Integration Center for Data Archiving enables full audit and records management for data archiving alongside files and emails from any business application to the ECM Suite. It is a data and content integration platform that unifies information silos that cross application boundaries, consolidating and transforming data and content throughout the entire information ecosystem, including leading-edge ERP, CRM, and ECM systems as well as legacy applications. This product enables you to:

• control the lifecycle of your data with integrated Records Management and Archiving in the ECM Suite;
• archive data to the ECM Suite's Archive Server from any application;
• utilize full record extraction from source systems and transport to the Archive Server;
• automatically apply lifecycle management rules to archived data;
• transform data, enhance content metadata, and deliver records into the Archive Sarver as one process;
• perform monitoring and generate audit trails for reporting.

See more about Open Text products in my upcoming posts.