Data Ingestion for Enterprise Data Platforms

May 5, 2014

http://hortonworks.com/wp-content/uploads/2014/03/Oil-and-Gas-Ref-Arch.png

The Ingestion Box in the reference architecture is displayed as the smallest box.  However, this is the component that integrates with all the available data sources.  This tends to be among the most complex and time consuming task, but tends to be relegated to a lower priority which is a big mistake.

One needs to prioritize the data sources that generate maximum value and ensure we can ingest the data into the Big Data platform for subsequent “cool” analytics.

In my experience, it is also extremely important to have a robust User Interface for the ingestion section.  Otherwise, there could be a series of manual steps leading to errors and ingestion of “bad” data that will minimize impact of subsequent analytics.

 

 


Steps to moving E-Discovery to the Cloud – Making it work

September 26, 2013

See http://www.information-management.com/news/10-things-to-know-before-moving-e-discovery-to-the-cloud-10024898-1.html?zkPrintable=1&nopagination=1

for proposed steps.  The steps might appear logical, but involving all stakeholders in committee meetings as a first step is a sure way to bring the project to a screeching halt.

I would reverse the steps as follows to be a more agile approach to implementation of moving E-discovery to the cloud

1 – Evaluate the e-discovery platform first and the cloud options second – This is to ensure you have the right e-discovery platform

2 – Assess potential – and realistic – risks associated with security, data privacy and data loss prevention – This is homework to ensure you are prepared to answer questions that will surely come up in regards to data security.  What you will find in most cases is that the solution is going to be more secure.

 3 – Learn the differences between public and private clouds – This is part of security assessment and this step is to reach a decision on which cloud to utilize for your needs.

4 – Run a pilot on a small project before moving to larger, mission-critical matters – this puts the project in action mode

5 – Benchmark your existing e-discovery processes including data upload, processing, review and export. – This is necessary to arm you with information as you sell the move to the cloud.  Once again, you will find that processes in general work faster than behind the firewall if implemented correctly.

6 – Document and define areas of potential cost savings – This is necessary step and required to make the case for transition to the cloud

7 – Leverage the success or adoption of other SaaS solutions in the organization to lessen resistance – This is the start of the sales pitch.  We have done it before & we are now going to adopt similar approach for E-Discovery

8 -Actively involve all stakeholders across multiple departments – Now get into a meeting with all parties. At this stage you are armed with success on a small project, have information on data security, benchmarks and cost to face the “committee”

9 – Develop an implementation plan, including an internal communication strategy – You have the OK, now go Execute!!

10 – Understand you are still the ultimate custodian of all electronically stored information.


Handling Embedded Objects in E-Discovery

September 24, 2013

Excellent article describing embedded objects.

http://www.meridiandiscovery.com/articles/embedded-objects-in-e-discovery/

We should ignore the cons listed in the article as there is no real excuse for not extracting embedded objects.


E-Discovery Integration with Archive Solutions

September 19, 2013

Why should email archiving solutions be tightly integrated with eDiscovery ?

It enables enterprises to have a smooth workflow across all aspects of e-discovery, from collection/preservation to analysis/review to production/presentation. This saves a lot of time that would otherwise be wasted on importing/exporting data from different systems, and reduces the risk that something gets lost in the shuffle.


Is Exchange 2013 ready for Litigation Hold

September 16, 2013

It is not ready according to Greg Buckles – http://ediscoveryjournal.com/2013/08/exchange%E2%80%99s-litigation-hold/

The following critical information is not held:

  • Folder Location
  • Read/Unread Status
  • Flags
  • Categories
  • Reply/Forward Info

Also check out this comment on readiness of Exchange 2013  – http://sourceoneinsider.emc.com/2013/02/15/understanding-whats-new-in-exchange-2013-for-archiving-and-ediscovery/

Exchange 2013 is unlikely to be sufficient for organizations facing a higher frequency of litigation and who have invested in in-house legal staff to perform early case assessment and sophisticated review of content before exporting such content to external legal counsel. –


Democratization of Social Media Data

March 18, 2013

The state of North Carolina has made available to the general public more than 100k  social media records from selected North Carolina state agencies.

It is a live customer deployment available for others to play around with.  Anyone interested in social media archiving should certainly check it out.

http://tinyurl.com/bp89sxm

 


eDiscovery mergers, acquisitions

December 30, 2012

Complex Discovery updated their website….

http://tinyurl.com/8edfulw