Building an Enterprise Data Lake & Data Refinery for Enterprise Data as a Service
Speaker: Mike Ferguson
5-6 October 2017, London
6-7 March 2018, London

Overview

Most organisations today are dealing with multiple silos of information. These include cloud and on-premises based transaction processing systems, multiple data warehouses, data marts, reference data management (RDM) systems, master data management (MDM) systems, content management (ECM) systems and more recently Big Data NoSQL platforms such as Hadoop and other NoSQL databases. In addition the number of data sources is increasing dramatically especially from outside the enterprise. Given this situation it is not surprising that many companies have ended up managing information in silos with different tools being used to prepare and manage data across these systems with varying degrees of governance. In addition, it is not only IT that is now managing data. Business users are also getting involved with new self-service data wrangling tools. The question is, is this the only way to manage data? Is there another level that we can get reach to allow us to more easily manage and govern data across an increasingly complex data landscape?

This 2-day course looks at the business problems caused by poorly managed information. It looks at reference data, master data, transaction data, metrics, big data and unstructured content (e.g. documents, email, etc). It looks at the requirements to be able to define, govern, manage and share trusted high quality information in a hybrid computing environment. It also explores a new approach getting control of your data that includes participation from IT data architects, business users and IT developers. This includes creating and organising data in reservoirs and introduces data refineries in an enterprise approach to managing data. It emphasises the need for a common collaborative process and common data services to govern and manage data.