Watch Video

Untangling Data Mesh, Fabric, and Lakehouse

[Three virtual half day sessions from 9:00 until 13:00 CET. This half day format received high evaluations!]

 

The data warehouse is now middle-aged. BI has turned twenty and the data lake ten. So, is it time for something new? Something better? In fact, three new frameworks have recently emerged: data fabric, data mesh, and data lakehouse.

But what are they? Are they truly novel or simply marketing hype? In essence, all three are competing technological responses to the growing needs of digital transformation. If you are facing the urgent challenges of delivering high-value, consistent, and near real-time information across Cloud and on-premises environments, understanding these approaches and their differences is critical. Learn if you should move beyond your existing data warehouse or lake and, if so, how.

In this course, Barry Devlin explains and positions data fabric, mesh, and lakehouse, as well as other concepts, old and new, using a logical digital information systems architecture framework. Exploring existing and emerging technologies as well as organisational issues, methodologies, and implementation approaches, Barry will help you decide if one of these new approaches is right for your business needs, existing technical environment, and current skills.

 

The seminar

Three new data delivery and information preparation approaches have recently emerged to challenge current data warehouse and data lake thinking. Each has its pros and cons, strengths and weaknesses. Data fabric proposes active metadata and knowledge graphs to power a logical data warehouse approach. Data mesh suggests that a domain-oriented, self-service approach based on microservices thinking should be adopted, eliminating data copies almost entirely. Data lakehouse, as the name implies, attempts to combine the best of data warehouse and data lake, as well as promising transactional consistency within its scope.

All these new and old terms, with partially overlapping scopes, preferred technology bases, and different promoters, are types of digital information systems. Their aim is to prepare, deliver, and manage data / information to all decision-making and action-taking business processes.

Today’s business, with its conflicting needs for data timeliness vs. consistency, immediate vs. correct decisions, and information-informed competition, places extensive new demands on digital information systems. These demands have led to the emergence of the lakehouse, fabric, and mesh approaches honed for the complex distributed and network-centric environments that are already common. However, the prevalence of legacy systems, historical data management issues, as well as existing and evolving complications in information meaning and usage mean that traditional approaches and knowledge cannot be readily abandoned.

The key questions, therefore, are if and how data lakehouse, fabric, and mesh address these new needs, how differently each does that, where they improve on existing approaches or create new problems, and how they can coexist with or replace established data warehouses and lakes.

To answer these questions, Barry Devlin compares and contrasts all these approaches, old and new, using as a foundation the Digital Information Systems Architecture (DISA) first defined in “Business unintelligence.” Existing and emerging technologies for data storage, preparation, and virtualization; data catalogs and knowledge graphs; and other tools, both on-premises and Cloud, are described and analysed. Also explored are a wide variety of organisational issues, methodologies, and implementation approaches that are often as important in assessing solutions as the underlying technologies.

What you will learn

  • Origins, drivers, meaning, and detailed functionality of data lakehouse, fabric, and mesh
  • Benefits—business and technical—and lessons learned for each approach
  • An introduction to the technical rationale, structure and components of the conceptual and logical Digital Information Systems Architecture (DISA) and its business and technical uses
  • An in-depth comparison of data fabric and mesh with data warehouse, lake, hub, and lakehouse using DISA as a basis
  • Possibilities and challenges of new database and data management technologies in Cloud, on-premises, and hybrid environments
  • The central role of context-setting information, knowledge systems, and metadata
  • Adaptive Processes as the basis for data preparation, information creation, and insight discovery
  • Using data virtualization and preparation as tools for integration of all types of content and data in Cloud, on-premises, and hybrid environments
  • Practical planning and implementation steps from data warehouse / lake to data lakehouse, fabric, or mesh.

DISA is the new name for the conceptual and logical architectures introduced in “Business unIntelligence”

 

Who should attend?

  • Enterprise, systems, solutions and data warehouse architects
  • Systems, strategy and business intelligence managers
  • Data warehouse, data lake and IT systems designers and developers
  • Data and database administrators
  • Tech-savvy business analysts.

Barry Devlin

Founder
9sight Consulting
Dr. Barry Devlin is one of the foremost authorities in the field of business insight and he is one of the founders of data warehousing.
With over thirty years' experience in IT, of which twenty with IBM as "Distinguished Engineer", he is a valued consultant and teacher all around, plus author of the standard book “Data Warehouse – from Architecture to Implementation”.

Read more

The virtual seminars and workshops will be offered through an online meeting platform, usually Webex or Zoom, from our video studio. The virtual classroom is equipped with multiple professional cameras and microphones and we have a two person crew available so that we can offer a similar experience to that of the traditional classroom and, more important, still offer adequate interaction with the speaker.

The presenter / trainer will still use his Powerpoint, combined with flipchart and paper, virtual whiteboard and physical whiteboard and will be accompanied by a operator / moderator at the scene. The presenter does not have to worry about technical issues such as switching, splitting, microphone settings and such but can fully focus on the course material and on engaging with the online attendees.

  • When using the flipchart, the moderator will take care of switching scenes and camera perspective and of switching to attendees to ask questions.
  • When switching to flipchart you will have full view of the presenter and of the flipchart with all text and diagrams crystal clear.
  • And since the presenter / trainer is equipped with a wireless lapel microphone and the questions of the participants enter the course room clearly understandable (amplified), he can answer those questions from anywhere in the classroom and from any camera angle.
  • Asking questions and the speaker answering them can therefore be done just like you are used to in a regular classroom.
  • Because the course room is equipped with at least four monitors, the speaker/trainer also has a view of the online participants during the meeting.
  • For some (international) speakers we may use their own virtual course room with similar facilities but we will send the invite ourselves and the meeting will run on the Adept Events online meeting platform.

All of the above is to ensure that it does not become an impersonal one-way webinar but an interactive virtual classroom setting.

Those attending an online event or a hybrid event with the online meeting platform will be sent an invitiation with the meeting hyperlink and instructions a few days before, so well in advance of the course.

In-house Info

Practically all of our seminars and workshops can be offered as an In-house course for your company exclusively. We can tailor with extra focus on specific topics that apply to your organization. Also available in online format or in face-to-face format with live video stream.

MORE INFO