Data Lake Strategy via Data Mesh Architecture at JPMorgan Chase; Data Mesh Learning Meetup

Подписаться 2,8 тыс.

Просмотров 24 тыс.

0% 0

Three very senior leaders at JPMorgan Chase presented about their data mesh journey so far, including moving from on-prem to the cloud, with true honesty about what is working and what is a work-in-progress. Topics included how they are mapping domains to high level products with a number of sub-products and how they are handling a very strict regulatory environment (basically - let's not try to move the really tough stuff to data mesh first). Extensive Q&A with the team as well.
Recorded July 8, 2021, hosted by Data Mesh Learning (DML), a vendor-independent resource for learning about data mesh.
Speaker LinkedIn Pages:
James Reid (CIO): / jamesrreid
Sarita Bakst (Chief Information Architect): / saritabakst
Arup Nanda (Head of Data for Cloud): / arupnanda
Link to the Slides:
drive.google.com/file/d/18AL6...
Community resources:
Meetup Group: www.meetup.com/data-mesh-lear...
Community Slack Signup: launchpass.com/data-mesh-lear...
Newsletter/Blog: datameshlearning.substack.com/
DML Website: datameshlearning.com/
LinkedIn: / data-mesh-learning
Free data mesh journey check-ins: / urn:li:activity:681025...

Наука

Опубликовано:

23 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 10

@NavaShanker Год назад

Where common data which is shared across multiple domains will be stored in data mesh architecture?

@harold3167 3 года назад

Hi Arup, is the, or should the, Data Ingestor, be centralized or federated when it comes to ingesting the data [or products] from the various producers? Similar question in regard to the Router? - Thanks

@datameshlearning 3 года назад

They talk more about this around minute 59 that might help you understand it further.

@ravindranagvekar1667 2 года назад

Mesh need to show multiple domains(Data Products) connecting to central hub?

@ziadirida 2 года назад

Not very convincing. But a lot of good ideas. Hope it works for you. Let us know

@jairamram9225 2 года назад

I hope Zhamak does not watch this. This is completely the opposite of what she is suggesting.

@zielxxc 2 года назад

The presented approach is not necessarily wrong, it is just very AWS centric as it relies on AWS for data catalog and access control to satisfy the data mesh principle of Federated Computational Governance. A more complex hybrid multi-cloud environment will need a more generic solution.

@mmcwalter 2 года назад

This is actually 100% aligned with Zhamaks vision.

@datameshlearning 2 года назад

I have no idea where you are getting that...

@datameshlearning 2 года назад

@@zielxxc yes, they came out with an AWS offering from JPMC. JPMC also cannot talk about any other vendors they are using. If you notice the way they talk about AWS Glue, it is clear it is not the actual data catalog they use for most of their use case but JPMC has weird communications rules :(