Rethinking Data Catalogs: The Promise and Pitfalls @PyConAU
Rethinking Data Catalogs: The Promise and Pitfalls  @PyConAU
Uploaded December 2024 | Updated September 2026, 5 hours ago
(Harmeet Sokhi, Vishal Srivastava) The promise of data catalogs, a single source of truth for your organisation's data, often clashes with the reality of under-utilised features, redundancy across various data catalog solutions across teams, adoption challenges and a lack of clear strategy.


This talk will pose some critical questions concerning current approaches of choosing and implementing data catalogs:


- Do you actually need a Data catalog?
- Are data catalogs becoming just glorified registries without much practical use?
- Why do organisations find themselves juggling multiple catalogs?
- Is there a synergy between System Catalog & Data Catalog?
- How do you identify the right fit and what are the considerations?
- How to measure success for a data catalog?

We'll dissect the reasons behind these challenges and share our experience of implementing data catalogs across different organisations.

pretalx.com/pycon-au-2024/talk/U3YKPB

python, pycon, australia, programming, conference, technical, developers, panel, sessions, libraries, frameworks, community, sysadmins, students, education, data, science

Videos licensed as CC-BY-NC-SA 4.0

PyCon AU is the national conference for the Python programming community, bringing together professional, student and enthusiast developers, sysadmins and operations folk, students, educators, scientists, statisticians, and many others besides, all with a love for working with Python.

Licensed as CC BY-NC-SA - creativecommons.org/licenses/by-nc-sa/4.0

Produced by Next Day Video Australia: https://nextdayvideo.com.au

Sun Nov 24 11:15:00 2024 at Eureka 2
Rethinking Data Catalogs: The Promise and PitfallsSwitching from Sphinx to Markdown - Kattni (PyCon AU 2026)Time and Time Again - Yaakov (Pycon AU 2024)Conference Open (Saturday) - Peter Hall (Pycon AU 2024)Object-Oriented Oncology: Making Sense of Complex Patient JourneysOptimizing Scientific Python with C++, CUDA, and Serverless Compute - Alex Zinovev (PyCon AU 2026)Authentication for humans, why passkeys finally make sense. - George Coldham (PyCon AU 2026)Three Django Apps in a Trenchcoat: Writing an event management website with not a lot of timeClosing Address (Sunday) - Peter Hall (Pycon AU 2024)Unarchiving vulnerabilities and avoiding tar-pits - Caleb Brown (PyCon AU 2025)Building with Multiple Languages: A Python-First Approach - Ramon Perez (PyCon AU 2025)Taking wheels mobile - Russell Keith-Magee (PyCon AU 2025)
PyCon AU |

Rethinking Data Catalogs: The Promise and Pitfalls

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER