Get the slides: www.datacounci...
ABOUT THE TALK:
Developing source of truth data and metrics has been a perpetual quest at Airbnb. As complexity and the size of the company grows, the number of key metrics and dimensional cuts teams track grows, as well. Tribal knowledge of important data does not scale to large teams, and all teams may not have the data engineering skills to build and maintain pipelines.
To scale metric definition and discovery, we built a metrics framework to be the source of truth for metric definitions. This framework calculates metrics daily, feeds those metrics to reporting, experimentation, and anomaly detection applications, makes the searchable in Airbnb's Dataportal, and abstracts data lifecycle management issues such as schema evolution and backfilling. This solves the challenge of inconsistent metrics definitions, improving efficiency of Data Scientists defining metrics and freeing them from pipeline management. We have seen rapid adoption of this framework, ultimately driving business value through increasing the trustworthiness and availability of metrics.
ABOUT THE SPEAKER:
Lauren is the Product Manager for Data Quality & Analytics Frameworks at Airbnb. Previously she worked as a Senior Data Scientist at LinkedIn and as Data Scientist at Airbnb & LinkedIn. She earned her Ph.D. in Chemical and Systems Biology from Stanford University.
ABOUT DATA COUNCIL:
Data Council (www.datacounci...) is a community and conference series that provides data professionals with the learning and networking opportunities they need to grow their careers. Make sure to subscribe to our channel for more videos, including DC_THURS, our series of live online interviews with leading data professionals from top open source projects and startups.
FOLLOW DATA COUNCIL:
Twitter: / datacouncilai
LinkedIn: / datacouncil-ai
Facebook: / datacouncilai
Eventbrite: www.eventbrite...
18 сен 2024
