Extending Postgres for High Performance Analytics (with Philippe Noël) 

PostgreSQL is an incredible general-purpose database, but it can’t do everything. Every design decision is a tradeoff, and inevitably some of those tradeoffs get fundamentally baked into the way it’s built. Take storage for instance - Postgres tables are row-oriented; great for row-by-row access, but when it comes to analytics, it can’t compete with a dedicated OLAP database that uses column-oriented storage. Or can it?
Joining me this week is Philippe Noël of ParadeDB, who’s going to take us on a tour of Postgres’ extension mechanism, from creating custom functions and indexes to Rust code that changes the way Postgres stores data on disk. In his journey to bring Elasticsearch’s strengths to Postgres, he’s gone all the way down to raw datafiles and back through the optimiser to teach a venerable old dog some new data-access tricks.
-
ParadeDB: paradedb.com
ParadeDB on Twitter: / paradedb
ParadeDB on Github: github.com/paradedb/paradedb
pgrx (Postgres with Rust): github.com/pgcentralfoundatio...
Tantivy (Rust FTS library): github.com/quickwit-oss/tantivy
PgMQ (Queues in Postgres): tembo.io/blog/introducing-pgmq
Apache Datafusion: datafusion.apache.org/
Lucene: lucene.apache.org/
Kris on Mastodon: mastodon.social/@krisajenkins
Kris on LinkedIn: / krisjenkins
Kris on Twitter: / krisajenkins
-
0:00 Intro
2:03 Podcast
1:06:36 Outro
#softwaredevelopment #rdbms #programming #databases