(Alex Ware) What is PySpark? Can it solve all of my data problems? Are you sure I can’t just use pandas instead?
This talk will aim to answer at least some of the questions you may have if you’re starting out with or looking to scale up your use of PySpark when working with data. This will be a mix of useful intro hints mixed with more technical backing, including a peek into what goes on behind the API and some common issues I’ve run into so that you can hopefully spend slightly less time getting frustrated by them.
So whether you’re prepping for your next data engineering interview or are just curious about what might be going on in one small corner of the world of data, you’ll hopefully leave this talk feeling a bit more confident taking your next steps with big data.
pretalx.com/py...
python, pycon, australia, programming, conference, technical, pyconline, developers, panel, sessions, libraries, frameworks, community, sysadmins, students, education, data, science
Videos licensed as CC-BY-NC-SA 4.0
PyCon AU is the national conference for the Python programming community, bringing together professional, student and enthusiast developers, sysadmins and operations folk, students, educators, scientists, statisticians, and many others besides, all with a love for working with Python.
Licensed as CC BY-NC-SA - creativecommons...
Produced by Next Day Video Australia: nextdayvideo.c...
Fri Aug 18 13:50:00 2023 at Hall C (Plenary)
21 авг 2023
