Тёмный

DataFrame: Kotlin's Innovative Approach to Data Structures | Roman Belov 

Kotlin by JetBrains
Подписаться 73 тыс.
Просмотров 7 тыс.
50% 1

Recording brought to you by American Express. americanexpress.io/kotlin-jobs
We'll talk about Dataframe - a library and a data structure that can help to read, write, generate, transform and organize data for displaying or plotting. It supports not only flat data structures but also hierarchical ones and thus can represent CSV, JSON or even subgraphs of objects in memory. While dataframes are usually mentioned in the context of data analytics, Kotlin Dataframe is also focused on general data cases and perfect for both professional and personal projects. We'll start with how it all works in Kotlin Notebook - an environment where you can write and execute fragments of code. It’s a good fit for prototyping and trying out ideas. The IDE provides beautiful interactive tables that can display hierarchical data. Also, in the notebooks, the types of dataframe variables are updated after each fragment execution. It means that columns of the dataframe will appear in completion together with their content type. Kotlin Dataframe’s new compiler plugin takes this idea even further and infers on-the-fly the types of columns while data wrangling. Come over, and we’ll show it in action and share what Kotlin language features make it possible

Наука

Опубликовано:

 

27 июн 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 10   
@__J____ff
@__J____ff 8 дней назад
this is how KOTLIN SCRIPT should act as well ! Convenience is key with scripting and kotlin should strive to be even better than python in convenience.
@skarloti
@skarloti Месяц назад
Some time ago I tried to use this library for huge datasets (billion rows) like CSV and Json Lines, but despite being able to stream it it didn't work well. Has anyone done actual samples? However, this is important if you decide to train a large language model.
@Noxafurry
@Noxafurry Месяц назад
It would be nice to see an example where one JSON field couldn't be typed. Let's say we have a collection of objects and some field in them while having the same name has different types in different objects. The solution with Any is obvious, but could this type be converted into a sealed class holder for example?
@JolanRensen
@JolanRensen Месяц назад
Actually that's a difficult case, because in JSON, fields of objects can be undefined. You cannot know if two objects are actually two different types or just two versions of the same one (at least not without a json schema) So currently, in Dataframe by default, if you read an array of objects, they will be seen as one type and for properties existing in one object, in the other they will be read as nulls. Mismatching primitives will become the common super type.
@Noxafurry
@Noxafurry Месяц назад
On the production part: it looks cool, but wouldn't having a network request (I assume) lead to non-stable build, also does it mean that build will heavily rely on an internet connection? If I am right, it doesn't sound production-like :(
@JolanRensen
@JolanRensen Месяц назад
It's indeed not production ready, by far :) we're still thinking about how to implement this responsibly and suggestions are welcome! (But it certainly shows the power of the new compiler plugins, doesn't it? :D )
@skarloti
@skarloti Месяц назад
42:19 In this part in production it is promising, but I also injected a scheme in Kotlin 1.x and classes are automatically generated!
@luishenriquegomescamilo2790
@luishenriquegomescamilo2790 Месяц назад
Amazing!
@LarryGarfieldCrell
@LarryGarfieldCrell Месяц назад
The live demo gods were not kind today...
Далее
ТЫ С ДРУГОМ В ДЕТСТВЕ😂#shorts
01:00
Build Environment Setup for KMP Projects
17:30
Kotlin + Power-Assert = ❤️ | Brian Norman
13:13
Просмотров 6 тыс.
Compose UI for... a Light Switch | Jake Wharton
47:02
Coroutines Beyond Concurrency by Alex Semin
39:35
Просмотров 20 тыс.