Тёмный

Locality Sensitive Hashing By Spark 

Spark Summit
Подписаться 39 тыс.
Просмотров 9 тыс.
50% 1

Опубликовано:

 

5 окт 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 3   
@geoffreyanderson4719
@geoffreyanderson4719 8 лет назад
Thank you. THis is good information.
@snivesz32
@snivesz32 7 лет назад
I enjoyed the talk, but it doesn't actually require LSH to solve efficiently. Rephrase the question as finding those trips which start out near each other and end near each other, regardless of path taken. Use the time dimension to collapse your path into a single start lat/lon and finish lat/lon pair. The data isn't high dimensional which makes the problem very simple. Use your favorite spatial index/hash to bucket your nearest neighbors, one for trip starts, one for finishes.. Then for each bucket in starts, collect all those finishes who also share a finish index/hash. Tune the size of your spatial index/hash to achieve acceptable bucket sizes.
@AndrewHelmer47
@AndrewHelmer47 7 лет назад
I think the problem (likely for Uberpool) is not to find trips which have the same start and end, but trips which overlap enough so that combining the trips won't add much time for either passenger. So if I am traveling from A -> D, and the best route is from A -> B -> C -> D, and someone else is traveling from B -> E, with the best route B -> C -> D -> E, Uber would want to match us together, because the extra pickup and dropoff won't add much time to either trip.
Далее
ЛЮБИТЕ ШКОЛУ?😁​⁠​⁠@osssadchiy
00:20
Пчёлы некроманты.
00:46
Просмотров 22 тыс.
Locality-Sensitive Hashing and Beyond
54:28
Просмотров 8 тыс.
Locality Sensitive Hashing   Part 1, Jeffrey D  Ullman
50:09
Lessons Learned From Running Spark On Docker
26:35
Просмотров 17 тыс.
LSH.9 Locality-sensitive hashing: how it works
16:18
Просмотров 54 тыс.
Locality Sensitive Hashing   Part 2, Jeffry D  Ullman
51:37
Deep Dive: Apache Spark Memory Management
26:13
Просмотров 56 тыс.
LSH.10 False positive and negative errors of LSH
10:42
ЛЮБИТЕ ШКОЛУ?😁​⁠​⁠@osssadchiy
00:20