Arxiv Dives is part of a reading group that gets together every Friday to dig into state of the art research that relates to Machine Learning and Artificial Intelligence. If you would like to join the live discussion we would love to have you!
Join here: lu.ma/oxenbook...
Each week we dive deep into a topic in ML/AI. Whether it is a research paper, a blog post, a book, or a RU-vid video, we break down the content into a digestible format and have an open discussion with the Oxen.ai team, and anyone else who wants to join. We try to cover the content as high level so that anyone can understand it, and will dive into deeper technical details to get a clearer understanding.
This week we cover the Mamba model architecture which claims 5x faster throughput than Transformers and scales linearly instead of quadratically with the length of the sequence. Its performance shows promise on data up to million-length sequences.
The notes can all be found on the Oxen.ai blog:
blog.oxen.ai/m...
8 сен 2024