The Case for Random Access I/O
One of the reasons we started the Lance file format and have been investigating new encodings is because we wanted a format with better support for random access.
One of the reasons we started the Lance file format and have been investigating new encodings is because we wanted a format with better support for random access.
I'm Raunak, a master's student at the University of Illinois, Urbana-Champaign. This summer, I had the opportunity to intern as a Software Engineer at LanceDB, an early-stage startup based in San Francisco.
Get about zero shot image classification with vector search. Get practical steps, examples, and best practices you can use now.
In this blog, we’ll explore how to build a chat application that interacts with CSV and Excel files using LanceDB’s hybrid search capabilities.
The API used to read files has evolved over time, from simple full table reads to batch reads and eventually to iterative record batch readers. Lance takes this a step further to return a stream of read tasks.
Remember flipping through coding manuals? Those quickly became relics with the rise of Google and Stack Overflow, a one-stop shop for developer queries.
Explore columnar file readers in depth: column shredding with practical insights and expert guidance from the LanceDB team.
Improve retrieval quality by reranking LanceDB results with Cohere and ColBERT. You’ll plug rerankers into vector, FTS, and hybrid search and compare accuracy on real datasets.
Explore about tokens per second is not all you need. Get practical steps, examples, and best practices you can use now.