augmetec-finds-critical-evidence-faster
Augmetec
newsletter-september-2026
ChanChan Mao
how-jev-compares-to-other-rerankers
Taylor Smith
Ayush Chaurasia
giving-back-to-open-source
Xuanwo
Taylor Smith
10-billion-vector-search
Yang Cen
practical-llm-pretraining
Ayush Chaurasia
newsletter-august-2026
ChanChan Mao
data-mining-challenge-in-physical-ai
Lei Xu
feature-engineering-examples
Justin Miller
announcing-reverie-summit-2026
LanceDB
newsletter-july-2026
ChanChan Mao
crewai-rebuilt-agent-memory-on-lancedb
CrewAI
data-loading-guide
Weston Pace
volcano-engine-lance-agent-memory
Bytedance
make-handwritten-notes-searchable-optimizing-an-ocr-pipeline-with-lancedb
Prashanth Rao
china-merchants-lancedb-story
China Merchants Lion Rock AI Lab
rabitq-gets-faster-higher-recall-lower-latency-query-time-control
Yang Cen
newsletter-june-2026
ChanChan Mao
from-messy-pdfs-to-verifiable-answers-with-liteparse-and-lancedb
Prashanth Rao
Clelia Astra Bertelli
faster-vlm-fine-tuning-with-materialized-model-features-in-lancedb
Prashanth Rao
Ayush Chaurasia
lance-blob-v2-late-materialization-for-large-binary-data-in-spark
Drew Gallardo
semantic-memory-for-hermes-agent-with-lancedb
Prashanth Rao
a-metadata-benchmark-of-lance-delta-lake-and-iceberg-on-s3
Jack Ye
scalable-feature-engineering-on-multimodal-datasets
Prashanth Rao
stable-worldmodel-a-high-performance-platform-for-reproducible-world-model-research
Ayush Chaurasia
Quentin Lhoest
Lucas Maes
Quentin Le Lidec
reproducible-data-curation-in-the-multimodal-lakehouse
Prashanth Rao
newsletter-may-2026
ChanChan Mao
newsletter-april-2026
ChanChan Mao
how-lancedb-accelerates-vector-search-at-10-billion-scale
Yang Cen
opensearch-vs-lancedb-for-vector-search-query-cost-and-infrastructure
Justin Miller
volcano-engine-autonomous-driving-data-lake-solution
Kejian Ju
unifying-the-av-ml-stack-lancedb
Ayush Chaurasia
lance-json-support-why-you-might-not-really-need-variant
Jack Ye
building-a-storage-format-for-the-next-era-of-biology
Pavan Ramkumar
newsletter-march-2026
ChanChan Mao
smart-parsing-meets-sharp-retrieval-combining-liteparse-and-lancedb
Clelia Astra Bertelli
Prashanth Rao
lance-format-v2-2-benchmarks-half-the-storage-none-of-the-slowdown
Xuanwo
make-your-sql-workflows-multimodal-with-lancedb-x-duckdb
Prashanth Rao
agentic-coding-as-community-stewardship
Xuanwo
what-we-mean-by-multimodal
Prashanth Rao
ai-native-development-local-continue-lancedb
Ty Dunn
lance-file-format-2-2-taming-complex-data
Xuanwo
lance-blob-v2
Xuanwo
Jack Ye
openclaw-lancedb-memory-layer
Xuanwo
Prashanth Rao
openclaw-lancedb-seed2
LanceDB
openclaw-memory-from-zero-to-lancedb-pro
Prashanth Rao
upload-lance-datasets-to-hf-hub
Prashanth Rao
zero-shot-image-classification-with-vector-search
Vipul Maheshwari
werides-data-platform-transformation-how-lancedb-fuels-model-development-velocity
Qian Zhu
Fei Chen
training-a-variational-autoencoder-from-scratch-with-the-lance-file-format
LanceDB
track-ai-trends-crewai-agents-rag
LanceDB
tokens-per-second-is-not-all-you-need
Mingran Wang
Tan Li
the-future-of-open-source-table-formats-iceberg-and-lance
Jack Ye
the-case-for-random-access-i-o
LanceDB
series-a-funding
Chang She
semanticdotart
Ayush Chaurasia
second-dinners-secret-weapon-lancedb-powered-rag-for-faster-smarter-game-development
Qian Zhu
search-within-an-image-331b54e4285e
Kaushal Choudhary
scalable-computer-vision-with-lancedb-voxel51-d8b65066d5f6
LanceDB
rethinking-table-file-paths-lance-multi-base-layout
Jack Ye
rag-isnt-one-size-fits-all
Leonard Marcq
python-package-to-convert-image-datasets-to-lance-type
Vipul Maheshwari
one-million-iops
Weston Pace
november-feature-roundup
Will Jones
newsletter-september-2025
Jasmine Wang
newsletter-october-2025
Jasmine Wang
newsletter-november-2025
ChanChan Mao
newsletter-june-2025
David Myriel
newsletter-july-2025
Jasmine Wang
newsletter-january-2026
ChanChan Mao
newsletter-february-2026
ChanChan Mao
newsletter-december-2025
ChanChan Mao
newsletter-august-2025
Jasmine Wang
my-summer-internship-experience-at-lancedb-2
Raunak Sinha
my-simd-is-faster-than-yours-fb2989bf25e7
LanceDB
multimodal-myntra-fashion-search-engine-using-lancedb
LanceDB
multimodal-lakehouse
David Myriel
multi-document-agentic-rag-a-walkthrough
Vipul Maheshwari
modified-rag-parent-document-bigger-chunk-retriever-62b3d1e79bc6
Mahesh Deshwal
memgpt-os-inspired-llms-that-manage-their-own-memory-793d6eed417e
Ayush Chaurasia
late-interaction-efficient-multi-modal-retrievers-need-more-than-just-a-vector-index
Ayush Chaurasia
lancedb-x-continue
LanceDB
lance-x-huggingface-a-new-era-of-sharing-multimodal-data
Prashanth Rao
Quentin Lhoest
Xuanwo
Ayush Chaurasia
lance-x-duckdb-sql-retrieval-on-the-multimodal-lakehouse-format
Xuanwo
lance-windows-windows-lance
Chang She
lance-v2
Weston Pace
lance-namespace-lancedb-and-ray
Jack Ye
lance-file-2-1-stable
Weston Pace
lance-file-2-1-smaller-and-simpler
Weston Pace
lance-data-viewer
Gordon Murray
lance-community-governance
Jack Ye
introducing-lance-namespace-spark-integration
Jack Ye
implementing-corrective-rag-in-the-easiest-way-2
LanceDB
hybrid-search-rag-for-real-life-production-grade-applications-e1e727b3965a
Mahesh Deshwal
hybrid-search-combining-bm25-and-semantic-search-for-better-results-with-lan-1358038fe7e6
LanceDB
hybrid-search-and-custom-reranking-with-lancedb-4c10a6a3447e
LanceDB
how-to-reduce-hallucinations-from-llm-powered-agents-using-long-term-memory-72f262c3cc1f
Tevin Wang
guide-to-use-contextual-retrieval-and-prompt-caching-with-lancedb
LanceDB
grpo-understanding-and-fine-tuning-the-next-gen-reasoning-model-2
Mahesh Deshwal
graphrag-hierarchical-approach-to-retrieval-augmented-generation
Akash Desai
gpu-accelerated-indexing-in-lancedb-27558fa7eee5
LanceDB
geo-support
Jack Ye
geneva-twelvelabs
David Myriel
geneva-feature-engineering
Jonathan Hsieh
from-bi-to-ai-lance-and-iceberg
Jack Ye
Prashanth Rao
fluss-integration
Wayne Wang
file-readers-in-depth-parallelism-without-row-groups
Weston Pace
feature-rabitq-quantization
David Myriel
Yang Cen
feature-full-text-search
David Myriel
enhance-rag-integrate-contextual-compression-and-filtering-for-precision-a29d4a810301
Kaushal Choudhary
effortlessly-loading-and-processing-images-with-lance-a-code-walkthrough
LanceDB
designing-a-table-format-for-ml-workloads
Weston Pace
custom-dataset-for-llm-training-using-lance
LanceDB
creating-a-fintech-agent
Vipul Maheshwari
convert-any-image-dataset-to-lance
LanceDB
columnar-file-readers-in-depth-structural-encoding
Weston Pace
columnar-file-readers-in-depth-repetition-definition-levels
Weston Pace
columnar-file-readers-in-depth-compression-transparency
Weston Pace
columnar-file-readers-in-depth-column-shredding
Weston Pace
columnar-file-readers-in-depth-backpressure
Weston Pace
columnar-file-readers-in-depth-apis-and-fusion
Weston Pace
chunking-techniques-with-langchain-and-llamaindex
Prashant Kumar
chunking-analysis-which-is-the-right-chunking-approach-for-your-language
Shresth Shukla
chat-with-csv-excel-using-lancedb
LanceDB
case-study-netflix
David Myriel
case-study-dosu
Qian Zhu
Michael Ludden
case-study-cognee
David Myriel
Vasilije Markovic
case-study-coderabbit
Qian Zhu
building-rag-on-codebases-part-2
Sankalp Shubham
building-rag-on-codebases-part-1
Sankalp Shubham
branching-and-shallow-clone
Jack Ye
better-rag-with-active-retrieval-augmented-generation-flare-3b66646e2a9f
LanceDB
benchmarking-random-access-in-lance
Chang She
benchmarking-lancedb-92b01032874a-2
LanceDB
benchmarking-cohere-reranker-with-lancedb
LanceDB
anythingllms-competitive-edge-lancedb-for-seamless-rag-and-agent-workflows
Ayush Chaurasia
announcing-lance-sdk
Weston Pace
agentic-rag-using-langgraph-building-a-simple-customer-support-autonomous-agent
LanceDB
advanced-rag-precise-zero-shot-dense-retrieval-with-hyde-0946c54dfdcb
LanceDB
accelerate-vector-search-applications-using-openvino-lancedb
LanceDB
a-primer-on-text-chunking-and-its-types-a420efc96a13
Prashant Kumar
a-practical-guide-to-training-custom-rerankers
Ayush Chaurasia
a-practical-guide-to-fine-tuning-embedding-models
Ayush Chaurasia
keep-your-data-fresh-with-cocoindex-and-lancedb
Prashanth Rao
Linghua Jin

Announcing Reverie Summit: What AI’s Next Breakthroughs Are Made On

•
August 11, 2026
•
Announcement

AI’s most visible breakthroughs arrive as generated videos, simulated worlds, intelligent search, and machines that can act in the physical world. Behind each one is a less visible layer of work that determines what the model can actually learn.

On November 5, speakers from NVIDIA, Runway, Microsoft AI, Applied Intuition, Adobe, Exa, Luma AI, Zoox, Cruise, XPeng, Tubi, and LanceDB will join 200 AI researchers, engineers, and technical leaders in San Francisco for Reverie, a one-day summit about that work and the people doing it firsthand.

Reverie goes inside the systems beneath the models. The people building these systems will share the architectures they chose, the tradeoffs they made, the experiments that failed, and the lessons they learned at scale.

The frontier has moved below the model

The next breakthrough will not come from compute alone. It will also come from making better use of the data and compute teams already have.

That means finding the few valuable examples hidden among billions of frames. It means enriching raw video, images, audio, and sensor data with embeddings, captions, trajectories, quality scores, and other features. It means building evaluation sets that distinguish genuine understanding from surface-level imitation. And it means shortening the loop between discovering what a model is missing and training on the data that can teach it.

For many frontier teams, this is now where model quality is made. Reverie puts that work on stage.

What you will hear at Reverie

The program spans the comprehensive research and data loop, from building omnimodal world models and curating higher-quality training sets to operating petabyte-scale autonomy pipelines, enterprise multimodal platforms, and web-scale search infrastructure.

Below is a preview of the themes and speakers shaping the day. See the full Reverie schedule for session times, complete talk details, and the latest additions.

The model is only as good as the data it can learn from

The day will answer the question, What Will AI Dream Next? by looking beneath the models themselves. In Cosmos: Omnimodal World Models for Physical AI, NVIDIA Cosmos Lab Tech Lead Max Li will show what it takes to bring language, images, video, audio, and action into a shared foundation that can serve robotics and autonomy. At roughly a million hours of video and tens of billions of training candidates, Cosmos 3 makes the connection between model ambition and data infrastructure impossible to ignore. Its data must be filtered, enriched, inspected, and delivered to large GPU clusters continuously, with NVIDIA’s SILA platform using Lance as a common substrate across the workflow.

More data and more modalities do not automatically produce better intelligence, however. Runway Principal Research Engineer Ethan Rosenthal will pick up that thread in Scalable, Multimodal Data Curation, showing how embeddings, semantic deduplication, and large-scale similarity search help the team improve quality and diversity without giving up scale. Yichen Wang of Luma AI brings another perspective from the frontier of generative video, where what goes into a training set shapes not only what a model can generate, but how well it understands motion and the visual world.

The data layer is becoming the research loop

Once the right data has been found, it still has to move through curation, feature generation, search, training, evaluation, and then back through the cycle again. Suqiang “Jack” Song, Head of Data Platform at Microsoft AI, gives that loop its clearest frame in Building the Data Flywheel for Frontier AI Model. His session follows multimodal data through preparation, deduplication, decontamination, pretraining, and low-latency search, showing why teams need to bring different kinds of compute to the same durable data instead of rebuilding the foundation for every workload. Adobe’s Jing Chen He and Miao Wang extend that idea into the enterprise with How Adobe Built a Multimodal Lakehouse for AI-Native Experiences, where structured data, conversations, embeddings, and multimodal assets must come together without leaving behind governance, change data capture, or data-residency requirements.

The same pattern appears in very different domains. In Tubi’s Cornucopia: Serving Up Every Modality of Data at the AI Feast, John Trenkle will show how keeping media, metadata, embeddings, and derived signals together in one expandable table makes content easier to search, enrich, and reuse across analytics, machine learning, and agents. Exa pushes the idea to web scale. Jan van der Vegt’s Managing an Index of 100s of Billions of Pages with Exa Skeleton goes inside a distributed streaming engine that ingests billions of crawls a day and supports massive column backfills without rebuilding production datasets. Together, these talks tell a larger story about the data layer becoming an active part of the research process rather than a passive place to store its outputs.

Physical AI makes every bottleneck visible

The research loop becomes concrete when models have to operate in the physical world. Applied Intuition Software Engineer Shiyan Xu will trace raw driving logs into searchable, versioned data for hard-example mining, scenario discovery, and reinforcement learning in From Raw Driving Logs to RL Training: A Petabyte-Scale Lance Pipeline in Production. The pipeline has to evolve as new data arrives and definitions of useful training data change, while still feeding large multimodal samples directly into training. Zoox HPC Engineer Adharvan Jakkula approaches the same challenge from the storage layer in Beyond HPC Storage: S3-Native Training Without the Performance Tradeoff, exploring how teams can move demanding training workloads toward object storage without surrendering the throughput they need.

One day, one connected research loop

The same data moves through collection, inspection, enrichment, retrieval, training, and evaluation, but those stages have traditionally been split across different formats and systems. As multimodal datasets grow, the seams between those systems increasingly slow the research itself.

Reverie is a chance to hear how leading teams are closing those gaps in practice. Expect technical architectures, hard-won lessons, production numbers, and candid conversations about what worked, what broke, and what the next generation of AI infrastructure will need.

What dreams are made on

The models get the attention. Reverie is about the work that makes them possible.

The raw artifacts and the derived features. The hard cases and the failed experiments. The evaluation sets, training pipelines, and data engines. The researchers and engineers who turn an idea into evidence, then turn that evidence into the next model.

Reverie takes place Thursday, November 5, 2026, at the Contemporary Jewish Museum in San Francisco. Capacity is limited. Explore the full schedule and apply to attend to join the people building what AI will dream next.

🤖 LeRobot Trains on Lance, 🦾 Mining Robot Fleet Data Demo, 🔍 Vector Search at 10B Scale

ChanChan Mao
•
October 7, 2026
newsletter-september-2026

How Jev Compares to Other Rerankers

Taylor Smith
Ayush Chaurasia
•
September 25, 2026
how-jev-compares-to-other-rerankers

From 10 Million to 10 Billion: Vector Search Built to Grow

Yang Cen
•
September 17, 2026
10-billion-vector-search