Langchain Chunking Benchmarking · AI Developer Accelerator

Oct 11 (edited) in Full Stack Development with AI

Langchain Chunking Benchmarking

Hey guys!

I just finished the project I was showing on the last call. For those who were not there, it's a benchmarking environment to compare different semantic chunking methods from Langchain in both scientific and medical domains. It has a custom scoring system which consists of both chunk size distribution and quality of retrieval.

Feel free to read the paper or actually run some tests yourself: https://github.com/monami44/Langchain-Semantic-Chunking-Arena

For a video walkthrough go here: https://www.youtube.com/watch?v=7_YNeJvcAtM

5 comments