GitHub topics: text-chunking
drittich/SemanticSlicer
🧠✂️ SemanticSlicer — A smart text chunker for LLM-ready documents.
Language: C# - Size: 73.2 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 23 - Forks: 1
isaacus-dev/semchunk
A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.
Language: Python - Size: 128 KB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 318 - Forks: 19
Besthope-Official/predoc
Preprocess document service for RAG (Retriveal Augumented Generation)
Language: Python - Size: 151 KB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 1 - Forks: 2
lazyFrogLOL/llmdocparser
A package for parsing PDFs and analyzing their content using LLMs.
Language: Python - Size: 1.21 MB - Last synced at: 21 days ago - Pushed at: 11 months ago - Stars: 271 - Forks: 9
jparkerweb/semantic-chunking
🍱 semantic-chunking ⇢ semantically create chunks from large document for passing to LLM workflows
Language: JavaScript - Size: 8.81 MB - Last synced at: 29 days ago - Pushed at: 4 months ago - Stars: 94 - Forks: 6
betcorg/llm-text-splitter Fork of golbin/llm-chunk
A lightweight TypeScript text splitter for RAG applications
Language: TypeScript - Size: 180 KB - Last synced at: 5 days ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0
adityapathak-cubastion/cubastion-hr-chatbot
Presenting, Cubastion's HR chatbot - it can answer queries based on all the latest HR documents published by Cubastion's HR team. This conveniently saves time, allowing a Cubastion employee to resolve their query without having to comb through the actual documents. <<Developed with Python, sentence-transformers, Pinecone, llama3.2, and Streamlit>>
Language: Python - Size: 33.4 MB - Last synced at: 3 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 1
philnash/chunkers
An exploration of text splitting and chunking in JavaScript
Language: TypeScript - Size: 15.5 MB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0
ChenTaHung/HTML-Text-Parser
This project is designed to extract text from documents and prepare it for processing by Large Language Models (LLM). Implemented a feature to store and utilize text style information, enabling the program to identify and segment content based on potential headers and titles.
Language: HTML - Size: 18.7 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 6 - Forks: 1
