Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
yding
on July 31, 2023
|
parent
|
context
|
favorite
| on:
Chunking 2M files a day for code search using synt...
This is really cool and a much needed contribution to helping LLMs run better on large code bases.
kevinlu1248
on July 31, 2023
[–]
Thanks! Would love to see this algorithm in LlamaIndex.
kevinlu1248
on Aug 1, 2023
|
parent
|
next
[–]
For others in this thread, this algo is now publicly accessible in LlamaIndex at
https://github.com/jerryjliu/llama_index/blob/e567e6a20cf89b...
thomasfromcdnjs
on July 31, 2023
|
parent
|
prev
|
next
[–]
Also thank you! I had an idea of how this all worked but this definitely concreted my thoughts.
kevinlu1248
on July 31, 2023
|
root
|
parent
|
next
[–]
I'm glad to hear! Let me know if you need more questions or are interested in implementing this chunking algo.
sandGorgon
on Aug 1, 2023
|
parent
|
prev
[–]
oh really ? Thats awfully kind. I'll take that in for EdgeChains as well.
https://github.com/arakoodev/EdgeChains/issues/172
kevinlu1248
on Aug 1, 2023
|
root
|
parent
[–]
Feel free to use the algo! Happy to help and reach out if you need help with implementation!
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
