Jun 11, 2024
Great points about context windows and LLMs! But let’s spice things up a bit—if shorter context models like LC-Boost are so efficient and effective, why should we keep pouring resources into long context models? Could it be that we're over-engineering for a few niche applications? 😄 Also, with the energy consumption concerns, do you think future regulations might push us to rethink how we develop LLMs? Can't wait to hear your thoughts!