
´óС£¡£¡£¡£¡£¡£º49.85MÓïÑÔ£º¼òÌåÖÐÎÄ
ÖÖ±ð£ºOneRoundϵͳ£ºAndroid/IOS
?¼ÓÄôópcÕ¹Íû2.8Õ¹ÍûÍø100%?ΪÄãÌṩ¼ÓÄôópcÕ¹Íû2.8Õ¹ÍûÍø100%APP°²×¿°æÏÂÔØ£¬£¬£¬£¬£¬£¬£¬£¬ÀúÊ·°æ±¾¡¢¾É°æÏÂÔØ£¬£¬£¬£¬£¬£¬£¬£¬Éó²é×îмÓÄôópcÕ¹Íû2.8Õ¹ÍûÍø100%ÊÖ»ú°æÏÈÈÝ¡¢Ó¦ÓýØÍ¼¡¢ÍøÓÑ̸ÂÛ£¬£¬£¬£¬£¬£¬£¬£¬Àû±ã¿ì½ÝµÄ½«°²×¿°æ¼ÓÄôópcÕ¹Íû2.8Õ¹ÍûÍø100%Ó¦ÓÃÃâ·ÑÏÂÔØµ½ÊÖ»ú¡£¡£¡£¡£¡£¡£
ÊÇÒ»¿îÐж¯Ã°ÏÕÓÎÏ·£¬£¬£¬£¬£¬£¬£¬£¬À´×ÔÒ£Ô¶µÄÁãÐÐÐǵÄÒ»¸ö¿Õ¼äÕ¾·¢³öÁËÒ»¸ö¾øÍûµÄÇó¾ÈÐźţ¬£¬£¬£¬£¬£¬£¬£¬ºÜ¿ì±»Ò»ÈºÒøºÓϵµÄìî³ýÕßÎüÊÕµ½£¬£¬£¬£¬£¬£¬£¬£¬ÕâȺÓ¸ҵÄÉúÑÄÕßÁ¬Ã¦³ö·¢Ç°Íù¿Õ¼äÕ¾£¬£¬£¬£¬£¬£¬£¬£¬µ«µ±ËûÃǵִïÄÇÀïʱ£¬£¬£¬£¬£¬£¬£¬£¬ËûÃDzŷ¢Ã÷Ò»Çж¼ÒѾ³¹µ×¸Ä±äÁË£¬£¬£¬£¬£¬£¬£¬£¬½Ó´ýÀ´µ½Õâ¸ö³äÂúÉñÃØ¡¢Î£ÏÕºÍδ֪µÄÌ«¿ÕÌìÏ¡£¡£¡£¡£¡£¡£
ÊÇÒ»¿îÊ®·ÖÓÐȤµÄÐÝÏÐÍ£³µÄ£ÄâÓÎÏ·£¬£¬£¬£¬£¬£¬£¬£¬Íæ¼Ò¿ÉÒÔ¼ÝÊ»í§Òâ³µÁ¾ÌôÕ½ÕâЩͣ³µÊ¹Ãü£¬£¬£¬£¬£¬£¬£¬£¬Ö»ÓÐÊìÁ·ÕÆÎÕ³µÁ¾¼ÝÊ»ÊÖÒղŻª½«³µÁ¾Ë³ËìÍ£·Åµ½Ö¸¶¨Î»Ö㬣¬£¬£¬£¬£¬£¬£¬Ï²»¶µÄÅóÙ½Ó´ýǰÀ´ÏÂÔØÌåÑé¡£¡£¡£¡£¡£¡£
ÊÇÒ»¿îÊÖ»úÊ®ÈýË®ÓÎÏ·£¬£¬£¬£¬£¬£¬£¬£¬ÓÎÏ·ÓµÓÐËíµÀÍæ·¨£¬£¬£¬£¬£¬£¬£¬£¬»ÃæÏ¸Ä壬£¬£¬£¬£¬£¬£¬£¬Çå¾²Îȹ̣¬£¬£¬£¬£¬£¬£¬£¬¹«Õý¹«Õý£¬£¬£¬£¬£¬£¬£¬£¬¿ÉÒÔ¸øÓèÍæ¼Ò³¬°ôµÄÊ®ÈýË®ÓÎÏ·ÌåÑé¡£¡£¡£¡£¡£¡£
ÊÇÒ»¿îÈ«Çò¾µäÅÜ¿áÓÎÏ·£¬£¬£¬£¬£¬£¬£¬£¬ÅÜ¿áÖ÷½ÇÍÅÖØ¾Û¿Õ¼äÕ¾£¬£¬£¬£¬£¬£¬£¬£¬È«ÐÂÂọ́¬£¬£¬£¬£¬£¬£¬£¬Ë«Ïò±¼¸°Ê®ÖÜÄêÅɶԣ¬£¬£¬£¬£¬£¬£¬£¬»ðÈȼ¯½á¡£¡£¡£¡£¡£¡£Ð¡Í¬°é£¬£¬£¬£¬£¬£¬£¬£¬»¹µÈʲô£¬£¬£¬£¬£¬£¬£¬£¬ÈÃÐܺ¢×ӽܿ˴øÄãÖÜÓÎÈ«Ììϰɣ¡
ÊÇÒ»¿îÊ®·ÖºÃÍæµÄÐÝÏÐÄ£Äâı»®ÓÎÏ·£¬£¬£¬£¬£¬£¬£¬£¬×¼±¸ºÃÍæ½¨ÉèÒ»¸öÏÐÖõĹºÎïÖÐÐIJ¢Í¨¹ý´ÓС×öÆð׬ǮÀ´Éý¼¶ÄúµÄÓªÒµ£¬£¬£¬£¬£¬£¬£¬£¬½¨ÉèÄúµÄÃÎÏëêaê_£¬£¬£¬£¬£¬£¬£¬£¬³ÉΪÓÐÊ·ÒÔÀ´×î´óµÄêaê_Àϰ塣¡£¡£¡£¡£¡£
ÊÇÒ»¿îÒÔ¿Ö²À̽ÏÕΪÖ÷ÌâµÄÓÎÏ·£¬£¬£¬£¬£¬£¬£¬£¬ÓÎÏ·³¡¾°ÒÔÃÜÊÒΪÅä¾°£¬£¬£¬£¬£¬£¬£¬£¬Íæ¼ÒÐèÒªÔÚÃÜÊÒÖÐÕÒµ½ÏßË÷£¬£¬£¬£¬£¬£¬£¬£¬½â¿ªÃÕÌ⣬£¬£¬£¬£¬£¬£¬£¬ÌÓÀë³öÈ¥¡£¡£¡£¡£¡£¡£ÓÎÏ·»ÃæÏ¸Ä壬£¬£¬£¬£¬£¬£¬£¬ÕæÊµÔÙÏÖÁËÃÜÊÒ³¡¾°£¬£¬£¬£¬£¬£¬£¬£¬ÈÃÍæ¼ÒÉíÁÙÆä¾³¡£¡£¡£¡£¡£¡£ÓÎÏ·ÄѶÈÊÊÖУ¬£¬£¬£¬£¬£¬£¬£¬Íæ¼ÒÐèÒª¶¯Í·ÄÔ£¬£¬£¬£¬£¬£¬£¬£¬Í¬Ê±»¹ÐèÒªÒ»¶¨µÄÊÓ²ìÁ¦ºÍ·´Ó¦ÄÜÁ¦¡£¡£¡£¡£¡£¡£
![]()
½üÄêÀ´£¬£¬£¬£¬£¬£¬£¬£¬´óÄ£×ÓÎı¾¼ìË÷£¨LLM-based Text Retrieval£©ÊÖÒÕÉú³¤Ñ¸ÃÍ£¬£¬£¬£¬£¬£¬£¬£¬SOTA µÄ LLM Embedding Model ²ÎÊýÄ¿ÆÕ±éÔÚ 7B ÒÔÉÏ£¬£¬£¬£¬£¬£¬£¬£¬Ïà¹ØÐÔËÑË÷ÐÔÄÜÌáÉýµÄͬʱ£¬£¬£¬£¬£¬£¬£¬£¬°²Åű¾Ç®Ò²´ó·ùÔöÌí
ÖÚËùÖÜÖª£¬£¬£¬£¬£¬£¬£¬£¬LLM Embedding Model ÊÇÒ»ÖÖ¶Ô³ÆÊ½Ë«Ëþ½á¹¹£¬£¬£¬£¬£¬£¬£¬£¬Query ºÍ Doc ²à³£¹²Ïíͳһ¸öÍêÕûµÄ LLM¡£¡£¡£¡£¡£¡£µ«Ò»¸öºã¾Ã±»ºöÊÓµÄÎÊÌâÊÇ£ºÏßÉÏÍÆÀíÖУ¬£¬£¬£¬£¬£¬£¬£¬ÅÌÎʶˣ¨Query£©ÕæµÄÐèÒªºÍÎĵµ¶Ë£¨Document£©Ò»Ñù ¡°ÖØ¡± µÄ´óÄ£×ÓÂ𣿣¿£¿£¿£¿£¿£¿ÔÚÎÒÃÇ×îеÄÑо¿ÂÛÎÄ LightRetriever ÖУ¬£¬£¬£¬£¬£¬£¬£¬ÎÄÕ¸ø³öÁËÒ»¸öÃ÷È·¡¢¼¤½ø¡¢µ«±»´ó×ÚʵÑé֤ʵ¿ÉÐеÄÃÕµ×£º²»ÐèÒª
LightRetriever Éè¼ÆÁËÒ»ÖÖ¼«Ö·ǶԳÆÊ½½á¹¹µÄ LLM Embedding Model¡ª¡ª Doc ²àʹÓÃÍêÕû LLM ½¨Ä££¬£¬£¬£¬£¬£¬£¬£¬µ«Query ²à×î¶à½öÓÃÒ»²ã Embedding Lookup¡£¡£¡£¡£¡£¡£¼«Ö»¯½µµÍÁË Query ²àÍÆÀí¼ç¸º£¬£¬£¬£¬£¬£¬£¬£¬Ò²ÄÜ×öºÃ´óÄ£×ÓÎı¾ËÑË÷¡£¡£¡£¡£¡£¡£±ÈÕÕ Query-Doc ¾ùÓÃÍêÕû LLM µÄ±ê×¼Éè¼Æ£¬£¬£¬£¬£¬£¬£¬£¬LightRetriever Èà Query ²àµÄÍÆÀíËÙÂÊÌáÉýÁËǧ±¶ÒÔÉÏ¡¢¶Ëµ½¶Ë QPS ÌáÉý 10 ±¶£¬£¬£¬£¬£¬£¬£¬£¬Í¬Ê± BeIR¡¢CMTEB Retreival µÈ²âÊÔ¼¯ÉϵÄÖÐÓ¢ÎļìË÷ÐÔÄÜÒ²ÄÜά³Ö 95% ×óÓÒ
ÎÄÕÂÓÉÖпÆÔºÐʤËù & À½ÖۿƼ¼ÅäºÏÍê³É£¬£¬£¬£¬£¬£¬£¬£¬ÒÑÎüÊÕÓÚ¹ú¼ÊÅÌËã»ú¶¥¼¶¾Û»á ICLR 2026¡£¡£¡£¡£¡£¡£ICLR£¨International Conference on Learning Representations£©ÊÇ»úеѧϰÓëÌåÏÖѧϰÁìÓòµÄ¹ú¼Ê¶¥¼¶¾Û»áÖ®Ò»£¬£¬£¬£¬£¬£¬£¬£¬Óë NeurIPS¡¢ICML ²¢ÁÐΪÈ˹¤ÖÇÄÜÆ«Ïò×î¾ßÓ°ÏìÁ¦µÄѧÊõ¾Û»á¡£¡£¡£¡£¡£¡£±¾´Î ICLR 2026 ¹²Óп¿½ü 19000 ƪÓÐÓÃͶ¸å£¬£¬£¬£¬£¬£¬£¬£¬ÎüÊÕÂÊԼΪ 28%¡£¡£¡£¡£¡£¡£
![]()
ÂÛÎÄÎÊÌ⣺LightRetriever: A LLM-based Text Retrieval Architecture with Extremely Faster Query InferenceÂÛÎÄÁ´½Ó£ºhttps://arxiv.org/abs/2505.12260
LightRetriever£º¼«ÖÂ·Ç¶Ô³ÆµÄ LLM Embedding Model
LightRetriever µÄ½¹µãÍ·ÄÔºÜÊÇÃ÷È·£º½«Éî¶È½¨Ä£µÄÖ÷ÒªÅÌËã¼ç¸º³¹µ××ªÒÆµ½ Doc ²à£¬£¬£¬£¬£¬£¬£¬£¬Query ²àÖ»±£´æÐëÒª¡¢¿É»º´æµÄ±íÕ÷ÄÜÁ¦¡£¡£¡£¡£¡£¡£LightRetriever ΪŨÃÜÏ£º±¼ìË÷Á½´ó¼ìË÷·¶Ê½£¬£¬£¬£¬£¬£¬£¬£¬»®·ÖÉè¼ÆÁ˼«Ö·ǶԳƵĽ¨Ä£ÒªÁì¡£¡£¡£¡£¡£¡£
![]()
ͼ¡£¡£¡£¡£¡£¡£ÔÚŨÃÜ / Ï£º±¼ìË÷ÖУ¬£¬£¬£¬£¬£¬£¬£¬¶Ô³ÆÊ½ LLM Embedding Model ʹÓÃÁË 1) ±ê×¼µÄ Full-sized Query Inference£¬£¬£¬£¬£¬£¬£¬£¬ÅÌÎʲàÍÆÀí¼ç¸ººÜÖØ£»£»£»£»£»£»£»£»2) LightRetriever ´ó·ù½µµÍÁËÅÌÎÊÍÆÀí±¾Ç®£¬£¬£¬£¬£¬£¬£¬£¬ÅÌÎÊ²à¸ºÔØ½µµÍÖÁ²»Áè¼ÝÒ»²ã Embedding Layer Lookup¡£¡£¡£¡£¡£¡£
ŨÃܼìË÷£¨Dense Retreival£©ÑµÁ·ÖУ¬£¬£¬£¬£¬£¬£¬£¬Doc ²à¼á³Ö½¨Ä£·½·¨Îȹ̣¬£¬£¬£¬£¬£¬£¬£¬LightRetriever ´Ê´ü»¯ÁË Query ²à½¨Ä££ºÍêÕûµÄ LLM ÎüÊÕ ¡°Ö¸Áî + µ¥¸ö Query Token¡± ×÷ΪÊäÈ룬£¬£¬£¬£¬£¬£¬£¬ÏȽ¨Ä£ Token Embedding£¬£¬£¬£¬£¬£¬£¬£¬ÔÙÇ󯽾ù»ñÈ¡ Query ¾äÏòÁ¿£¬£¬£¬£¬£¬£¬£¬£¬²¢Í¨¹ý±ÈÕÕѧϰ»ñµÃ Prompted Token Embedding¡£¡£¡£¡£¡£¡£
![]()
²î±ðÖ®´¦ÔÚÓÚ£¬£¬£¬£¬£¬£¬£¬£¬ÕâЩ Token Embedding ÔÚѵÁ·Íê³Éºó£¬£¬£¬£¬£¬£¬£¬£¬¿ÉÒÔ±»ÕûÌ建´æÎªÒ»¸ö´Ê±í¼¶ Embedding ¾ØÕ󡣡£¡£¡£¡£¡£ÔÚÏßÍÆÀíʱ£¬£¬£¬£¬£¬£¬£¬£¬Query ¾äÏòÁ¿µÄÍÆÀí½öÐèÒ»´Î¼òÆÓµÄ Token Embedding ²é±í + Çó¾ùÖµ£¬£¬£¬£¬£¬£¬£¬£¬²»ÔÙÉæ¼°ÈκΠLLM ÍÆÀí¡£¡£¡£¡£¡£¡£ÓÉÓÚ Query ²àÔÚѵÁ·½×¶ÎÈÔÐèÒªÍêÕû LLM ½¨Ä££¬£¬£¬£¬£¬£¬£¬£¬Å¨ÃÜÏòÁ¿ÑµÁ·×ñÕÕ ¡°ÑµÁ·È«Á¿ + ÍÆÀíÇáÁ¿¡± µÄÍ·ÄÔ¡£¡£¡£¡£¡£¡£ºóÃæµÄÏûÈÚʵÑé֤ʵ£¬£¬£¬£¬£¬£¬£¬£¬¡°ÑµÁ·È«Á¿¡± ÕâÖÖÉèÖò»¿ÉºöÂÔ¡£¡£¡£¡£¡£¡£
![]()
ͼ. LightRetriever µÄŨÃܼìË÷Éè¼Æ×ñÊØ ¡°ÑµÁ·È«Á¿ + ÍÆÀíÇáÁ¿¡± µÄÍ·ÄÔ£¬£¬£¬£¬£¬£¬£¬£¬Í¨¹ý´Ê´ü»¯ Query ²à½¨Ä££¬£¬£¬£¬£¬£¬£¬£¬Í»ÆÆÉÏÏÂÎÄÒÀÀµ£¬£¬£¬£¬£¬£¬£¬£¬Ê¹µÃ Query ²àÏòÁ¿ÍÆÀí¾ß±¸¿É»º´æ£¨Cacheable£©µÄÌØÕ÷¡£¡£¡£¡£¡£¡£½öÐèÒ»´Î»º´æ£¬£¬£¬£¬£¬£¬£¬£¬¾Í¿ÉÒÔÎÞ LLM °²ÅÅ Query ÍÆÀíЧÀÍ¡£¡£¡£¡£¡£¡£
Ï£º±¼ìË÷£¨Sparse Retrieval£©ÖУ¬£¬£¬£¬£¬£¬£¬£¬LightRetriever ½« Query ²à½øÒ»²½±»¼ò»¯Îª´Ê±í¿Õ¼ä T µÄ ¡°Token ID -> ¸öÊý¡± µÄ´ÊƵӳÉ䣬£¬£¬£¬£¬£¬£¬£¬ÍêÈ«ÒÆ³ýÁË¿ÉѧϰµÄÄ£×Ó²ÎÊý¡£¡£¡£¡£¡£¡£
![]()
ͬÑùͨ¹ý¶Ëµ½¶Ë±ÈÕÕѧϰ£¬£¬£¬£¬£¬£¬£¬£¬Í¨¹ý Doc ²àµÄ LLM£¬£¬£¬£¬£¬£¬£¬£¬Ñ§Ï°Àà SPLADE ÒªÁìµÄ TF-based £¨Term Frequency-based£©Ï£º±ÏòÁ¿¡£¡£¡£¡£¡£¡£
![]()
ͼ. LightRetriever µÄÏ£º±¼ìË÷Éè¼ÆÔ½·¢¼«Ö£¬£¬£¬£¬£¬£¬£¬£¬Query ²à½öÒÀÀµ´Ê´ü»¯µÄͳ¼ÆÒªÁ콨ģ´ÊÆµÌØÕ÷£¬£¬£¬£¬£¬£¬£¬£¬À´ÊµÏÖÎÞ LLM ¸ßЧ»¯ÏßÉÏÍÆÀí¡£¡£¡£¡£¡£¡£
¼«¶ËÇáÁ¿»¯µÄÅÌÎÊ£¬£¬£¬£¬£¬£¬£¬£¬²¢Ã»ÓдøÀ´ÔÖÄÑÐÔµÄÐÔÄܼÛÇ®
Ö±¾õÉÏ£¬£¬£¬£¬£¬£¬£¬£¬ÒƳý Query ²àµÄÉî¶ÈÉÏÏÂÎĽ¨Ä£»£»£»£»£»£»£»£»áÏÔÖøË𺦼ìË÷Ч¹û¡£¡£¡£¡£¡£¡£È»¶ø£¬£¬£¬£¬£¬£¬£¬£¬´ó¹æÄ£ÊµÑéЧ¹û¸ø³öÁËÒ»¸ö³öºõÒâÁϵĽáÂÛ£º
ÔÚ BeIR£¨Ó¢ÎÄ£©Óë CMTEB-Retrieval£¨ÖÐÎÄ£©µÈ¶àʹÃüÎı¾¼ìË÷»ù×¼ÉÏ£¬£¬£¬£¬£¬£¬£¬£¬Ïà¶ÔÍêÕûµÄ¶Ô³ÆÊ½ LLM Embedding£¬£¬£¬£¬£¬£¬£¬£¬LightRetriever µÄ nDCG@10 ÅÅÐòÖ¸±êֻϽµ1¨C5 pp£¬£¬£¬£¬£¬£¬£¬£¬Æ½¾ùÐÔÄܼá³ÖÂÊԼΪ95%¡£¡£¡£¡£¡£¡£¸üÖ÷ÒªµÄÊÇ£¬£¬£¬£¬£¬£¬£¬£¬¸ÃÒªÁìµÄÐÔÄÜˮƽ´ó·ùÁè¼Ý¹Å°åÏ£º±ÒªÁ죨BM25¡¢SPLADE£©ÒÔ¼°¶àÖÖÇáÁ¿»¯»òÕôÁó¼ìË÷Ä£×Ó£¬£¬£¬£¬£¬£¬£¬£¬²¢ÆÈ½üÁËÀàËÆ¿ªÔ´ÑµÁ·ÓïÁϵÄÉèÖÃÏ£¬£¬£¬£¬£¬£¬£¬£¬LLM2Vec¡¢E5-Mistral µÈ¾µäµÄ LLM Embedding ÒªÁì¡£¡£¡£¡£¡£¡£
ÕâÅú×¢£ºÔÚ¾ø´ó´ó¶¼Ïà¹ØÐÔµ¼ÏòµÄ¼ìË÷ʹÃüÖУ¬£¬£¬£¬£¬£¬£¬£¬Query ²à²¢²»ÐèÒªÍêÕûµÄÉî¶È Token ½»»¥£¬£¬£¬£¬£¬£¬£¬£¬Ò²Äܹ»Æ¥Åä Doc ²àËùѧϰµ½µÄÓïÒå½á¹¹¡£¡£¡£¡£¡£¡£
![]()
±í. BeIR / CMTEB-Retrieval Ö÷ʵÑéЧ¹û£¬£¬£¬£¬£¬£¬£¬£¬°üÀ¨¾µä Embedding Model Baseline¡¢¶Ô³ÆÊ½ Full LLM Retriever Óë LightRetriever µÄ¼ìË÷Ч¹û¡£¡£¡£¡£¡£¡£
ÎÄÕ±ÈÕÕÁË LightRetriever ÔÚ²î±ðʹÃüÖеÄϸÁ£¶ÈÐÔÄÜÌåÏÖ¡£¡£¡£¡£¡£¡£ÒÔ BeIR ΪÀý£¬£¬£¬£¬£¬£¬£¬£¬LightRetriever ÔÚ´ó´ó¶¼Í¨ÀýµÄÏà¹ØÐÔ¼ìË÷ʹÃüÖÐÐÔÄÜÌåÏÖÊ®·ÖÓÅÒ죬£¬£¬£¬£¬£¬£¬£¬ÊÇÈ«¶Ô³ÆÊ½½á¹¹µÄ 93% ÒÔÉÏ£»£»£»£»£»£»£»£»ÔÚ Domain-specific QA¡¢Entity Retrieval¡¢Citation Prediction µÈ¸ü¾ßÌôÕ½Ð﵀ OOD ʹÃüÖУ¬£¬£¬£¬£¬£¬£¬£¬ÐÔÄÜά³ÖÔÚÈ«¶Ô³ÆÊ½½á¹¹µÄ 87%¡«89%¡£¡£¡£¡£¡£¡£ËäÈ»Ïà¶ÔÐÔÄÜÂÔÓÐϽµ£¬£¬£¬£¬£¬£¬£¬£¬ÕâЩʹÃüÐÔÄܵľø¶ÔÊýÖµÈÔÈ»¾ß±¸½ÏÇ¿µÄ¾ºÕùÁ¦¡£¡£¡£¡£¡£¡£
![]()
±í¡£¡£¡£¡£¡£¡£ÔÚ BeIR µÄ²î±ðʹÃüÖУ¬£¬£¬£¬£¬£¬£¬£¬LightRetriever µÄÐÔÄÜÌåÏÖ¼°Ïà¶Ôת±ä£¨Retention£©¡£¡£¡£¡£¡£¡£
ÅÌÎÊЧÀÍËÙÂÊ´ó·ùÌáÉý
LightRetriever µÄ Query ÇáÁ¿»¯Éè¼Æ£¬£¬£¬£¬£¬£¬£¬£¬ÎªÅÌÎÊÍÆÀíЧÂÊ´øÀ´ÁËÊýÄ¿¼¶µÄÌáÉý
ÔÚ MSMARCO ¼ìË÷³¡¾°ÏÂ¶Ô 64k ÅÌÎʾÙÐмìË÷£¬£¬£¬£¬£¬£¬£¬£¬ÍêÕûµÄ Llama-8B ÅÌÎʱàÂëÐèÒªÁè¼Ý100 Ã룻£»£»£»£»£»£»£»¶ø LightRetriever µÄÅÌÎʱàÂëʱ¼ä½öΪ0.04 Ã룬£¬£¬£¬£¬£¬£¬£¬¶ÔÓ¦Áè¼Ý 1000¡ÁµÄ±àÂë¼ÓËÙ¡£¡£¡£¡£¡£¡£¼´±ã˼Á¿ Faiss Óë Lucene µÄ¼ìË÷ʱ¼ä£¬£¬£¬£¬£¬£¬£¬£¬¶Ëµ½¶ËÍÌÍÂÈÔÈ»»ñµÃÁË10¡Á ÒÔÉ쵀 QPS ÌáÉý¡£¡£¡£¡£¡£¡£ÎÄÕ»¹ÊµÑéÁËÒ»¸ö¾µäµÄ Transformers Layer ²Ã¼ô Baseline£ºÔÚ Query ²àÖ»Óà Llama-8b µÄµÚÒ»²ã Transformers Layer ÓÃÓÚѵÁ·ºÍÍÆÀí¡£¡£¡£¡£¡£¡£È»¶ø£¬£¬£¬£¬£¬£¬£¬£¬Õâ¸öÉèÖõļìË÷ÐÔÄÜºÍ QPS ¾ù²»Èç LightRetriever£¬£¬£¬£¬£¬£¬£¬£¬ÓÉÓÚѵÁ·Ê± Query ²àûÓÐÍêÕûµÄ LLM ½¨Ä£¡£¡£¡£¡£¡£¡£Õâ֤ʵÎúÎÄÕÂÖÐ ¡°ÑµÁ·È«Á¿ + ÍÆÀíÇáÁ¿¡± µÄÉè¼ÆµÄºÏÀíÐÔ¡£¡£¡£¡£¡£¡£
![]()
±í¡£¡£¡£¡£¡£¡£ÅÌÎʱàÂëʱ¼ä / ¶Ëµ½¶Ë QPS ±ÈÕÕ
ΪʲôÕâÖÖ ¡°ÑµÁ·È«Á¿ + ÍÆÀíÇáÁ¿¡± ÊÇÐëÒªµÄ£¬£¬£¬£¬£¬£¬£¬£¬¶ø²»ÊÇÎÞÒâÓÐÓã¿£¿£¿£¿£¿£¿£¿
ÔÚ LightRetriever µÄŨÃܼìË÷ÖУ¬£¬£¬£¬£¬£¬£¬£¬Query ²àÔÚѵÁ·Ê±Ê¹ÓÃÈ«Á¿£¨Full£©½¨Ä£¡¢ÍÆÀíʱת»¯Îª Embedding Layer£¨Emb£©¸ßЧ»¯ÍÆÀí¡£¡£¡£¡£¡£¡£ÎªÁËÑéÖ¤ÕâÖÖÉè¼ÆµÄºÏÀíÐÔ£¬£¬£¬£¬£¬£¬£¬£¬ÎÄÕ¾ÙÐÐÁËÒÔÏÂÁ½×éÏûÈÚʵÑ飺
A1) Doc ²àÔÚÍÆÀíʱҲʹÓà Embedding Layer¡£¡£¡£¡£¡£¡£
A2) Query ²àÔÚѵÁ·Ê±Ö±½ÓÓà Embedding Layer¡£¡£¡£¡£¡£¡£
Á½Õß¾ù»áÒýÆðÐÔÄܵĴó·ùϽµ¡£¡£¡£¡£¡£¡£Õâ˵Ã÷£ºÔÚ´óÄ£×ÓÎı¾¼ìË÷ÖУ¬£¬£¬£¬£¬£¬£¬£¬ÒƳýÉî¶È½¨Ä£²¢·ÇÎÞÒâÉè¼Æ¡£¡£¡£¡£¡£¡£
ÏûÈÚʵÑéÒ»£¨A1£©Ö¤ÊµÎú£ºDoc ²àʼÖÕÐèÒªÍêÕû½¨Ä££¬£¬£¬£¬£¬£¬£¬£¬¶ø Query ²à¿Éͨ¹ý´Ê´ü»¯ÒªÁì×öµ½½üËÆ½¨Ä£¡£¡£¡£¡£¡£¡£
ÏûÈÚʵÑé¶þ£¨A1£©Ö¤ÊµÎú£ºLightRetriever µÄÒªº¦²»ÔÚÓÚ ¡°ïÔ̽¨Ä£¡±£¬£¬£¬£¬£¬£¬£¬£¬¶øÔÚÓÚ½«½¨Ä£¸ºÔØÐ¶ÔØÖÁ²î±ð½×¶Î¡ª¡ª ÔÚѵÁ·½×¶ÎÓë Doc ²à³ä·Ö½¨Ä££¬£¬£¬£¬£¬£¬£¬£¬ÔÚÍÆÀí½×¶Î×î´ó»¯¸´Óÿɻº´æµÄ Query ´ÊÏòÁ¿£¬£¬£¬£¬£¬£¬£¬£¬¼´ ¡°ÑµÁ·È«Á¿ + ÍÆÀíÇáÁ¿¡±¡£¡£¡£¡£¡£¡£
´ÓÕâÒ»½Ç¶È¿´£¬£¬£¬£¬£¬£¬£¬£¬LightRetriever ²¢²»ÊÇÒ»´ÎÕë¶ÔÄ£×ӽṹµÄ΢µ÷£¬£¬£¬£¬£¬£¬£¬£¬¶øÊÇ¶Ô LLM Ë«ËþÄ£×ÓÅÌË㷶ʽµÄÖØÐÂÉóÔÄ¡£¡£¡£¡£¡£¡£
![]()
±í¡£¡£¡£¡£¡£¡£¶Ô³ÆÐÔÏûÈÚʵÑé¡£¡£¡£¡£¡£¡£A1) Doc ²àÍÆÀíʱҲ¾ÙÐÐÁË´Ê´üÇáÁ¿»¯£»£»£»£»£»£»£»£»A2) Query ²àѵÁ·Ê±Ö±½ÓʹÓÃÁË Embedding ´Ê´ü¡£¡£¡£¡£¡£¡£Á½ÕßЧ¹û¾ùÏÔÖøÏ½µ¡£¡£¡£¡£¡£¡£
½áÓµ± Query ²à°²ÅŲ»ÔÙÊǼ縺£¬£¬£¬£¬£¬£¬£¬£¬LLM ¼ìË÷²ÅÕæÕý¾ß±¸¿ÉÀ©Õ¹ÐÔ
LightRetriever Åú×¢£¬£¬£¬£¬£¬£¬£¬£¬¸ßÖÊÁ¿µÄ LLM Embedding Model ²¢·×Æç¶¨Òâζן߰ºµÄÔÚÏßÍÆÀí±¾Ç®¡£¡£¡£¡£¡£¡£Í¨¹ýÃ÷È·Çø·Ö Query Óë Doc ÔÚ¼ìË÷Á÷³ÌÖеĽÇÉ«£¬£¬£¬£¬£¬£¬£¬£¬²¢ÓÐÒâʶµØÍ»ÆÆ¶Ô³Æ½¨Ä£ÕâÒ»ºã¾ÃĬÈϵÄÉè¼Æ¼ÙÉ裬£¬£¬£¬£¬£¬£¬£¬¼ìË÷ϵͳ¿ÉÒÔÔÚά³ÖЧ¹ûµÄÌõ¼þÏ£¬£¬£¬£¬£¬£¬£¬£¬»ñµÃÊýÄ¿¼¶µÄЧÂÊÌáÉý¡£¡£¡£¡£¡£¡£
¹ØÓÚÃæÏòÕæÊµÓ¦Óó¡¾°µÄ¼ìË÷ϵͳ¡¢RAG ¿ò¼ÜÓëÔÚÏßËÑË÷ЧÀͶøÑÔ£¬£¬£¬£¬£¬£¬£¬£¬ÕâÖÖÅÌÎÊÇáÁ¿»¯µÄ½¨Ä£Ë¼Ð÷£¬£¬£¬£¬£¬£¬£¬£¬»òÐí±È´¿´â×·Çó¸ü´óµÄÄ£×Ó¹æÄ£¸ü¾ßÓ¦ÓüÛÖµ¡£¡£¡£¡£¡£¡£
×÷Õß¼ò½é
ÎÄÕµÚÒ»×÷ÕßΪÖйú¿ÆÑ§ÔºÐÅÏ¢¼ÓÄôópcÕ¹Íû2.8Õ¹ÍûÍø100%¹¤³ÌÑо¿Ëù²©Ê¿Ñо¿ÉúÂí¹ãÔ¶£¬£¬£¬£¬£¬£¬£¬£¬Ñо¿Æ«ÏòΪ´óÄ£×ÓÐÅÏ¢¼ìË÷£¬£¬£¬£¬£¬£¬£¬£¬µ¼Ê¦ÊÇ»¢áÔÁÖÑо¿Ô±¡£¡£¡£¡£¡£¡£±¾ÎÄÔÚ΢ÈíÑÇÑÐԺǰ¸±Ôº³¤¡¢ÏÖÀ½ÖۿƼ¼ CEO ÖÜÃ÷²©Ê¿ºÍ»¢áÔÁÖÑо¿Ô±µÄÅäºÏÖ¸µ¼ÏÂÍê³É¡£¡£¡£¡£¡£¡£
İͷ°ÔÍõ´óС£¡£¡£¡£¡£¡£º34.80M°æ±¾£ºvip1.0.33ÏÂÔØ
Chaos Chronicles´óС£¡£¡£¡£¡£¡£º25.47M°æ±¾£ºvip3.6.34ÏÂÔØ
ÌìÏÂÈý·Ö´óС£¡£¡£¡£¡£¡£º77.94M°æ±¾£ºvip6.7.47ÏÂÔØ
ÎÞË«ÈÍõ´óС£¡£¡£¡£¡£¡£º89.20M°æ±¾£ºvip0.3.10ÏÂÔØ
ÆáºÚáÈÆð´óС£¡£¡£¡£¡£¡£º69.65M°æ±¾£ºvip2.3.74ÏÂÔØ
Öð¹³à±Ú´óС£¡£¡£¡£¡£¡£º71.48M°æ±¾£ºvip1.6.62ÏÂÔØ

ÒõÓ°Ö®Õ½Sports57.47Mvip1.0.33
ÏÂÔØ
Nebula KnightsTurn-Based10.64Mvip3.6.34
ÏÂÔØ
ÐÇÔÆÆ¯Á÷Military97.25Mvip5.1.33
ÏÂÔØ
ÃÔʧ´ÎÔªÕ½ÕùÓÎÏ·23.36Mvip7.0.28
ÏÂÔØ
»ÔÒ«ÌìÑÄÒæÖÇÓÎÏ·25.23Mvip4.8.40
ÏÂÔØ
Lost Heroesµç×ÓÒÕÊõ75.39Mvip9.3.29
ÏÂÔØ
ÖîºîÖ®Õ½RPG-Role-PlayingGame22.81Mvip0.3.10
ÏÂÔØ
äöÎÐÆïÊ¿Competitive59.41Mvip8.0.35
ÏÂÔØ
Eternal FlameRacing62.23Mvip7.0.28
ÏÂÔØ
¾ø¾³Ä°Í·Éç½»40.55Mvip9.0.62
ÏÂÔØ