Merge branch 'main' into feature/json_write_prd

docs/FAQ-EN.md

@@ -17,14 +17,15 @@
 1.  EN
 
     1.  Demo Video: [MetaGPT: Multi-Agent AI Programming Framework](https://www.youtube.com/watch?v=8RNzxZBTW8M)
-    1.  Tutorial: [MetaGPT: Deploy POWERFUL Autonomous Ai Agents BETTER Than SUPERAGI!](https://www.youtube.com/watch?v=q16Gi9pTG_M&t=659s)
+    2. Tutorial: [MetaGPT: Deploy POWERFUL Autonomous Ai Agents BETTER Than SUPERAGI!](https://www.youtube.com/watch?v=q16Gi9pTG_M&t=659s)
+    3. Author's thoughts video(EN): [MetaGPT Matthew Berman](https://youtu.be/uT75J_KG_aY?si=EgbfQNAwD8F5Y1Ak)
 
 1.  CN
 
     1.  Demo Video: [MetaGPT：一行代码搭建你的虚拟公司_哔哩哔哩_bilibili](https://www.bilibili.com/video/BV1NP411C7GW/?spm_id_from=333.999.0.0&vd_source=735773c218b47da1b4bd1b98a33c5c77)
     1.  Tutorial: [一个提示词写游戏 Flappy bird, 比AutoGPT强10倍的MetaGPT，最接近AGI的AI项目](https://youtu.be/Bp95b8yIH5c)
-    1.  Author's thoughts video(CN): [MetaGPT作者深度解析直播回放_哔哩哔哩_bilibili](https://www.bilibili.com/video/BV1Ru411V7XL/?spm_id_from=333.337.search-card.all.click)
-
+    2.   Author's thoughts video(CN): [MetaGPT作者深度解析直播回放_哔哩哔哩_bilibili](https://www.bilibili.com/video/BV1Ru411V7XL/?spm_id_from=333.337.search-card.all.click)
+  
 <!---->
 
 3.  ### How to become a contributor?
@@ -153,6 +154,7 @@
 
     1.  Youtube（CN）：[一个提示词写游戏 Flappy bird, 比AutoGPT强10倍的MetaGPT，最接近AGI的AI项目=一个软件公司产品经理+程序员](https://youtu.be/Bp95b8yIH5c)
     1.  Youtube（EN）https://www.youtube.com/watch?v=q16Gi9pTG_M&t=659s
+    2.  video(EN): [MetaGPT Matthew Berman](https://youtu.be/uT75J_KG_aY?si=EgbfQNAwD8F5Y1Ak)
 
 1.  openai.error.RateLimitError: You exceeded your current quota, please check your plan and billing details
 
@@ -161,7 +163,7 @@
 
 1.  What does "borg" mean in n_borg?
 
-    1.  https://en.wikipedia.org/wiki/Borg
+    1.  [Wikipedia borg meaning ](https://en.wikipedia.org/wiki/Borg)
     1.  The Borg civilization operates based on a hive or collective mentality, known as "the Collective." Every Borg individual is connected to the collective via a sophisticated subspace network, ensuring continuous oversight and guidance for every member. This collective consciousness allows them to not only "share the same thoughts" but also to adapt swiftly to new strategies. While individual members of the collective rarely communicate, the collective "voice" sometimes transmits aboard ships.
 
 1.  How to use the Claude API？

metagpt/actions/detail_mining.py

@@ -0,0 +1,52 @@
+#!/usr/bin/env python
+# -*- coding: utf-8 -*-
+"""
+@Time    : 2023/9/12 17:45
+@Author  : fisherdeng
+@File    : detail_mining.py
+"""
+from metagpt.actions import Action, ActionOutput
+from metagpt.logs import logger
+
+PROMPT_TEMPLATE = """
+##TOPIC
+{topic}
+
+##RECORD
+{record}
+
+##Format example
+{format_example}
+-----
+
+Task: Refer to the "##TOPIC" (discussion objectives) and "##RECORD" (discussion records) to further inquire about the details that interest you, within a word limit of 150 words.
+Special Note 1: Your intention is solely to ask questions without endorsing or negating any individual's viewpoints.
+Special Note 2: This output should only include the topic "##OUTPUT". Do not add, remove, or modify the topic. Begin the output with '##OUTPUT', followed by an immediate line break, and then proceed to provide the content in the specified format as outlined in the "##Format example" section.
+Special Note 3: The output should be in the same language as the input.
+"""
+FORMAT_EXAMPLE = """
+
+##
+
+##OUTPUT
+...(Please provide the specific details you would like to inquire about here.)
+
+##
+
+##
+"""
+OUTPUT_MAPPING = {
+    "OUTPUT": (str, ...),
+}
+
+
+class DetailMining(Action):
+    """This class allows LLM to further mine noteworthy details based on specific "##TOPIC"(discussion topic) and "##RECORD" (discussion records), thereby deepening the discussion.
+    """
+    def __init__(self, name="", context=None, llm=None):
+        super().__init__(name, context, llm)
+
+    async def run(self, topic, record) -> ActionOutput:
+        prompt = PROMPT_TEMPLATE.format(topic=topic, record=record, format_example=FORMAT_EXAMPLE)
+        rsp = await self._aask_v1(prompt, "detail_mining", OUTPUT_MAPPING)
+        return rsp

metagpt/tools/search_engine.py

@@ -5,7 +5,7 @@
 @Author  : alexanderwu
 @File    : search_engine.py
 """
-# from __future__ import annotations
+from __future__ import annotations
 
 import importlib
 from typing import Callable, Coroutine, Literal, overload

requirements.txt

@@ -27,7 +27,7 @@ PyYAML==6.0
 # sentence_transformers==2.2.2
 setuptools==65.6.3
 tenacity==8.2.2
-tiktoken==0.3.3
+tiktoken==0.4.0
 tqdm==4.64.0
 #unstructured[local-inference]
 # playwright
@@ -39,6 +39,7 @@ typing_extensions==4.5.0
 libcst==1.0.1
 qdrant-client==1.4.0
 pytest-mock==3.11.1
-open-interpreter==0.1.3
+open-interpreter==0.1.4; python_version>"3.9"
 ta==0.10.2
+semantic-kernel==0.3.10.dev0
 

tests/metagpt/actions/test_detail_mining.py

@@ -0,0 +1,23 @@
+#!/usr/bin/env python
+# -*- coding: utf-8 -*-
+"""
+@Time    : 2023/9/13 00:26
+@Author  : fisherdeng
+@File    : test_detail_mining.py
+"""
+import pytest
+
+from metagpt.actions.detail_mining import DetailMining
+from metagpt.logs import logger
+
+@pytest.mark.asyncio
+async def test_detail_mining():
+    topic = "如何做一个生日蛋糕"
+    record = "我认为应该先准备好材料，然后再开始做蛋糕。"
+    detail_mining = DetailMining("detail_mining")
+    rsp = await detail_mining.run(topic=topic, record=record)
+    logger.info(f"{rsp.content=}")
+    
+    assert '##OUTPUT' in rsp.content
+    assert '蛋糕' in rsp.content
+