{"id":3879,"date":"2025-02-13T12:00:00","date_gmt":"2025-02-13T04:00:00","guid":{"rendered":"http:\/\/benjenq.ddns.net\/blog\/%e3%80%90%e7%a2%bc%e8%be%b2%e3%80%91%e8%87%aa%e5%bb%ba%e4%bd%8e%e6%88%90%e6%9c%ac-ai-%e8%81%8a%e5%a4%a9%e6%a9%9f%e5%99%a8%e4%ba%ba\/"},"modified":"2025-02-13T12:00:00","modified_gmt":"2025-02-13T04:00:00","slug":"%e3%80%90%e7%a2%bc%e8%be%b2%e3%80%91%e8%87%aa%e5%bb%ba%e4%bd%8e%e6%88%90%e6%9c%ac-ai-%e8%81%8a%e5%a4%a9%e6%a9%9f%e5%99%a8%e4%ba%ba","status":"publish","type":"post","link":"http:\/\/benjenq.ddns.net\/blog\/%e3%80%90%e7%a2%bc%e8%be%b2%e3%80%91%e8%87%aa%e5%bb%ba%e4%bd%8e%e6%88%90%e6%9c%ac-ai-%e8%81%8a%e5%a4%a9%e6%a9%9f%e5%99%a8%e4%ba%ba\/","title":{"rendered":"\u3010\u78bc\u8fb2\u3011\u81ea\u5efa\u4f4e\u6210\u672c AI \u804a\u5929\u6a5f\u5668\u4eba"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" alt=\"\u672a\u547d\u540d-1.png\" height=\"324\" src=\"https:\/\/pic.pimg.tw\/benjenq\/1739553333-1771871032-g.png\" title=\"\u672a\u547d\u540d-1.png\" width=\"720\"><\/p>\n<p>\u6700\u8fd1 AI \u5708\u7684\u91cd\u78c5\u6d88\u606f\uff1a<a href=\"https:\/\/www.deepseek.com\/\" target=\"_blank\">DeepSeek R1<\/a> \u7a81\u8972\u767b\u5834\uff0c\u5728\u67d0\u7a2e\u7a0b\u5ea6\u4e0a\u91cd\u65b0\u5b9a\u7fa9\u4e86 AI \u7684\u904a\u6232\u898f\u5247\uff0c\u6253\u7834\u4e86\u897f\u65b9\u570b\u5bb6\u5c0d AI \u79d1\u6280\u7684\u58df\u65b7\u3002\u540c\u6642\uff0cDeepSeek \u4e5f\u958b\u6e90\u4e86\u5176\u8a9e\u8a00\u5927\u6a21\u578b\uff0c\u8b93\u672c\u5730\u90e8\u7f72 LLM\uff08\u5927\u8a9e\u8a00\u6a21\u578b\uff09\u7684\u8a71\u984c\u518d\u6b21\u71b1\u9580\u4e86\u8d77\u4f86\u3002\u5176\u5be6\uff0c\u672c\u5730\u90e8\u7f72\u8a9e\u8a00\u6a21\u578b\u670d\u52d9\u672c\u4f86\u662f\u4e00\u9805\u975e\u5e38\u7e41\u7463\u7684\u4e8b\uff0c\u4f46\u96a8\u8457 Ollama \u5728 2023 \u5e74 7 \u6708\u7684\u554f\u4e16\uff0c\u5982\u4eca\u9019\u4e00\u5207\u8b8a\u5f97\u8d85\u7d1a\u7c21\u55ae\u4e86\u3002\u6700\u8fd1\u6211\u5728\u5617\u8a66 Telegram \u6a5f\u5668\u4eba\u670d\u52d9\u6642\uff0c\u7a81\u7136\u9748\u5149\u4e00\u9583\uff0c\u82e5\u80fd\u5c07\u6a5f\u5668\u4eba\u8207\u672c\u5730\u8a9e\u8a00\u6a21\u578b\u7d50\u5408\u8d77\u4f86\uff0c\u90a3\u4e0d\u5c31\u8b8a\u6210\u4e86\u81ea\u88fd AI \u804a\u5929\u6a5f\u5668\u4eba\u55ce\uff1f\u6c92\u60f3\u5230\u5be6\u4f5c\u8d77\u4f86\u4e5f\u975e\u5e38\u7c21\u55ae\uff0c\u56e0\u6b64\u5beb\u9019\u7bc7\u6587\u7ae0\u4f86\u7c21\u55ae\u8a18\u9304\uff0c\u5e0c\u671b\u4e5f\u80fd\u8b93\u5c0d\u6b64\u611f\u8208\u8da3\u7684\u4eba\u5c11\u8d70\u4e00\u4e9b\u5f4e\u8def\u3002<\/p>\n<p><!-- more --><\/p>\n<p>\u672c\u6587\u4e3b\u8981\u5206\u6210\u4e09\u500b\u90e8\u5206\uff1aOllama \u672c\u5730\u90e8\u7f72 LLM \u5927\u8a9e\u8a00\u6a21\u578b\u670d\u52d9\u3001\u7533\u8acb Telegram \u6a5f\u5668\u4eba\u3001\u64b0\u5beb Python \u4ee3\u78bc\u6574\u5408\u5169\u8005\u3002\u6574\u500b\u64cd\u4f5c\u6d41\u7a0b\u4e0d\u542b\u4e0b\u8f09\u6642\u9593\uff0c10 \u5206\u9418\u5167\u5c31\u80fd\u5168\u90e8\u641e\u5b9a\u3002\u6211\u500b\u4eba\u4ee5\u4e09\u865f\u6a5f\u5be6\u6e2c\uff08Intel i7-10700K, RTX 3060 12GB\uff09\uff0cOllama \u5728 Windows \u5e73\u53f0\u7684\u8868\u73fe\u6700\u597d\uff0cmasOS \u5e73\u53f0\u4e0d\u8ad6\u662f\u9ed1\u860b\u679c\u6216\u662f Apple M2\uff0cOllama \u90fd\u7121\u6cd5\u4f7f\u7528 GPU \u52a0\u901f\uff0c\u904b\u884c\u901f\u5ea6\u5dee\u5f88\u591a\u3002\u672c\u6587\u4ee5 Windows \u70ba\u4f8b\u3002<\/p>\n<p><span style=\"font-size:16px\"><strong>\u4e00\u3001Ollama \u672c\u5730\u90e8\u7f72\u5927\u578b\u8a9e\u8a00\u6a21\u578b\u670d\u52d9<\/strong><\/span><\/p>\n<p>Ollama \u662f\u958b\u6e90\u7684\u5927\u8a9e\u8a00\u90e8\u7f72\u5957\u4ef6\uff0c\u652f\u63f4 Windows \/ macOS \/ Linux \u8de8\u5e73\u53f0\uff0c\u5b89\u88dd\u7c21\u55ae\u3001\u5bb9\u6613\u4f7f\u7528\u3002<\/p>\n<p>1.1 \u4e0b\u8f09\u4e26\u5b89\u88dd <a href=\"https:\/\/ollama.com\/\" target=\"_blank\">Ollama<\/a>\uff1a\u53ef\u6839\u64da\u81ea\u5df1\u7684\u4f5c\u696d\u7cfb\u7d71<a href=\"https:\/\/ollama.com\/download\" target=\"_blank\">\u9078\u64c7\u4e0b\u8f09<\/a>\u5b89\u88dd\u6a94\u3002\u5b89\u88dd\u4e5f\u5f88\u7c21\u55ae\uff0c\u57f7\u884c\u5b89\u88dd\u6a94\u4e4b\u5f8c\uff0c\u4e00\u76f4\u4e0b\u4e00\u6b65\u5c31\u884c\u4e86\u3002<\/p>\n<p>\u6700\u5f8c\u5b89\u88dd\u5b8c\u6210\u4e4b\u5f8c\uff0c\u958b\u555f\u547d\u4ee4\u63d0\u793a\u8996\u7a97\uff08\u7d42\u7aef\u6a5f\uff09\uff0c\u57f7\u884c ollama \uff0c\u5982\u679c\u770b\u5230\u4ee5\u4e0b\u7684\u6307\u4ee4\u8aaa\u660e\u756b\u9762\uff0c\u5c31\u8868\u793a ollama \u5b89\u88dd\u5b8c\u6210\u4e86\u3002<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" alt=\"\u87a2\u5e55\u64f7\u53d6\u756b\u9762 2025-02-13 235012.png\" height=\"670\" src=\"https:\/\/pic.pimg.tw\/benjenq\/1739461844-3057716568-g.png\" title=\"\u87a2\u5e55\u64f7\u53d6\u756b\u9762 2025-02-13 235012.png\" width=\"720\"><\/p>\n<p>1.2 \u9078\u64c7\u5927\u8a9e\u8a00\u6a21\u578b<\/p>\n<p>Ollama \u652f\u63f4\u7684 LLM \u5927\u8a9e\u8a00\u6a21\u578b\u5f88\u591a\uff0c\u9ede\u64ca<a href=\"https:\/\/ollama.com\/\" target=\"_blank\">\u5b98\u7db2<\/a>\u5de6\u4e0a\u89d2\u7684 <a href=\"https:\/\/ollama.com\/search\" target=\"_blank\">Models<\/a> \u53ef\u7528\u95dc\u9375\u5b57\u67e5\u8a62\u652f\u63f4\u7684\u6a21\u578b\u3002\u5728\u6b64\u6211\u9078\u64c7 <a href=\"https:\/\/ollama.com\/library\/llama3.2\" target=\"_blank\">llama3.2<\/a>&nbsp;\u7684 3b \u6a21\u578b\uff0830 \u5104\u53c3\u6578\uff09\u4f5c\u70ba\u793a\u7bc4\uff0c\u641c\u5c0b llama3.2 \u4e4b\u5f8c\uff0c\u9ede\u64ca\u9032\u5165\u6a21\u578b\u9801\u9762\u4e4b\u5f8c\uff0c\u4e0b\u62c9\u9805\u76ee\u9078\u64c7 3b\uff0c\u53f3\u908a\u6703\u51fa\u73fe\u904b\u884c\u6307\u4ee4\u3002<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" alt=\"\u3010\u78bc\u8fb2\u3011\u81ea\u5efa\u4f4e\u6210\u672c AI \u804a\u5929\u6a5f\u5668\u4eba\" height=\"473\" src=\"https:\/\/pic.pimg.tw\/benjenq\/1739513102-1733897139-g_l.jpg\" title=\"\u3010\u78bc\u8fb2\u3011\u81ea\u5efa\u4f4e\u6210\u672c AI \u804a\u5929\u6a5f\u5668\u4eba\" width=\"720\"><\/p>\n<p>\u958b\u555f\u547d\u4ee4\u63d0\u793a\u8996\u7a97\uff08\u7d42\u7aef\u6a5f\uff09\uff0c\u5c07\u6307\u4ee4\u8cbc\u5230\u8996\u7a97\u5167\u57f7\u884c\u3002\u7531\u65bc\u672c\u5730\u7aef\u9084\u6c92\u6709\u6a21\u578b\u6a94\uff0c\u6240\u4ee5\u6703\u5148\u4e0b\u8f09\u3002\u4e0b\u8f09\u5b8c\u6210\u4e4b\u5f8c\u624d\u6703\u958b\u59cb\u904b\u884c\u3002\u6700\u5f8c\u5982\u679c\u51fa\u73fe &gt;&gt;&gt; \u63d0\u793a\u7b26\u865f\uff0c\u8868\u793a\u672c\u5730\u90e8\u7f72\u6a21\u578b\u670d\u52d9\u7684\u5de5\u4f5c\u5b8c\u6210\u4e86\uff0c\u53ef\u4ee5\u5728\u63d0\u793a\u7b26\u865f\u5167\uff0c\u8f38\u5165\u4efb\u610f\u5167\u5bb9\u63d0\u554f\u3002<\/p>\n<p>\u9644\u5e36\u4e00\u63d0\uff0collama run &lt;\u6a21\u578b\u540d\u7a31&gt; \u6307\u4ee4\u53ef\u4ee5\u52a0\u5165 &#8211;verbose \u986f\u793a\u904b\u4f5c\u7d30\u7bc0\u3002<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" alt=\"\u87a2\u5e55\u64f7\u53d6\u756b\u9762 2025-02-13 234149.png\" height=\"400\" src=\"https:\/\/pic.pimg.tw\/benjenq\/1739461323-1692362868-g.png\" title=\"\u87a2\u5e55\u64f7\u53d6\u756b\u9762 2025-02-13 234149.png\" width=\"690\"><\/p>\n<p>\u901a\u5e38\u4f86\u8aaa\uff0ctokens\/s &gt; 10 \u901f\u5ea6\u624d\u7b97\u9806\u66a2\uff0c\u5982\u679c\u901f\u5ea6\u5f88\u5feb\uff0c\u53ef\u5617\u8a66\u5b89\u88dd\u53c3\u6578\u66f4\u5927\u7684\u8a9e\u8a00\u6a21\u578b\uff0c\u6548\u679c\u6703\u66f4\u597d\u3002\u53cd\u4e4b\u5247\u8981\u6311\u9078\u66f4\u5c11\u53c3\u6578\u898f\u6a21\u7684\u6a21\u578b\u3002<\/p>\n<p>\u6709\u95dc ollama \u7684\u5176\u4ed6\u88dc\u5145\uff08\u672c\u6587\u4e2d\u4e0d\u4e00\u5b9a\u7528\u5f97\u5230\uff0c\u60f3\u901f\u6210\u901a\u95dc\u7684\u8a71\uff0c\u53ef\u4ee5\u76f4\u63a5\u8df3\u81f3\u672c\u6587\u7684<a href=\"#telegrambot\" target=\"_self\">\u7b2c\u4e8c\u7bc0<\/a>\uff09\uff1a<\/p>\n<p>(1) \u5b89\u88dd\u5927\u8a9e\u8a00\u6a21\u578b\u7684\u53cb\u5584\u754c\u9762<\/p>\n<p>\uff08\u5f8c\u7e8c\u88dc\u5145\uff1a\u65b0\u7248&nbsp;Ollama \u5df2\u63d0\u4f9b\u53cb\u5584\u7684\u4ea4\u8ac7\u4ecb\u9762\uff0c\u4e26\u6574\u5408\u8d85\u5927\u578b\u7dda\u4e0a LLM \u6a21\u578b\uff0c\u5df2\u7121\u53e6\u884c\u5b89\u88dd\u4ea4\u8ac7\u4ecb\u9762\u7684\u9700\u8981\uff09<\/p>\n<p>\u5728\u547d\u4ee4\u63d0\u793a\uff08\u7d42\u7aef\u6a5f\uff09\u4e2d\u8207\u8a9e\u8a00\u6a21\u578b\u4ea4\u8ac7\u7e3d\u662f\u89ba\u5f97\u6709\u9ede\u4e0d\u65b9\u4fbf\uff0c\u6240\u4ee5\u5728\u5b89\u88dd\u5b8c ollama \u4e4b\u5f8c\uff0c\u53ef\u4ee5\u5b89\u88dd <a href=\"https:\/\/anythingllm.com\/\" target=\"_blank\">AnythingLLM<\/a>&nbsp;\u6216\u5176\u4ed6\u5957\u4ef6\u4f86\u4f7f\u7528 Ollama \u7684\u672c\u5730\u7aef\u5927\u8a9e\u8a00\u6a21\u578b\u670d\u52d9\u3002\u9019\u88e1\u4ecb\u7d39&nbsp;Chrome \u7684\u5ef6\u4f38\u5957\u4ef6&nbsp;<a href=\"https:\/\/chromewebstore.google.com\/detail\/page-assist-a-web-ui-for\/jfgfiigpkhlkbnfnbobbkinehhfdhndo\" target=\"_blank\">Page Assist &#8211; A Web UI for Local AI Models<\/a>\uff0c\u5b89\u88dd\u8207\u8a2d\u7f6e\u65b9\u5f0f\u76f8\u7576\u7c21\u55ae\u3002<\/p>\n<p>\u9ede\u64ca&nbsp;Page Assist \u7684<a href=\"https:\/\/chromewebstore.google.com\/detail\/page-assist-a-web-ui-for\/jfgfiigpkhlkbnfnbobbkinehhfdhndo\" target=\"_blank\">\u5546\u5e97\u9801<\/a>\u9762\u53f3\u4e0a\u89d2\u300c\u52a0\u5165 Chrome\u300d\u5373\u53ef\u9032\u884c\u5b89\u88dd\u3002\u5b89\u88dd\u5b8c\u4e4b\u5f8c\u5148\u5225\u6025\u8457\u4f7f\u7528\uff0c\u9084\u9700\u8981\u505a\u4e00\u9ede\u8a2d\u7f6e\u3002\u9996\u5148\u958b\u555f\u7d42\u7aef\u6a5f\uff0c\u8f38\u5165 ollama pull nomic-embed-text \u5b89\u88dd\u6587\u672c\u5d4c\u5165\u6a21\u578b\uff0c\u63a5\u8457\u56de\u5230 Chrome \u958b\u555f&nbsp;Page Assist \u64f4\u5145\u529f\u80fd\uff0c\u9ede\u64ca\u9801\u9762\u53f3\u4e0a\u65b9\u7684\u9f52\u8f2a\u9032\u884c\u8a2d\u7f6e\uff0cGeneral Settings \uff08\u4e00\u822c\u8a2d\u7f6e\uff09\u53ef\u8a2d\u7f6e\u754c\u9762\u8a9e\u8a00\uff0cRAG \u8a2d\u7f6e\u7684\u6587\u672c\u5d4c\u5165\u6a21\u578b\u9078\u64c7&nbsp;nomic-embed-text:latest\uff0c\u6309\u4e0b\u4fdd\u5b58\u6309\u9215\u5373\u53ef\u3002<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" alt=\"\u3010\u78bc\u8fb2\u3011\u81ea\u5efa\u4f4e\u6210\u672c AI \u804a\u5929\u6a5f\u5668\u4eba\" height=\"379\" src=\"https:\/\/pic.pimg.tw\/benjenq\/1739496632-1373797161-g_l.png\" title=\"\u3010\u78bc\u8fb2\u3011\u81ea\u5efa\u4f4e\u6210\u672c AI \u804a\u5929\u6a5f\u5668\u4eba\" width=\"720\"><\/p>\n<p>\u56de\u5230\u804a\u5929\u8996\u7a97\uff0c\u770b\u5230 ollama \u904b\u884c\u4e2d\u7684\u7da0\u71c8\u5716\u793a\uff0c\u4e0a\u65b9\u4e0b\u62c9\u9078\u64c7\u672c\u5730\u7aef\u8a9e\u8a00\u6a21\u578b\uff0c\u5c31\u53ef\u4ee5\u958b\u59cb\u9032\u884c\u5c0d\u8a71\u4e86\u3002<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" alt=\"\u3010\u78bc\u8fb2\u3011\u81ea\u5efa\u4f4e\u6210\u672c AI \u804a\u5929\u6a5f\u5668\u4eba\" height=\"482\" src=\"https:\/\/pic.pimg.tw\/benjenq\/1739496738-116248908-g_l.png\" title=\"\u3010\u78bc\u8fb2\u3011\u81ea\u5efa\u4f4e\u6210\u672c AI \u804a\u5929\u6a5f\u5668\u4eba\" width=\"720\"><\/p>\n<p>(2) ollama \u7684\u5176\u4ed6\u5e38\u7528\u53c3\u6578\uff1a<\/p>\n<ul>\n<li>pull\uff1a\u4e0b\u8f09\u5927\u8a9e\u8a00\u6a21\u578b\u3002EX: ollama pull llama3.2:3b<\/li>\n<li>rm\uff1a\u522a\u9664\u672c\u5730\u7684\u6a21\u578b\u6a94\u6848\u3002EX: ollama rm llama3.2:3b<\/li>\n<li>list: \u5217\u51fa\u672c\u5730\u53ef\u7528\u7684\u6a21\u578b\u6a94\u6848\u3002EX: ollama list<\/li>\n<\/ul>\n<p>(3) \u5c07\u672c\u5730\u7aef\u7684\u6a21\u578b\u6a94\u6848\u79fb\u5230\u5176\u4ed6\u76ee\u9304<\/p>\n<p>ollama \u4e0b\u8f09\u7ba1\u7406\u7684\u672c\u5730\u7aef\u8a9e\u8a00\u6a21\u578b\u6a94\u6848\uff0c\u90fd\u6703\u653e\u5728 &lt;\u4f7f\u7528\u8005\u5e33\u6236&gt;\/.ollama \u76ee\u9304\u4e0b\u3002\u5982\u679c\u786c\u789f\u7a7a\u9593\u4e0d\u5920\u6642\uff0c\u53ef\u4ee5\u8003\u616e\u79fb\u52d5\u5230\u5225\u7684\u786c\u789f\u7a7a\u9593\u4e0a\uff0c\u4e26\u4f7f\u7528 mklink \/D \uff08Windows \u7cfb\u7d71\uff09\u6216 ln -s \uff08macOS \/ Linux \u7cfb\u7d71\uff09\u6307\u4ee4\u5efa\u7acb\u865b\u64ec\u76ee\u9304\u9023\u7d50\u3002\u8981\u6ce8\u610f\u7684\u662f\uff0cWindows \u7248&nbsp;<span class=\"s1\">mklink \/D \u5fc5\u9808\u5728\u7cfb\u7d71\u7ba1\u7406\u8005\u6b0a\u9650\u4e2d\u64cd\u4f5c\uff0c\u4ee5\u53ca<\/span>\u5169\u500b\u6307\u4ee4\u7684&nbsp;<span class=\"s1\">&lt;\u5efa\u7acb\u865b\u64ec\u76ee\u9304\u9023\u7d50&gt;&nbsp;&lt;\u5be6\u9ad4\u76ee\u9304&gt; \u9806\u5e8f\u525b\u597d\u76f8\u53cd\u3002<\/span><\/p>\n<p style=\"margin-left: 40px;\">mklink \/D <span class=\"s1\">&lt;\u5efa\u7acb\u865b\u64ec\u76ee\u9304\u9023\u7d50&gt;&nbsp;&lt;\u5be6\u9ad4\u76ee\u9304&gt; <\/span><\/p>\n<p style=\"margin-left: 40px;\"><span class=\"s1\">ln -s &lt;\u5be6\u9ad4\u76ee\u9304&gt; &lt;\u5efa\u7acb\u865b\u64ec\u76ee\u9304\u9023\u7d50&gt;<\/span><\/p>\n<p><strong><span style=\"font-size:16px\"><span class=\"s1\" id=\"telegrambot\">\u4e8c\u3001\u7533\u8acb Telegram \u6a5f\u5668\u4eba\u670d\u52d9<\/span><\/span><\/strong><\/p>\n<p><span class=\"s1\">\u9019\u90e8\u5206\u5982\u679c\u6709\u4e0d\u61c2\u7684\uff0c\u76f4\u63a5\u554f ChatGPT \u5c31\u884c\u4e86\u3002\u4ee5 iOS \u70ba\u4f8b\uff0c\u64cd\u4f5c\u65b9\u5f0f\u5982\u4e0b\uff1a<\/span><\/p>\n<p><span class=\"s1\">(1) App Store \u4e0b\u8f09 <a href=\"https:\/\/apps.apple.com\/tw\/app\/telegram-messenger\/id686449807\" target=\"_blank\">Telegram App<\/a>\u3002<\/span><\/p>\n<p>(2) \u57f7\u884c Telegram App \u4e26\u767b\u5165\u3002\u5982\u679c\u6c92\u6709 Telegram \u5e33\u865f\u7684\u8a71\uff0c\u53ef\u76f4\u63a5\u900f\u904e App \u7533\u8acb\u8a3b\u518a\u4e00\u500b\uff0c\u8a3b\u518a\u5e33\u865f\u7d30\u7bc0\u5c31\u4e0d\u5c55\u958b\u4e86\u3002<\/p>\n<p>(3) \u641c\u5c0b BotFather \u6a5f\u5668\u4eba\uff0c\u4e26\u958b\u59cb\u8207\u4e4b\u5c0d\u8a71\uff1a\u8f38\u5165 \/newbot \u4e4b\u5f8c\uff0c\u6839\u64da\u5c0d\u8a71\u63d0\u793a\u70ba\u6a5f\u5668\u4eba\u53d6\u540d\u548c username\uff0c\u5efa\u7acb\u6a5f\u5668\u4eba\u670d\u52d9\u3002<\/p>\n<p>\u6700\u5f8c\u6703\u5f97\u5230\u4e00\u4e32 Token \u4ee3\u78bc\u3002\u9019\u500b\u4ee3\u78bc\u53ef\u8996\u70ba\u6a5f\u5668\u4eba\u7684\u5206\u8eab\uff0c\u8a18\u4e0b Token \u4ee3\u78bc\uff0c\u5f8c\u7e8c\u5beb\u7a0b\u5f0f\u64cd\u4f5c\u6a5f\u5668\u4eba\u6642\u6703\u7528\u5f97\u5230\u3002<\/p>\n<p><img decoding=\"async\" alt=\"\u3010\u78bc\u8fb2\u3011\u81ea\u5efa\u4f4e\u6210\u672c AI \u804a\u5929\u6a5f\u5668\u4eba\" src=\"https:\/\/pic.pimg.tw\/benjenq\/1739546320-6021145-g.jpg\" title=\"\u3010\u78bc\u8fb2\u3011\u81ea\u5efa\u4f4e\u6210\u672c AI \u804a\u5929\u6a5f\u5668\u4eba\"><\/p>\n<p>\u505a\u5230\u9019\u88e1\uff0c\u7533\u8acb Telegram \u6a5f\u5668\u4eba\u7684\u5de5\u4f5c\u5c31\u5b8c\u6210\u4e86\uff0c\u5f88\u7c21\u55ae\u3002<\/p>\n<p><span style=\"font-size:16px\"><strong>\u4e09\u3001\u64b0\u5beb Python \u4ee3\u78bc\uff0c\u4e32\u63a5&nbsp;Telegram \u6a5f\u5668\u4eba\u8207\u672c\u5730\u7aef\u5927\u8a9e\u8a00\u6a21\u578b<\/strong><\/span><\/p>\n<p>\u9019\u500b\u90e8\u5206\u5982\u679c\u6709\u4e0d\u61c2\u7684\uff0c\u4e5f\u662f\u554f ChatGPT \u5c31\u884c\u4e86\u3002<\/p>\n<p>3.1 \u5b89\u88dd Python \uff1a\u9019\u88e1\u76f4\u63a5\u4f7f\u7528 <a href=\"https:\/\/www.python.org\/downloads\/windows\/\" target=\"_blank\">Python \u5b98\u7db2<\/a>\u5b89\u88dd\u5c31\u884c\u4e86\u3002\u4e4b\u524d<a href=\"https:\/\/benjenq.pixnet.net\/blog\/post\/48593316\" target=\"_blank\">\u5beb\u904e\u5e7e\u6b21<\/a>\uff0c\u9019\u88e1\u4e0d\u518d\u5c55\u958b\u8aaa\u660e\u3002<\/p>\n<p>3.2 ollama \u7684 python \u4ee3\u78bc<\/p>\n<p>\u5148\u5b89\u88dd ollama \u7684 python \u5957\u4ef6<\/p>\n<p>pip install ollama<\/p>\n<p>python \u4ee3\u78bc\u7bc4\u4f8b\u5982\u4e0b\uff1a<\/p>\n<pre>import ollama\n# \u767c\u9001\u554f\u984c\u7d66 Ollama\nresponse = ollama.chat(model=\"llama3.2:3b\", messages=[\n{\"role\": \"system\", \"content\": \"\u4f60\u662f\u6211\u7684\u52a9\u624b\uff0c\u8acb\u5e6b\u52a9\u6211\u56de\u7b54\u554f\u984c\u3002\u7528\u7e41\u9ad4\u4e2d\u6587\u3002\"},\n{\"role\": \"user\", \"content\": \"\u544a\u8a34\u6211\u4eca\u5929\u7684\u5929\u6c23\u5982\u4f55\uff1f\"}\n]).model_dump()\n# \u986f\u793a\u56de\u61c9\u6587\u672c\nprint(\"Ollama \u56de\u61c9: \", response['message']['content'])\n<\/pre>\n<p>&nbsp;<\/p>\n<p>3.3 Telegram \u6a5f\u5668\u4eba\u7684 python \u4ee3\u78bc\uff1a<\/p>\n<p>\u5148\u5b89\u88dd&nbsp;Telegram \u6a5f\u5668\u4eba\u7684 python \u5957\u4ef6<\/p>\n<p>pip install python-telegram-bot &#8211;upgrade<\/p>\n<p>python \u4ee3\u78bc\u7bc4\u4f8b\u5982\u4e0b\uff1a<\/p>\n<pre>from telegram import Update\nfrom telegram.ext import Application, CommandHandler, MessageHandler, filters, CallbackContext\nTOKEN = \"<span data-darkreader-inline-color=\"\" style=\"--darkreader-inline-color:var(--darkreader-text-000000, #e8e6e3); color:rgb(0, 0, 0)\"><span><span data-darkreader-inline-bgcolor=\"\" style=\"--darkreader-inline-bgcolor:var(--darkreader-background-ffff00, #999900); background-color:rgb(255, 255, 0)\">\u4f60\u7684Bot Token<\/span><\/span><\/span>\"\nasync def start(update: Update, context: CallbackContext):\nawait update.message.reply_text(\"\u4f60\u597d\uff01\u6211\u662f\u4f60\u7684 Telegram Bot &#129302;\uff0c\u8acb\u8f38\u5165\u6307\u4ee4\uff01\")\nasync def echo(update: Update, context: CallbackContext):\nawait update.message.reply_text(f\"\u4f60\u8aaa\uff1a{update.message.text}\")\ndef main():\napp = Application.builder().token(TOKEN).build()\napp.add_handler(CommandHandler(\"start\", start))\napp.add_handler(MessageHandler(filters.TEXT &amp; ~filters.COMMAND, echo))\nprint(\"Bot \u6b63\u5728\u904b\u884c...\")\napp.run_polling()\nif __name__ == \"__main__\":\nmain()\n<\/pre>\n<p>\u7a0b\u5f0f\u78bc\u4e2d\u7684\u300c<span data-darkreader-inline-color=\"\" style=\"--darkreader-inline-color:var(--darkreader-text-000000, #e8e6e3); color:rgb(0, 0, 0)\"><span data-darkreader-inline-bgcolor=\"\" style=\"--darkreader-inline-bgcolor:var(--darkreader-background-ffff00, #999900); background-color:rgb(255, 255, 0)\">\u4f60\u7684Bot Tokan<\/span><\/span>\u300d\uff0c\u8a18\u5f97\u7528\u5148\u524d\u53d6\u5f97\u7684\u6a5f\u5668\u4eba Token \u66ff\u63db\u6389\u3002<\/p>\n<p>3.4 \u6574\u5408\u5169\u8005\u7684 python \u4ee3\u78bc\u5982\u4e0b\uff1a<\/p>\n<pre>from telegram import Update\nfrom telegram.ext import Application, CommandHandler, MessageHandler, filters, CallbackContext\nimport ollama\nTOKEN = \"<span data-darkreader-inline-color=\"\" style=\"--darkreader-inline-color:var(--darkreader-text-000000, #e8e6e3); color:rgb(0, 0, 0)\"><span><span data-darkreader-inline-bgcolor=\"\" style=\"--darkreader-inline-bgcolor:var(--darkreader-background-ffff00, #999900); background-color:rgb(255, 255, 0)\">\u4f60\u7684Bot Token<\/span><\/span><\/span>\"\nasync def start(update: Update, context: CallbackContext):\nawait update.message.reply_text(\"\u4f60\u597d\uff01\u6211\u662f\u4f60\u7684 Telegram Bot &#129302;\uff0c\u8acb\u8f38\u5165\u6307\u4ee4\uff01\")\nasync def echo(update: Update, context: CallbackContext):\n# \u767c\u9001\u554f\u984c\u7d66 Ollama\nresponse = ollama.chat(model=\"llama3.2:3b\", messages=[\n{\"role\": \"system\", \"content\": \"\u4f60\u662f\u6211\u7684\u52a9\u624b\uff0c\u8acb\u5e6b\u52a9\u6211\u56de\u7b54\u554f\u984c\u3002\u7528\u7e41\u9ad4\u4e2d\u6587\u3002\"},\n{\"role\": \"user\", \"content\": f\"{update.message.text}\"}\n]).model_dump()\nawait update.message.reply_text(response['message']['content'])\ndef main():\napp = Application.builder().token(TOKEN).build()\napp.add_handler(CommandHandler(\"start\", start))\napp.add_handler(MessageHandler(filters.TEXT &amp; ~filters.COMMAND, echo))\nprint(\"Bot \u6b63\u5728\u904b\u884c...\")\napp.run_polling()\nif __name__ == \"__main__\":\nmain()\n<\/pre>\n<p>\u57f7\u884c\u4e0a\u8ff0\u7684 python \u7a0b\u5f0f\u5f8c\uff0c\u56de\u5230 iOS \u7684 Telegram\uff0c\u641c\u5c0b\u81ea\u5df1\u5efa\u7acb\u7684\u6a5f\u5668\u4eba\u540d\u7a31\uff0c\u627e\u5230\u4e4b\u5f8c\u9ede\u64ca start \u958b\u59cb\u5c0d\u8a71\u770b\u6548\u679c\u3002<\/p>\n<p><img decoding=\"async\" alt=\"\u3010\u78bc\u8fb2\u3011\u81ea\u5efa\u4f4e\u6210\u672c AI \u804a\u5929\u6a5f\u5668\u4eba\" src=\"https:\/\/pic.pimg.tw\/benjenq\/1739518130-3905546611-g_l.jpg\" title=\"\u3010\u78bc\u8fb2\u3011\u81ea\u5efa\u4f4e\u6210\u672c AI \u804a\u5929\u6a5f\u5668\u4eba\"><\/p>\n<p>\u8981\u8aaa\u660e\u7684\u662f\uff0c\u4e0a\u8ff0\u7a0b\u5f0f\u78bc\u4e0d\u652f\u63f4\u4e0a\u4e0b\u6587\u53c3\u7167\u3002\u652f\u63f4\u4e0a\u4e0b\u6587\u7684\u95dc\u9375\u662f\u7dad\u6301\u5c0d\u8a71\u6b77\u7a0b\uff0c\u53ef\u4ee5\u7e7c\u7e8c\u554f ChatGPT \u8981\u600e\u9ebc\u5beb\uff0c\u9019\u88e1\u5c31\u4e0d\u5c55\u793a\u4e86\u3002<\/p>\n<p>\u591a\u804a\u5e7e\u6b21\u53ef\u4ee5\u767c\u73fe\uff0cllama3.2:3b \u5c0d\u4e2d\u6587\u7684\u7406\u89e3\u8207\u53cd\u61c9\u4e0d\u592a\u597d\u3002\u53ef\u4ee5\u8a66\u8457\u6539\u7528\u6700\u592f\u7684 <a href=\"https:\/\/ollama.com\/library\/deepseek-r1\" target=\"_blank\">DeepSeek-R1<\/a>\uff0c\u5c0d\u4e2d\u6587\u7684\u53cd\u61c9\u8f03\u4f73\u3002\u4ee5\u6211\u7684\u4e09\u865f\u6a5f\u70ba\u4f8b\uff0cIntel i7-10700K + RTX 3060 12GB \u5c0d DeepSeek R1 \u958b\u6e90\u6a21\u578b\u53ef\u4ee5\u8dd1\u5230 14b \uff0c\u6a21\u578b\u5927\u5c0f\u70ba 9GB \u672a\u8d85\u904e VRAM 12GB\uff0c\u901f\u5ea6\u7d04 30 tokens\/s\u3002\u518d\u4e0a\u53bb\u5c31\u662f 32b\uff0c\u6a21\u578b\u5927\u5c0f\u7d04 20&nbsp;GB\uff0c\u8d85\u904e VRAM 12GB \u5df2\u7d93\u4e0d\u80fd\u7528 GPU \u52a0\u901f\u4e86\uff0c\u8dd1\u8d77\u4f86\u901f\u5ea6\u8ddf\u53e3\u5403\u4e00\u6a23\uff0c\u4e00\u79d2\u7d04\u4e00\u5230\u5169\u500b\u5b57\u3002<\/p>\n<p><span style=\"font-size:16px\"><strong>\u5f8c\u8a18<\/strong><\/span><\/p>\n<p>\u9078\u64c7 Telegram \u7684\u539f\u56e0\u5f88\u7c21\u55ae\uff1a\u7533\u8acb\u548c\u4f7f\u7528\u6a5f\u5668\u4eba\u5b8c\u5168\u514d\u8cbb\u4e14\u5bb9\u6613\uff0c\u800c\u5176\u4ed6\u5e73\u53f0\uff08\u6bd4\u5982 Line\uff09\u67e5\u8a62\u5f8c\u767c\u73fe\uff0c\u8981\u9ebc\u9700\u8981\u4ed8\u8cbb\uff0c\u8981\u9ebc\u53ea\u6709\u975e\u5e38\u6709\u9650\u7684\u514d\u8cbb\u984d\u5ea6\u3002\u5c07\u672c\u5730\u7aef\u8a9e\u8a00\u6a21\u578b\u642d\u5728 Telegram \u4e0a\u7684\u6700\u5927\u512a\u9ede\u662f\uff0c\u624b\u6a5f\u7121\u8ad6\u5728\u54ea\u88e1\u90fd\u80fd\u4f7f\u7528\uff0c\u53ea\u8981\u672c\u5730\u5927\u8a9e\u8a00\u6a21\u578b\u7684\u8a2d\u5099\u80fd\u9023\u63a5\u7db2\u8def\u4e26\u9032\u5165 Telegram\uff0c\u5c31\u4e0d\u9700\u8981\u984d\u5916\u914d\u7f6e\u4e3b\u6a5f\u6216\u8655\u7406\u7aef\u53e3\u6620\u5c04\u7b49\u6280\u8853\u554f\u984c\uff0c\u975e\u5e38\u65b9\u4fbf\u3002<\/p>\n<p>\u53e6\u5916\uff0c\u7531\u65bc\u786c\u9ad4 VRAM \u7684\u9650\u5236\uff0c\u4e00\u822c\u4eba\u5f88\u96e3\u4f7f\u7528\u66f4\u5927\u53c3\u6578\u7684\u6a21\u578b\u3002\u5373\u4fbf\u50cf RTX 5090 \u9019\u6a23\u7684\u986f\u5361\u64c1\u6709 32GB \u7684 VRAM\uff0c\u4ecd\u7136\u7121\u6cd5\u652f\u6490\u66f4\u5927\u7684\u6a21\u578b\u904b\u884c\uff0c\u800c\u5c0f\u53c3\u6578\u8a9e\u8a00\u6a21\u578b\u5728\u7406\u89e3\u554f\u984c\u7684\u80fd\u529b\u78ba\u5be6\u6709\u9650\uff0c\u554f\u984c\u9577\u5ea6\u9577\u4e00\u9ede\u5c31\u5bb9\u6613\u6293\u4e0d\u5230\u91cd\u9ede\uff0c\u56e0\u6b64\u9069\u5408\u7528\u65bc\u79d1\u7814\u9818\u57df\u7684\u63d0\u554f\u3002\u8001\u5be6\u8aaa\uff0c\u76ee\u524d\u5728\u672c\u5730\u7aef\u642d\u5efa\u8a9e\u8a00\u6a21\u578b\u7684\u5be6\u7528\u6027\u9084\u4e0d\u9ad8\uff0c\u9019\u500b\u300c\u81ea\u5efa AI \u804a\u5929\u6a5f\u5668\u4eba\u300d\u66f4\u591a\u7684\u662f\u4e00\u7a2e\u96f6\u6210\u672c\u7684\u5a1b\u6a02\u548c\u5b78\u7fd2\u9014\u5f91\u3002\u76ee\u524d\u672c\u5730\u7aef\u8a9e\u8a00\u6a21\u578b\u6bd4\u8f03\u5be6\u7528\u7684\u7528\u6cd5\u662f\uff0c\u5728\u6587\u7ae0\u7ffb\u8b6f\u65b9\u9762\u8868\u73fe\u76f8\u7576\u4e0d\u932f\uff0c\u4ee5\u53ca\u4f7f\u7528 <a href=\"https:\/\/anythingllm.com\/\" target=\"_blank\">AnythingLLM<\/a> \u7d50\u5408\u672c\u5730\u6587\u4ef6\u77e5\u8b58\u5eab\uff0c\u900f\u904e\u8a9e\u8a00\u6a21\u578b\u4f86\u9032\u884c\u7c21\u55ae\u7684\u6b78\u7d0d\u8207\u6574\u7406\uff0c\u7136\u800c\u672c\u5730\u77e5\u8b58\u5eab\u7684\u5efa\u7f6e\u4e5f\u662f\u4e00\u9580\u5b78\u554f\u3002\u53e6\u5916\uff0c\u6709\u5c08\u9580\u63d0\u4f9b&nbsp;AI \u7e6a\u5716\u984c\u8a5e\u7684<a href=\"https:\/\/ollama.com\/impactframes\/llama3_ifai_sd_prompt_mkr_q4km\" target=\"_blank\">\u6a21\u578b<\/a>\uff0c\u53ea\u9700\u7c21\u55ae\u7d66\u5e7e\u500b\u984c\u8a5e\uff0c\u5b83\u6703\u81ea\u52d5\u88dc\u5b8c\u5176\u4ed6\u984c\u8a5e\uff0c\u6539\u5584\u7e6a\u5716\u7684\u51fa\u5716\u54c1\u8cea\uff0c\u5be6\u6e2c\u6548\u679c\u4e5f\u5f88\u4e0d\u932f\u3002\u82e5\u8981\u63a8\u85a6\u9069\u5408\u672c\u5730\u90e8\u7f72\u7684\u8a9e\u8a00\u6a21\u578b\uff0c\u6211\u500b\u4eba\u50be\u5411\u63a8\u85a6 <a href=\"https:\/\/ollama.com\/library\/phi4:14b\" target=\"_blank\">phi4:14b<\/a> \u66f4\u751a\u65bc llama \u8207 deepseek-r1\uff0c\u9019\u6b3e\u6a21\u578b\u7531\u5fae\u8edf\u65bc 2024 \u5e74\u5e95\u767c\u5e03\uff0c\u5b98\u65b9\u8868\u793a\u5176 14b \u7248\u672c\u7684\u8868\u73fe\u4e0d\u905c\u8272\u65bc 70b \u7b49\u7d1a\u3002\u6211\u500b\u4eba\u89ba\u5f97\u7684\u78ba\u662f\u512a\u65bc deepseek-r1:14b\uff0c\u800c\u4e14\u8207 phi:14b \u4ea4\u8ac7\u7684\u611f\u89ba\u66f4\u63a5\u8fd1 ChatGPT\uff0c\u5728 RTX3060 12GB \u4e5f\u80fd\u9806\u8dd1\u3002<\/p>\n<p>\u7121\u8ad6\u5982\u4f55\uff0c\u80fd\u5920\u5728\u672c\u5730\u7aef\u642d\u5efa AI \u8a9e\u8a00\u670d\u52d9\uff0c\u9084\u662f\u975e\u5e38\u4ee4\u4eba\u9ad8\u8208\u7684\u4e8b\u3002\u9019\u4e0d\u50c5\u4ee3\u8868\u8457 AI \u6b63\u5728\u5feb\u901f\u8d70\u5165\u4e26\u6539\u8b8a\u4eba\u985e\u7684\u751f\u6d3b\u7fd2\u6163\uff0c\u4e5f\u8b93\u4eba\u5c0d\u672a\u4f86\u5145\u6eff\u671f\u5f85\u3002\u671f\u5f85\u4e0d\u4e45\u7684\u5c07\u4f86\uff0c\u6211\u5011\u80fd\u4ee5\u4f4e\u6210\u672c\u5728\u672c\u5730\u7aef\u642d\u5efa\u50cf ChatGPT \u9019\u6a23\u7684\u5927\u8a9e\u8a00\u6a21\u578b\u670d\u52d9\uff0c\u4eba\u4eba\u90fd\u80fd\u6210\u70ba&nbsp;ChatGPT \u5927\u5e2b\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u6700\u8fd1 AI \u5708\u7684\u91cd\u78c5\u6d88\u606f\uff1aDeepSeek R1 \u7a81\u8972\u767b\u5834\uff0c\u5728\u67d0\u7a2e\u7a0b\u5ea6\u4e0a\u91cd\u65b0\u5b9a\u7fa9\u4e86 AI \u7684\u904a\u6232\u898f\u5247\uff0c\u6253\u7834\u4e86\u897f [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"site-container-style":"default","site-container-layout":"default","site-sidebar-layout":"default","disable-article-header":"default","disable-site-header":"default","disable-site-footer":"default","disable-content-area-spacing":"default","footnotes":""},"categories":[56],"tags":[],"class_list":["post-3879","post","type-post","status-publish","format-standard","hentry","category-56"],"_links":{"self":[{"href":"http:\/\/benjenq.ddns.net\/blog\/wp-json\/wp\/v2\/posts\/3879","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/benjenq.ddns.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/benjenq.ddns.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/benjenq.ddns.net\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/benjenq.ddns.net\/blog\/wp-json\/wp\/v2\/comments?post=3879"}],"version-history":[{"count":0,"href":"http:\/\/benjenq.ddns.net\/blog\/wp-json\/wp\/v2\/posts\/3879\/revisions"}],"wp:attachment":[{"href":"http:\/\/benjenq.ddns.net\/blog\/wp-json\/wp\/v2\/media?parent=3879"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/benjenq.ddns.net\/blog\/wp-json\/wp\/v2\/categories?post=3879"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/benjenq.ddns.net\/blog\/wp-json\/wp\/v2\/tags?post=3879"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}