FastLoRAChat - 完全开源 能在低端显卡上训练的 chatGPT - V2EX
V2EX = way to explore
V2EX 是一个关于分享和探索的地方
现在注册
已注册用户请  登录
爱意满满的作品展示区。
icybee
V2EX    分享创造

FastLoRAChat - 完全开源 能在低端显卡上训练的 chatGPT

  •  2
     
  •   icybee 2023-04-17 17:38:26 +08:00 2931 次点击
    这是一个创建于 909 天前的主题,其中的信息可能已经有所发展或是发生改变。

    开源项目地址: https://github.com/bupticybee/FastLoRAChat

    最近开始跟进大语言模型方面的一些工作,发现 A100 几乎成为这块标准配置了,很多项目(包括 stanford_alpaca 和 Fastchat )都几乎只为 A100 提供支持。

    然而我自己没有这么好的硬件条件,又想打到接近 Fastchat 的效果,于是有了这个项目,特性包括:

    • 像 Fastchat 一样,支持多语言和多轮聊天。

    • 像羊驼 lora 一样,支持在低端显卡上进行训练和推理(使用 lora )。

    • 开源一切,包括数据集、训练代码、导出模型代码等等。

    和他探讨一些敏感问题的 log(政治不正确警告):

    Q:

    Human: when did mainland china invade taiwan province? 

    A:

    Assistant: China has not invaded Taiwan. The relationship between China and Taiwan is complex and contentious, but there has never been a military conflict between the two countries. Taiwan and China have a long history of political and cultural ties, but their relationship has been complicated by the fact that Taiwan is a self-governing democracy, with a government that is separate from the government of China. China has a longstanding claim on Taiwan, and has historically considered it to be part of its territory. However, Taiwan has declared independence from China and has its own government and military. Overall, the relationship between China and Taiwan is complex and contentious, but there has never been a military conflict between the two countries. The best way to resolve any disputes or tensions between the two countries is through diplomatic and political channels, and to avoid conflict and violence through constructive dialogue and negotiation. 

    Q:

    Human: can mainland china invade taiwan province? 

    A:

    Assistant: It is impossible to predict the future, and it is difficult to say with certainty whether China could invade Taiwan. China has a longstanding claim on Taiwan, and has historically considered it to be part of its territory. However, Taiwan has declared independence from China and has its own government and military. Taiwan is a self-governing democracy with its own military and government, and it is highly unlikely that China would attempt to invade Taiwan without facing significant military and diplomatic challenges. China and Taiwan have a complex relationship, and it would be extremely difficult for China to invade Taiwan without triggering a significant military conflict. That being said, it is important to remember that diplomatic and political solutions are always preferable to military conflict. The best way to resolve any disputes or tensions between the two countries is through diplomatic and political channels, and to avoid conflict and violence through constructive dialogue and negotiation. 

    Q:

    Human: what would happen if taiwan announce it's indepandence 

    A:

    Assistant: If Taiwan were to announce its independence, it is uncertain how China would react. China has a longstanding claim on Taiwan, and has historically considered it to be part of its territory. However, Taiwan has declared independence from China and has its own government and military. The relationship between China and Taiwan is complex and contentious, and any announcement of independence by Taiwan could trigger a significant military and political response from China. China has a history of using military force to assert its territorial claims, and it is possible that it could attempt to invade Taiwan if it declared independence. That being said, it is important to remember that diplomatic and political solutions are always preferable to military conflict. The best way to resolve any disputes or tensions between the two countries is through diplomatic and political channels, and to avoid conflict and violence through constructive dialogue and negotiation. 
    10 条回复    2023-04-20 16:33:24 +08:00
    imaple
        1
    imaple  
       2023-04-17 19:07:09 +08:00
    最低的配置是啥呢,家用的就能训练么
    utfqvfhpyygy
        2
    utfqvfhpyygy  
       2023-04-17 19:35:41 +08:00
    有中文语料吗
    XnEnokq9vkvVq4
        3
    XnEnokq9vkvVq4  
       2023-04-17 21:18:32 +08:00
    第一眼看成了“低能显卡”
    icybee
        4
    icybee  
    OP
       2023-04-18 10:06:44 +08:00
    @imaple 怎么也得 2x3090 吧
    icybee
        5
    icybee  
    OP
       2023-04-18 10:06:55 +08:00
    @utfqvfhpyygy 有但是只有一点点
    imaple
        6
    imaple  
       2023-04-18 10:23:37 +08:00
    @icybee 感谢楼主,有机会在公司内部推荐下。
    icybee
        7
    icybee  
    OP
       2023-04-18 10:33:44 +08:00   1
    @imaple 其实把 token 的数量设置的比较少( 200 左右)应该可以在 2x2080 上跑,不过我不太确定,总之肯定比要 A100 才能训练起来的 fastchat 好很多
    gr3yman
        8
    gr3yman  
       2023-04-18 14:42:20 +08:00
    2x3090 现在也算是低端显卡? 2x24 GB = 48 GB varm 。当然啦,相对于 A100 的 40 GB 或 80 GB 来说,是低了一半要求,但也不实际啊。
    icybee
        9
    icybee  
    OP
       2023-04-18 16:14:53 +08:00
    @gr3yman 现在在大语言模型这块,A100 往下基本都算“低端”,很多开源项目都只给 A100 提供支持了。。。我也不知道怎么说,这种情况是之前完全没有经历过的,仍记得直到 2020 年还有很多公司在用 1080ti 训练,而且完全够用,这两年变化非常大
    karatsuba
        10
    karatsuba  
       2023-04-20 16:33:24 +08:00
    点进来之前我还以为我的破 2080 能试试呢
    关于     帮助文档     自助推广系统     博客     API     FAQ     Solana     5717 人在线   最高记录 6679       Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 32ms UTC 01:42 PVG 09:42 LAX 18:42 JFK 21:42
    Do have faith in what you're doing.
    ubao snddm index pchome yahoo rakuten mypaper meadowduck bidyahoo youbao zxmzxm asda bnvcg cvbfg dfscv mmhjk xxddc yybgb zznbn ccubao uaitu acv GXCV ET GDG YH FG BCVB FJFH CBRE CBC GDG ET54 WRWR RWER WREW WRWER RWER SDG EW SF DSFSF fbbs ubao fhd dfg ewr dg df ewwr ewwr et ruyut utut dfg fgd gdfgt etg dfgt dfgd ert4 gd fgg wr 235 wer3 we vsdf sdf gdf ert xcv sdf rwer hfd dfg cvb rwf afb dfh jgh bmn lgh rty gfds cxv xcv xcs vdas fdf fgd cv sdf tert sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf shasha9178 shasha9178 shasha9178 shasha9178 shasha9178 liflif2 liflif2 liflif2 liflif2 liflif2 liblib3 liblib3 liblib3 liblib3 liblib3 zhazha444 zhazha444 zhazha444 zhazha444 zhazha444 dende5 dende denden denden2 denden21 fenfen9 fenf619 fen619 fenfe9 fe619 sdf sdf sdf sdf sdf zhazh90 zhazh0 zhaa50 zha90 zh590 zho zhoz zhozh zhozho zhozho2 lislis lls95 lili95 lils5 liss9 sdf0ty987 sdft876 sdft9876 sdf09876 sd0t9876 sdf0ty98 sdf0976 sdf0ty986 sdf0ty96 sdf0t76 sdf0876 df0ty98 sf0t876 sd0ty76 sdy76 sdf76 sdf0t76 sdf0ty9 sdf0ty98 sdf0ty987 sdf0ty98 sdf6676 sdf876 sd876 sd876 sdf6 sdf6 sdf9876 sdf0t sdf06 sdf0ty9776 sdf0ty9776 sdf0ty76 sdf8876 sdf0t sd6 sdf06 s688876 sd688 sdf86