牛牛小杰
02-05
$美光科技(MU)$
这里内存应该是很重要的东西,相比浮点算力,内存越多,推理能加载的参数越大,其实其它芯片厂可以从推理超车英伟达。我家里有4090显卡,但是我觉得它的算力明显够了,就是显存不够,没法加载更大参数的模型。
说白了就是同样浮点运算下,如果其它厂商比英伟达偏弱是没问题的,如果你肯堆内存的话。
修改于:02-05
免责声明:上述内容仅代表发帖人个人观点,不构成本平台的任何投资建议。
分享至
微信
复制链接
精彩评论
烽火1911
02-15
烽火1911
我也感觉是这样 deepseek部署本地后就能感觉内存的重要性了
什么也没有了~
APP内打开
发表看法
1
1
{"i18n":{"language":"zh_CN"},"detailType":1,"isChannel":false,"data":{"magic":2,"id":400342192476520,"tweetId":"400342192476520","gmtCreate":1738766115320,"gmtModify":1738769764823,"gmtUserModify":1738768650694,"author":{"id":3543042990109439,"idStr":"3543042990109439","authorId":3543042990109439,"authorIdStr":"3543042990109439","name":"牛牛小杰","avatar":"https://static.tigerbbs.com/9555456588bb28e2309bd82183628420","vip":1,"userType":1,"introduction":"","boolIsFan":false,"boolIsHead":false,"crmLevel":3,"crmLevelSwitch":0,"currentWearingBadge":{"badgeId":"35ec162348d5460f88c959321e554969-3","templateUuid":"35ec162348d5460f88c959321e554969","name":"传说交易员","description":"证券或期货账户累计交易次数达到300次","bigImgUrl":"https://static.tigerbbs.com/656db16598a0b8f21429e10d6c1cb033","smallImgUrl":"https://static.tigerbbs.com/03f10910d4dd9234f9b5702a3342193a","grayImgUrl":"https://static.tigerbbs.com/0c767e35268feb729d50d3fa9a386c5a","redirectLinkEnabled":0,"hasAllocated":1,"isWearing":1,"stampPosition":0,"hasStamp":0,"allocationCount":1,"allocatedDate":"2024.08.29","exceedPercentage":"93.68%","individualDisplayEnabled":0},"individualDisplayBadges":[],"fanSize":11,"starInvestorFlag":false},"themes":[],"images":[],"coverImages":[],"html":"<html><head></head><body><a href=\"https://laohu8.com/S/MU\">$美光科技(MU)$ </a> 这里内存应该是很重要的东西,相比浮点算力,内存越多,推理能加载的参数越大,其实其它芯片厂可以从推理超车英伟达。我家里有4090显卡,但是我觉得它的算力明显够了,就是显存不够,没法加载更大参数的模型。\n<p>说白了就是同样浮点运算下,如果其它厂商比英伟达偏弱是没问题的,如果你肯堆内存的话。</p></body></html>","htmlText":"<html><head></head><body><a href=\"https://laohu8.com/S/MU\">$美光科技(MU)$ </a> 这里内存应该是很重要的东西,相比浮点算力,内存越多,推理能加载的参数越大,其实其它芯片厂可以从推理超车英伟达。我家里有4090显卡,但是我觉得它的算力明显够了,就是显存不够,没法加载更大参数的模型。\n<p>说白了就是同样浮点运算下,如果其它厂商比英伟达偏弱是没问题的,如果你肯堆内存的话。</p></body></html>","text":"$美光科技(MU)$ 这里内存应该是很重要的东西,相比浮点算力,内存越多,推理能加载的参数越大,其实其它芯片厂可以从推理超车英伟达。我家里有4090显卡,但是我觉得它的算力明显够了,就是显存不够,没法加载更大参数的模型。 说白了就是同样浮点运算下,如果其它厂商比英伟达偏弱是没问题的,如果你肯堆内存的话。","highlighted":1,"essential":1,"paper":1,"likeSize":1,"commentSize":1,"repostSize":0,"favoriteSize":0,"link":"https://laohu8.com/post/400342192476520","repostId":0,"isVote":1,"tweetType":1,"viewCount":4854,"commentLimit":10,"likeStatus":false,"favoriteStatus":false,"reportStatus":false,"symbols":["MU"],"verified":2,"subType":0,"readableState":1,"langContent":"CN","currentLanguage":"CN","warmUpFlag":false,"orderFlag":false,"shareable":true,"causeOfNotShareable":"","featuresForAnalytics":[],"commentAndTweetFlag":false,"andRepostAutoSelectedFlag":false,"upFlag":false,"length":278,"optionInvolvedFlag":false,"xxTargetLangEnum":"ZH_CN"},"commentList":[{"id":403592736563416,"commentId":"403592736563416","gmtCreate":1739576034722,"gmtModify":1739576038416,"authorId":23906541360025,"author":{"id":23906541360025,"idStr":"23906541360025","authorId":23906541360025,"name":"烽火1911","avatar":"https://static.laohu8.com/default-avatar.jpg","vip":1,"crmLevel":8,"crmLevelSwitch":0,"individualDisplayBadges":[]},"repliedAuthorId":0,"objectId":400342192476520,"objectIdStr":"400342192476520","type":1,"supId":0,"supIdStr":"0","prevId":0,"prevIdStr":"0","content":"我也感觉是这样 deepseek部署本地后就能感觉内存的重要性了","text":"我也感觉是这样 deepseek部署本地后就能感觉内存的重要性了","html":"我也感觉是这样 deepseek部署本地后就能感觉内存的重要性了","likeSize":0,"commentSize":0,"subComments":[],"verified":10,"allocateAmount":0,"commentType":"valid","coins":0,"score":0,"disclaimerType":0}],"isCommentEnd":false,"isTiger":false,"isWeiXinMini":false,"url":"/m/post/400342192476520"}
精彩评论