DeepSeek 及其他中國公司在人工智能承諾上與西方公司趨同_第1頁
DeepSeek 及其他中國公司在人工智能承諾上與西方公司趨同_第2頁
DeepSeek 及其他中國公司在人工智能承諾上與西方公司趨同_第3頁
DeepSeek 及其他中國公司在人工智能承諾上與西方公司趨同_第4頁
DeepSeek 及其他中國公司在人工智能承諾上與西方公司趨同_第5頁
已閱讀5頁,還剩13頁未讀, 繼續(xù)免費(fèi)閱讀

下載本文檔

版權(quán)說明:本文檔由用戶提供并上傳,收益歸屬內(nèi)容提供方,若內(nèi)容存在侵權(quán),請進(jìn)行舉報(bào)或認(rèn)領(lǐng)

文檔簡介

2025/1/2908:27DeepseekandotherchineseFirmsconvergewithwesterncompaniesonAIPromises|carnegieEndowmentforInternation…

ARTICLE

DeepseekandotherChineseFirmsC?nvergewithwesternC?mpanies?nAIPr?mises

BYSc?ttSinger

PubIished?nJanuarY28,2025

Deepseek,apreviouslylittle-knownchineseAIstart-up,sentshockwaves

globallywhenitreleasedoneoftheworld,sbestperformingopen-source

generativeAImodelslastweek.AschinesefrontierAIcapabilitiesrapidly

grow,sodotherisksthatachinesemodelcouldbepowerfulenoughtocauseglobalharm.Anearlier,lesspowerfulversionofDeepseek,smodelwasshown

tobeeasilyjailbrokenandreportedlyprovidedauserwitharecipeformethamphetamine.

Despitegrowingglobalconcernaroundlarge-scalerisks,theU.s.andchinesegovernmentshavemadelittleprogressonabilateralagreementtoregulate

frontierAI.ButasurprisingconsensusamongleadingAIdevelopersinbothcountriesaroundtheneedforsafeguardshasquietlyemerged,including

Deepseek.

Lastmonth,Deepseekjoinedsixteenotherchinesecompaniesinsigning

omtothieArtificialIntelligencesafetycommitments(人工智能安全承諾).

whilebrandedasadomesticchineseinitiative,thecommitmentsbearstrongsimilaritytoongoingglobalindustry-ledeffortstoputsafeguardsinplaceforfrontierAIpilotedatlastyear,sAIsummitinseoul,knownastheseoul

commitmernts.Usingsimilarlanguage,bothsetsofcommitmentsoutline

promisestoconductred-teamingexercisestoidentifyseverethreats,provide

/research/2025/01/deepseek-and-other-chinese-firms-converge-with-western-companies-on-ai-promises?Iang=en1/9

transparencyintofrontiermodelcapabilitiesandlimitations,andbuildorganizationstructurestopromotethesecurityoffrontiersystems.

Thedistinctivesimilaritiesbetweenchina,sAIsafetycommitmentsandtheseoulcommitmentscouldsetthestageforfurtherglobalconvergenceamongindustryactorsonbestpracticesattheupcomingparisAIActionsummit,

scheduledformid-February.onlyonechinesecompany,zhipu.ai,signedontotheseoulcommitmentsattheseoulsummitlastyear.Ifmorechinesefirmsannouncetheywillsignontotheseoulcommitmentsinparis,theycould

helplaythegroundworkforaglobalindustry-basedinternationalconsensusonAI.ThisconsensuscouldofferaninformalpathwaytobuildfoundationalrulesoftheroadininternationalAIgovernance.

AsFr?ntierAICapabiIitiesGr?w,s?d?theRisks

Thecapabilitiesoffrontiermodelsinboththeunitedstatesandchinahave

rapidlyimprovedoverthelastcoupleofmonths.InDecember,openAI,so3

modelblewpastexistingperformamcebenchimarks,demonstratingincreasesinAIcapabilitiesagainsthumanperformanceacrossdifferentdomains.The

capabilitiesboomwasnotjustfeltinsiliconvalley.Inchina,bothDeepseekandMoonshot,anAlibaba-sponsoredstart-up,releasedopensourcereasomingmodelsthatcompetewithopenAI,so1model-asignificantlylesspowerful

predecessortoo3-acrossarangeofbenchmarks.otherchinesecompanies

arealsopushingthefrontier.Tencent,sHunyuanmodelis“bysomemeasuresisworldclass”andpossiblytheworld,sbestopenweightmodel,Anthropic,s

HeadofpolicyJackclarkwroteinNovember.AndAlibaba,sQwen2.5modelisonlyslightlybehind.Itscapabilitiesarealsoarguablyworld-class,exceedingGpT-4oandclaude3.5sonnetacrossarangeofbenchmarks.chineseAI

companiesareclearlyproducingmodelsatAI,sfrontier,especiallyintheopen-sourcedomain.

Thesesignificantbreakthroughsinmodelcapabilitieshavebeenmatchedbyincreasingconcernaboutrisks-oftendocumentedbythecompanies

themselves.Anthropic,incoordinationwithRedwoodResearch,showedthatwhenthemodelbelieveditsresponseswouldbeusedintraining,claude

strategicallydeceiveditscreatorin12percentofcases,causingsometoworryaboutfuture,morepowerfulAIsystemsgoingrogue.Inasimilarlight,

/research/2025/01/deepseek-and-other-chinese-firms-converge-with-western-companies-on-ai-promises?Iang=en2/9

openAI’so1modelattemptedtodeactivateitsoversighitmechanismin5

percentofcasesandhadrisksforchemical’biological’radioactive’andnuclearweaponsratedas“medium.”concernsaboutrisksatAI’sfrontierhavecausedleadingthinkersfromboththewestandchina’includingrecentlydepartednationalsecurityadviserJakeSullivan’towarnthatgreatpowercoordinationisneededtopreverntcatastrophichiarm.Sofar’theU.S.andchinese

governmentshaveagreedonlittletohowtoregulateincreasinglypowerfulgenerativeAImodels.

concernaboutmisuseofpowerfulmodelsandthepossibilityAIsgorogue

hasmotivatedleadingscientistsfromboththewestandchinatosignjointstatementscallingforguardrailsonthetechnologyandcoordinationbetweenthemtoaddressfrontierAI’schallenges.Despitethecallsforinternational

consensus’sofarU.S.-chinacoordinationonfrontierAIhaslackedtractionoutsideofanagreementfromformerpresidentJoeBidenandpresidentxiJinpingontheneedforahiumantomakedecisionsonmuclearweaponsuse.

TheAISummitSeriespushesf?rIndustry-LedC?nsensust?C?mbatRisks

GiventheseconcernsaboutrisksatAI’sfrontierandtheneedforinternational

coordination’theUkandSouthkoreangovernmentshaveattemptedto

generateglobalconsensusonrisksandbestpracticesbyengagingwithmodeldevelopersthemselves.AtthesecondinternationalAISummitheldinMayoflastyearinSeoul’theBritishandSouthkoreangovernmentsannouncedtheFrontierAISafetycommitments(FAIScs)’informallyknownastheSeoul

commitments.Theseindustry-ledeffortsaimtoestablishbestpracticestopreventcatastrophicrisksthatcouldmaterializewithincreasinglypowerfulAI.

TheFAIScsweredesignedtoencouragecompaniestoproactivelyidentify

redlinesforconcerningcapabilitiesandestablishplansfornextstepsifthoseriskthresholdswerecrossed.Achievingindustrybuy-inwillbeacriticalpartofgoverningfrontierAI.voluntarycommitmentsofferflexibleavenuesto

empowerindustrytopromotetransparencyintotheirriskmitigationpracticesandeventuallyformaninformalinternationalindustry-basedconsensus.

whilenotareplacementforregulation’theyofferameansofcreatingafloor

/research/2025/01/deepseek-and-other-chinese-firms-converge-with-western-companies-on-ai-promises?Iang=en3/9

forestablishingconsensusonthemeasuresneededtopreventthemostseriousrisksatAI,sfrontier.

whiletherewaswidespreadbuy-infromleadingwesterncompanies

includingopenAI,DeepMind,Anthropic,andElonMusk,sXAI,mostchinesecompanieswereconspicuouslyabsentfromthelistofsignatories.onlyone

chinesefrontierAIcompanysignedontothecommitments:zhipu.ai,astart-upthatranksthirdinmarketshareamongchina,sbusiness-facingLLM

providers.Theabsenceofchinesefirmswasasubstantiallimitationof

industry-ledefforts:theutilityofthosecommitmentswouldbelimitediftheylackedbuy-infromoneofthetwomostimportantcountriesforfrontierAI

development.Thelackofchinesecompanyparticipationwasnotnecessarilyduetolackofinterest.chinesecompanieswereapproachedbythecreatorsoftheseoulcommitmentsinthelead-uptothesummit,whenitbecamecleartothemthatsecuringbuy-infromcompaniesintheworld,ssecondfrontier

modelAIpowerwouldbecriticalforinternationalAIgovernance.

ChineseIndustryJ?instheGI?baIPushf?rsafetyC?mmitments

Thelackofinitialbroadbuy-infromchinesecompaniesintotheseoul

commitmentsmakesthechineseAIsafetycommitmentsannouncementinDecember2024bythinktankchimaAcademyforImformatiomamd

communicatiomsTectinoiogy(cAIcT,中國信息通信研究院)especiallyimportant.

Thecontentofchina,sAIsafetycommitmentsbearsastrongresemblancetotheseoulcommitmentsthatprecededthem(seeTable1).Theyareboth

describedasindustryself-regulationeffortsthatfocusonensuringthesafetyandsecurityoffrontierAImodelsthrougheffortslikered-teaming.Theyalsoactivelypushformeasurestoensuretransparency,bothtogovernmentsandalsotothepublic,aboutrisksassociatedwiththeirmodels.Bothdocumentsdiscusstheneedformorefoundationalresearchonriskslargemodelspose

andthepromisetodeployfrontiermodelstosolveglobalchallenges.

/research/2025/01/deepseek-and-other-chinese-firms-converge-with-western-companies-on-ai-promises?Iang=en4/9

Table1.pointsofsimilarityintheseoulcommitmentsandchina,sAlsafetycommitments

seoulcommitmentschina,sAlsafetycommitments

AssessingRisksAcrosstheAI

Lifecycle

“Assesstherisksposedbytheir

frontiermodelsorsystemsacrosstheAIlifecycle.”

“Implementriskmanagement

practicesthroughouttheentireAIdevelopmentanddeploymentlifecycle.”

Implementingorganizationalstructuresto

promotesafetyandsecurity

“organisationsareaccountableforsafelydevelopinganddeploying

theirfrontierAImodelsand

systems.Theywill:...develop[]and

continuouslyreview[]internal

accountabilityandgovernanceframeworksandassigningroles’responsibilitiesandsuficient

resourcestodoso.”

“Establishsafetyteamsor

organizationalstructuresandbuild

safetyandsecurityrisk

managementmechanisms.

Designate[a]leaderresponsibleforAIsafetyandsecurity’establish

specializedteamstoconductAIriskassessmentsandsafetygovernancewithintheenterprise.”

RiskMitigation

“Articulatehowriskmitigationswillbeidentifiedandimplementedto

keepriskswithindefinedthresholds.”

“clearlyoutlineprocessesand

measuresforriskidentificationandmitigation.”

Transparencyon

capabilities’

Limitations’andApplications

“Topubliclyreportmodelorsystem

capabilities’limitations’anddomainsofappropriateandinappropriateuse.”

“Enhancemodeltransparency.

proactivelydisclosesafetyand

securitygovernancemeasuresandimprovetransparencyforall

stakeholders.provideclear

informationaboutthemodel,s

capabilities’applicablefields’andlimitations.

Transparencytothepublic

“providepublictransparencyontheimplementation...exceptinsofarasdoingsowouldincreaseriskor

divulgesensitivecommercial

informationtoadegree

disproportionatetothesocietalbenefit.”

“Informpotentialriskstothepublicthroughmodeldocumentation’

serviceagreements’orothers.”

Red-Teaming

“Internalandexternalred-teamingoffrontierAImodelsandsystemsforsevereandnovelthreats.”

“Throughdedicatedsimulationandred-teamingexpertstorigorouslytestmodelspriortotheirreleaseorupdate.”

MoreResearch

“ToprioritizeresearchonsocietalrisksposedbyfrontierAImodelsandsystems.”

“vigorouslyadvancefrontiersafetyandsecurityresearch.”

/research/2025/01/deepseek-and-other-chinese-firms-converge-with-western-companies-on-ai-promises?Iang=en5/9

DeployingModelstosolve

challenges

“DevelopanddeployfrontierAI

modelsandsystemstohelpaddresstheworld,sgreatestchallenges.”

“Innovateinthedevelopmentand

deploymentofAIsystemsthat

embodytheprincipleofAIforgood’contributingtoaddressingthemost

pressingchallengesfacedbysociety.”

source:“FrontierAIsafetycommitments’AIseoulsummit2024’”UKDepartmentforscience’Innovation’and

Technology’May21’2024’.uk/government/publications/frontier-ai-safety-commitments-ai-seoul-

summit-2024/frontier-ai-safety-commitments-ai-seoul-summit-2024;and“protectingAIsecurityandBuildingaModelofIndustryself-Discipline-TheFirstBatchof17companiessignedthe‘ArtificialIntelligencesecuritycommitment’,”chinaAcademyofInformationandcommunicationsTechnology’December24’2024’/s/s-

XFKQcwhu0uye4opgb3Ng.

Althughtherearemeaningfuldifferencesinthescpeftheircmmitments,thesimilarspecificcmmitmentsandsmetimesidenticallanguageprvide

gdreasnstbelievechina’sAIsafetycmmitmentsweredirectly

inspiredbyseul.Thatseemstfllwanincreasinglyfamiliarpatternin

china’sAIdmain.chinafrequentlyfreshadwseventualcnvergencewithinternatinalAIgvernanceeffrtsbypreemptivelylaunchingdmestic

prjectscdedin“party-speak.”Frfundatinalgvernancecnceptsinanyplicyareainchina,beingablettraceideastdistinctivelychinesertsiscriticalfrtheenduringlegitimacyftheidea.Asimilardynamicplayedut

whenchinalauncheditsGlotalAIGovernanceinitiativejusttwweeksbefreitsignednttheUk-ledBletchleyDeclarationinNvember2023.chinaviewsitsGlbalAIGvernanceInitiativeascmplementaryt

Bletchley,whickiitirequentlypraisesfritspsitiverleininternatinalAIgvernance.

ThesigningfthecmmitmentsmeanssixteennewchinesecmpaniesjinthesixteensignatriesftheseulcmmitmentstmakeAIsafetyprmises,generatingtheptentialfrstrngchinesebuy-inthattheinitialseul

cmmitmentslacked.Betweenthesignatriesftheseulcmmitments

andchineseAIsafetycmmitments,mstfthecmpaniesinvlvedin

prducingpwerfulgenerativeAImdelshavesignedntatleastnefthetwsetsfcmmitments(seetable2).

/research/2025/01/deepseek-and-other-chinese-firms-converge-with-western-companies-on-ai-promises?Iang=en6/9

Table2:companiessigningontoseoulcommitmentsandchina’sAlsafetycommitments

seoulcommitmentssignatories(May2024)

chineseAlsafetycommitmentssignatories(December2024)

Amazon

01.AI

Anthropic

360

cohere

4paradigm

Google

Alibaba

G42

AntGroup

IBM

Baidu

InflectionAI

chinaMobile

Meta

chinaTelecom

Microso什

Deepseek

MistralAI

Huawei

Naver

iFlyTek

openAI

Megvii

samsungElectronics

MiniMax

TechnologyInnovationInstitute

senseTime

XAI

Tencent

zhipu.ai

volcdance

zhipu.AI

source:“FrontierAIsafetycommitments’AIseoulsummit2024’”UKDepartmentforscience’Innovation’and

Technology’May21’2024’.uk/government/publications/frontier-ai-safety-commitments-ai-seoul-

summit-2024/frontier-ai-safety-commitments-ai-seoul-summit-2024;and“protectingAIsecurityandBuildingaModelofIndustryself-Discipline-TheFirstBatchof17companiessignedthe‘ArtificialIntelligencesecuritycommitment’9”china

AcademyofInformationandcommunicationsTechnology’December24’2024’/s/s-XFKQcwhu0uye4opgb3Ng.

yettherearedifferencesinthesubstanceofthesetwoagreements.The

chineseAIsafetycommitmentsofferamorecomprehensivesetofsecurityrequirementsfordataandcriticalinfrastructuresandhaveaspecificlineonadoptingappropriatesafetymeasuresforopensourceinitiatives,where

chineseproductslikeDeepseek’sareespeciallycompetitiveinternationally.Theseoulcommitments,incontrast,arefundamentallyfocusedon

establishingredlinesforfrontierrisksthatshouldnotbecrossedand

identifyingstepscompanieswouldtakeifthoseriskthresholdswerereached.Thisdifferencecouldbeexplainedbythefactthatchinaisfocusedonusing

/research/2025/01/deepseek-and-other-chinese-firms-converge-with-western-companies-on-ai-promises?Iang=en7/9

AIasameansofboostingitseconomy.RedlinescouldbeseenasanoverlyrestrictivepolicytoolatatimewhenthegovernmentwantstosignalitisembracingAIandnotoverregulatingitduetoconcernsaboutthelastingeffectsofitscOVID-eratechcrackdown.

Andthereisabroaderstructuraldifferencebetweenchinese-ledandinternationaleffortsthathasimportantimplicationsforchineseAI

governance:chineseindustryhasmoreexplicitgovernment-industry

connectionsthanwesterncompanies.Thismakestheimplicitbackingofkeygovernmentstakeholdersthatchina,sAISafetycommitmentsreceived

critical.cAIcTisaleadingchinesethinktankhousedunderthestate,s

MinistryofIndustryandInnovationTechnology(MIIT).MIIT,sinstitutionalbackinglendsthepromisesparticularweightinchina,sregulatorylandscape,whereindustryinitiativestypicallyaligncloselywithgovernmentpriorities.Moreover,theeffortwasexplicitlyspearheadedbychina,sArtificial

ImntelligenceIndustryAlliance(AIIA),aprominentindustryconsortiumguidedbyMIIT.

ThisindustrybackingcouldforeshadowfuturechineseAIpolicy.Historically,AIIAinvolvementhaspresagedfuturechineseregulation.In2019and2020,

AIIAworkinggroupsledbycAIcTofficialsofferedrecommendationsandcreatedtheIndustrySelf-DisciplineJointpledge(行業(yè)自律公約).These

recommendationsformedthefoundationforfoundationalchinese

regulationsonrecommendationalgorithmsanddeepfakes.Evenifchinese

industrylacksthedirectauthoritytoshapeitsdomesticregulatory

environment,itcouldbeempoweredtomatchwesternfirms,effortsandforeshadowmorechinesefirmssigningontotheSeoulcommitments.

TheparisAIActi?nsummitoffersakeyJuncturet?BuiIdIndustryc?nsensus

DeepSeek,srapidascenthighlightsagrowingchallengeforU.S.policymakers:chinesemodelsareincreasinglypowerful,and,withoutsafeguards,theycouldthreatenU.S.nationalsecurityandeconomicinterests.

ThischallengehasintensifiedasboththeU.S.andchinesegovernmentshavebackedtheAIcompaniesatthevanguardoffrontierdevelopment.The

/research/2025/01

溫馨提示

  • 1. 本站所有資源如無特殊說明,都需要本地電腦安裝OFFICE2007和PDF閱讀器。圖紙軟件為CAD,CAXA,PROE,UG,SolidWorks等.壓縮文件請下載最新的WinRAR軟件解壓。
  • 2. 本站的文檔不包含任何第三方提供的附件圖紙等,如果需要附件,請聯(lián)系上傳者。文件的所有權(quán)益歸上傳用戶所有。
  • 3. 本站RAR壓縮包中若帶圖紙,網(wǎng)頁內(nèi)容里面會(huì)有圖紙預(yù)覽,若沒有圖紙預(yù)覽就沒有圖紙。
  • 4. 未經(jīng)權(quán)益所有人同意不得將文件中的內(nèi)容挪作商業(yè)或盈利用途。
  • 5. 人人文庫網(wǎng)僅提供信息存儲空間,僅對用戶上傳內(nèi)容的表現(xiàn)方式做保護(hù)處理,對用戶上傳分享的文檔內(nèi)容本身不做任何修改或編輯,并不能對任何下載內(nèi)容負(fù)責(zé)。
  • 6. 下載文件中如有侵權(quán)或不適當(dāng)內(nèi)容,請與我們聯(lián)系,我們立即糾正。
  • 7. 本站不保證下載資源的準(zhǔn)確性、安全性和完整性, 同時(shí)也不承擔(dān)用戶因使用這些下載資源對自己和他人造成任何形式的傷害或損失。

評論

0/150

提交評論