Gartner-如何引導(dǎo)生成型人工智能英

HowtoPilotGenerativeAI

Published10July2023-IDG00797246-25minread

ByAnalyst(s):LeinarRamos,AnthonyMullen,RajeshKandaswamy,RaduMiclaus,ErickBrethenoux,AvivahLitan,HarithaKhandabattu

Initiatives:

Arti?cialIntelligence

;EvolveTechnologyandProcessCapabilitiestoSupport

D&A

WhenorganizationsbeginexperimentingwithgenerativeAI,theyoftenneglectitstransformativenatureandtheoperationalizationchallengesitentails.ITleadersresponsibleforAIcanfollowthe?vestepsinthisresearchtopilotgenerativeAIandstartdeliveringbusinessvalue.

Overview

KeyFindings

■Themostsuccessfulpilotsfocusondemonstratingbusinesspotential,notontechnicalfeasibility.OrganizationstendtoruntechnicaIpilotsthatsimplydemonstratethatitispossibletobuildsomethingwithgenerativeAI,leadingtoonlyincrementalimprovementsandignoringthetransformativepotentialofthistechnology.

■ITleadersstruggletoidentifyandprioritizeimpactfulgenerativeAIusecasesduetothebroadandemergingnatureofthetechnology.

■MatureAIorganizationsinvolvebusinesspartnersandsoftwareengineersaskeymembersoftheirAIprojectsandpilotteams.

■GenerativeAIallowsforfasterdevelopmentcyclesthantraditionalAIprojects.Forthisreason,agenerativeAIpilotrequiresaleancycleofinnovation—shortexperimentstotesthowthetechnologycouldaddstrategicvalue—whilemitigatingthepotentialrisksthatcomewithgenerativeAI.

■SuccessingenerativeAIpilotsrequiresrapidtesting,re?nementand,often,theeliminationofusecasesthatdonothavetheanticipatedeffectonbusinessvalue.

Gartner,Inc.|G00797246

Page1of21

Recommendations

AsanITleaderfocusedonleveraginggenerativeAItocreatebusinessvalue,youshould:

■Runaworkshoptogenerateuse-caseideaswiththebusiness,focusingonthedisruptivepotentialofgenerativeAIandthewayinwhichitcanenablestrategicobjectives.

■Prioritizetheusecasesforyourpilotagainsttheirpotentialbusinessvalueandfeasibility.FocusonnomorethanafewusecasesforyourgenerativeAIpilot.

■Assembleasmallbutdiverseteam,includingbusinesspartners,softwaredevelopersandAIexperts.Dedicatethisfusionteamforthedurationofthepilot.

■Createaminimumviableproducttovalidateeachusecase.Identifythetargetbusinesskeyperformanceindicator(KPI)improvementhypothesis,andde?nethedeploymentapproachesandriskmitigationsrequiredtoquicklytestthishypothesis.

■Delivertheminimumfunctionalityrequiredtotesttheusecases,andre?neyourassumptionsonthecostandvalueofscalingthem.Decidewhethertostop,re?neorscaleeachusecase.BuilduponinitialsuccessestoexpandthegenerativeAIpilot.

Introduction

OrganizationsareplanningtoimplementgenerativeAI.InarecentGartnerwebinar,45%organizationshaveseenanincreaseinAIinvestmentsinceChatGPTwasreleased,and68%ofexecutivesbelievethatgenerativeAIbene?tsoutweighitsrisks.However,despitethisexcitement,organizationsstruggletogetstarted:Only19%oforganizationsare

currentlyrunningapilotorproducinggenerativeAI(seeExecutivePulse:AIInvestment

GetsaBoostFromChatGPTHype).

GenerativeAIcanbeoverwhelming.Itopensupabroadsetofopportunities:Organizationscanuseittogeneratemanydifferenttypesofartifacts,includingtext,code,images,video,music,speechanddesigns(e.g.,3D,partsandbuildings).

AgenerativeAIpilotmightcoveradiversesetofusecases,forinstance:

■Applyinglargelanguagemodels(LLMs)tocreatedraftsforagentstoreplytocustomerinquiries

■Usingacode-generationapplicationtoimprovedeveloperproductivity

Gartner,Inc.|G00797246

Page2of21

■Leveragingimagegenerationtocreatemarketingmaterials

Moreover,therearedifferentapproachestoimplementingthiswiderangeofusecases,frombuyinganexternalapplicationandcustomizingfoundationmodelsallthewaytobuildingyourownAImodelsfromscratch.

Giventhiscomplexity,whatstepscanITleaderstaketoinitiateandrunagenerativeAIpilot?

ITleadersneedasystematicwaytonavigatethewidespaceofopportunities.Theymust?ndandprioritizeafewofthemostpromisingusecasesfortheirorganizationandrunapilottoquicklydeliverandvalidatetheseideasinpractice.Toachievethis,ITleaderscanfollowthe?vestepsdescribedinthisresearch(seeFigure1).

Figure1:GenerativeAIPilotCycle

Analysis

Gartner,Inc.|G00797246

Page3of21

Step1:IdentifyTransformativeUseCasesWiththeBusiness

Whenanew,transformativetechnologylikegenerativeAI(GenAI)is?rstintroduced,thetemptationistorunatechnicalproofofconceptthatsimplydemonstratesthatitispossibletobuildsomethingwithit.ThisresultsinonlyincrementalimprovementsandleavesITleaderswithafalsesenseofcomfortbecausetheyhaveexperimentedwiththetechnology.Thisisamistake.

YourgenerativeAIpilotshouldnotbeaboutjustprovingthatthetechnologyworks,butaboutlearninghowgenerativeAIfitsintothefutureofyourcompany.

UnderstandHowGenerativeAICanTransformtheOrganization

ThegoalofyourpilotshouldbetolearnhowgenerativeAIcandrivestrategicvalue,soitiskeytofocusonitstransformationpotential.TherearethreegenerativeAIdisruptionpatternsthatgobeyondwhatwaspreviouslypossiblewithotherAItechniques(seeFigure2):

■Contentconsumption:CustomersandemployeeswillincreasinglyexpecttheircontentconsumptiontobeenhancedwithgenerativeAIviachatandsimilarinterfaces.EnterpriseswillneedtoenablethisnewuserexperiencethroughUXdesign,knowledgemanagementandsearch.

■Contentgeneration:EmployeeswilluseAI-poweredassistantstocompletemostoftheirtasks.Therewillbeadisruptiveshiftacrossmultipleareasofcontentgeneration—whetheritisgeneratingtextforinternalcommunicationsandexternalmessagingorgeneratingvisualcreativecontentacrossawidespectrumofmodalites(image,videoandsound).

■Technologycreation:GenerativeAIwillacceleratetechnologycreation,notonlyimprovingtheproductivityofdevelopers,butalsodemocratizingtechnologycreationfurtherbyenablingbusinesstechnologiststomoreeasilydevelopapplications.

Gartner,Inc.|G00797246

Page4of21

Figure2:KeyGenerativeAIDisruptions

ThesearebroadcategoriesofgenerativeAIopportunities,buttheyneedtobetranslatedintospeci?cusecasesforyourorganization.Forthis,itiscrucialtoinvolvethebusinessfromtheverystartofyourgenerativeAIjourney:Withoutbusinessinvolvement,yourpilotwillbecomeanITdemo.

CapitalizeonthebroadexcitementaroundgenerativeAI.Involvebusinesspartnersfromtheverystartofyourpilot.

RunIdeationWorkshopsWiththeBusiness

Toinvolvethebusiness,?rstidentifyandpartnerwithaseniorexecutivesponsorforthepilot.Theidealcandidatewouldhavebothaninterestinthetopicandenoughin?uenceacrosstheorganizationtogetthepilotgoingandaddresspotentialbarriers.

Aftergainingexecutivesupport,organizeanideationworkshoptodiscusshowgenerativeAIcanenableyourstrategicbusinessgoals.Thisshouldincludeamixofbusinesspartners,AIandITexperts.Theobjectiveistogenerateideasforusecasesandgainbuy-inforaninitialpilot.Thissessionshouldbeshortandtargeted.

Gartner,Inc.|G00797246

Page5of21

Starttheworkshopbycreatingasharedunderstandingofthetechnology,presentingabalancedviewofopportunitiesandrisks(see

BoardBriefonGenerativeAI

).IntroducethethreedisruptionpatternsfromFigure1tocommunicatehowgenerativeAIenablesnew-in-kindusecases.Then,runanexercisetogeneratepotentialusecases.

Tomaintainafocusonthestrategicpotentialofthetechnology,youcanfollowtheformatinTable1,encouragingparticipantstothinkaboutthestrategicgoalsandhowgenerativeAIandspeci?cusecasescouldcontribute.ITleadersshouldpushfortheparticipantstothinkbeyondincrementalimprovementstotheirprocessesandtoimaginehowgenerativeAIcouldleadtotransformingthebusiness.

Gartner,Inc.|G00797246

Page6of21

Table1:FormatandExampleofIdeationExercise

(EnlargedtableinAppendix)

Toexpandideageneration:

■Runacampaigntocollectideasbroadlyfromacrosstheorganization.Keepthissimple,withaclearformtocollectideasandincentivesforpeopletocontribute.

■IdentifywhatotherorganizationsaredoingintermsofgenerativeAIusecases(see

Tool:EnterpriseUseCasesforChatGPT

).

Gartner,Inc.|G00797246

Page7of21

Thefocusinthis?rststageistocollectasmanyideasaspossiblewithoutprioritizingthem:Usecaseprioritizationshouldbekeptseparatefromideageneration.

Step2:PrioritizetheUseCasesforYourPilot

Ifdonewell,theidea-generationstepshouldresultindozensofpotentialgenerativeAIusecases.However,Gartnerdoesnotrecommendrunningmanyusecasesatoncewhenstartingtoexperimentwiththistechnology.

Thekeytopilotsuccessisprioritization:SelectnomorethanafewgenerativeAIusecasestostartwithfortheshortdurationofthepilot.

Prioritizeyouruse-caseideasbyscoringthemaccordingtotheirbusinessvalueandfeasibility:

■Businessvalue:Howmuchdoesthisparticularusecasecontributetoeachofthestrategicobjectivesofyourorganization,suchasthosede?nedinTable1(e.g.,improvedcustomersatisfaction,increasedemployeeproductivityandtop-linerevenuegrowth)?

■Feasibility:Whatistheriskpro?leofthisparticularuseofgenerativeAI(seeTable2forgenerativeAIrisks)?Isthisusecasecurrentlyfeasiblewiththetechnologyavailable?1Arethereanyturnkeysolutionsthatwillmakeiteasiertoimplement(seeDeploymentApproachessectioninStep4)?Howreadyisyourorganizationtoadoptit?

StartwithgenerativeAIusecasesthatdonotrequiresharingconfidentialinformationorintellectualproperty,aswellasthosewhereoutputaccuracydoesnotneedtobeperfect.

YoucanfollowGartner’sAIprismmethodology,whichenablesyoutode?necriteriafor

businessvalueandfeasibility,andthenscoreAIusecases(seeToolkit:Discoverand

PrioritizeYourBestAIUseCasesWithaGartnerPrism).Figure3showsanillustrationof

whataprioritizationmightlooklike,continuingontheuse-caseexamplesgiveninTable1.(Note:ThisexampledoesnotrepresentGartner’sviewofthevalueandfeasibilityoftheseusecases.)

Gartner,Inc.|G00797246

Page8of21

Figure3:IllustrativeExampleofGenerativeAIPrioritization

IntheexampleinFigure3,theorganizationmightdecidetoprioritizethethreeusecasesatthetop:codegeneration,imagegenerationformarketing,andthedraftingofcustomerserviceresponsesviatextgeneration.

Thinkabouttheseinitialusecasesasaportfolio.Balanceriskandreward,investinginsomeusecasesthataremorefeasible,andothersthataremorevaluable.Diversifytheseinvestmentsbyselectingusecasesthatcontributetodifferentbusinessobjectives.

Takeasmallbiteofabigbusinessproblem.Yourpilotusecaseportfolioshoulddeliverbusinessvaluedirectly,butalsodemonstratethestrategicpotentialthatgenerativeAIcouldhaveinyourorganization.

Gartner,Inc.|G00797246

Page9of21

Step3:AssembleaSmallbutDiverseTeam

Thepilotteamshouldincludeeveryonerequiredtorunthefullpilot.Mostteamsshouldincludeatleastthreetypesofteammembers(seeFigure4):

■Businessexperts:Involveexpertsfromthebusinessunitsthatwillbeimpactedbytheselectedusecases.Theywillhelpalignthepilotwiththeirstrategicgoalsandidentifyanychangemanagementandprocessreengineeringrequiredtosuccessfullyrunthepilot.

■Softwareengineers:Provideuser-interface,front-endapplicationandscalabilitysupport.The2022GartnerAIUseCaseROISurveyshowsthatorganizationsinwhichsoftwareengineersareinvolvedinthestageofdevelopingAIusecasesaremuchmorelikelytoreachmaturelevelsofAIimplementation.3

■DatascientistsandAIexperts:ThesecontributorsmanagetheAIcomponentsoftheprojects.Youareunlikelyto?ndgenerativeAIexpertsinyourorganizationbecausethe?eldisrelativelynew,butlookforstaffmemberswithdeeplearningskills,ideallywithexperienceontransferlearningtechniquesandworkingwithfoundationmodels.

Thedegreeofinvolvementoftheserolesmayvarydependingonthespeci?cusecasesthathavebeenselected.However,thisfusionteam,combiningITandbusinessexperts,willbeinamuchbetterpositiontosucceedthantechnicalteamsthatconsultonlythebusinessfortheirrequirements(see

FusionTeams:AProvenModelforDigitalDelivery

).

Dedicatethepeopleinthisteamforthefulldurationofthepilot(e.g.,twoorthreemonths).UseyourpilotasawaytodevelopthenewskillsrequiredforgenerativeAI(see

QuickAnswer:HowWillPromptEngineeringImpacttheWorkofDataScientists

).

Beyondthecorepilotteam,youmightneedtoinvolveotherpartsoftheorganizationatdifferentpointsofthepilot:

■AgenerativeAIgovernanceteam,whichshouldde?nepoliciesandensuretheyareimplementedwithinthepilot

■Securityandlegalexpertstoassessrisksandconsiderriskmitigationsforthepilot(seetheDetermineRiskandMitigationforPilotUseCasessectioninStep4)

■Technicalexpertsfortestingandqualityassuranceforthepilot

Gartner,Inc.|G00797246

Page10of21

■Enterprisearchitectstosetandenforcestandardsinthedeploymentphaseofpilotusecases

Step4:DesignandPlanthePilot

DeterminePilotObjectivesandKPIs

Thepilotteammustquicklygothroughadesignandplanningsprintthatlastsonlyoneortwoweeks.Theobjectiveofthisphaseisnottodesignafully-?edgedapplication,buttoplanforaminimumviableproduct(MVP)—thatis,aproductthatrequirestheleastamountofefforttovalidateahypothesisofthevaluethatitcouldcreateforcustomersoremployees.Additionalfeatureswillcomelater.

TheAIteammustde?neavaluehypothesis,whichisanassumptionabouttheimprovementthattheAIusecasewillhaveonaspeci?cbusinessKPI.YoucanusethesimpleformatinFigure4todocumenttheexpectedimpactontheKPI(seeStep2in

CaptureAIValueWithThese5Bene?tRealizationBestPractices

formoredetails).

Figure4:ValueHypothesisFormatandExample

ThisbusinessKPImustbeidenti?edatthestartoftheproject,withoutexception—thisiskeytosuccess;the2022GartnerAIUseCaseROISurveyfoundthatmatureAIorganizationsaremorelikelytode?netheirbusinessmetricsattheideationphaseofeveryAIusecasethanlow-maturityones.3

Thepilotwillbeabletonotonlydemonstratethevaluehypothesis,butalsovalidate

assumptionsaboutthecostsforscalingeachusecase(seeAssesstheValueandCostof

GenerativeAIWithNewInvestmentCriteria).

DetermineRisksandMitigationsforPilotUseCases

Gartner,Inc.|G00797246Page11of21

GenerativeAIunlocksmanyusecases,butitalsobringsadditionalrisks:

■Outputandinputrisks:GenerativeAI’soutputscanbeunreliablegivenfactualerrorsandhallucinations.Outputscanalsobebiasedonandpotentiallyincludecopyrightedmaterialorotherunwanted,illegitimateorillegalinformation.InputsintogenerativeAImodelscanresultindatacompromiserisks.

■Privacyanddataprotectionrisks:ManygenerativeAIimplementationswilldependonaccesstothird-partyfoundationmodelsandapplications.Theuseofprivate,proprietary,sensitiveorcon?dentialinformationasinputsintothesegenerativeAImodelsentailsrisksofdataleakageandpotentialviolationsofexistingregulations.Organizationsmustmonitorandenforceprivacy,con?dentialityandgovernanceoftheirdataintheenvironmentswheremodelsarehosted.

■AIapplicationsecurityrisks:AIintroducessecuritythreatsthatarenotaddressedbyconventionalsecuritycontrols.Theseincludepromptinjectionattacksandhackeraccesstomodelstatesandparameters.Further,attackersthemselvescanusegenerativeAIforhackingtechniquesthatenterprisesarenotpreparedfor,andthisisindependentofthenewAIapplicationattackvector.

Giventhis,thepilotteammustsettheriskmitigationsandcontrolsfortheirusecases.SeeTable2foraformatforriskassessmentandmitigationplanforeachgenerativeAIusecaseinthepilotscope.

Gartner,Inc.|G00797246

Page12of21

Table2:RiskAssessmentandMitigation

(EnlargedtableinAppendix)

DecideontheDeploymentApproach

Consideringboththepilotobjectivesanditsrisks,thepilotteammustdecideonthedeploymentapproachforeachusecase.ThereisavarietyofoptionstoconsumegenerativeAIcapabilities(seeFigure5):

1.ConsumegenerativeAIembeddedinapplications:OrganizationscandirectlyusecommercialapplicationsthathavegenerativeAIcapabilitiesembeddedwithinthem.Anexampleofthiswouldbeusingadesignsoftwareapplicationthatincludesimage-generationcapabilities(e.g.,AdobeFire?y).

Gartner,Inc.|G00797246

Page13of21

2.EmbedgenerativeAIAPIsinacustomapplication:Enterprisescanbuildtheirownapplications,integratinggenerativeAIviafoundationmodelAPIs.Mostclosed-sourcegenerativeAImodels(GPT-3,GPT-4,PaLM2,etc.)areavailablefordeploymentviacloudAPIs.

3.ExtendgenerativeAImodelsviadataretrieval:Foundationmodelscanbeaugmentedwithdataretrievedfromadditionaldocumentdatabases.Thisrequiresaretrieval/searchstepbeforeusingthegenerativemodels.

4.ExtendgenerativeAImodelsviafine-tuning:Fine-tuningfurthertrainsalargefoundationmodelonasmallerdatasetforaspeci?cusecase.Forexample,aninsurancecompanycould?ne-tuneafoundationmodelwithitsownpolicydocumentstoincorporatethisknowledgeintothemodel.

5.Buildcustomfoundationmodelsfromscratch:Organizationscouldultimatelybuildtheirownfoundationmodelsfromscratch,fullycustomizingthemtotheirowndataandbusinessdomains.Thisoptionisunfeasibleformostorganizations.Forexample,a?nancialinstitutionmightcreateafoundationmodeltrainedwith?nancialdata,whichcouldthenbeusedformanyusecases.

Figure5:GenerativeAIDeploymentApproaches

Therearetrade-offstoeachofthe?veoptions(seeHowtoChooseanApproachfor

DeployingGenerativeAIforafulldiscussion).2However,becausetheobjectiveofthe

pilotistoquicklyvalidatethevaluehypothesis,theapproachesofconsumingapplicationsorembeddingAPIsarepreferableovertheoptionsofextendingvia?ne-tuningorbuildingfoundationmodelsfromscratch.

Gartner,Inc.|G00797246

Page14of21

Don’tstartyourgenerativeAIpilotfromscratch,usethefoundationmodelsandapplicationsavailableexternally.

Dependingonthedeploymentapproach,theteamwillbeabletodesignthearchitecture

ofitsinitialusecases,selectingamongdifferentgenerativeAIdesignpatterns.SeeAI

DesignPatternsforLargeLanguageModelstoexploredifferentwaystoutilizegenerative

AIfoundationmodels.

Figure6illustratesdifferentdesignpatterns.

Figure6:DesignPatternsforLargeLanguageModels(LLMs)

Thespeci?cpatternschosenforeachusecasewilldependontheobjectivede?ned,aswellastheorganizationalreadinessintermsofskillsanddata.

Gartner,Inc.|G00797246

Page15of21

Eachusecaseisthereforemappedtoadeploymentapproachanddesignpattern(seeTable3).

Table3:IllustrativeExampleofUseCasesMappedtoDesignPatterns

Draftcustomerserviceresponses

ExtendgenerativeAImodelsviadataretrieval

LLMwithdocument

retrieval/search

Codegenerationtoimprovedeveloperproductivity

BuyagenerativeAI

embeddedapplication

Useapplicationas-is

Imagegenerationfor

marketing

BuyagenerativeAI

embeddedapplication

Useapplicationas-is

Source:Gartner(July2023)

Deliveringthepilotusecasesislikelytorequireselectingavendorthatofferstheunderlyingfoundationmodelcapabilities—eitherviafull-?edgedapplicationsorAPIs.Contemplatewhetheryourexistingportfolioofapplicationsandvendorscouldful?llaroleinthepilotbecauseitmightbefastertogetstartedwithanexistingrelationship.Regardless,consideratleastthe?vecriteriainTable4whenselectingavendorforyourpilot.

Gartner,Inc.|G00797246

Page16of21

Table4:VendorCriteriaforGenerativeAIPilot

(EnlargedtableinAppendix)

Thepilotisnotthemomenttomakelong-termvendordecisions—thisisamuchlongerprocess.Itissimplyanopportunitytorunasmallproofofconceptutilizingexternal

capabilities.Formoreadviceonvendoridenti?cationandselection,seeToolkit:Vendor

Identi?cationandSelectionGuideforAIandDataandAnalytics(D&A)ServiceProviders.

Gartner,Inc.|G00797246

Page17of21

Step5:DeliverandIterate

Afterthedesignandplanningphase,theteammustdeliveronthepilotusecases.Thisisaniterativeprocessinwhichteamswillbuild,testandre?netheirimplementation(seeFigure7).Thereshouldbe,however,atimelimitforthisdeliveryphase:Considerallowingnomorethantwomonthstore?neandtesteachusecase.

Thistimeconstraintwillforcetheteamtofocusonrunningthesimplestpilotpossible,testingtheideawiththeminimumfunctionalityrequiredandmovingontootherideasiftheusecasedoesnotreachtheintendedperformanceinthisperiod.

GenerativeAIallowsforfasterdevelopmentcyclesthantraditionalAIprojectssinceteamscanleveragepretrainedfoundationmodels.Usethisspeedtoyouradvantagebyquicklyiteratingandtestingyourpilotusecases.

Figure7:GenerativeAIPilotPhasesandDecisionPoints

Gartner,Inc.|G00797246

Page18of21

TestandRefineYourUseCases

TestthebusinessKPIimpactforeachusecase,asde?nedinthevaluehypothesis(seeStep4).Theusecasecanbetestedwithasmallnumberofusersorcustomerstoreduceriskexposure,butit’simportanttodirectlytestitwiththefutureusersofthesolution.

Theinitialuse-caseiterationwillrarelymeetthevaluehypothesis.However,thechallengesencounteredwillbethecrucialinformationtolearnwhatneedstobeimproved.Dependingontheissuesencountered,youmightwanttoexploredifferentoptionstoimproveperformance(see

HowtoImprovethePerformanceofAIProjects

):

■Modelingandarchitecture:ItcouldbethattheperformanceoftheGenAImodelis

simplynotgoodenoughfortheintendedusecase.Inthiscase,theteammight

explorewaystoaugmentmodelswithadditionaldataortools(seeAIDesign

PatternsforLargeLanguageModels)orconsideralternativefoundation

models/applicationsthatcouldbringhigherperformance.

■Processengineering:Theissuemightnotbetechnicalinnature,butinsteaddrivenbylackofuseradoption.Effortsinchangemanagementandprocessengineeringmightberequiredinthiscase.

■Data:Ifyouareusingyourowndata(forexample,whenusingaretrievalsystem),thenyoumightconsiderimprovingdataquality,increasinginternalandexternaldatacollection,orimprovingdata/featureengineering.

Itcouldbethecase,however,thatdespitethebesteffortsoftheteamafterseveraliterations,itisnotpossibletoachievetheintendedbusinessvalueforagivenusecasewithinthetimelimit.Thisisnotafailure,butasignalthattherealopportunitieswithingenerativeAImightlieelsewhere.Discoveringthatausecasedoesn’tworkatthepilotstageisawaytoavoidthecostsofbuildingalong-termsolutionthatwon’tbevaluableforyourorganization.

Thegoalofthepilotistolearn,nottodeliver.Learnfromearlyeffortsandfindapathforward.

StoporScale

Bytheendofthisphase,theteamwillneedtomakeadecisionforeachusecase:

Gartner,Inc.|G00797246

Page19of21

■Stop:Thereisnoclearwaytogettheusecasetotherequiredperformance.Documentthelessonslearned,includingwhatworkedandwhatdidnot.Gobacktotheideationphase(Step1)toconsiderotherusecasesnotincludedintheoriginalpilot.

■Scale:Havingdemonstratedthepotentialvalueoftheusecase,buildaroadmaptoscale,potentiallyexpandingonthefeaturesfromthepilotanddecidingonthelong-termarchitecture.Thepilotphaseshouldalsouncoverlong-termfeasibilityandhelptore?neyourassumptionsonthetotallong-term-coststructureandinvestmentrequiredfordeliveringthesolutionatscale.Toestimatethepotentialcostandreturn

oninvestmentoftheinitiative,seeAssesstheValueandCostofGenerativeAIWith

NewInvestmentCriteria.

Builduponyourinitialsuccess.Tellastoryonthevalueobtainedandlessonslearnedinyourpilot,andexpandintoadditionalgenerativeAIusecasesbygoingbacktotheideationphase(Step1).GenerativeAIisafast-moving?eld;newusecaseswillbeunlocked,andthefeasibilityandvalueofusecasesmightalsochangeasnewtechniquesemergeandperformanceimproves.

Evidence

1ThegenerativeAItechnologylandscapeisevolvingquickly.Technicalfeasibilityassessmentsshouldbemadewithaforward-lookingapproach.

2Open-sourcefoundationmodelscouldbeusedindifferentdeploymentapproaches.Forexample,theycouldbe