代碼搜索技術(shù)的研究和實(shí)踐

代碼搜索技術(shù)的研究和實(shí)踐Programming

ishard…?

Programming

is

largelyamanualeffort,

which

is

tediousandtime

consuming.?

Developersoftenwonderwhatcodetowriteinorder

to

complete

aprogramming

task?

Unfamiliar

problems?

Unfamiliar

APIs?

…?

Inasurvey

conductedatMicrosoft,

67.6%respondents

mentionedthattheyencounteredproblemsinlearning

APIs.(M.P.

Robillard,“Whatmakes

APIshard

to

learn?Answersfrom

developers,”

IEEE

Softw.,

vol.

26,no.

6,

pp.27–34,

2009)?

Vision:Improving

Developer

ProductivitybyCode

SearchSearching

forAPIUsageQuestion:

how

to

reuse

an

API?Ourwork:

Recommending

sample

codeabout

theAPI

usage?

Extract

API

usage

informationfromasoftware

repository?

SupportC/C++/C#/Java/JavaScriptlanguages.?

Supportnative

andthird-partyAPIs.?

Supporta

varietyofdatasources(including

GitHub,

MSDN,andMicrosoftinitiativeslike

Office

APIs,Azure

I

OT,UniversalWindowsPlatform,etc.)HongyuZhang,AnujJain,

Gaurav

Khandelwal,Chandrashekhar

Kaushik,ScottGeandWenxiang

Hu,Bing

Developer

Assistant

–ImprovingDeveloperProductivity

by

RecommendingSampleCode,To

appear:

FSE2016,

industrytrack,Seattle,

WA,USA,

November

2016.Static

analysis

ofaprogram:?

Parse

thesourcecode

andheaderfiles

into

anAST?

Performs

anin-ordertraversal

oftheAST?

Process

eachnode

accordingto

itstype?

Challenges:?

Third-party

APIs?

Type

inference

for

weaklytypedlanguagesAnExampleofanASTExtractedAPIUsageData?

We

construct

alarge-scalecodebaseby

crawling

projectsfromMSDN

andGitHub：

65,253projects,

437

GB,

3.5million

sourcecodefiles.?

Intotal,78

million

codesnippetsare

obtained.?

TheAPI

usage

dataandsamplecodeare

stored

inandmanagedbyMicrosoftAzure

Table.Thestatistics

oftheobtainedAPI

usagedataBingDeveloper

Assistant(BDA)http://aka.ms/devassistant?

Client

side:anextension

ofMicrosoftVisualStudio.?

Serverside:MicrosoftAzureservers

locatedaroundtheworld.?

TheAPIsprovidedbyIntelliSense

ofVS

triggerthebackend

BDA

service.?

Thereturnedsample

codeisdisplayedwithinVisualStudio.Technology

Transfer?

Transferred

to

Bing

DeveloperAssistant

(BDA)

in2015.?

StatusUpdates(as

ofJuly2016):?Receivedmore

than450Kdownloads???~2.1

million

queriespermonthBuild2016

presenceNewrelease

ofBDAon

July13,2016

(withC/C++

support)Availableat:http://aka.ms/devassistantVisualStudioBlogVisualC++Team

BlogCollaborators:BingTech

SegmentHyderabadVisualStudioRedmondDX

Audience

Online

EnginesRedmondSearching

for

Reusable

CodeWe

proposeCodeHow,

a

methodfor

searching

reusable

codebased

onfree-formqueries?

Given

auserquery,

CodeHow

searchescodebasesand

returns

therelevant

codesnippetsthat

match

the

query.?

Consider

bothtext

similarity

andprogramsemantics

incode

retrievalHow

to

use

SqlConnection.OpenHow

to

use

SSL.acceptHow

to

compute

MD5

HashHow

to

convert

a

string

to

int…..Open

SourceProjectsLocal

Projects?

Build

thetoolontop

of

ElasticSearch

andMicrosoftAzureQuery?

Indexed~50K

C#/Java/C++/VBprojectscollectedfromGitHuband

CodeplexCodebaseCode

SnippetsFei

Lv,

Hongyu

Zhang,Jian-guang

Lou,

Shaowei

Wang,

Dongmei

Zhang,andJianjun

Zhao,

"CodeHow:

Effective

CodeSearch

basedonAPIUnderstandingand

Extended

Boolean

Model",inProc.ASE2015,

Lincoln,Nebraska,

Nov

2015.Natural

Language

Query-

Query

Formulation?

Text

SimilarityQuery?

For

retrieving

code

snippetsthat

match

the

queryinterms

oftext

similarity?

API

Query?

Obtainthetop

kAPIs

thatare

potentiallyrelevant

to

thequery?

For

retrieving

codesnippetsthatcontaintheAPIs?

Expanded

Query:

incorporate

both

APIsimilarity

and

text

similarityNatural

Language

Query-

Retrieval?

Retrieve

code

snippets

basedon

thesimilarity

betweentheexpandedquery

qexpand

andacodesnippet

d:Thesimilarity

value

iscomputedusingExtended

Boolean

model:Fei

Lv,

Hongyu

Zhang,

Jian-guang

Lou,

Shaowei

Wang,Dongmei

Zhang,

and

JianjunZhao,

“CodeHow:

Effective

CodeSearch

basedon

APIUnderstanding

and

Extended

BooleanModel”,

Proc.

ASE’15,Lincoln,

USA,

Nov

2015.SystemStructure.

ElasticSearch(1

masterand4workers).

Azure

platformNatural

LanguageQueryQueryExamples:Enter

yourqueryhereredbl