Axis Communications Analytics Detects User manual

Brand: Axis Communications

Model: Analytics Detects

Type: User manual

Axis Communications Analytics Detects is a powerful AI-driven tool that helps you detect and classify moving objects, specifically humans or vehicles, with a high degree of accuracy. It can be used to trigger various actions, such as recording video, playing an audio message, or alerting security staff. The application is easy to set up and use, and it can be customized to meet your specific needs. You can define detection zones and lines, adjust sensitivity levels, and choose which types of objects to detect.

AXISObjectAnalytics

UserManual

AXISObjectAnalytics

Solutionoverview

Views

Cameras

Abouttheapplication

AXISObjectAnalyticsdetectsandclassiesmovingobjects,specicallyhumansorvehicles.Youcanchoosedifferentconditionsfor

detection,suchasobjectsthatmoveorstaylongerthanasettimeBETAwithinapredenedareaorthatcrossadenedline.Upon

detection,Axisnetworkdevicesorthird-partysoftwarecanperformdifferentactions,suchasrecordingvideo,playinganaudio

message,oralertingsecuritystaff.

AXISObjectAnalytics

Considerations

Forbestresults,thecameramustbeappropriatelymounted,andtherearerequirementsonthescene,imageandobjects.

Thisimageillustratesanappropriatelymountedcamera.

1Mountingheight

2Tilt

3Detectionarea

4Minimumdetectiondistance

5Maximumdetectiondistance

Thefollowingconsiderationsapplytothemountingofallcameratypes:

Mountingposition

Ifyoumountthecamerasoitlooksdownfromabove,itmakesitdifcultfortheapplicationtoclassifyobjects.

Tilt

Thecameramustbesufcientlyorientedtowardsthegroundsothatthecenteroftheimageisbelowthehorizon.Mountthecamera

sothattheminimumdetectiondistanceislongerthanhalfofthecamera’smountingheight(minimumdetectiondistance>

cameramountingheight/2).

AXISObjectAnalytics

Considerations

Detectionarea

Anobject’spointofdetectionmustbeinsidethedetectionarea.Thepointofdetectionofahumanisatitsfeet,andofavehicleit’s

atitscenter.

Maximumdetectiondistance

Themaximumdetectiondistancedependson:

•Cameratypeandmodel

•Cameralens.Ahigherfocalrangeallowsforalongerdetectiondistance.

•Weather.Forexample,heavyrainorsnowcanaffectthedetectiondistanceandaccuracy.

•Light.Detectionaccuracyandrangecanbeaffectedbyinsufcientillumination.

•Cameraload

WerecommendyoutouseAXISSiteDesignertodeterminethemaximumdetectiondistancefordifferentcameramodelsatyoursite.

Roll

Thecamera’srollanglemustbenearlyequaltozero.Itmeansthattheimageshouldbelevelwiththehorizon.

Fieldofview

Thecamera’seldofviewmustbexed.

Vibrations

Theapplicationtoleratessmallcameravibrations,butyougetthebestperformancewhenthecameraisnotsubjecttovibrations.

Objectsize

Forahumantobedetected,theminimumheightis4%ofthetotalimageheight.Foravehicle,theminimumheightis3%ofthe

totalimageheight.However,thisrequiresperfectimageconditionsandnoobstructionstotheview.Tominimizetheriskofmissed

detections,werecommendaheightofatleast8%forhumansand6%forvehicles.

AXISObjectAnalytics

Considerations

Objectvisibility

Detectionaccuracycanbeaffected:

•ifobjectsareonlypartiallyvisibledueto,forexample,foliage.It’sparticularlyimportantthatcharacteristicfeatures,

suchaslegsorwheels,arevisible.

•whenthesceneiscrowdedwithobjects.Forexamplewhenthere’satrafccongestion.

•whenyouusethetimeinareafunctionalityBETA:ifobjectsfrequentlyoverlapeachother.

Contrast

Thereneedstobeacertainlevelofcontrastbetweenobjectsandthebackground.Fog,directlightshiningonthecamera,oran

overlynoisyimagecancausecontrastissues.Youcanincreasethelevelofilluminationandadjusttheimagesettingstoimprove

thelevelofcontrast.

•Whenyouuseaday-and-nightcamerawitharticiallighting,werecommendatleast50luxintheentiredetectionarea.

•Whenyouusebuilt-inIRlighting,themaximumdetectiondistancedependsonthecameraandtheenvironment.

AXISObjectAnalytics

Considerations

Expectedmovementofobjectsinthescene

Objectsthatapproachthecamerainastraightlineneedtomoveforalongertimebeforetheygetdetectedcomparedtoobjectsthat

moveperpendiculartothecamera’seldofview.

Humanpose

Humansneedtomoveinasomewhatuprightposition.

Objectmotion

Objectsneedtomovewithinthesceneforatleast2seconds.

AXISObjectAnalytics

Considerations

Recommendedimagesettings

Beforeyoustarttousetheapplication,werecommendyoutoturnonForensicWDRandbarreldistortioncorrection,ifthey

areavailableforyourcamera.

Theimagetotherightisanexampleofbarreldistortion.Barreldistortionisalenseffectwherestraight

linesappearincreasinglybentclosertotheedgesoftheframe.

Conditionswheredetectionscanbedelayedormissed

•Fog

•Directlightshiningonthecamera

•Inadequatelight

•Overlynoisyimage

Situationsthatcantriggerfalsealarms

•Partiallyhiddenpeopleorvehicles.Forexample,asmallvanthatappearsfrombehindawallcanlooklikeaperson

sincethevehicleishighandnarrow.

•Insectsonthecameralens.Notethatday-and-nightcameraswithinfraredspotsattractinsectsandspiders.

•Acombinationofcarheadlightsandheavyrain.

•Human-sizeanimals.

•Stronglightcausingshadows.

AXISObjectAnalytics

Getstarted

1.Logintotheproduct’swebpageasanadministratorandgotoSettings>Apps>AXISObjectAnalytics.

2.Selecttheapplication.

3.StarttheapplicationandclickOpen.

4.Inthewelcomescreen,clickStep-by-steptofollowtherecommendedsetupprocedure.

5.Instep1,readthroughtheconsiderations.

6.Instep2,selectifyouwanttheapplicationtodetecthumans,vehicles,orboth.ReadmoreaboutClassicationof

objectsonpage12.

7.SelectifyouwanttheapplicationtodetectwhenobjectsmoveorstayforlongerthanasettimeBETAinsideadenedarea,

orwhentheycrossadenedline.Ifyouwanttolearnmore,seeObjectinareaonpage13andLinecrossingonpage15

8.ForPTZcameras,youcanchoosetorestrictdetectiontoaspecicpresetposition.Selectitfromthelist.

9.Adjustthedefaultlinethatobjectsneedtocross,ortheareawhereobjectsneedtomove.

Tondouthowtoadjustthedefaultlineorincludearea,seeAdjustvirtuallineorareaonpage9.

10.Instep3,verifyyoursettings.

Youhavenowcreatedonescenario.Torenameormodifyit,clickOpen.

Tocreatemorescenarios,click+.

Towatchthisvideo,gotothewebversionofthisdocument.

www.axis.com/products/online-manual/62075#t10056465

Createscenario:objectinarea

Towatchthisvideo,gotothewebversionofthisdocument.

www.axis.com/products/online-manual/62075#t10056465

Createscenario:timeinarea

AXISObjectAnalytics

Getstarted

Towatchthisvideo,gotothewebversionofthisdocument.

www.axis.com/products/online-manual/62075#t10056465

Createscenario:linecrossing

Adjustvirtuallineorarea

•Toreshapeavirtuallineorarea,clickanddragoneoftheanchorpoints.

•Tomoveavirtuallineorarea,clickanddrag.

•Toremoveacorner,right-clickthecorner.

Virtualline

•Toresetthevirtuallinetoitsdefaultsize,clickScene>Resetline.

•Tochangethedirectionthatobjectsshouldmovetobedetected,clickScene>Changetriggerdirection.Theredarrows

nexttothelineshowthecurrentdirection.Actionstriggerwhenobjectscrossthelineinthedirectionofthearrows.

Area

•Toresettheincludeareatoitsdefaultsize,clickScene>.

•Tocreateanareainsidetheincludeareawhereyoudon’twantobjectstobedetected,clickScene>Addexcludearea.

AXISObjectAnalytics

Conﬁguretheapplication

Modifyascenario

Tomodifyascenario,clickScenariosandclickOpeninthescenariocard.

•Torenamethescenario,click.

•Tochangewhattypeofobjectstodetect,clickTriggeringobjects.

Note

IfyouselectAnymotion,theapplicationdoesn’tclassifyobjects.Instead,theapplicationdetectsanyobjectthatmovesin

thescene.Itcan,forexample,beanimals,swayingfoliage,ags,orshadows.Toignoresmallobjectsorobjectsthatonly

appearforashorttime,youcanuselters.Formoreinformation,seeFiltersonpage20.

•InanObjectinareascenario:Toallowobjectstostayinsidetheincludeareaforacertaintimebeforetheapplication

triggersanaction,clickTriggeringobjectsandturnonTimeinareaBETA.Settheallowedtime.

•Toadjustthevirtuallineorarea,clickScene.

Calibrateperspective

Ifthescenehasasignicantdepth,youneedtocalibratetheperspectivetoremovefalsealarmsduetosmallobjects.During

calibration,theapplicationcomparestheheightoftheobjectsastheyappearintheimagewiththeactualheightsofthe

correspondingphysicalobjects.Theapplicationusesthecalibratedperspectivetocalculatetheobjectsize.

Placeverticalbarsintheimagetocalibrateperspective.Thebarsrepresentphysicalobjectsatdifferentdistancesfromthecamera.

1.GotoSettings>Advanced>Perspectiveandclick+.

2.Intheliveview,choosetwoobjectsofthesame,knownheight,thatarelocatedonthegroundandatdifferentdistances

fromthecamera.

Youcanuse,forexample,fencepolesorahuman.

3.Placethebarsbytheobjectsandadjustthelengthofeachbartotheheightoftheobject.

AXISObjectAnalytics

Conﬁguretheapplication

4.Selectthescenariosyouwanttoapplytheperspectiveto.

5.EntertheheightoftheobjectsinPerspectivebarheight.

6.ClickSave.

Example

Ifthereisafencewith2meterhighpolesextendingfromthecameratowardsthehorizon,positionthebarsatthefencepoles,

adjusttheirlengthsandenter200cm(6ft7in)intheelds.

Important

Makesurethebarsdon’toverlapeachotherinheight.

Addburnt-inmetadataoverlaystovideostreams

Toshowtheeventthatwasdetectedintheliveandrecordedvideostream,turnonmetadataoverlay.Whenyouturnonmetadata

overlaytheapplicationshows:

•Arectanglearounddetectedobjects.

•Theareaorlineofthescenariowheretheobjectwasdetected.

Ifyouturnontrajectories,theapplicationalsoshowsalinethatoutlinesthepaththatanobjecthastaken.

Ifseveralscenariosgettriggeredatthesametime,overlaysareshownforalloftheminallstreamswiththatselectedresolution.

Important

Themetadataoverlaysareburntinalarmoverlaystotheselectedresolutionofthevideostream.Youcan’tremovethem

fromrecordedvideo.

Note

Ifyouuseviewareas,themetadataoverlaysonlyappearintherstviewarea.Thedefaultnameoftherstviewareais

Viewarea1.

1.Intheapplication’swebpage,gotoSettings>Advancedand,dependingonyourcamera:

-TurnonMetadataoverlay.

-UnderMetadataoverlay,selectinwhichresolutionburnt-inmetadataoverlaysshouldappear.Youcanonly

selectoneresolutionandthesettingappliestoallscenarios.

2.Toshowthepathanobjecthastaken,selectTrajectories.

RestrictdetectiontoaPTZpresetposition

ForPTZcameras,youcanrestrictdetectiontoaspecicpresetposition.

1.GotoScenariosandclickOpeninascenariocard,orclick+tocreateanewscenario.

2.ClickSceneandselectapresetpositionfromthelist.

Note

Eachtimethepresetpositionchanges,theapplicationneedstorecalibrate.Werecommendyoutowaitatleast15seconds

beforeyouchangebetweenpresetpositionsinaguardtour.

AXISObjectAnalytics

Learnmore

Classicationofobjects

Theapplicationcanclassifytwotypesofobjects:humansandvehicles.Theapplicationshowsarectanglearoundclassiedobjects.

Objectsclassiedashumansgetaredrectangle,andobjectsclassiedasvehiclesgetabluerectangle.

Forcameraswithdeeplearning,vehiclescanbefurthercategorizedintotrucks,buses,cars,andbikes.

IfyouusethetimeinareaBETAfunctionality,therectangleisyellowuntilthetimeconditionhasbeenfullled.Iftheobjectthen

staysinsidetheincludeareaforanother30seconds,therectanglebecomesdashed.

Eachclassiedobjecthasapointofdetectionthattheapplicationusestodecideifanobjectisinsideoroutsideanincludeareaor

whenitcrossesavirtualline.Forahuman,thepointofdetectionisatitsfeet,andforavehicleit'satitscenter.Ifahuman'sfeetora

vehicle'scentergetsobstructedfromthecamera'sview,theapplicationmakesanassumptionofthelocationofthepointofdetection.

Note

Werecommendyoutotaketheassumedlocationofobjects'pointofdetectionintoconsiderationwhenyoudrawthe

includeareaorvirtualline.

Forthebestpossibleresults:

•Atsomepoint,theentireobjectneedstobevisibleinthescene.

•Theobjectneedstobeinmotionwithinthesceneforatleast2seconds.

•Forcameraswithmachinelearning,humansneedtomoveinasomewhatuprightposition.Forcameraswithdeep

learning,thisisnotarequirement.

AXISObjectAnalytics

Learnmore

•Theupperbodyofahumanneedstobevisible

•Objectsneedtostandoutfromthebackground

•Reducemotionblur.

Objectinarea

WhenyouusethetriggerconditionObjectinarea,theapplicationdetectsobjectsthatmoveinsideadenedarea.Thisareais

calledanincludearea.

YoucanturnontimeinareaBETAtosetatimelimitforhowlonganobjectisallowedtostayinsidetheincludeareabeforethe

applicationtriggersanaction.Whenanobjectenterstheincludearea,thecounterstarts.Iftheobjectmovesoutoftheincludearea

beforethesettimelimitisreached,thecounterresets.It’stheobject’spointofdetectionthatmustbeinsidetheincludeareaforthe

countertokeepcounting.ThetimeinareaBETAfunctionalityissuitableforareaswherehumansorvehiclesareonlysupposedto

stayforashortwhile,liketunnelsorschoolyardsafterhours.

Includearea

Theincludeareaistheareawheretheapplicationdetectsselectedobjecttypes.Theapplicationtriggersactionsforobjectsifits

pointofdetectionisinsidetheincludearea.Theapplicationignoresobjectsthatareoutsidetheincludearea.

Reshapeandresizetheareasothatitonlycoversthepartofthescenewhereyouwanttodetectobjects.Ifyouusethetimein

areaBETAfunctionality,it’simportanttoonlyincludepartsofthescenewhereobjectsdon’tfrequentlyoverlapeachother.Thedefault

includearearectanglecanbechangedtoapolygonwithupto10corners.

Recommendation

Ifthere’sabusyroadorsidewalkclosetotheincludearea,drawtheincludeareasothatobjectsoutsidetheincludeareadon’t

accidentallygetdetected.Thismeansyoushouldavoiddrawingtheincludeareatooclosetothebusyroadorsidewalk.

AXISObjectAnalytics

Learnmore

Excludeareas

Anexcludeareaisanareainsidetheincludeareainwhichselectedobjecttypesdon’tgetdetected.Useexcludeareasifthereare

areasinsidetheincludeareathattriggeralotofunwantedactions.Youcancreateupto5excludeareas.

Move,reshape,andresizetheareasothatitcoversthedesiredpartofthescene.Thedefaultrectanglecanbechangedtoa

polygonwithupto10corners.

Recommendation

Placeexcludeareasinsidetheincludearea.Useexcludeareastocoverareaswhereyoudon’twanttodetectobjects.

AXISObjectAnalytics

Learnmore

Linecrossing

WhenyouusethetriggerconditionLinecrossing,theapplicationdetectsobjectsthatcrossavirtuallydenedline.

Thevirtuallineisayellowlineintheimage.Objectsoftheselectedtypethatcrossthelineinacertaindirectiongetdetected.The

redarrowsonthelineshowthecurrentdirection.Actionstriggerwhenobjectscrossthelineinthedirectionindicatedbythearrows.

Totriggeranactiontheobjectmustcrosstheline.Asshownintheillustration,theobject’spointofdetectionmustcrossthelinefor

theactiontotrigger.Objectsthatonlytouchthelinedon’ttriggeractions.

•Intheillustrationtotheleft,themandoesn’ttriggeranaction,ashispointofdetectionhasnotyetcrossedtheline.

•Intheillustrationtotheright,themantriggersanaction,ashispointofdetectionhascrossedtheline.

Forinformationaboutthepointofdetection,seeClassicationofobjectsonpage12.

AXISObjectAnalytics

Learnmore

Virtuallinerecommendations

Adjustthevirtuallinesothat:

•objectsareclearlyvisibleintheimagebeforetheycrosstheline.

•anobject’spointofdetectionislikelytocrosstheline.

•objectscan’tentertheprotectedareawithoutpassingtheline.

AXISObjectAnalytics

Integration

SetupalarmsinAXISCameraStation

ThisexampleexplainshowtosetuparuleinAXISCameraStationtoalerttheoperatorandrecordvideothatincludesmetadata

overlayswhenAXISObjectAnalyticsdetectsanobject.

Beforeyoustart

Youneed:

•anAxisnetworkcamerawithAXISObjectAnalyticssetupandrunning,seeGetstartedonpage8.

•metadataoverlaysturnedonintheapplication,seeAddburnt-inmetadataoverlaystovideostreamsonpage11.

•acomputerwithAXISCameraStationinstalled

Towatchthisvideo,gotothewebversionofthisdocument.

www.axis.com/products/online-manual/62075#t10145372

AddthecameratoAXISCameraStation

1.InAXISCameraStation,addthecamera.SeetheusermanualforAXISCameraStation.

Createadeviceeventtrigger

1.ClickandgotoConguration>Recordingandevents>ActionrulesandclickNew.

2.ClickAddtoaddatrigger.

3.SelectDeviceeventfromthelistoftriggersandclickOk.

4.IntheConguredeviceeventtriggersection:

-InDevice,selectthecamera.

-InEvent,selectoneofthescenariosforAXISObjectAnalytics.

-InTriggerperiod,setanintervaltimebetweentwosuccessivetriggers.Usethisfunctiontoreducethenumber

ofsuccessiverecordings.Ifanadditionaltriggeroccurswithinthisinterval,therecordingwillcontinueandthe

triggerperiodstartsoverfromthatpointintime.

5.InFilters,setactivetoYes.

6.ClickOk.

Createactionstoraisealarmsandrecordvideo

1.ClickNext.

AXISObjectAnalytics

Integration

2.ClickAddtoaddanaction.

3.SelectRaisealarmfromthelistofactionsandclickOk.

Note

Thealarmmessageiswhattheoperatorseeswhenanalarmisraised.

4.IntheAlarmmessagesection,enteranalarmtitleanddescription.

5.ClickOk.

6.ClickAddtoaddanotheraction.

7.SelectRecordfromthelistofactionsandclickOk.

8.Inthelistofcameras,selectthecameratouseforrecording.

Important

Toincludemetadataoverlaysintherecording,makesureyouselectaprolewiththesameresolutionastheoneselectedfor

metadataoverlaysintheapplication.

9.Selectaproleandsettheprebufferandpostbuffer.

10.ClickOk.

Specifywhenthealarmisactive

1.ClickNext.

2.Ifyouonlywantthealarmtobeactiveduringcertainhours,selectCustomschedule.

3.Selectaschedulefromthelist.

4.ClickNext.

5.Enteranamefortherule.

6.ClickFinish.

Note

Toseethemetadataoverlaysintheliveview,makesureyouselectthestreamingprolethatmatchestheoneyouset

intheapplication.

Recordvideowhenanobjectgetsdetected

ThisexampleexplainshowtosetuptheAxisdevicetorecordvideotoanSDcardwhentheapplicationdetectsanobject.

1.Inthedevice’swebinterface,gotoAppsandmakesuretheapplicationisstarted.

2.TocheckthattheSDcardismounted,gotoSystem>Storage.

3.GotoSystem>Eventsandaddarule.

4.Typeanamefortherule.

5.Inthelistofconditions,underApplication,selecttheapplicationscenario.Totriggerthesameactionforallscenarios,

selectObjectAnalytics:AnyScenario.

6.Inthelistofactions,underRecordings,selectRecordvideo.

7.Inthelistofstorageoptions,selectSD-DISK.

8.SelectaCameraandaStreamprole.

AXISObjectAnalytics

Integration

Toshowmetadataoverlays,makesureyouhaveturneditonintheapplicationforthesameresolutionthatisin

thestreamprole.

Note

Wedon’trecommendyoutouseascenariowithtimeinareaBETAtotriggerrecordingsifthetimeanobjectisallowedtostay

insidetheincludeareaismorethan30seconds.Thereasonisthatit’schallengingtouseaprebuffertimelongerthan30

seconds,whichisrequiredifyouwanttoseewhathappenedbeforetheobjectwasdetected.

9.Ifyouwanttostarttherecordingbeforetheobjectwasdetected,enteraPrebuffertime.

10.ClickSave.

11.Totesttherule,gototheapplication’swebpageandopenthescenario.ClickTestalarm.Thisgeneratesanevent,asifthe

scenariohadtriggeredforreal.Ifyouhaveturnedonmetadataoverlays,aredorbluerectanglewillshow.

AXISObjectAnalytics

Troubleshooting

Problemsdetectingobjects

...whenimageisunstableTurnonElectronicimagestabilization(EIS)intheImagetaboftheproduct’swebpage.

...atimageedges,wherethe

imagelooksdistorted

TurnonBarreldistortioncorrection(BDC)intheImagetaboftheproduct’swebpage.

...immediatelyObjectsneedtobefullyvisibleinthescenebeforetheycanbedetectedbytheapplication.

...inothersituationsItcouldbebecausetheobjectsmeltintothebackgroundiftheyarethesamecolor,orbecause

thereisbadlightinthescene.Trytoimprovethelight.

Problemswithfalsealarms

...duetosmallanimalsthat

appearlargeintheimage

Calibratetheperspective.SeeCalibrateperspectiveonpage10.

Problemswithmetadataoverlays

...onasecondclientMetadataoverlaysareonlyvisibleforoneclientatatime.

Problemswiththevideostream

...onFirefoxbrowser

forcameraswithhigh

resolutions

TryGoogleChrome™browserinstead.

Filters

Ifyouhavesetuptheapplicationissetuptodetectanymotion,youmayexperiencefalsealarms.Youcanthenuselters.

Short-livedobjects-Usethistoignoreobjectsthatonlyappearintheimageforashortperiodoftime.

Smallobjects-Usethistoignoresmallobjects.

Swayingobjects-Usethistoignoreobjectsthatonlymoveashortdistance.

Filterrecommendations

•Filtersareappliedtoallmovingobjectsfoundbytheapplicationandshouldbesetupwithcaretomakesurethat

noimportantobjectsareignored.

•Setuponelteratatimeandtestitbeforeyouturnonanotherlter.

•Changetheltersettingscarefullyuntilyou’vereachedthedesiredresult.

Theshort-livedobjectslter

Usetheshort-livedobjectsltertoavoiddetectingobjectsthatonlyappearforashortperiodoftime,suchaslightbeamsfroma

passingcarorquicklymovingshadows.

Whenyouturnontheshort-livedobjectslterandtheapplicationndsamovingobject,theobjectdoesn’ttriggeranactionuntil

thesettimehaspassed.Iftheactionistostartarecording,congurethepre-triggertimesothattherecordingalsoincludesthe

timetheobjectmovedinthescenebeforeittriggeredtheaction.

Page is loading ...

Axis Communications Analytics Detects User manual

Axis Communications Analytics Detects User manual

Axis Communications Analytics Detects User manual

Related papers

Other documents