TheDArk MatterParticleExplorer(DAMPE)- andtheHighEnergyRadiationDetectionfacility(HERD)

XinWuDPNC,UniversityofGeneva,Switzerland

ScienceDataCenterMeeting29September2016,ISDC,Geneva,Switzerland

NeutronDetector(NUD)

PlasticScintillatorDetector (PSD)

Silicon-TungstenTracker(STK)

BGOCalorimeter(BGO)

TheDAMPEdetector

2XinWu

highenergyelectron,γ-ray,andcosmicray

telescope

ü Thickimagingcalorimeter(BGOof32X0 )

ü PrecisetrackingwithSistripdetectors(STK)

ü Tungstenphotonconvertersintracker(STK)

ü ChargemeasurementswithPSDandSTK

ü ExtrahadronrejectionwithNUD

�

Firsttime3in1!

ScientificobjectivesofDAMPE

• Highenergyparticledetection inspace– MeasurethehighenergycosmicelectronandgammaspectraandsearchforDarkMattersignatures

– Studyofcosmicrayspectrumandcomposition– Highenergygammarayastronomy

3

Detectionof1GeV- 10TeVe/γ,100GeV- 100TeV cosmicrayswithexcellentenergyresolution,directionreconstruction (γ)andchargemeasurement

XinWu

Electronflux

4

Detectionof1GeV- 10TeVe/γ,100GeV- 100TeV cosmicrayswithexcellentenergyresolution,directionreconstruction (γ)andchargemeasurement

XinWu

DAMPE3years,projection

Protonsandnuclei:DAMPE3years

5XinWu

proton helium

B/C

p to Fe

TheDAMPEdetectorinreal

6XinWu

Weight:1450/1850kg(payload/satellite)Power:300/500W(payload/satellite)Readoutchannels:75,916(STK73,728)

Size:1.2mx1.2mx1.0mDatarate:16GB/day

�EQM,Oct.2014,CERN Integratedsatellite,Sept.2015,Shanghai

TheDAMPECollaboration• China

– PurpleMountainObservatory,CAS,Nanjing– UniversityofScienceandTechnologyofChina,Hefei– InstituteofHighEnergyPhysics,CAS,Beijing– InstituteofModernPhysics,CAS,Lanzhou– NationalSpaceScienceCenter,CAS,Beijing

• Switzerland– DPNC,UniversityofGeneva,Switzerland

• Italy– INFNPerugiaandUniversityofPerugia– INFNBariandUniversityofBari– INFNLecceandUniversityofSalento

7XinWu

Firstlaunchofthe5approvedscientificsatellitesoftheChineseAcademyofSciences

8XinWu

STK:DPNCresponsibilityDPNCistheleadinghouseofthesilicon-tungstentrackerproject,incollaboration

withINFNPerugiaandIHEP,Beijing

9XinWu

SuccessfullylaunchedonDec.172015!• Altitude:500km

• Inclination: 97.4065�

• Period:95minutes

• Orbit:sun-synchronous

• Pointingprecision0.005�

• Dec.20:alldetectorspoweredon,excepttheHVforPMTs

• Dec.24:HVon!

• Dec.30:stabletriggercondition

• Smoothoperationsince!

10XinWu

• 15 orbits/day• ~50Hzaveragetriggerrate

– Mainhighenergytriggerandprescaled lowenergyandMIPtriggers

Particlehitcountsvsorbit

Date01-01 03-02 05-02 07-02 08-31

Even

ts p

er d

ay

1000

2000

3000

4000

5000

6000310×

All StatisticsHET TriggerHET Trigger W/O SAA

Statistics of Events

11XinWu

• ~5Meventsrecordedperday,triggerrateverystable– Datadown-link:16GB/day– ~100GB/daydataproducedonground

Numberofeventsrecordedperday

STKconst.upload FineDACruns

Mostlystabledata-takingsinceDec.30,2weeksafterlaunch!

BGO total energy [GeV]1 10 210 310 410 510 610

Entri

es

1

10

210

310

410

510

610

710

Not in SAAHigh E triggerLow E triggerMIP trigger

3 months of data (May-July 2016)With fiducial cut DAMPE Preliminary

12XinWu

Lotsofhighenergyparticlescollected

• ~465Meventscollectedfor3months!– ~9.4%inSAA,mainly<1GeV– BulkofdatacollectedbyhighE

trigger,efficient for>10GeV– AlsocollectlargeamountoflowE

(forγ)andMIP(forcalibration)data

~200kTeV (raw)events/year!

Reachingfew100TeV forhighenergyCRphysics:connecttoground-basedextendedair-showerexperiments

�

13XinWu

ChargemeasurementwithPSDandSTK

PSDlowgain readout

PSDhighgain readoutproton

helium

STKchargemeasurement

rCore370.7 0.75 0.8 0.85 0.9 0.95 1

Entr

ies

510

610fiducial cutfiducial cut and raw E>10 GeV

3 months of data (May-July 2016) with rElongi20>0.9 cutDAMPE Preliminary

rCore370.7 0.75 0.8 0.85 0.9 0.95 1

Entr

ies

500

1000

1500

2000

2500

3000

3500

4000

4500

5000

fiducial cutfiducial cut and track matched

3 months of data (May-July 2016)with rElongi20>0.9 cutraw enegy > 100 GeV

DAMPE Preliminary

• ~15keventsinfittedsignal(2σ)withE>100GeV

– Signalstablewithtrackmatchcut,s/bimproved

Electronandphotons(3months)

14XinWu

trackmatched<10�

• ~24Meventsinfittedsignale/γ (2σ)infullenergyrange

– ~2.2Meventsine/γ signalregionabove10GeV

15XinWu

DAMPE165daysE>1GeVCounts /(0.5�)2 pixelσθ ≈ 0.2�@3GeV

FERMI5yearsE>1GeV

Vela

Crab

Geminga

Gammaraysobserved!

16XinWu

• L0:telemetrypacketsfromthesatellitereceivedby3groundstationstwiceperday(morningandafternoon,~16GB/day)– Automaticallytransferred toGroundSupportSystem(GSS)inBeijing

• L1:payloaddataextractedfromL0,thenmerged,duplicatedfragmentsremovedandCRCchecked– 1dayofdatacanbeprocessedatGSSwithin1hour– NewL1datasynchronizedtoScienceApplicationSystem(SAS)inNanjing

• L2/L3:unpackedandprocessedpayloaddatainrootformat– PerformedatSASinNanjing(PMO)

• L1/L2/L3dataautomaticallytransferred fromPMOtoEurope(CNAFinItaly)– SynchronizedtolocalclusteratDPNC

DAMPEDataPath

L0

L0 L1

L1/2/3

L1/2/3

17XinWu

DAMPEDataProcessingPipeline

*_0013_*.fits

*_0013_*.frd

Mergedfiles

*_PED_*.frd *_DLD_*.frd *_DAC_*.frd *_OBS_*.frd

Data splitting

Data splitting

Data splittingPedestalcalibration Pedestalupdate Gaincalibration Scientificdata

Housekeeping data13filesperdatatransfer

Scientificdata1filesperdatatransfer

e.g.*_011A_*.fits

HousekeepingDataBase

Dataconversion

Calibrationdata

CalibrationDataBase

Data conversionRaw data conversionADCvaluesHousekeepingdata

Reconstructed dataHousekeepingdata

*.root *.rootReconstruction

DatadescriptionDataBase

*.cal

ReconstructiondoneatDAMPESDCatPMO(>1400cores,canreprocess3years

ofdatain~1month)

18XinWu

CollaborativeSoftwareDevelopment• BaseinaSVNcoderepositoryDAMPEsoftwareisstoredintheSVN

servers inChinaandEurope– svnsync isinvokedinPMOserveraftereachcommitrequest– cron jobisrunninginGenevacheckingifservers aresynchronized

http://119.78.211.2:81/SVNDAMPE/rep1/

Master:SVNserverPMO(China)

svnsync

User inChina

svn checkout

svn checkoutsvn commit

svn commit

User inEurope

http://dpnc.unige.ch/SVNDAMPE/DAMPE1/

19XinWu

Datatransferstatus• PMO->CNAF: gridftp

– 6gridftp processes runningallthetimeonadedicatedserver atPMO– Meantransfer rate~6MB/s,dailytransfer:~100GB,~110TB

transferred• MainL2sciencedatastream(2A)~60GB/day

– LeasedconnectionbetweenPMOandtheChinaEducationandResearchNetwork(CERNET)

• Limitedto100Mb/s,OKfordailytransfer~100GB/day• Forreprocesseddata(~11TBfor6 monthsofdata)moreefficienttotransferbyharddrives!

• CNAF->Geneva: rsync– 10lsf jobsrunningallthetimeatCNAF– Dedicateddatatransfer server atDPNC– 70-80MB/s,sobasicallynolatency– Newdatatransfer schemebasedonXRootD isunderdevelopment

20XinWu

DAMPEDPNClocalcluster• SharewiththeATLASTier3clusteratDPNC(alsoIceCube,AMS,T2K)

– Total:~750(+240soon)cores,~360(soon~600)TB– DAMPE:~60TB,>200TBbytheendoftheyear

• DAMPEdatastoredinXRootD andNSFdiskservers– MainscienceandMCdatasetsinXRootD servers forintensiveaccess

• Needagridcertificate– SmallerandtemporarydatasetsinNSFdisk

• Localdataactivities– STKmonitoring,calibration,alignment,trackreconstruction– Protonandheavyionfluxes,electronspectrum,gammarayanalysis

• MCsimulationiscentrallyhandledfromGeneva– acustomdistributedworkflowsubmissionsystemwhichinteractswith

variouscomputingresourcesacrossEurope(CNAF,INFN-Bari,DPNC)• TwoDELLservers runninginstancesforELOG,Doxygen,workflow

submission,datacatalog,databaseserver, …

21XinWu

Datatransferintegrityassurance• AjobrunningatPMO evaluatesmd5checksumsandpushestheresultsto

theDPNCdataserver.– ~30secondsperfile,~30filesperday’sdata

• OntheDPNCrsync server, “agents”– Evaluatesmd5sumsoflocalfiles;– Marksas“good”fileshavingmatchedmd5sumwithPMO– Checksif"good"filesinXRootD serverwiththesamechecksum

• Iffiledoesn'texist(orhasdifferentchecksum),itisuploaded(re-uploaded)toXRootD

• CheckindependentlyeachfileonXRootD hasthesamemd5sumasinPMO• AloopisdonethroughthefilesinPMO,toensurethateachofthemwas

copiedtoGeneva.• Inaddition,everyfileonXROOTDisopenwithROOTbya"crawler",and

basictreesarechecked,toseeiffileisnotcorrupted.

HERD:HighEnergyRadiationDetectionfacility

22XinWu

HERD3nd InternationalWorkshopDec.2-3,2013,Beijing

On board the Chinese Space Station, ~2025

• NextgenerationhighenergyparticledetectoronboardtheChineseSpaceStation

– SimilartoDAMPE,butwithlargeracceptance– 5-sidesensitive!

• AdvancethefrontiersofDMsearch,cosmic-rayphysicsandγ-rayastronomy

– Payload~2000kg,launch~2025,lifetime~10years

• Internationalproto-collaborationformed:China,Switzerland,Italy,Sweden

• X.WuistheTrackerWorkingGroupco-leader• R.Walter(ISDC)istheGamma-rayAstronomy

WorkingGroupco-leader

Bigger,better,longer!

Conclusions

23XinWu

• DAMPEisapowerfulspacetelescopeforhighenergyelectron,γ-ray,andcosmicrays,inoperation!– Detectorhasbeenwellcalibratedbeforelaunch

• On-orbitcommissioninghascompleted– A shortcommissioningperiodthankstotherobustdetectortechnologies

andthehighqualityofconstruction• Smoothcontinuesandalargeamountofgoodqualitydataisbeingcollected• Ratherrobustdataprocessing/reprocessing anddatatransfer schemeshave

beenimplemented• SciencedatainfrastructureatDPNCisinplace

– Dataproductionandanalysisareinfullswing!• Similarinfrastructureisneeded forHERD

24XinWu

DAMPEOfflineSoftwareFramework• DAMPEofflinesoftwareframeworkisinspiredbytheGAUDIphilosophy

(http://proj-gaudi.web.cern.ch/proj-gaudi/)– ThecorepartisimplementedinC++– ManagementpartisdoneinPython

• Thecentralcomponentofframeworkisthealgorithmbaseclass– Allalgorithmsareinheritedfromthebaseclass,includingalgorithms

fortheconversionofbinarydata,simulation,andreconstructions• Severalcoreservices:

– algorithmmanager,input-output service (basedonROOT),geometrymanager,…

• GeometrymanagerallowsforloadingDAMPEread-outgeometryfromtheXMLdatabasewithoutusingGeant4libraries– Reducingsignificantlytheoverheadofinitializingthereconstruction

andanalysisjobs

25XinWu

SomeSoftwareFrameworkDetails• Simulationisimplementedasadedicatedalgorithm,basedonGeant4• Allthesupportingstructuresofthedetectorareimplementedinthe

geometry,directlyfromtheCADdrawings,usinga customCAD-to-GDMLconvertor

• AllDAMPEofflinejobsareconfiguredviajoboptionfileswritteninPython– Boost-pythonlibrariesareexploitedforaccessingtheC++codefrom

Python• Algorithmscanbestackedtogetherinsideajoboption,formingasequence• IO-service actsasadatabuffer forcommunicationbetweenalgorithms,and

forreading(writing)theinput(output)datatotheROOTfiles– IO-service isagnosticofwhetherdatacomesfromtheinputfileorasan

outputofprecedingalgorithminasequence• Configurationfilesareusedtostoretheconfigurationparameters

– Allowsforexplicitversioning(tagging)ofdata-productioncampaigns

26XinWu

Algorithm Base ClassC++

…Simulation(Alg1)

import DampeCore as Core

#Algorithm sequenceCore.Add(Alg1)Core.Add(Alg2)...Core.Add(AlgN)

#Ancillary servicesCore.Add(GeometryMgr)Core.Add(ConfigMgr)

#Code executionCore.Initialize()Core.RunEventLoop()Core.Finalize()

Input-OutputService(ROOT)

Job Description Files (Python)

Input data (ROOT)

Output data (ROOT)

Reconstruction(Alg2)

etc.(AlgN)

DetectorGeometry(GDML)

CADdrawings(.STEP)

Simulation.cfgReconstruction.cfgetc.

Configuration Manager C++

Geometry Manager C++

BlockDiagramofDAMPESoftware

27XinWu

# Info Folder Description1 Single

transferdata1AM Testbinarydata

2 1E Rawdata(ADChits,HCdata).Rootformat

3 2Q Reconstructeddataforfastmonitoring(clusters,tracks, etc.)

4 1BS Binarydata

5 Multitransfermergeddata

1A Binarydata

6 1C Pedestal,MIPs andObservation SciencePackets

7 1B Binarydata

8 1F Rawdata(ADChits,HCdata),ROOTformat

9 2A Reconstructeddata(calibrated energies,hits,tracks,etc.)

10 1D Pedestal,MIPs andObservation SciencePackets

11 1Q BGO calibrationdataandplots

12 Calibration CAL Calibrationconstants

13 Configuration Config Joboptions usedfordataprocessing

14 Positioninformation

EE Satelliteposition(longitude,altitude,X,Y,Z), speed(Vx,Vy,Vz)

15 EF Testpositiondata

16 Orbitsimulationinformation

OA Orbitinformation16h-00hoftheprevious day

17 OI Orbitinformation00h-08hofthecurrentday

18 OL Orbitinformation00h-08hoftheprevious day

19 ---- Productlist Empty

20 ---- Sub Empty

21 ---- TE Satellitetestdata

22 ---- TM Documentation