ODR_LLR_2008-07-29

ODR Status

29 July 2008



Matt Warren

Valeria Bartsch, Barry Green, Andrzej Miesijuk, Tao Wu

Hardware/Firmware



• ODR is working(!)

–Receive data on 4x fibre (RX),

–Write to disk FAST (250MB)

–Send data up fibre (TX)

–Controlled from Linux driver





• Future upgrade: Decode event header from LDA

–Provides on-line info

–Can deal with control messages from LDA

–Allows host to write to disk without processing







29 Jul 08 Matt Warren & Co. - ODR Starus 2

Software Status

ODR receiver: program running on a host machine. Communicate

with ODR cards,retrieves the data, sets up ODR card

parameters.



Progress in the following areas:



• Data transferred from ODR memory -> host memory->to disk

(rate 250 MB/s for event fragment 2 kB

• Tested sending messages (Tx message to LDA)

• Interface to DOOCS and processing messages:

DOOCS->ODR receiver ->ODR, ODR receiver-> DOOCS:

a) Setting up parameters: ODR Receiver and ODR card

b) Passing ODR statistics back to DOOCS

c) Passing commands to ODR receiver (start, stop,pause, etc)‫‏‬





29 Jul 08 Matt Warren & Co. - ODR Starus 3

Performance (data to memory)‫‏‬



Simultanious access



800

Transfer rate [MB/s]









600

Ch 0

Ch 0&1

400 Ch 0&1&2

Ch 0&1&2&3

200



0

0 1000 2000 3000 4000

Data size [bytes]







Improvements in performance when accessing more then one channel.

The maximum performance achieved for 3-channels access. Adding additional

Channel (4-channel access) does not yield improvement in transfer rate.



29 Jul 08 Matt Warren & Co. - ODR Starus 4

Performance

400



350

Top:Data to memory

300

All other: data to disk:

250 a) best performance-

Rate [MB/s]









data2mem



200

data2disk scat-gath scatter gather- data

data2disk buf150

data2disk buf130

copied to up to 80

150

buffers, then written

100

to disk.

50



0

Two lower curves: data

0 1000 2000 3000 4000 to a single memory

Data size [bytes] buffer, then copied to

disk.



Single channel.

Data written to RAID array. Maximum bandwidth for the array: 300 MB/s.

Adding active channel has no effect on the rate (remain constant).

Best performance for scatter-gather scenario.





29 Jul 08 Matt Warren & Co. - ODR Starus 5

Interface to DOOCs





Tx LDA msg Supervisor DOOCS







DMA FIFO to user

buffer FIFO Two way

Dup. communication

ODR

VHDL code

Requester

Data

DOOCS

Data

Buff Interface

Data

Buff

DMA data to user buffer(s)‫‏‬ Buff

(host memory)‫‏‬



Hardware ODR From DOOCS perspective, everything to right of

line‫‏‬is‫“‏‬ODR”

29 Jul 08 Matt Warren & Co. - ODR Starus 6

Future Development







• Improve DOOCS GUI.

• Add (DOOCS) plots of basic ODR statistics ( on-line).

• Create event fragment data base (inside DOOCS ?)‫‏‬

• Test‫‏‬connectivity‫‏‬to‫‏‬LDA‫‏‬with‫‏‬the‫“‏‬real”‫‏‬LDA‫‏‬

hardware









29 Jul 08 Matt Warren & Co. - ODR Starus 7