CAT Chat Minutes

November 10, 2003

 

General Information

Machine Stats -  R. Klaffky:

Delivered beam 793.42 hrs.
Percent of scheduled time 96.06%
Downtime during period 32.55 hrs.
Mean Time Between Faults (MTBF) 44.08 hrs.

Machine faults:

# 33  11/04 08:00  To  11/04 16:24    8.40   PEM Steering Error [OAG]   0.29 Refill, resume top-up
# 34  11/04 16:41  To  11/08 23:55  103.23   SR-RF4 Trip [RF]   0.33 Power monitor trip, reset, refill, resume top-up
# 35  11/09 00:15  To  11/09 01:34    1.32   UPS Fault [IT]   9.73 recovery of systems, refill, resume top-up
# 36  11/09 11:18  To  11/10 00:09   12.85   UPS Fault [IT]   6.53 UPS by-passed, recovery, refill, resume top-up
# 37  11/10 06:41  To  11/10 08:59    2.31   Int Dump: End of Period    0.00 

Beamline Downtime Report:  Summary period 10/31 - 11/06/2003

Number

Date

Time

Beamline

Description

Downtime

Group

000280

10/31/03

04:50

05-ID

Significant orbit change requiring call to machine physicist

1:30

OPS

000286

11/01/03

23:40

10-12

IOC Reboot affecting sectors 10-12

0:07

OPS

000281

11/03/03

08:00

-
Leak in integral shutter requiring repair and revalidation

8:04

Beamline

000282

11/04/03

08:00

-
BP adjusted flow to component, causing water fault

0:27

Beamline

000285

11/06/03

13:00

08-ID

Network problem impacting secondary tasks (data collection)

2:30

IT

UPS Faults - B. McDowell:  New air conditioner in computer room being installed.  UPS is behind computer room and being cooled by a portable fan.  The fan was removed by someone, which caused heat damage to the UPS.  A battery needed to be replaced and logs showed interruption of power.  We are now bypassing the UPS system until the cause is determined.

RESPONSE TO UPS SYSTEM OUTAGE (11/10/03)

Submit change order to ongoing ac upgrade in computer room to include enlarged ductwork into UPS area.

Split the sytems so that Storage Ring and Zone F will be on their own UPS. This will shorten the recovery time since all accelerator systems would not have to be searched and secured after UPS fault.

Upgrade UPS in Control Room to a true "in-line"(3 phase) system from the present system where power loads must be de-energized before the UPS can be bypassed. There is a "break-before-make" switch at present on the single phase systems.

Emergency Access Policy Draft Following is the viewgraph Roger showed regarding the proposed policy.

EMERGENCY ACCESS POLICY (draft)

If an ID and/or front-end fault prevents a beamline from conducting normal operations, but has no operational impact on the storage ring or presents no safety implications to the facility or personnel, any access to the ring to diagnose and repair the fault will be made under the following conditions:

If there is a machine intervention period planned within 48 hours of the time the fault occurs, then the repair will occur during the machine intervention period.

If there is not a machine intervention period within 48 hours of the fault, then the local beamline group affected by the fault can request an access starting at 4am with exit from the tunnel at a time that will allow beam injection by 7am. Such a request must be made by noon on the day prior to the access. The APS will notify users of the access by 3 pm and will be discussed at daily 4 pm MCR meeting.

The AOD Director or his designee will review and approve all such repair requests.

User questioned use of term experimental groups as incorrect and should be replaced with local beamline group.  Roger agreed to make this change (it is already incorporated in text below.) It was also requested that the access occur during the 4-7am time slot.  These changes are incorporated in the draft. Thomas Gog asked how often a policy such as this is actually needed.  He was answered by Roger that, although it is not often, we do need to set a policy.

Orange tag was shown by Bob Dortwegt - The ME group will begin use of these tags to identify water valves that control water to critical beamline components.  The color orange was chosen because all critical systems currently use orange tags.  Additionally, he asks that no changes in water flows be made until the floor coordinator has been notified prior to adjustments.

Safety - E. Chang:  Elroy highlighted the following:

Laser Presentation - We will have a series of presentations here at ANL to educate/instruct on laser safety.  The dates are:  December 2nd, building 200; and December 4, building 402. 

Electrical Waste Form - Work on the waste form continues.  Jeff Alicz is providing step-by-step instructions. 

Transfer of Materials - We do not have a formal procedure for CAT members to use when leaving ANL, therefore, contact E. Chang for help if needed. Elroy can be reach at ext. 6714.