sls/gitea-pages
0
1
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
main
gitea-pages/docs/machine/bdm.md
armborst_f 88564c3d73 fix broken links
2025-10-15 10:31:17 +02:00

180 KiB
Raw Permalink Blame History

Minutes of the SLS 2.0 Beam Development Meetings

04/08/2025

Participants: {{Volker}}, {{RomainG}}, {{Hans}}, {{Masamitsu}}, {{Lukas}}, {{Jonas}}, {{Simona}}, {{MartinB}}, {{Boris}}, {{Michael}}, {{Felix}}

  1. Introduction

    • Approval of last minutes

      • All those present confirm the minutes of the last meeting

    • Communication

      • Please keep voices down in the control room and go elsewhere for intense discussions
      • Please send shift requests ahead of the BDM meetings. Then I can prepare a preliminary schedule for discussion in the meeting.
      • The current machine schedule is available on a dedicated subsite of the SLS 2.0 Operations Management website:
      • Machine Shift Reports
        • Please prepare shift reports in elog. If you send me a mail with the link I will add the link to the machine shifts table.
      • Please remember to always keep the control room informed, i.e.,
        • call the operators before starting and after finishing your shift
        • call the operators before starting and after finishing maintenance or update work on your HW, FW, SW, ....
        • make sure that any changes you have made are documented in the elog, e.g., bridges
        • announce spontaneous on-site shifts, e.g., over the weekend or night in advance to the control room (either you or me should give the operators a call before you arrive)

  2. Reports

    • Operation / Vacuum Conditioning by {{Felix}}

      • Summary of Machine Activities since last BDM

        • BPM/OFB development
        • Timing/FPFB development
        • BAGA

      • Incidents/Issues

        • 2 Further dangerous beam loss incidents at 200 and 140 mA with majority of losses located at collimators instead of beam dump occurred
          • now at 5 in total:
            • Misfiring of individual kicker during turning off 4 Kicker Bump at 400 mA (EPICS procedure to prevent this is implemented)
            • Misfiring of individual kicker during timing development due to wrong delay settings
            • Writing NAN to corrector magnets from FOFB
            • 2 x writing bad values to quadrupole setpoints (Fast orbit detection might prevent this in future but not if tune moved to 0.5)
          • during an MD shift large changes were applied to the setpoints of quadrupoles in one step
            • such studies must be done at below 50 mA
            • such studies must be prepared with incremental steps and checking of tune/lifetime/orbit/beam size after each step to decide if the next step is possible: lifetime below 1 hour and tunes close to (half-) integer resonances need to be avoided and orbit deviation should stay below 200 um
        • Overall too many beam dumps encountered - especially from over 100 mA
          • Please only work at the minimum working beam current for your shift and if this is above 100 mA make a plan to avoid or at least minimize beam loss
        • Fast orbit beam dump not yet possible due to AEK FW delivering too many wrong BPM readout values that would trigger beam dumps
        • Decision to turn off RF VME crate for booster teststand klystron
        • ABOMA-B is not required to be cycled 20 seconds before injection otherwise lifetime issue
          • 3 cycles, i.e., 1 second should be enough

      • Interlock Beam Dumps from over 100 mA

        Nr/Time/Link
        mA
        		 BDC Input Shift/Contact Details
        01 - Mon 28-Jul-25 10:32:25 100 VCS MD shift - {{Boris}} VMMG Error in sectors 6, 11
        02 - Tue 29-Jul-25 02:16:38 400 Manual MD shift - {{Jonas}} ...
        03 - Tue 29-Jul-25 06:56:53 100 VCS MD shift - {{Jonas}} VMMG Error in sectors 1, 5, 9
        04 - Tue 29-Jul-25 07:15:37 100 Manual MD shift - {{Jonas}} ...
        05 - Tue 29-Jul-25 08:22:14 100 Orbit MD shift - {{Boris}} ...
        06 - Tue 29-Jul-25 12:24:40 200 Orbit MD shift - {{Simona}} ...
        07 - Tue 29-Jul-25 15:50:03 140 LLRF MD shift - {{Simona}} Majority of losses at Collimators !
        08 - Tue 29-Jul-25 16:42:18 200 LLRF MD shift - {{Simona}} Majority of losses at Collimators !
        09 - Tue 29-Jul-25 19:18:48 400 Manual MD shift - {{Jonas}} ...
        10 - Tue 29-Jul-25 20:07:10 400 Manual MD shift - {{Jonas}} ...
        11 - Wed 30-Jul-25 08:55:12 400 Manual MD shift - {{Michael}} Prepare tunnel access
        12 - Wed 30-Jul-25 15:38:44 400 Manual MD shift - {{Michael}} ...
        13 - Thu 31-Jul-25 07:30:58 400 Manual MD shift - {{Boris}} ...
        14 - Thu 31-Jul-25 11:49:59 100 Manual MD shift - {{Jonas}} ...
        15 - Thu 31-Jul-25 12:06:59 300 FPFB MD shift - {{Jonas}} ...
        16 - Thu 31-Jul-25 12:22:45 400 FPFB MD shift - {{Jonas}} ...
        17 - Thu 31-Jul-25 13:57:46 400 Manual MD shift - {{Jonas}} ...
        18 - Fri 01-Aug-25 10:08:57 400 Manual MD shift - {{Boris}} ...
        19 - Fri 01-Aug-25 18:27:37 350 VCS MD shift - {{Masamitsu}} VMMG error sector 11
        20 - Fri 01-Aug-25 20:35:17 400 LLRF MD shift - {{Masamitsu}} ...
        21 - Fri 01-Aug-25 20:52:02 200 MIS Beamline shift - OP ARS04-MQUA-5730:TEMP-QA-COIL-1-MIS
        22 - Fri 01-Aug-25 21:15:31 350 MIS Beamline shift - OP ARS04-MQUA-5730:TEMP-QA-COIL-1-MIS
        23 - Fri 01-Aug-25 21:40:20 200 MIS Beamline shift - OP ARS04-MQUA-5730:TEMP-QA-COIL-1-MIS
        24 - Sun 03-Aug-25 00:32:09 400 Orbit MD shift - {{Boris}} ...

    • Linac/LTB Optimization by {{Volker}}

      • LTB refurbishment started
        • 3D CAD Model starting mid August
        • adapter plates for magnet supports
        • adaption of vacuum system for smaller bore diameter QA magnets
        • overall it seems installation in shutdown is feasible

    • Storage Ring Optimization by {{Masamitsu}}

      • AN magnet shift to reduce corrector currents in sectors 4, 5, 6 and maybe also 8
      • will start with sector 6 this week Thursday
      • additional BBA measurements done:
        • using sextupoles difficult
        • using additional quads between BPMs confirms alignment plans for sector 6

    • Feedbacks and BPMs by {{Boris}}

      • elog
      • elog
      • elog
      • elog
      • Reference orbit can be changed in GUI
      • BPM sampling rate currently limited to 74 KHz for stable readout
      • Corrector bandwidth 3dB measured to be > 3kHz
      • 90 Hz suppressed by factor of ~5
      • 0 dB point of overall loop currently at 400 Hz, goal is 1 kHz, SLS 1 was 100 Hz

    • Shift Summaries

Minutes written by {{Felix}}

28/07/2025

Participants: {{Simona}}, {{RomainG}}, {{Micha}}, {{Martin}}, {{Michael}}, {{Jonas}}, {{Boris}}, {{Felix}}

  1. Introduction

    • Approval of last minutes

      • All those present confirm the minutes of the last meeting

    • Communication

      • Please keep voices down in the control room and go elsewhere for intense discussions
      • Please send shift requests ahead of the BDM meetings. Then I can prepare a preliminary schedule for discussion in the meeting.
      • The current machine schedule is available on a dedicated subsite of the SLS 2.0 Operations Management website:
      • Machine Shift Reports
        • Please prepare shift reports in elog. If you send me a mail with the link I will add the link to the machine shifts table.
      • Please remember to always keep the control room informed, i.e.,
        • call the operators before starting and after finishing your shift
        • call the operators before starting and after finishing maintenance or update work on your HW, FW, SW, ....
        • make sure that any changes you have made are documented in the elog, e.g., bridges
        • announce spontaneous on-site shifts, e.g., over the weekend or night in advance to the control room (either you or me should give the operators a call before you arrive)

  2. Reports

    • Operation / Vacuum Conditioning by {{Felix}}

    • Storage Ring Optimization by {{Masamitsu}}

      • Parasitic loss/injection studies during beamline development
        • Increase of injection efficiency from ~80% to ~90%
        • Remaining loss seems to be originated in BTR
        • Tight aperture in booster extraction channel
        • elog

    • Feedbacks and BPMs by {{Boris}}

    • Shift Summaries

  3. Requests

    • Monday -> BPM development (SW/FW Upgrade; investigation of 10-20um orbit deviation after power cycle)
    • Donnerstag & Freitag 10-18h -> FOFB development (SW/FW Upgrade; Synchronisation FOFB zu BPMs; check FOFB stability wenn BPMs fail)
    • BRTL dispersion correction + quadrupole scans (+ optics matching): 8 hours
      • Dispersion is slightly non-zero in the “dispersion-free” section. I hope to fix it.
      • No stored beam available during this time
    • BO extraction / SR injection optimization: 4 hours
      • to look for the missing 10%. Main suspect (for me) is the extraction process.
    • [] Booster RF phase ramping: 4 hours
      • Preferably late in the week (might require some from work from LLRF beforehand so I’d like to give them some time)
      • Might require dumping the SR beam
      • Might also require SR RF phase shift but hopefully not since it influences some of Boris’ stuff.

Minutes written by {{Felix}}

21/07/2025

Participants: {{Boris}}, {{Masamitsu}}, {{Jonas}}, {{Martin}}, {{Jesus}}, {{Simona}}, {{Cigdem}}, {{Michael}}, {{Micha}}, {{Felix}}

  1. Introduction

    • Approval of last minutes

      • All those present confirm the minutes of the last meeting

    • Communication

      • Please keep voices down in the control room and go elsewhere for intense discussions
      • Please send shift requests ahead of the BDM meetings. Then I can prepare a preliminary schedule for discussion in the meeting.
      • The current machine schedule is available on a dedicated subsite of the SLS 2.0 Operations Management website:
      • Machine Shift Reports
        • Please prepare shift reports in elog. If you send me a mail with the link I will add the link to the machine shifts table.
      • Please remember to always keep the control room informed, i.e.,
        • call the operators before starting and after finishing your shift
        • call the operators before starting and after finishing maintenance or update work on your HW, FW, SW, ....
        • make sure that any changes you have made are documented in the elog, e.g., bridges
        • announce spontaneous on-site shifts, e.g., over the weekend or night in advance to the control room (either you or me should give the operators a call before you arrive)

    • Proposal for after the summer shutdown

      • Rename BDM to MDM
      • Schedule for Wednesday mornings 10:00
      • Reduce frequency to every 2 weeks
      • Hybrid should be possible

  2. Reports

  3. Requests

    • Test of Event Master Interface to FPFB and of the FPFB
    • Upgrade and test of FOFB firmware and software
    • BPM Tests
    • Error detection using machine learning ({{Simona}})

Minutes written by {{Felix}}

14/07/2025

Participants: {{Boris}}, {{Jonas}}, {{Jesus}}, {{Masamitsu}}, {{Michael}}, {{Simona}}

  1. Introduction

    • Approval of last minutes

      • All those present confirm the minutes of the last meeting

    • Communication

      • Please keep voices down in the control room and go elsewhere for intense discussions
      • Please send shift requests ahead of the BDM meetings. Then I can prepare a preliminary schedule for discussion in the meeting.
      • The current machine schedule is available on a dedicated subsite of the SLS 2.0 Operations Management website:
      • Machine Shift Reports
        • Please prepare shift reports in elog. If you send me a mail with the link I will add the link to the machine shifts table.
      • Please remember to always keep the control room informed, i.e.,
        • call the operators before starting and after finishing your shift
        • call the operators before starting and after finishing maintenance or update work on your HW, FW, SW, ....
        • make sure that any changes you have made are documented in the elog, e.g., bridges
        • announce spontaneous on-site shifts, e.g., over the weekend or night in advance to the control room (either you or me should give the operators a call before you arrive)

  2. Reports

    • Operation / Vacuum Conditioning by {{Felix}}

      • Summary of Machine Activities since last BDM
        • MD on 08/07/2025: FOFB with crossbar switches enabled
        • User operation: Many interruptions throughout the week.
      • Incidents/Issues
        • FOFB: Thu. 10. July, 8 FOFB-induced dumps within 20 minutes:
          • Bad corrector settings when injection
          • Operators re-fill machine -> FOFB auto-enables at 5 mA -> FOFB interlocks
          • Boris has provided procedure to avoid the issue: https://elog-gfa.psi.ch/SLS/61563
        • ABOMA-B: Thu. 10. July, following orbit issues, Operators couldn't fill booster anymore
          • most likely a sequence of human errors led to ABOMA-B losing "forgetting" its ramp. After that, it is hard to recover without ABOMA-B experts.
        • PLC/Vacuum problems in X06DA
          • looks like one or more valves loses communication => interlock
          • sometimes operation can continue immediately after, sometimes only after an hour.
          • reoccurance seemingly random: Saturday was "quiet" while Friday evening and Monday morning was crazy.
          • cause and solution being investigated.
        • PolLux experienced beam jitter during Saturday
          • Machine Physicist contacted in the late afternoon. Nothing to be seen on BPMs/FOFB and nothing done but PolLux reported less jitter.
          • Probably related to announced roadworks on Kantonstrasse.
            • Request: archiving of BPM RMS and peak-to-peak?

      alt text

    • Linac/LTB Optimization by {{Volker}}

      • Optimization of linac on SM-E. Went from "ugly" to "how you would like to have it". 10% increase in transmission by also tuning the injection.
        • works well for low charge, not great for high charge (>300 pC)
      • should still establish high-charge settings for linac. No good compromise between low- and high-charge settings.

    • Feedbacks and BPMs by {{Boris}}

      • New DBPM3 firmware which supports switching of crossbar switches

        • smaller noise
        • enabling crossbars causes offset charges (80 um). Partially suppressed over time. When enabling the interlock must be disabled first.
        • turn-by-turn data has strong modulation. BPMA's are not running with crossbars to allow tune measurements.
        • Boris has technique to remove crossbar switch signal

      • BPM data rate instead from 20 kS/sec to 74 kS/sec.

        • FOFB now runs with 40 kHz.
          • can go up to 50 kHz but missing data is seen. 40 kHz is stable.
        • allows 90 Hz suppression with FOFB by factor 5-10.
        • to be done:
          • use larger gain range of ADC (currently ~20%, would like to test at 50%).
          • configure FOFB to run even if a BPM fails or a POF link fails.

        Slides about FOFB performance

  3. Requests

Minutes written by {{Jonas}}

07/07/2025

Participants: {{Boris}}, {{Hans}},{{Jesus}}, {{Jonas}},{{Masamitsu}}, {{Michael}}, {{Micha}}, {{Simona}}, {{Volker}}

  1. Introduction

    • Approval of last minutes

      • All those present confirm the minutes of the last meeting

    • Communication

      • Please keep voices down in the control room and go elsewhere for intense discussions
      • Please send shift requests ahead of the BDM meetings. Then I can prepare a preliminary schedule for discussion in the meeting.
      • The current machine schedule is available on a dedicated subsite of the SLS 2.0 Operations Management website:
      • Machine Shift Reports
        • Please prepare shift reports in elog. If you send me a mail with the link I will add the link to the machine shifts table.
        • Note: When submitting draft versions of your elog entry please suppress the email notification
      • Please remember to always keep the control room informed, i.e.,
        • call the operators before starting and after finishing your shift
        • call the operators before starting and after finishing maintenance or update work on your HW, FW, SW, ....
        • make sure that any changes you have made are documented in the elog, e.g., bridges
        • announce spontaneous on-site shifts, e.g., over the weekend or night in advance to the control room (either you or me should give the operators a call before you arrive)

  2. Reports

    • Operation / Vacuum Conditioning by {{Jonas}}

      • Summary of machine activities since last BDM, i.e., of KW 27

        • Machine development focused on LLRF and FPFB
        • Milestone experiments for ADDAMS and PX-III
          • FOFB improves beam stability significantly

        alt text

      • Incidents/Issues

        • Temperature interlock Sat. 11:20 at many sensors simultaneously (typical 3500 deg error). ~2 hours downtime

          • ARS01-VTTC-1550:CBI-cu4-MIS, ARS01-VTTC-1550:CBI-cd4-MIS, ARS01-VTTC-1550:CBI-wf1-MIS, ARS01-VTTC-1550:AB-wu1-MIS, ARS01-VTTC-1550:AB-wd1-MIS, ARS01-VTTC-2100:CRU-cu1-MIS, ARS01-VTTC-2100:CRU-cd1-MIS

        • PX-II orbit or Diaphragm moved vertically

          • No clear cause or explanation. PX-II claim diaphragm movement not possible
          • approx. -20 urad vertical bump needed to return beam to position - actually cancels previous bump!
          • PX-II will now check beam position regularly and inform Control Room if it

        • Persistent orbit oscillations - 90 Hz!

          • unrelated to local groundwork - appears also around midnight. Mechanical vibrations of the whole girder+magnet setup.
          • FOFB 0dB point is a little lower than 90 Hz at the moment. To be improved in coming shifts.

    • Timing by {{Boris}}

      • Work on event system on-going. Romain's system recieves list of buckets to inject from FPFB, but still bugs to remove to fill right sequence.

    • Feedbacks and BPMs by {{Boris}}

      • FOFB working stablely. Occasional stops due to corrector window limits.
      • FOFB runs at 8 kHz but BPMs at 20 kSamples. Now possible to sync. BPMs and corretors => faster correction. To be tested.
      • BPM data spikes source is still unknown. Suspect is Firmware but TBC.
      • Crossbar switches can reduce BPM noise significantly, but have not been tested yet together with the feedback. Measurements on BPMA's look good!
        • better noise suppression => more aggressive feedback => better orbit stability

    • RF by {{Micha}}

      • 3HC pressure spikes improves by adjusting feedbacks and resovier
        • test to be conducted: revert back to old settings to see if spikes reappear.
      • Systematic variations stemming from filling pattern still there - needs improved Filling Pattern Feedback.

    • Alignment by {{Michael}}

      • Vertical girder realignment planned for KW29+30.
        • important to test motors before realignment to confirm all connections are good.
        • 15th July: goal: arc1-arc4. Adjustments with beam but also plinth adjustments by Timo.
          • Affected beamline: STOMCAT and ADDAMS (and Debye but only a little bit). ADDAMS should improve but will still have a 40 urad bump...
        • 21st-22nd July: arc9-arc12.
        • 29th July: Arc7. Undecided whether to corret to "zero" or maintain slow misalignment wave.
      • Horizontal alignment: sector 5 to be "test bed" for horizontal realignments during August shutdown.

    • Shift Summaries

      • {{Jesus}}: Beta-function measurements
        • Horizontal beta-beat of 5.6% RMS, vertical beta-beat 5.2% RMS
        • FOFB off during measurements. Would be nice to try with FOFB.

  3. Requests

Minutes written by {{Felix}}

30/06/2025

Participants: {{Felix}}

  1. Introduction

    • Approval of last minutes

      • All those present confirm the minutes of the last meeting

    • Communication

      • Please keep voices down in the control room and go elsewhere for intense discussions
      • Please send shift requests ahead of the BDM meetings. Then I can prepare a preliminary schedule for discussion in the meeting.
      • The current machine schedule is available on a dedicated subsite of the SLS 2.0 Operations Management website:
      • Machine Shift Reports
        • Please prepare shift reports in elog. If you send me a mail with the link I will add the link to the machine shifts table.
        • Note: When submitting draft versions of your elog entry please suppress the email notification
      • Please remember to always keep the control room informed, i.e.,
        • call the operators before starting and after finishing your shift
        • call the operators before starting and after finishing maintenance or update work on your HW, FW, SW, ....
        • make sure that any changes you have made are documented in the elog, e.g., bridges
        • announce spontaneous on-site shifts, e.g., over the weekend or night in advance to the control room (either you or me should give the operators a call before you arrive)

  2. Reports

    • Operation / Vacuum Conditioning by {{Felix}}

      • Summary of machine activities since last BDM, i.e., of KW 26

        • Machine development focused on FOFB, MBFB and FPFB
        • First light for PXII and S-TOMCAT on Wednesday
          • S-TOMCAT SU permit for 400 mA received on Thursday, 26.06.2025
          • PXII SU permit for 400 mA received on Friday, 27.06.2025
        • FOFB running well since Friday
          • MTBF much better that minutes, i.e., 4 faults over weekend
          • 3 Hz orbit distortion from booster ramps is reduced
          • slow orbit distortions still visible on TbT data

      • Incidents/Issues

        • Interlock from VCS in combination with MIS/MIS-FE Interlock (elog)
          • ARS01-MSXT-1980:TEMP-SX-COIL-4-MIS
          • X06DA-FE-VCVS
          • Alarmlists of VCS/MIS/MIS-FE not reliable and not giving PVs of corresponding devices
          • Root Cause not clear (X06DA-FE via VCS vs MSXT via MIS)
        • Temperature upstream of Kicker 2
          • No interlocks since installation of fan (Temporary and dirty fix) and realignment
          • Next steps: X-Ray in August shutdown

    • Feedbacks and BPMs by {{Boris}}

      • elog
      • errors in data from BPMs still present, despiker from Goran, always at same position in data package, not understood yet
      • feedback only on BPM signal without taking pilot into account since difference calculation (pilot - BPM reading) not working
        • fix would significantly reduce noise/drift

    • RF by {{Lukas}}

      • Issues restarting water cooling of SR4
        • limiting restart power to 200 Watt resolved the issue
      • Instabilities of 3HC cryo system still under investigation
      • Sporadeously driven horizontal synchrotron oscillations not yet further investigated
        • bandwidth could be further reduced

    • Diagnostics by {{Cigdem}}

      • Beam size measurement X08DB measured horizontal beam size agrees very well with model when dispersion beat is taken into account
      • Effect of FOFB on measured beam size seems negligible thus effect of beam size depending on integration time either due to vibration in beamline or not yet suppressed 90 Hz orbit motion

    • Alignment by {{Michael}}

      • Karsten has delivered the aligment data for all arcs before beginning vacation
      • Misaligment of the last arcs (10, 11, 12) are significant and require large realignments > 100 um
      • realignment of sector 7 also challenging since neighboring sectors strongly misaligned
      • Meeting this Wednesday to discuss alignment strategy
        • Overall strategy first machine realignment and beamlines follow the machine
        • Better sooner than later
        • Minimize / avoid orbit bumps for beamlines

  3. Requests

Minutes written by {{Felix}}

23/06/2025

Participants: {{Hans}}, {{RomainG}}, {{Lukas}}, {{Masamitsu}}, {{Boris}}, {{Jonas}}, {{Michael}}, {{Cigdem}}, {{Simona}}, {{Martin}}, {{Jesus}}, {{Felix}}

  1. Introduction

    • Approval of last minutes

      • All those present confirm the minutes of the last meeting

    • Communication

      • Please keep voices down in the control room and go elsewhere for intense discussions
      • Please send shift requests ahead of the BDM meetings. Then I can prepare a preliminary schedule for discussion in the meeting.
      • The current machine schedule is available on a dedicated subsite of the SLS 2.0 Operations Management website:
      • Machine Shift Reports
        • Please prepare shift reports in elog. If you send me a mail with the link I will add the link to the machine shifts table.
        • Note: When submitting draft versions of your elog entry please suppress the email notification
      • Please remember to always keep the control room informed, i.e.,
        • call the operators before starting and after finishing your shift
        • call the operators before starting and after finishing maintenance or update work on your HW, FW, SW, ....
        • make sure that any changes you have made are documented in the elog, e.g., bridges
        • announce spontaneous on-site shifts, e.g., over the weekend or night in advance to the control room (either you or me should give the operators a call before you arrive)

    • Operation Coordination

      • Due to the reduced scope of the machine devlopment meeting in its current form as beam development meeting, operational issues are often not properly followed up and need to be chased individually
      • Due to the absence of the user operation meeting the coordination between beamlines and machine is not optimal, e.g.,
        • beamlines bring their requests forward uncoordinated and individually via mails or calls to operations manager, machine coordinator or the control room
        • beamlines do not know how to interact with or find their operational panels
        • handshaking between beamline and machine development shifts not clearly defined
        • tunnel access for beamline shifts not clearly defined / communicated
        • communication channels between machine and beamlines not clearly defined
        • responsibilities unclear, i.e., operations manager / floor coordination / COM meeting / various beamline meetings all do scheduling of machine operation and tunnel access shifts
      • These issues in sum lead to reduced efficiency due to amongst others duplication and loss of valuable machine and tunnel access time

  2. Reports

    • Operation / Vacuum Conditioning by {{Felix}}

      • Summary of machine activities since last BDM, i.e., of KW 25 *
      • Incidents/Issues
        • Archiver performance not meeting expectations
          • Felix will follow up with Tadej
        • PSYS beam dump today
          • needs to be followed up
        • Beam Dump Kicker Issue: Saturday Evening the BDK did not recover after a beam dump
          • overall almost 6 hours downtime
          • operation would be limited to 30 mA (?!) without beam dump kicker
          • Despite unfortunately not having a pulsed magnets piquet service, we luckily have a highly motivated Martin who came to PSI from Zurich during the night from Saturday to Sunday and managed to fix the beam dump kicker after ~5 hours enabling further operation at nominal parameters over the weekend
          • switches not holding high voltage, issue with one of the switches
          • abnormal power consumption from the HV PS
          • switch degraded and features increased leakage current
          • interlock due to monitored average power from HV PS
          • switch exchanged for test switch which needed second tunnel access for quickfix and confirmed to be the underlying issue
          • possibly linked to radiation damage of semiconductor (very high gain thyristors)
            • according to company this should not be the case
          • we need to prepare easy procedure for final beam dump to operate with 2/4 or 3/4 stages
          • leakage current started rising 1-2 hours before incident
          • manual beam dump tests only feasible without RF outage for current below 10 mA
        • ALIMA-CV-a6:I-SET Offset
          • Set/RB comparison alarm
          • RB does however follow set with offset
          • elog - Lukas suggests to increase alarm tolerance --> yes, please but also fix the PS since it has significant offset
            • PS currently still in Paolo's responsibility
            • Lukas willi follow up with Paolo
            • Replacement of the power supplies is foreseen for 2026/2027 and will move responsibility to the power supply group
        • Beamdrop starting at shift handover on Friday
          • After Injection issues operators switched back to workaround timing system
          • root cause unclear - maybe a silent interlock or crash/limit reached for timing master filling pattern local mode
          • it would be good if we could soon switch to the final FPFB system to avoid the uncertainty of which system to use for the operators
        • Accidental reboot of FOFB
          • operators were not able to restart FOFB
          • when Goran noticed his mistake he called the control room and informed them of the mishap
          • on trying to restart the FOFB, the beam was lost
          • intermediate use of python OFB until FOFB repaired by Goran and Boris
        • spurious VCS alarms
          • Maintenance request of CPU
        • Temperature downstream of Kicker 2
          • No issues since installation of fan (Temporary and dirty fix) and realignment
          • ??? info "drawings" Image{ align=left } Image{ align=left } Image{ align=left } Image{ align=left }
          • Assumption: RF heating
          • Candidates: gap between kicker chamber and bellow / RF springs in bellows / Ti coating of ceramic chamber
          • ??? info "thermal images" Image{ align=left } K2_1547_StartTopTup400mA K2_1637_1hTopUp400mA K2_1721 K2_1731_WithFan
          • Next steps: X-Ray, swap for spare chamber
            • X-ray in August shutdown

    • Linac and LTB Optimization by {{Jonas}}, {{Simona}}, {{Fabio}} and {{Volker}}

      • elog
      • goal was to switch off solenoids
      • Jonas optimized for max charge day before and achieved 600 pC at gun bias 40 kV
      • 600 pC at gun bias 40 kV was achieved also with one solenoid switched off
      • Optimal transmission for 300 pC from Linac
      • High sensitivity to orbit in LinaC

    • Feedbacks and BPMs by {{Boris}}

      • elog
      • elog
      • spikes on BPM data
        • stops FOFB every 70 seconds
        • scale of issue not yet clear, next FOFB version will count these spikes
      • synchrotron oscillations on order of um observed at dispersive BPMs while usually nm
        • LLRF feedback not changed
        • Test of switching LLRF off to confirm it as source should be performed
      • supression of booster induced orbit distortion by FOFB
        • possible if spike issue fixed
      • goal is to get FOFB running with low gain to supress 3 Hz distortions by order of magnitude
        • higher gain increases risk of FOFB outage

    • RF by {{Lukas}}

      • 3HC spectrum analyzer could be used to compare sidebands with issue observed by Boris
      • pressure fluctuations being investigated, possibly related to gauge
      • LLRF upgrades of HLA performed enabling diagnostic post mortem tests
      • LLRF FW upgrade to be done

    • Diagnostics by {{Cigdem}}

      • PCT noise level worse than SLS - 1
      • Beam size measurement is running, EPICS PVs with customizable ROI array would be nice
      • Horizontal emittance measurement showing increased beam size not 100% understood
        • knife edge scan from PX-III can be used for comparison
        • contribution from spurious dispersion
        • continuous measurement of energy spread and emittance/beam size challenging due to small beam size

    • ID Feed Forward by {{Masamitsu}} and {{Simona}} and {{Dirk}}

      • PX-II asked for smallest gap setting so far --> EPICS soft limit at 100 mA

    • Pulsed Magnets by {{Martin}}

      • preparing final beam dump system
        • priority of health monitoring system dropped
          • prototype will be finished but final setup needs to be transferred to AEK request
      • exchange of pinger HV PS planned

    • Girder Alignment by {{Michael}}

      • all alignment data (sectors 1,2,3,4,5,6,8) in model illustrates necessary movements for required angle change for ADDAMS (X04SA) shows significant realignment would be required to correct the 50 urad
        • root cause of this error to be investigated
        • wait for full picture (data from Karsten) before decision of compromise between alignment to zero vs alignment to global smoothing fit
        • need to be very transparent with beamlines while taking these decisions

  3. Requests

Minutes written by {{Felix}}

16/06/2025

Participants: {{Cigdem}}, {{Lukas}}, {{Jesus}}, {{RomainG}}, {{Jonas}}, {{Michael}}, {{Simona}}, {{Felix}}

  1. Introduction

    • Approval of last minutes

      • All those present confirm the minutes of the last meeting

    • Communication

      • Please keep voices down in the control room and go elsewhere for intense discussions
      • Please send shift requests ahead of the BDM meetings. Then I can prepare a preliminary schedule for discussion in the meeting.
      • The current machine schedule is available on a dedicated subsite of the SLS 2.0 Operations Management website:
      • Machine Shift Reports
        • Please prepare shift reports in elog. If you send me a mail with the link I will add the link to the machine shifts table.
      • Please remember to always keep the control room informed, i.e.,
        • call the operators before starting and after finishing your shift
        • call the operators before starting and after finishing maintenance or update work on your HW, FW, SW, ....
        • make sure that any changes you have made are documented in the elog, e.g., bridges
        • announce spontaneous on-site shifts, e.g., over the weekend or night in advance to the control room (either you or me should give the operators a call before you arrive)

  2. Reports

    • Operation / Vacuum Conditioning by {{Felix}}

      • Summary of Machine Activities since last BDM
        • KW 21
          • Restricted tunnel access for escalation tests during the day and scrubbing over night
          • First Light ADDAMS, Pollux & SuperXAS
          • SU Permit ADDAMS
          • scrubbing over weekend
        • KW 22
          • MD week (FOFB, FPFB, MBFB, timing, injection, zone plates, ...)
          • SU Permit Pollux/SuperXAS
          • scrubbing over weekend
        • KW 23 (IPAC in Taiwan)
          • Restricted tunnel access for escalation tests during the day
          • scrubbing over night and weekend
        • KW 24
          • Some MD (FOFB and FPFB)
          • Tunnel access for kicker 2 intervention (down to < 35°C from 50 to 60 before, interlock at 70)
          • First beamline development block, i.e., user operation conditions (Thursday 16:00 until Tuesday 06:00)
      • Incidents/Issues
        • Injection efficiency low
          • Reason not clear, possibly: Timing issues, FOFB orbit, drift of injection elements
        • Top Up
          • currently defined by current thresholds (400.5 - 403 mA) which are set for injection periodicity close to 3 minutes
          • top up scheme for beamline operation to be defined
          • beamlines asking for top up countdown
        • Many beamlines have difficulty finding the panels to open their absorbers/shutter/stopper
          • OP in coordination with controls (Luka Debenjak) have prepared some panels
        • 3HC pressure
          • peaks remain
          • variation on order of 10 to 20 mbar observed (TPS limit is 2 mbar)
          • see also elog
          • only the slow variation can be attributed to the filling pattern
        • Filling pattern
          • issue with race condition between workaround and local mode of timing resolved
          • update of epics workaround to synchronize rounding error for 8 ns tick and us setpoints
          • FPFB in development
        • MIS Magnet Temperature Interlock
          • Despite definition (cooling piquet!) it is not obvious which piquet should be called / is responsible (neither for the operator nor for the piquet)
        • Temperature downstream of Kicker 2
          • Fan installed (Temporary and dirty fix) and realignment
          • ??? info "drawings" Image{ align=left } Image{ align=left } Image{ align=left } Image{ align=left }
          • Assumption: RF heating
          • Candidates: gap between kicker chamber and bellow / RF springs in bellows / Ti coating of ceramic chamber
          • Next steps: Thermal Camera to be installed, X-Ray, swap for spare chamber

    • Storage Ring Optimization by {{Masamitsu}}

      • Orbit has been changed via BBA to reduce corrector currents and enable FOFB
      • Optics optimization is outstanding

    • RF by {{Lukas}}

      • Post mortem data
      • LLRF update from 8 to 10 with {{Roger}} and {{Zheqiao}}
      • Cryo pressure: Daniel not around this week, will take some time to optimize

    • Diagnostics by {{Cigdem}}

      • Presented slides on the beam size measurements

    • ID Feed Forward by {{Masamitsu}} and {{Simona}} and {{Dirk}}

      • currently disabled for ADDAMS since used for pointing correction

  3. Requests

Minutes written by {{Felix}}

19/05/2025

Participants: {{Lukas}}, {{Micha}}, {{Michael}}, {{Jesus}}, {{Jonas}}, {{Martin}}, {{Masamitsu}}, {{Felix}}

  1. Introduction

    • Approval of last minutes

      • All those present confirm the minutes of the last meeting

    • Communication

      • Please keep voices down in the control room and go elsewhere for intense discussions
      • Please send shift requests ahead of the next meeting. Then I can prepare a preliminary schedule for discussion in the meeting.
      • For the convenience of the operators the machine shift and controlled tunnel access tables are located on dedicated subsites of the SLS 2.0 Operations Management website:
      • Machine Shift Reports
        • Please prepare shift reports in elog. These will be linked in the machine shifts table.
      • Please remember to always keep the control room informed, i.e.,
        • call the operators before starting and after finishing your shift
        • call the operators before starting and after finishing maintenance or update work on your HW, FW, SW, ....
        • make sure that any changes you have made are documented in the elog, e.g., bridges
        • announce spontaneous on-site shifts, e.g., over the weekend or night in advance to the control room (either you or me should give the operators a call before you arrive)

  2. Reports

    • Operation / Vacuum Conditioning by {{Felix}}

      • Summary of Machine Activities since last BDM
        • Machine development week following schedule
        • Scrubbing over night and shutdown since Friday 2 PM
        • Successful Beam Assisted Girder Alignment (BAGA) for Arcs 4, 5, 6 and 8 (elog)
        • Transverse MBFB system commissioning (elog)
        • Gap successfully reduced to design value of 30 buckets and 3HC tuning and camshaft tests (elog)
        • SU has measured very high dose rates in vicinity of straights 1, 5 and 9 (elog)
        • New timing version can control filling pattern and switchover between filling control by timing master or, e.g., BD workaround now easy (elog)
        • ID Gap FF implemented by Dirk for X04 and X10 confirmed working (elog)
      • Incidents/Issues
        • Misfiring of 4 kicker bump while turning it off lead to uncontrolled beam loss (400 mA) not detected by any of the RadFETs
          • Timing: With new timing version the booster extraction and SR injection events are separated removing necessity to switch off 4 kicker bump for most cases
          • EPICS: To avoid this issue when turning off the kickers, the underlying logic will be changed to set the amplitude to zero and then wait for the charging voltage to drop
        • Downdivided revolution trigger for streak camera not stable, i.e., bunches moving along fast axis
        • MIS provided enable signals for ID PLCs not visible (and thus not bridgable) in EPICS
        • ALH configuration now includes many more subsystems but not yet usable
          • RF linking to websites not reachable from machine network
          • RF, IOCs and Magnets creating too many "false" alarms
      • New PVs
        • AGEBD-PARAMS:INJECTION-ACTIVE (Injection to storage ring active?)
        • AGEBD-PARAMS:CURRENT (Current automatically switched between BPM and PCT)
        • AGEBD-TAUPCT:INJRATE (Injection rate calculated from PCT current measurement)
        • AGEBD-TAUPCT:TAU (Lifetime calculated from PCT current measurement)

    • Timing by {{Romain}}

      • No changes to timing system concerning linac except that for changing some local delays the new basedelay PVs must be used:
        • AGETI-CVME-MASTER-TMA:FP-CA-LI-LLE-BaseDelay-SP
        • AGETI-CVME-MASTER-TMA:FP-CA-LI-ICT1-BaseDelay-SP
        • AGETI-CVME-MASTER-TMA:FP-CA-LI-ICT2-LBDI-BaseDelay-SP
        • AGETI-CVME-MASTER-TMA:FP-CA-BRTL-ICT-BaseDelay-SP
        • AGETI-CVME-MASTER-TMA:FP-CA-InjK14-BaseDelay-SP

    • Booster/BRTL Optimization by {{Jonas}}

      • BRTL orbit looking good
        • BPM timing and gains needed optimization
        • Gains were set to old button BPM values leading to saturation effects
        • New gain settings prepared via IOC update improve
        • BPM offsets unknown
        • Alignment of BRTL unclear
        • Aperture limitation in thin septum keyhole chamber

    • Storage Ring Commissioning by {{Masamitsu}}

      • Injection
        • losses in X09 were still visible after startup but disappeared after orbit and injection optimization
        • 100 % injection efficiency achievable
        • injection losses not well distributed between 5L and 9L
      • Optics refinement (BBA, dispersion, linear optics, coupling and non-linear coupling correction) needs approx. 8 h

    • ID Feed Forward by {{Masamitsu}} and {{Simona}} and {{Dirk}}

      • Goals of FF tables
        • primary goal is to avoid strong change of corrector strengths when ID FF and FOFB working together
        • XBPM readings are not recorded for FF measurement
      • X04 and X10 implemented in EPICS and confirmed working
      • X06 and X12 FF tables measured and to be implemented
      • Reduction of change with FF active is clearly observed
      • X12 gap got stuck at min. Gap, requiring local reset at PLC (ID group can help), did not happen last shift, issue not clear, i.e., if implementing soft limit could help not clear

    • RF by {{Lukas}}

      • upgrade to FW with optical PCT interface
        • confirmed working
      • otimization of LLRF for beam dump behavior
        • controller of reflected power working well but interlocks sometimes result in "modules on"
      • 3HC voltage fluctuations
        • could be caused by regulation of helium pressure for which also over the weekend instabilities were observed, i.e., without beam
        • no indications observed of LLRF being connected to issue
        • optimization of controller settings ongoing
        • extremity tube seems to be behaving well
        • exchange of valve would be big task

    • Pulsed Magnets by {{Martin}}

      • Temperature of kicker 2 downstream is rising upto ~ 70 deg
        • should be monitored and an alarm raised at ?? deg (to be followed up with vacuum)
        • is in archiver
        • following beam current but not consistently
        • could be indication of RF fingers not behaving well
        • vacuum temperature sensor will be moved this shutdown to also measure at this location

    • Impedances and MBFB kickers by {{Micha}}

      • 3HC tuning for 30 bucket gap increasing voltage by ~5 kV and bunch length reduction ~5 %
      • bunch length measurement of camshaft with and without 3HC for charges between 0.2 and 2.5 nC
        • for 400 mA, i.e., with 3HC : bunch length shorter than expected and asymmetric
        • for 0 mA, i.e., without 3HC: zero current bunch length agrees well with expectation but lengthening with increase of single bunch charge is larger than expected, i.e., longer bunch (bunch lengthening normally function of broadband impedance)
        • measurement with FPFB would be nice
        • camshaft bunch in middle of gap should be fine for operation
      • tuning vs lifetime scan would be interesting

    • BAGA Shift by {{Michael}}

    • Diagnostics by {{Masamitsu}}

      • Beam size measurement
        • For very low current X08DA measurement in consistent with design value in both planes
          • 9.7 um
          • good agreement for vertical dispersion change
        • For high current the beam size is increased indicating significant vacuum contribution
          • 12 um

  3. Requests

    • High Priority

      • Reduce beam size and measure the PSF of the zone plate setup (30th May, not 1.30-2.30pm)
      • Beam current vs beam size check (26, 27 or 28 May)
      • FPFB Development (timing side)
      • FPFB Development (feedback side)
      • MBFB Development
      • LLRF development

    • Medium Priority

    • Low Priority

      • ID feedforward measurements for X06 and X12
      • Quadrupole response / tune based optics measurements
      • Investigate options for top-up save with booster RF

Minutes written by {{Felix}}

12/05/2025

Participants: {{Masamitsu}}, {{RomainG}}, {{Boris}}, {{Romain}}, {{Hans}}, {{Simona}}, {{Jesus}}, {{Jonas}}, {{Michael}}, {{Martin}}, {{Micha}}, {{Lukas}}, {{Felix}}

  1. Introduction

    • Approval of last minutes

      • All those present confirm the minutes of the last meeting

    • Communication

      • The operations commissioning team is no longer available. Thus we no longer have a dedicated operator for assistance. Thus the handling of, e.g., alarms, tunnel access will be slower and general support will be reduced.
      • Please send shift requests ahead of the next meeting. Then I can prepare a preliminary schedule for discussion in the meeting.
      • For the convenience of the operators the machine shift and controlled tunnel access tables are located on dedicated subsites of the SLS 2.0 Operations Management website:
      • Machine Shift Reports
        • Please prepare shift reports in elog. These will be linked in the machine shifts table.
      • Please remember to always keep the control room informed, i.e.,
        • call the operators before starting and after finishing your shift
        • call the operators before starting and after finishing maintenance or update work on your HW, FW, SW, ....
        • make sure that any changes you have made are documented in the elog, e.g., bridges
        • announce spontaneous on-site shifts, e.g., over the weekend or night in advance to the control room (either you or me should give the operators a call before you arrive)

  2. Reports

    • Operation / Vacuum Conditioning by {{Felix}}

      • Summary of Machine Activities since Startup
        • Startup
          • Test new timing version SLS-LOG 60827
            • local filling mode in principle working but
              • switch between timing internal and BD workaround not easy
              • was initially changing linac delays it should not
          • Test new gun pulser
            • injection efficiency to booster not significantly improved
            • charge loss in linac high, i.e., ICT-2 sees only ~130 pC of 200 pC measured by ICT-1
            • charge injected to storage ring limited to ~70 pC
            • decision to switch back to old pulser
          • Vacuum
            • four frontend absorbers were seeing synchrotron radiation for the first time
            • very high vacuum pressure in FE ~200 pbar
            • very bad vacuum dominated lifetime in machine
            • machine recovered after 9 hours scrubbing by Saturday morning 6:30 (scrubbing started Friday 22:00)
          • Vertical pinger
            • required tunnel access
            • inside prohibited access area due to beam dump
            • root causes was fiber cable (fix by unplugging and replugging)
            • good news in comparison to radiation damage destroying electronics (pulser board or triggering box)
          • BPMs
            • multiple BPMs required BBA for OFB
            • 500 Hz Master RF increase was required (cold machine after shutdown, will need to be corrected back over course of this week)
          • Scheduling
            • startup after long shutdown took 17 hours
            • machine startups should not be scheduled for Fridays
        • 400 mA Top-Up
          • Top-Up Save working
          • Lifetime improved from ~2h at 50 mA to ~6.4 h at 400 mA
          • Max vacuum pressure ~8 pbar for machine and 55 pbar for front ends
          • Accumulated beam dose of ~173 Ah
          • I*tau recovered to on average ~2500 mAh
          • Injection efficiency > 60 %
            • Booster Extraction Septum PID loop maybe required after all
      • Beam Aborts
      • Other communication issues
        • X06DA could not open absorbers - as it turns out controls has now implemented the operator permit PV without informing
        • SU booster loss measurements not communicated to piquet

    • Linac/LTB Optimization by {{Volker}}

      • Meeting on Wednesday about new quadrupoles

    • Booster/BRTL Optimization by {{Jonas}}

      • during shutdown bugs in ramp sw/fw were identified and fixed
      • extraction time corrected to peak of ramp
      • emittance exchange implemented achieving reduction of hor. emittance by factor ~2.5
      • injection efficiency of ~100% easily achieved
      • fast accumulation with injection rate ~60 mA/min (1 nC from gun -> 400 pC in booster)

    • Storage Ring Commissioning by {{Masamitsu}}

    • RF by {{Lukas}}

      • New LLRF FW for beam current feedback to installed
      • New issue discovered over weekend: bug in calculation of margins
      • To avoid reflected power interlocks the old settings with the fast reflected power feedback are required
        • currently slow reflected power increases cause interlock
      • Ramp up should be faster than 5 minutes
      • 2 arcs observed in cavity 1 and 2 last night
        • having BPM data and MBFB mode amplitudes in archiver would be nice
      • Last week during shutdown RF conditioning the RF IOC crashed
        • ALH logfile would be nice to look into

    • BPMS and Feedbacks by {{Boris}}

      • MBF
        • temp. technician dedicated to assembly of HW
        • 1 of 4 MBFB amps not working before shutdown but working now
        • 2 of 5 amps support gain change (intentional since option not ordered)
        • decision to use attenuators to equalize gain
      • BPMs
        • 1 cooling valve was broken
        • some oscillations observed
        • rack doors still open due to not all defective emergency switches being exchanged yet
        • New FW extensively tested last week by Boris and DSP group --> many bugs identified
          • 50 % fixed so far
          • will take weeks until ready
          • still running with old FW for now
      • OFB
        • on Friday issues in sectors 2 and 6 discovered
          • massive change of response suspected (response matrix used since February no longer working)
          • remeasuring response matrix recovered OFB
          • BBA for entire sector 6 recommended

    • Pulsed Magnets by {{Martin}}

      • many points already raised
      • Diamond colleagues interested in thin septum, meeting today
      • Fast kicker in preparation for test in October
        • Priority for beam dump kicker installation in August and ID installation in October

    • Impedances and MBFB kickers by {{Micha}}

      • complaints from vacuum concerning cabling and installation of attenuator blocks
        • could make ID installation complicated
      • camshaft mode to be investigated
        • factor 2 of charge anticipated
        • peak charge vs overall charge not yet clear
      • filling pattern feedback needed for tests
        • target MD week end of May

    • Optics Measurement Shift by {{Jesus}}

      • measurement of beta functions increasing quadrupole currents upto 2 A
        • impact on resolution not yet checked
      • hysteresis observed in hor. and ver. planes
        • minimization of hysteresis by reducing change of current in 2nd direction might be advisable
        • change is based on measurement of tune and thus automatically hysteresis corrected
        • but the hereby obtained new current set values could be wrong starting point for next cycling

  3. Requests

    • High Priority

      • Finish check new timing version (2 h)
      • Check injection losses after X01 and X09 realignment during shutdown
      • Investigate optics issue: resonance(s) close to the working point, and the lifetime is quite sensitive to the orbit
      • Vertical girder alignment with the girder mover system for sector 8 (sectors 4, 5, 6 (done))
      • SU mapping for machine worst case and nominell operation
      • LLRF Development
      • Check implementation of ID feedforward for X04

    • Medium Priority

      • FPFB Development
      • MBFB Development
      • 3HC tuning / bunch lengthening optimization for 30 bucket gap and camshaft investigations
      • Check necessity of PID loop control of booster extraction septum after change of BO Extraction Septum charging Resistor Chain
      • Test beam dump with closed IDs
      • Postmortem trigger alignment
      • Injection optimization

    • Low Priority

      • ID feedforward measurements for X06 and X12
      • Quadrupole response / tune based optics measurements
      • Investigate options for top-up save with booster RF

Minutes written by {{Felix}}

14/04/2025

Participants: {{Boris}}, {{Micha}}, {{Jesus}}, {{Jonas}}, {{Michael}}, {{Cigdem}}, {{Martin}}, {{Hans}}, {{Simona}}, {{Felix}}

  1. Introduction

    • Approval of last minutes

      • All those present confirm the minutes of the last meeting

    • Communication

      • Please send shift requests ahead of the next meeting. Then I can prepare a preliminary schedule for discussion in the meeting.
      • For the convenience of the operators the machine shift and controlled tunnel access tables are located on dedicated subsites of the SLS 2.0 Operations Management website:
      • Machine Shift Reports
        • Please prepare shift reports in elog. These will be linked in the machine shifts table.
      • Please remember to always keep the control room informed, i.e.,
        • call the operators before starting and after finishing your shift
        • call the operators before starting and after finishing maintenance or update work on your HW, FW, SW, ....
        • make sure that any changes you have made are documented in the elog, e.g., bridges
        • announce spontaneous on-site shifts, e.g., over the weekend or night in advance to the control room (either you or me should give the operators a call before you arrive)

  2. Reports

    • Operation / Vacuum Conditioning by {{Felix}}

    • Storage Ring Commissioning by {{Masamitsu}}

      1. the remaining items from Phase 5 and 6 are
        • FOFB: work in progress by Boris and his colleagues
        • ID feedforward: X06 and X12 to be done, Simona needs a shift
        • Beam dump with ID: Cigdem is ready for this. Need a shift (parasitic?)
      2. Phase 7 (Finalization) is ongoing in parallel:
        • MBFB test is scheduled in Phase 7
        • Injection tuning (Kicker bump closure) is briefly done. Need another shift
      3. Optics issue
        • Resonance(s) close to the working point, and the lifetime is quite sensitive to the orbit (between BPMs).
        • If it is 3Qx=118 or Qx+2Qy=70, it can be corrected by sextuoples (tool is ready). If not, I may have to spend more time for the linear optics...
        • Need a shift to investigate. Maybe rather urgent?
      4. RF frequency
        • FOFB feedback uses the average horizontal corrector current to find an optimum frequency, but it seems to me that it is not robust. I am finding it differently and can get more robust result. For the moment, it is better to change the frequency by hand if/when necessary. Need further discussion.
      5. ARS08-DBPM seems fixed after the tunnel access last Tuesday (see attached).
      6. Lifetime at 400 mA, several top-up cycle 400-396 mA
        • AGEBD-SCRUBBING:TOPUP-TAU 6.470 h
        • AGEBD-SCRUBBING:TOPUP-TAU 6.866 h
        • AGEBD-SCRUBBING:TOPUP-TAU 6.861 h
        • AGEBD-SCRUBBING:TOPUP-TAU 6.773 h
        • AGEBD-SCRUBBING:TOPUP-TAU 6.699 h
        • AGEBD-SCRUBBING:TOPUP-TAU 6.862 h
        • AGEBD-SCRUBBING:TOPUP-TAU 6.863 h
        • AGEBD-SCRUBBING:TOPUP-TAU 6.620 h
        • AGEBD-SCRUBBING:TOPUP-TAU 6.860 h
        • AGEBD-SCRUBBING:TOPUP-TAU 6.861 h
        • AGEBD-SCRUBBING:TOPUP-TAU 6.817 h
        • AGEBD-SCRUBBING:TOPUP-TAU 6.817 h
        • AGEBD-SCRUBBING:TOPUP-TAU 6.653 h
        • AGEBD-SCRUBBING:TOPUP-TAU 6.308 h
        • AGEBD-SCRUBBING:TOPUP-TAU 6.269 h
        • AGEBD-SCRUBBING:TOPUP-TAU 6.870 h
        • AGEBD-SCRUBBING:TOPUP-TAU 6.872 h
        • AGEBD-SCRUBBING:TOPUP-TAU 6.819 h
        • AGEBD-SCRUBBING:TOPUP-TAU 6.821 h
        • AGEBD-SCRUBBING:TOPUP-TAU 7.109 h
        • AGEBD-SCRUBBING:TOPUP-TAU 7.115 h
        • AGEBD-SCRUBBING:TOPUP-TAU 6.706 h

    • Booster/BRTL Optimization by {{Jonas}}

      • Booster cavities have been rephased w.r.t. the linac phase improving capture of high charge bunches from the linac
        • required rephasing of storage ring cavities by + 70 degrees via the individual phases to avoid reaching phase limits
        • filling of the ring with upto 56 mA/min confirmed

    • RF by {{Lukas}}

      • Power consumption at 400 mA less than 2 MW
        • would be interesting to see power consumption with all IDs closed

    • BPMS by {{Boris}}

      • Filling Pattern
        • bunches with lower than average charge are ignored
        • RF phase change needs to be taken into account manually and is not yet done since Jonas' booster optimization
      • OFB
        • RF correction implemented last week
          • calculate integral kick of all kickers with variable weight (now 1 for all)
          • frequency adjustment required and in good agreement with values from SLS-1 (~50 Hz down per day after a shutdown in spring)
          • as long as no orbit bumps in non-dispersive regions the approach of integrating over all (dispersive and non-dispersive) correctors is fine
          • correction should be on, issues with beam loss during RF changes
          • manual change applied by unknown entity caused beam loss Sunday evening
        • In future the OFB energy correction should be active by default as soon as it is well tested and the proper function is verified

    • Pulsed Magnets by {{Martin}}

      • working on final beam dump system
        • challenging to make robust against fire hazard due to high system density

    • Optics Measurement by {{Jesus}}

      • DEV-LOG 2480
        • Beta functions were measured around the whole ring.
        • Using the measured functions, an optics correction was performed, achieving slightly better lifetime. For a chromaticity of 0.6, lifetime increased to around 8.8 hours. For a chromaticity of (1.2, 1.1), lifetime increased to around 10.8 hours.
        • Beta functions were measured again with the new optics, the rms was reduced with respect to the first measurements. On the x direction, it went from 0.057 to 0.032, on the y direction from 0.047 to 0.043.
        • A second optics correction was attempted with no success.
      • Comment by Michael: simulating data for easier comparison with Masamitsu's beta-beat measurement would be nice

  3. Requests

    • Since "stable" operation at 400 mA is already possible, the priorities for MD shifts are:
      • High: FOFB developement
      • High: LLRF developement
      • High: Investigate optics issue: resonance(s) close to the working point, and the lifetime is quite sensitive to the orbit
      • Medium: 3HC tuning / bunch lengthening optimization for 30 bucket gap
      • Medium: MBFB and FPFB developement
      • Low: ID Feed forward measurements have lower priority since all planned ID commissioning IDs are already done
    • The exact planning for after the shutdown is not possible yet since there maybe shifts of beamline activities to the days directly after the shutdown before starting up the machine.
    • The general plan is:
      • Startup the machine as soon as possible after the shutdown
      • Then the MD activities share the machine and Felix will short-term coordinate their activities.

Minutes written by {{Felix}}

07/04/2025

Participants: {{Masamitsu}}, {{MartinB}}, {{Martin}}, {{Jesus}}, {{Simona}}, {{Volker}}, {{Cigdem}}, {{Michael}}, {{RomainG}}, {{Jonas}}, {{Micha}}, {{Boris}}, {{Lukas}}, {{Felix}}

  1. Introduction

    • Approval of last minutes

      • All those present confirm the minutes of the last meeting

    • Communication

      • Please send shift requests for coming week until Friday then I can prepare preliminary schedule for discussion in the meeting
      • For the convenience of the operators the machine shift and controlled tunnel access tables are located on dedicated subsites of the SLS 2.0 Operations Management website:
      • Machine Shift Reports
        • Please prepare shift reports in elog. These will be linked in the machine shifts table.
        • For SLS 2.0 commissioning shifts a template for the elog entries is prepared and will be automatically loaded when choosing the project "SLS-2 Commissioning" in the SLS Development Logbook
      • Please remember to always keep the control room informed, i.e.,
        • call the operators before starting and after finishing your shift
        • call the operators before starting and after finishing maintenance or update work on your HW, FW, SW, ....
        • make sure that any changes you have made are documented in the elog, e.g., bridges
        • announce spontaneous shifts, e.g., over the weekend via myself or just give the operators a call

  2. Reports

    • Operation / Vacuum Conditioning by {{Felix}}

      • ??? "400 mA milestone mail exchange" ??? info "Mail to SteCo" Dear members of the SLS 2.0 Steering Committee,

        I have the pleasure of informing you that we have successfully reached a key milestone of the machine commissioning for the SLS 2.0 project: As of today, 3rd of April 2025, we have achieved 400 mA stored beam, marking a significant step towards preparing the machine for beamline commissioning.

        This achievement reflects the dedication and collaboration of all the expert teams involved, and I want to take a moment to acknowledge their hard work and commitment to enable this success.

        Should you have any questions or require further details, please feel free to reach out. We appreciate your ongoing support and guidance in making this project a success.

        Kind regards,
        Felix Armborst on behalf of the SLS 2.0 Commissioning Team ??? info "Answer from Luc Patthey"

        Dear all, Congratulations to the entire team for this fantastic achievement!

        Regards,
        Luc ??? info "Answer from Meitian Wang" Dear Felix

        Fantastic news! 🚀 From the first-turn on 2025.01.17 to reaching 400mA on 2025.04.03—just 77 days (80 days from the start of commissioning on 2025.01.14)! 🎉 An absolutely incredible achievement! Huge congratulations to everyone involved! I’m sharing this exciting milestone with the macromolecular crystallography group @PXI, II, and III beamlines! 🔥👏

        Best
        meitian ??? info "Answer from Leonid Rivkin" Congratulations on reaching this fantastic result! SLS is back, full blast! And more, much more!

        Lenny ??? info "Answer from Gabriel Aeppli" Congratulations on this amazing achievement!
        Gabriel ??? info "Answer from Christian Rüegg" Dear colleagues,

        This is just absolutely fantastic! Congratulations to the entire team. We are even ahead of schedule.

        Best wishes, Christian ??? info "Answer from Frithjof Nolting" Waho, super, Gratulation an alle
        Gruss
        Frithjof

      • Summary of Vacuum Conditioning Activities (focus: past weekend)

        • ??? info "Plots" Image{ align=left } Image{ align=left }
        • beam dose increased over weekend from 86.2 Ah to 107.2 Ah
        • average current 360 mA at 4.5 h lifetime or 2.3 Lossratio
        • 82% uptime
        • achieved lifetime * beam current ~2000 mAh
        • max vacuum pressure machine improved from 20 to 9 pbar
        • max vacuum pressure front-ends improved from 76 to 57 pbar
        • Sunday around noon Masamitsu closed the gaps of the IDs in X04S (CPMU14, addams), X06S (U19, PX-I) and X10S (U19, PX-II) to 12 mm
        • post mortem logger example elog entry
          • planned features
            • add more scalars via 900 second compression records
              • ID gaps
            • add arrays for waterfall plot of last x seconds
              • filling pattern
              • MBFB modes
              • 20 kHz BPM data, i.e., orbit and charge
            • (add low level post mortem data)
              • RF
              • BPMs
              • Libera BLMs
          • please let me know your comments/suggestions
        • Major Interlocks this weekend
          • Sat, 00:46 - Vacuum Interlock, Sector 1 Ion Pump Controller VPIC-0010 (naming issue ARS01-VPIG-0110 or ARS01-VPIC-0010), pump pressures not included in max pressure PV
          • Sat, 08:31 - Vacuum Interlock, Sector 9 Maxi Gauge VMMG-0010 Error Sensor 3
          • Sat, 09:20 - LLRF Interlock, Cavity 2, no follow ups in elog
          • Sat, 13:04 - LLRF Interlock, Cavity 2, no follow ups in elog
          • Sat, 13:04 - Outage of complete linac (Gun, A1, A2), no follow ups in elog
          • Sun, 00:03 - LLRF Interlock, Cavity 2, no follow ups in elog
          • Sun, 07:03 - MIS, ARS05-VTTC-2100:CRU***, see MIS issue below
          • Sun, 08:17 - LLRF Interlock, Cavity 2, no follow ups in elog
          • Sun, 13:28 - MIS, ARS01-VTTC-3510:CBN***, see MIS issue below
          • Mon, 01:24 - LLRF Interlock, Cavity 2, no follow ups in elog
          • Mon, 01:43 - Vacuum Interlock, : Sektor 6 Maxi Gauge VMMG-1010 Error Sensor 1, no follow ups in elog
          • Mon, 02:21 - MIS, ARS01-MQUA-1260**, ARS01-MSXT-1300** , Ursache: Drahtbruch, see MIS issue below

      • Issues

        • BPM defect: ARS08-DBPM-5250
          • no operator procedure for removing BPM from BD SOFB defined
          • OFB engine from Feedback group not yet available
        • PCT measurement has frozen 2 times during operation in the meantime
          • unfortunate safetywise, i.e.,
            • risk of storing too much current
            • RF and 3HC interlocks for, e.g., reflected power or induced voltage are scaled with the PCT measured current
          • redundancy would be nice, i.e., separate IOCs, separate crates
          • what to do
            • document in the elog
            • inform Cigdem
            • check if trigger is on external (EVR0 LIPS > PCT WF > Trigger Source)
            • rebooting the IOC can help
        • Linac
          • due to vacuum issues it took ~1 hour to get the Linac modulator 2 on set voltage (Roger was able to manually ramp up) after an interlock just before tunnel access on tuesday
            • this delayed the entire tunnel access by 1 hour
          • issues with modulator 2 loosing voltage, phase and sum status partially (besides bac vacuum) caused by ramping tool being active during operation and ramping down when vacuum peaks
        • 3HC
          • unstable voltages / alarm limits and tuning not allowed for operators, i.e., many RF piquet calls
        • Vacuum
          • at 400 mA the vacuum lifetime was again the dominant contribution to the lifetime (only small gains achieved with coupling optimization for 400 )
          • valve X06 was closed and not interlocking the machine since actuator was not connected to valve and after realizing this mistake it took 4 hours to increase the current to 280 mA
          • thus more time might be required than is scheduled for the upcoming beamline tests
        • MIS
          • the promised deadband and wrong measurement detection is obviously not working - this weekend we had to beam interlocks triggered by the MIS and caused by multiple sensors of one IO module for one datapoint jumping to 3276 °C which should be ignored
        • Machine Commissioning Schedule
          • At the last COM meeting it was communicated to dedicate at least ~4 days of machine commissioning time to the beamlines
          • this will reduce the availability and reliability of the machine as well as increase the risk for serious issues (e.g., RF, 3HC, VAC, PSYS, PLC systems, SU/BAG, ...) for the long term scheduled dedicated ID commissioning weeks.
          • clear delays and unavailable systems until the scheduled, dedicated beamline commissioning due to this strategy change
            • development of timing system with update this week not feasible and thus FPFB will likely not be available and workaround remains required and risk from missing 4 kicker bump inhibit remains
            • development of LLRF feedback loops at high bandwidth not possible without machine time and likely not available for ID commissioning
            • development of OFB (SOFB and FOFB and fast interlocks) ?
            • development of MBFB (X, Y and Z and fast interlocks) ?

    • Booster/BRTL Optimization by {{Jonas}}

      • booster ramps off by 8 ms
      • reduced ABOMA-B ramps by a bit
      • not understood effect of quick change of orbit at extraction

    • Storage Ring Commissioning by {{Masamitsu}}

      • machine commissioning program almost finished
      • for phase 5 it seems we are lucky and do not need to close the MBFB loop yet (phase 7 now)
      • phase 5 almost done, FPFB needs to be postponed
      • phase 6 almost done, photon beam to user coming this week
      • Michael tested vertical girder movers to improve vertical alignment in sector 6
      • Simona is preparing feed forward for ID gaps
        • measurement procedure established
        • X04 and X10 prepared
      • injection and dump to be tested with closed gaps
      • optics optimization from Friday improved lifetime at 50 mA from 12 to 18 hours
        • scaling to 400 mA we can expect upto ~9 hours lifetime
        • sextupole feeddown from chromaticity correction corrected
        • chromaticity now 1.2 in both planes

    • RF by {{Lukas}}

      • temperatures of 3HC higher than expected, limits had to be adjusted, not understood
      • post mortem acquisition not working too well yet
      • reflected power interlock not working as expected
        • possibly tuner cannot follow fast current drops leading to reflected power interlocks
      • conditioning activities for spare cavity ongoing in teststand
      • fiber connection to PCT for current reading should be implemented
      • 3HC tuning with streak camera by {{micha}}
        • overall lengthening increased at cost of less lengthening in middle of bunch trained
        • due to larger gap the voltage is slightly lower and thus the lengthening reduced
        • we should try to close the gap in the filling pattern and redo the optimization
        • alarm on lower voltage should be further adjusted to avoid unnecessary alarms

    • BPMS by {{Boris}}

      • ARS08-DBPM-5250 issue
        • frontend was replaced but issue remains
        • cables to be replaced
        • channel A drifts more than others
        • pilot cable could be used as replacement
        • recommendation: BBA for this BPM and then correct and then exclude from OFB
        • to be excluded from orbit interlock
      • at 400 mA we have 180 ps arrival time variation over bunch train and thus the BPMs should not be used for lifetime calculation
      • Orbit feedback
        • fast feedback engine tested via EPICS and some issues found and fixed
        • dispersion suppression to be tested
      • MBFB
        • loop cannot be closed
        • needs several shifts to commission

    • Pulsed Magnets by {{Martin}}

      • Beam Dump Controller
        • should work as intended
        • firing of beam dump via HW backup (10 us delay) and FW (8 us delay) was tested and confirmed working

    • ID Feed Forward by {{Simona}}

      • SLS-DEV 2465
      • EPICS integration of feed forward LUT should be implemented and tested on clontrols side during upcoming shutdown

    • Girder Realignment by {{Michael}}

      • SLS-DEV 60492
      • findings
        • very successful vertical alignment using girder movers
        • good agreement of measurements with model
        • proper alignment of/with central bend on plinth recommended

  3. Requests

    • 1-2 shifts for LLRF tests, {{lukas}} and {{roger}}

    • testing postmortem with BLM, {{Cigdem}}, {{Felix}} and {{Romain}}

    • many shifts for preparing OFB, {{boris}}

    • many shifts for preparing MBFB, {{boris}}

    • 1 shift for testing timing update and filling control by timing system, {{Romain}} and {{Felix}}

    • optics measurements, {{jesus}} and {{jonas}}

    • Machine shift schedule KW15

  4. AOB

    • ...

Minutes written by {{Felix}}

31/03/2025

Participants: {{Lukas}}, {{Boris}}, {{Micha}}, {{Michael}}, {{Hans}}, {{Cigdem}}, {{RomainG}}, {{Martin}}, {{Jonas}}, {{Masamitsu}}, {{Felix}}

  1. Introduction

    • Approval of last minutes

      • All those present confirm the minutes of the last meeting

    • Communication

      • Please send shift requests for coming week until Friday then I can prepare preliminary schedule for discussion in the meeting
      • For the convenience of the operators the machine shift and controlled tunnel access tables are located on dedicated subsites of the SLS 2.0 Operations Management website:
      • Please remember to always inform the control room, i.e., the operators before starting and after finishing your shift
      • Machine Shift Reports
        • Please prepare shift reports in elog. These will be linked in the machine shifts table.
        • For SLS 2.0 commissioning shifts a template for the elog entries is prepared and will be automatically loaded when choosing the project "SLS-2 Commissioning" in the SLS Development Logbook
      • New mailing list for urgent communications: sls-urgent@psi.ch
        • Armborst Felix (mailing list owner)
        • Kallestrup Jonas (mailing list owner)
        • Seidel Mike
        • Kiselev Daniela
        • PSI.SLS-JCM
        • PSI.SynBD
        • Shared SLS Arealkoordination (PSI)
        • PSI.GFA-Operator
        • PSI.SLS-MDM
        • PSI.SLS-UOM
        • PSI.SLS-CONTROLS

  2. Reports

    • Operation / Vacuum Conditioning by {{Felix}}

      • Summary of Vacuum Conditioning Activities (focus: past weekend)
        • ??? info "Plots" Image{ align=left } Image{ align=left }
        • beam dose increased over weekend from 50.1 Ah to 65.4 Ah
        • average current 246.57 mA with 4.9 h lifetime or 1.3 Lossratio
        • achieved lifetime * beam current ~1380 mAh
        • max vacuum pressure improved from 8.5 to 6.8 pbar (at 250 mA)
        • three interlocks
          • Fri, 21:16:18 - SR cavity 2 triggered interlock resulting in all other SR cavities and VCS also interlocking (~15 minutes before injection was possible again)
          • Sat, 01:05:18 - LLRF 3HC triggered interlock resulting in all SR cavities also interlocking (~15 minutes before injection was possible again)
          • Mon, 02:07:48 - vacuum (less than 2 s over 100 pbar) triggered interlock resulting in all SR cavities and 3HC also interlocking (~20 minutes before injection was possible again)
      • High Level Applications
        • post mortem logger, automatic elog entry for BDC triggered beam dumps
          • for now includes BDC, MIS, MISFE and VCS alarmlists
          • adding plots of high level post mortem buffers, i.e., IOC circular buffers of, e.g., current, vacuum, lifetime, beam size, state of pulsed magnets soon
          • adding plots of low level post mortem buffers for BPM, RF and other diagnostics to be worked out
          • blocking of BDC reset until all inputs are ok and for at least 45 seconds should be implemented
        • injection guard now active, many checks on the list (wip), let me know if you have additional ideas
        • new machine overarching working group anticipated for CAS (Proton BD, Electron BD, Operation, RF, ...) to promote our interests in coordination with controls directly to AWI/AIT
      • Issues
        • Linac Modulator 2, regularly (1/30min)
          • SUM status falls from ok to transient
          • HVPS voltage falls below set point
          • phase comparison failing
        • Vacuum
          • after first 255 mA shift many vacuum interlocks from short peaks
          • implementation of the MAC recommended deadband of 5 s on all but RF gauges would avoid most of the experienced and according to MAC unnecessary interlocks
          • due to last week observed ion instability no vertical pinger over the weekend, i.e., reduced scrubbing efficiency
        • RF
          • SR cavities generally trip on beam dumps
          • SR cavities take ~15 minutes to recover after interlock
          • SR cavities trigger each other via beam dump event when tripping during rampup
        • Timing
          • 360 ps jitter between 500 MHz RF (distribution and high power) and gun event (before TX board)
        • MIS
          • responsibility for interlocks from temperature sensors not obvious
            • magnet group has no piquet, owns sensor and cable upto first connector
            • electricians bought cable from first connector to PLC IO module and cabled everything
            • PLC group owns PLC system including IO modules, IO module drawer, ...
            • cooling group responsible for water cooling, i.e., most critical risk and first to be informed but usually (sensor fail or IO module fail) no actions
          • since 2025 many (dozens) failures
            • complete failure easy to diagnose (3328 degrees) and thus easy to decide to bridge
              • cables breaking / loose contacts / bad welding
              • connectors loose
              • IO modules loose contacts (replugging fix)
            • now first observation of realistic seeming measurement that triggers interlock and requires tunnel access
        • Startup Issues after Long Tunnel Access
          • PSYS issue with end switch of gate in tunnel blocking patrol
          • failing temperature sensor on sextupole (ARS07-MQUA-0790:TEMP-QA-COIL-1-MIS)
          • SPB had lost settings
          • ABOMA-B issues (Output_filter_Power_P_too_high ABOMA-B )
          • BBA offsets of BPMA causing beam dumps
          • parallel work on orbit interlock system causing beam dumps
          • many issues lead to late (after midnight) restart of machine
      • Overview of potentially active feedbacks / automations
        1. scrubbing tool
        2. injection guard
        3. timing workaround
        4. timing master local mode
        5. SOFB by Masamitsu
        6. SOFB by Boris
        7. ?? Booster crosstalk suppression by Boris (feed forward table for corrector magnets depending on booster magnets ramping or not)
        8. PID Loop Regulator for Booster Extraction Septum
        9. ID feed forward

    • Booster/BRTL Optimization by {{Jonas}}

      • discovered large synchrotron oscillation after injection into booster
        • changing linac energy could not fix the issue
        • changing the booster RF phase by 70 degrees resolved the issue
        • due to link of booster and storage ring phase common phase optimization of SR is required after booster optimization
        • when the booster RF phase changed unclear
      • phase change in booster without changing storage ring phase would be a nice to have feature

    • Storage Ring Commissioning by {{Masamitsu}}

      • phase 1 to 6 mostly done
      • in case instabilities are encountered while increasing current to 400 mA the priority should be shifted to MBFB
      • ID feed forward table measurement procedure first implementation ready
        • optics for now tune correction sufficient
        • coupling feed forward not in scope of commissioning
        • beam dump tests with closed IDs to be done
      • Corrector settings in ARC 08 depend on beam current
      • For scrubbing could run the orbit response matrix measurement
      • Lifetime optimization at 50 mA could be improved from 5 to 12 hours
        • estimation for 400 mA at least 5 hours lifetime
      • aperture due to taper of super-3HC limiting injection and lifetime

    • Diagnostics by {{Cigdem}}

      • tunnel access
        • check alignment of X01 frontend
        • check location of BLMs for IDs
      • emittance measurements
        • horizontal presently not possible
        • vertical from pi polarization measurement
      • streak camera measurements
        • should be done for each current step

    • RF by {{Lukas}}

      • beam dump interlocks cause automatically RF beam dump in consequence
      • 3HC interlocks could come from instabilities, filling pattern or vacuum gauges being slower than RF
        • temperatures (HOM coupler, feedthrough) now at values like SLS-1 at 400 mA
      • MBFB thresholds: 200 um transverse, 50 ps Longitudinal
      • Curious: measure single bunch instability threshold
        • FPFB measurement has to be prepared (exchange attenuator)
        • explore feasible limits for camshaft bunch

    • BPMS by {{Boris}}

      • since Saturday preliminary transverse MBFB diagnostics using spare FPFB system
        • 4 um resolution
        • so far nothing to be seen
        • Mean(abs) written to AGEBD-PLAYGROUND:KEIL-02
      • DBPMA (BPMs without nearby corrector) show 0.5 to 1.5 um perturbation during top up
      • strong orbit drift when OFB is turned off (0.5 um/mA vertically, 2 um/mA horizontally)
        • source of vertical drift seem to be in sector 12
        • horizontal drift seems to be more global
        • pilot tone excludes electronic motion, i.e., only beam or BPM movement can explain observed drifts
        • finding/fixing source(s) of drifts should be priority
        • increased temperatures for DBPMA observed
        • um resolution encoder to check position of BPMs

    • Pulsed Magnets by {{Martin}}

      • Fabio has prepared scope with provisional cables
        • web interface not yet working but EPICS is
      • temperature increase in ceramic chambers at welding point to flange and pulse magnets themselves available and to be checked

    • MBFB kickers by {{Micha}}

      • stripling kicker aircooling will be replaced by water cooling during tunnel access tomorrow

  3. Requests

    • List of Requests

      • 5 short shifts - beam current increase
      • 1 shift - Thursday, LLRF-Tests -Messungen und -Optimierung, Lukas, Roger and Radoslaw
      • 2 shifts - SOFB commissioning, Boris
      • 1 shift - Measure beta functions and ADTS, Jesus (not Tuesday)
      • 1 shift for booster extraction, Jonas
        • confirm extraction at the right time
        • re-implement emittance exchange
      • 1 shift on timing after tunnel access, Romain and Felix
        • check overall usability and remaining compatibility with HLA for timing/filling control (backup and easier to test/implement features)
        • check injection guard functionality
        • check functionality of timing local mode for timing / filling control
        • check fix of 360 ps jitter to RF distribution

    • Machine shift schedule KW14

  4. AOB

    • Current increase shifts go for steps of 25 mA from now on.
    • Look into implementation of high level MBFB dump when instabilities are observed.

Minutes written by {{Felix}} -->

24/03/2025

Participants: {{Lukas}}, {{Boris}}, {{Jesus}}, {{Cigdem}}, {{Jonas}}, {{Romain}}, {{Martin}}, {{Micha}}, {{MartinB}}, {{Masamitsu}}, {{Volker}}, {{Michael}}, {{RomainG}}, {{Felix}}

  1. Introduction

    • Approval of last minutes

      • All those present confirm the minutes of the last meeting

    • Communication

      • Please send shift requests for coming week until Friday then I can prepare preliminary schedule for discussion in the meeting
      • For the convenience of the operators the machine shift and controlled tunnel access tables are located on dedicated subsites of the SLS 2.0 Operations Management website:
      • Please remember to always inform the control room, i.e., the operators before starting and after finishing your shift and also before any other actions that could impact machine operation
      • Machine Shift Reports
        • Please prepare shift reports in elog. These will be linked in the machine shifts table.
        • For SLS 2.0 commissioning shifts a template for the elog entries is prepared and will be automatically loaded when choosing the project "SLS-2 Commissioning" in the SLS Development Logbook

  2. Reports

    • Operation / Vacuum Conditioning by {{Felix}}

      • Summary of Vacuum Conditioning Activities (focus: past weekend)
        • ??? info "Plots" Image{ align=left } Image{ align=left }
        • beam dose increased over weekend from 24.4 Ah to 35.7 Ah
        • average current 175 mA with 2.9 h lifetime at 1.6 Lossratio
        • max stable current 200 mA with 3.2 h lifetime at 1.5 Lossratio
        • achieved lifetime * beam current ~570 mAh
        • vacuum pressure improved from 16 to 11 pbar at 200 mA
        • SLS-LOG 60263
      • Encountered Issues
        • Vacuum pump accidentally switched to self cleaning mode during free tunnel access
        • Beam dump kicker turned off after shutdown, no safety net (injection guard does check but can only actively inhibit injection after next timing update)
        • Pulsed magnets need special puls width of 1 us from the timing system but are connected to old EVR without GUI for checking/controlling subscribed event and pulse width
          • side effect / bug introduced with refactoring of timing system
        • SR RF takes ~60 minutes to get back to nominal values after RF interlock (downtime)
        • SR RF usually not handling load jump after beam interlocks from other systems well, i.e., 3/4 stations usually self interlock in consequence
        • SR RF directly triggering machine interlocks (22.03.: 05:11, 10:50, 11:47, 13:24, 19:59; 23.03.:10:21, 11:09)
        • SR RF not inhibiting injection --> added RF ready check to injection guard and asked operators to check this panel before injecting
          • It is important to wait until all cavities are at nominal voltage otherwise forward power is limited
        • BPMs lost calibration resulting in scrubbing tool continuously injecting (since then PCT crosscheck implemented)
        • PLC Piquet not yet trained for MIS
          • ARS01-MSXT-2200 PS Off locked
          • Temperature sensor defect (-3228 deg) could not be diagnosed and fixed
          • Piquet statement: we are only responsible if entire MIS fails not single sensors
        • Machine Expert Piquet training needed
        • We need to be extremely careful not to create the impression that priority is or can now be shifted to beamline tasks
          • we are still far from having reached the anticipated machine state for user operation
          • ??? info "We are so far slower at accumulating beam dose than anticipated" Image{ align=left }
          • many machine systems are not yet commissioned or running stable (timing, RF, feedbacks, diagnostics, operation, PLC systems, ALH, ...)
          • extending tunnel access for beamline work and providing free instead of restricted tunnel access could lead to misconception of our machine readiness state

    • Booster/BRTL Optimization by {{Jonas}}

      • After timing update, the magnet ramps had to be shifted by 2.5 ms earlier
        • in consequence the extraction time shift was forgotten
        • after this was fixed injection to storage ring was good again
        • emittance exchange was lost during this issue
      • better optimization for 200 pC optimization required

    • Storage Ring Commissioning by {{Masamitsu}}

      • Commissioning Progress Overview
      • Phase 5 not quite complete
      • Phase 6 started
        • X04 undulator CPMU14
          • ORM for measured obtaining 1st version of feed forward table
          • gap control not clear
          • for 20 to 12 mm no orbit disturbance, peak at 8mm, at 4 mm orbit disturbance very small again
          • lifetime and losses stable during gap change
        • X06 undulator U19
          • closing gap tested
          • vacuum issues in frontend leading to beam interlock
        • continue this week with 10, 12, 09

    • Diagnostics by {{Cigdem}}

      • beamline issues unclear
        • alignment for at least 1 bad
      • PCT measurements
        • communication with BDC to be validated
        • master switched to PCT 0200 for now
      • streak camera
        • delay shifting only possible locally at beamline console
        • more updates from timing required

    • RF by {{Lukas}}

      • interlock now takes current reading into account via EPICS
        • less vacuum interlocks
        • EPICS current measurement required
      • ramping up triggers beam dumps
        • feature should be switched off without beam to avoid unnecessary interlocks
      • super-3HC tuned roughly
        • for currents > 200 mA retuning recommended
        • tuning during ramp up like for SLS-1 should not be required
        • Longitudinal MBFB available (not hardwired to BDC yet)
      • increasing current
        • increase only during daytime, not nights
        • power margin and operating point of amplifiers
        • current forward power limit 80 kW

    • BPMS by {{Boris}}

      • pilot tone now continuously activated
      • observed drifts/noise
        • see DEV-LOG 2447
        • some 100 um drift during accumulation to 200 mA -> betatron motion
        • ~5 um betatron motion during top up
        • hypothesis
          • thermal heatup moving vacuum chamber moving magnets
          • fast and slow heatup effect observed
        • electronic noise on order of ~200 nm
      • Bunch arrival time GUI displaying modes (i.e., FFT of arrival time variation)
      • DSP group found bug causing linux driver crashed
        • FW until end of month for FOFB interface
        • FOFB commissioning to start next month
      • Steps on FPFB / arrival time measurement was caused by reflections in cables
      • attenuator for FPFB prepared for maximum 400 mA or 1.5 nC single bunch current
      • Next steps MBFB is providing displays of transverse plane (lower priority than FOFB)
      • Orbit interlock at plusminus 500 um

    • Pulsed Magnets by {{Martin}}

      • priority now on protection of beam dump kicker

    • MBFB kickers by {{Micha}}

      • link to elog with plots coming soon...
      • transverse modes
        • fast beam ion instability should go away with vacuum scrubbing
      • results
        • Longitudinal MBFB kicker: signals looking nice, fast amplitude decay after kick (roll-off)
        • transverse kicker: no HOM signatures, offset tests in kicker (too small) no clear result (short vacuum pressure rise)
      • heatup issue
        • feedthroughs at 200 mA around ~40 deg, body at ~60 deg
          • feedthroughs can survice upto 150 deg (manufacturer specification)
        • clearly linked to SiC absorbers
        • passive cooling blocks improve situation well
          • water cooling in preparation, maybe needed to go over 300 mA
          • absorbers in screen monitors also need to be checked
        • downstream horizontal getting significantly hotter
        • with standard fill pattern (1 gap) less heatup expected
        • request: reduce gap length

  3. Requests

    • List

      • 1-2 shifts for LLRF tests, Lukas and Roger
      • 1-3 shifts for ID feed forward development, Simona and Masamitsu
      • 1 shift for lifetime measurements, Felix
      • 1-2 shifts for timing and Injection guard tests, Romain and Felix
      • 1 short shift for current increase
      • 2 shifts for Current increase
      • 2 shifts for SOFB commissioning, Boris

    • Machine shift schedule KW13

  4. AOB

    • BBA studies required to understand corrector issue but can be postponed

Minutes written by {{Felix}}

17/03/2025

Participants: {{Micha}}, {{Michael}}, {{RomainG}}, {{Masamitsu}}, {{Cigdem}}, {{Lukas}}, {{Jesus}}, {{Jonas}}, {{Felix}}

  1. Introduction

    • Approval of last minutes

      • All those present confirm the minutes of the last meeting

    • Communication

      • Please send shift requests for coming week until Friday then I can prepare preliminary schedule for discussion in the meeting
      • For the convenience of the operators the machine shift and controlled tunnel access tables are located on dedicated subsites of the SLS 2.0 Operations Management website:
      • Please remember to always inform the control room, i.e., the operators before starting and after finishing your shift
      • Machine Shift Reports
        • Please prepare shift reports in elog. These will be linked in the machine shifts table.
        • For SLS 2.0 commissioning shifts a template for the elog entries is prepared and will be automatically loaded when choosing the project "SLS-2 Commissioning" in the SLS Development Logbook

  2. Reports

    • Operation / Vacuum Conditioning by {{Felix}}

      • Summary of Vacuum Conditioning Activities (focus: past weekend)
        • classical ion instability
          • observed as vertical beam size blow up and dipole oscillation on the vertical TbT data
          • improving vacuum and filling pattern should help
          • problem solved with the filling pattern proposed by Micha, i.e., two gaps of 50 buckets each
        • beam dose increased over weekend from 7.7 Ah to 16.4 Ah (more than doubled)
        • average current 150 mA with 2 h lifetime at 1.9 Lossratio
        • max stable current 170 mA with 1.5 h lifetime at 2.7 Lossratio
        • lifetime * beam current ~330 mAh
        • loss ratio vs. nominal SLS 2.0 (400 mA, 10 h lifetime) < 3.5
        • vacuum pressure improved from 2.5E-8 mbar at 150 mA to 1.6E-8 at 150 mA
        • Overall 3 beam dumps
          1. Saturday evening 19:02 - SR LLRF triggers beam dump, after this event the machine performance is significantly worse for 12 hours
          2. Sunday evening 20:56 - FOFB triggers beam dump after Boris turns noisy BPM on and off, SR RF self triggers interlock too (error)
          3. Sunday evening 22:52 - VCS lost connection to valve in sector 9 VVPG-0250 and Ion Pump Controllers in Sectors 12 and 4
        • side not: stable 2 nC single bunch confirmed
      • Identified Issues
        • MBFB Kicker reaches interlock temperature limit at 150 mA
        • SR RF limited to 65 kW and showing strange regulation behavior close to 65 kW
        • SR RF startup issues causing downtime on the order of ~1 hour
        • SR RF interlocks self-triggered unnecessarily after other beam interlocks requiring to restart the RF and thus adding downtime
        • Change in current (i.e., temperature of vacuum chamber and components) leads to vertical betatron motion indicating magnetic dc kick, e.g., from chamber moving magnets (see also SLS-LOG 60619)
        • virtual circuit disconnect for SOFB from Masamitsu
        • horizontal error in SOFB from Boris leads to losses/very small lifetime during injection
        • Some vacuum temperature sensors hot (sectors 6, 7, 9 and 10)
        • magnetic coupling between correctors in BRTL and storage ring -> install shielding (not urgent)
      • Boundary condition this week:
        • !!! max 0.5 nC single bunch and max 200 mA overall otherwise risk destroying FPFB RFSOC due to installed attenuator optimized for good SNR for upto 200 mA over 400 buckets -> maybe Boris can install some RF limiters
        • filling pattern for 200 mA: 0-200 240-440
      • Overview of potentially active feedbacks / automations
        1. scrubbing tool
        2. injection guard
        3. timing workaround
        4. SOFB by Masamitsu
        5. SOFB by Boris
        6. ?? Booster crosstalk suppression by Boris (feed forward table for corrector magnets depending on booster magnets ramping or not)
        7. PID Loop Regulator for Booster Extraction Septum

    • Booster/BRTL Optimization by {{Jonas}}

      • Orbit correction at end of booster ramp implemented to decouple the beam
        • improved the injection into the storage ring
      • Implementation of emittance exchange
        • reduced losses at 3HC taper in sector 9 by factor 2
        • injection efficiency
      • Linac optimized for high charge by Volker
        • 32 mA/min injection confirmed stable
        • max injection rate usually limited by injection to booster

    • Storage Ring Commissioning by {{Masamitsu}}

      • Orbit, optics and coupling correction implemented
      • vertical emittance controlled by vertical dispersion
      • time available to give priority to scrubbing
      • mechanical alignment can stay as is for now
        • If lifetime is not good enough when scrubbing is done this may have to be reconsidered
      • Now starting phase 6: insertion devices
        • Test movement of ID, check losses
        • two vertically separated BLMs can be used for optimizing the vertical alignment of IDs
        • only one BLM available per beamline

    • Diagnostics by {{Cigdem}}

      • A master beam current PV has been setup and is called ARS07-DPCT-0000:CURR.
        • Currently it is pointing to ARS07-DPCT-0100:CURR
        • Daniel will be testing the new FEE to replace the PAC modules on Monday.
          • They intend to test both the "Old PCT" (ARS07-DPCT-0100) and the "NPCT" (-0200) separately
          • Thus the control room always has a valid current reading from one of the two PCTs.
      • ??? info "X08DB monochromator temperature"
        • unexpectedly rising with beam current -> to be investigated Image{ align=left }
      • X01DD 1st zone plate aligned, beam on detector, measured beam size to be verified
      • streak camera working, more work on controls integration and timing required

    • RF by {{Lukas}}

      • PID controller for 3HC He level has new SW
        • when He level falls below 1% -> interlock via MIS
        • ALH only monitors temperatures
      • LLRF Interlocks at beam dumps to be investigated
        • reflected power interlock not working as desired
        • tuning control issue
        • beam dump event could be used to prepare for beam dump but not yet available from timing
      • VCS interlocks
        • issue with controller
      • Current should not go above 200 mA until issues understood
        • power limit will be increased to enable 200 mA

    • MBFB kickers by {{Micha}}

      • ??? info "MBFB Kicker"
      • SiC dampers next to feedthroughs for damping HOM -> heat up expected but stronger
        • additional heatup (exceeding expectation) could be due to filling pattern
        • SiC absorbers can heat up to 1000 deg without problems expected
        • quadratic correlation with beam current indicates RF power and not synchrotron radiation cause
      • Feedthroughs are ok upto 200 °C
      • Tunnel Access
        • check location of sensors
        • move sensors to feedthroughs
        • install external cooling blocks to SiC dampers
        • Goal: prove that SiC is source of heat

  3. Requests

Minutes written by {{Felix}}

10/03/2025

Participants: {{Boris}}, {{Jonas}}, {{Jesus}}, {{Cigdem}}, {{Martin}}, {{RomainG}}, {{Lukas}}, {{Masamitsu}}, {{Michael}}, {{Micha}}, {{Felix}}

  1. Introduction

    • Approval of last minutes

      • All those present confirm the minutes of the last meeting

    • Communication

      • Please send shift requests for coming week until Friday then I can prepare preliminary schedule for discussion in the meeting
      • For the convenience of the operators the machine shift and controlled tunnel access tables are located on dedicated subsites of the SLS 2.0 Operations Management website:
      • Machine Shift Reports
        • Please prepare shift reports in elog. These will be linked in the machine shifts table.
        • For SLS 2.0 commissioning shifts a template for the elog entries is prepared and will be automatically loaded when choosing the project "SLS-2 Commissioning" in the SLS Development Logbook

  2. Reports

    • Operation / Vacuum Conditioning by {{Felix}}

      • Machine state after shutdown (to be verified)
        • hopefully prerequisites for aggressive scrubbing are soon fulfilled, i.e.,
          • injection efficiency above 80 %
          • beam dump kicker available and tested
          • fast interlock for orbit
          • fast interlocks for CBI
          • 3HC tuning with streak camera
      • Machine Protection
        • ALH unfortunately still mostly undefined, i.e., many important alarms not yet available
        • Injection Guard
          • MAC recommended to implement
          • Preliminary GUI and IOC are ready
          • If timing is ready the HLA with first checks will be ready for machine startup
          • Follow-up meeting today
        • Vacuum Interlocks
          • MAC recommended to
            • increase interlock thresholds to 5e-7 mbar
            • add deadband of 5 s before closing valves or dumping beam
          • Issues
            • individual interlock tuning cumbersome
            • exceptions concerning deadband required for 3HC
            • unclear if PV ARIVA-VMAVE:PRESS-MAX really includes all relevant pressure measurements
          • Follow-up meeting soon
      • Vacuum Conditioning
        • Proposed daily schedule
          • 08:00 - 10:00 | OP Training
          • 10:00 - 14:00 | Shift 1
          • 14:00 - 18:00 | Shift 2
          • 18:00 - 08:00 | Beam scrubbing during night
        • If we stick to this schedule:
          • KW11 = 3 * 14 + 62
          • KW12 = 4 * 14 + 62
          • KW13 = 4 * 14 + 62
          • KW14 = 4 * 14 + 62
          • KW15 = 4 * 14 + 62
          • KW16 = 2 * 14
          • KW11 + KW12 + KW13 + KW14 + KW15 + KW16 = 604 hours of vacuum conditioning
        • Accumulated beam dose so far: 4 Ah of required 100 Ah
          • With proposed schedule
            • 96 Ah / 604 h = 159 mA
          • From experience beam scrubbing realistically starts at 22:00
            • 96 Ah / 500 h = 192 mA
        • It will be very challenging to achieve the vacuum conditioning goal until the next shutdown
          • OP will "donate" 2 hours of self learning training in the mornings to beam scrubbing (maybe with decaying beam)
          • Commissioning shifts should try to stop in the evenings until 6 PM
          • All interlocks should be followed up and future avoidance measures studied

    • Linac/LTB Optimization by {{Volker}}

      • OP training starting 10 AM

    • Booster/BRTL Optimization by {{Jonas}}

      • Optimization during shutdown weekend with beam
        • orbit correction at end of ramp improved
        • matching in BRTL improved
        • corrector ramps now required
        • emittance exchange prepared
          • achieved ex 4.5, ey 11
          • available as option

    • Storage Ring Commissioning by {{Masamitsu}}

      • first priority: injection studies
      • 2-3 days required for optics and orbit correction

    • Diagnostics by {{Cigdem}}

      • streak camera
        • issue with jitter between timing master and RF distribution (overall issue)
        • Helge needs more time
      • PCTs
        • some of the issues were coming from the frontend electronics -> bypass
        • test solution with DPCT2 and implement for one when confirmed working
      • Frontends
        • fixed and baked out
      • FPM
        • FW ready

    • RF by {{Lukas}}

      • Linac running since Friday (beam on spectrometer)
        • stability improvement not yet checked
        • interface box of charging unit for klystrons replaced (problem with overvoltage supervision)
        • additional amplifier for SPB and additional diagnostics installed
        • timing issue to be clarified
      • 3HC
        • alternatives to streak camera:
          • network analyzer at 50 mA
          • single bunch lifetime
        • status
          • cold again
          • tuner working
          • fast voltage interlock drifting and stepping, i.e., not stable yet
      • Main RF 500 MHz system
        • FW improved, new release expected tomorrow
        • handover between amplitude, power, phase controllers improved
        • current readback from PCT interface added
        • LLRF feedbacks to be tested at high currents
      • Booster RF
        • shielding of RF leakage improved -> check with beam
      • Spare cavity now in teststand
        • conditioning planned to start end of this week

    • BPMS by {{Boris}}

      • PDU have been update by external company and are now properly network configured, i.e., have hostname
      • all DBPM3 electronics working
        • 3 backends repaired
        • 5 frontends recalibrated
      • OFB
        • DSP group delayed (1 FW developer unavailable)
        • new FW end of march, required for FOFB
        • slow OFB via EPICS being prepared by Goran
      • BPM experts not available this week
      • Interlocks
        • orbit tested and working
        • CBI earliest in 2 weeks
      • FPFB
        • data from FPM available
      • Timing
        • no progress from Romain since dedicated to SwissFEL timing

    • Pulsed Magnets by {{Martin}}

      • Beam Dump Kicker
        • running in cabinet since yesterday until 10 PM
        • issues
          • failing (sparking and shorts) cables from Huber+Suhner AG
            • pulser damaged
            • main switches look good
            • protection diode of driver blew up
          • self-failure detection not yet available (workaround via EPICS possible)
          • long cables not yet tested (redundancy of 4)
        • 50 % should be available
        • magnet assembly fine, installation today
        • for commissioning
          • use pinger event for easier synchronization with BPM TbT measurement and Libera loss monitors
      • General issue
        • no reserve switches or caps for 4 kicker bump, thin septum, ...
        • delays
          • charging chain of booster extraction septum not yet improved (no time this shutdown)
          • current monitors of thin septum not updated
        • unclear if timing is suppressing 4 kicker bump
      • Martin not available next week

    • MBFB kickers by {{Micha}}

      • status
        • cabling should be done
        • patching this afternoon for kickers and amplifiers
        • RF check with network analyzer tomorrow

    • Guests by {{Michael}}

      • SOLEIL
        • 17.03.2025 - 21.03.2025
        • Alexis Gamelin, Vadim Gubaidulin
      • ELETTRA
        • 17.03.2025 - 20.03.2025
        • Marco Lonza, Stefano Cleva, Stefano Krecic
      • NSRRC
        • 24.03.2025 - 04.04.2025
        • Nuan-Ya Huang, Hao-Wen Luo
      • DIAMOND
        • 24.03.2025 - 26.03.2025
        • Ian Martin, Lorraine Bobb

  3. Requests

    • General Remarks by {{Felix}}

      • Shift schedule
      • Daily schedule
        • 08:00 - 10:00 | OP Training
        • 10:00 - 14:00 | Shift 1
        • 14:00 - 18:00 | Shift 2
        • 18:00 - 08:00 | Beam scrubbing during night

    • Many

        1. Check and optimization of injection efficiency BRTL to Ring
        1. Optimization of injection efficiency Linac to Ring
        1. Optimization of injector stability

    • {{Martin}} and {{Felix}}

      • Beam Dump Kicker Commissioning

    • {{Lukas}}

      • 3HC tuning with network analyzer and lifetime measurement at > 50 mA
      • LLRF feedbacks to be tested several times at high currents, i.e., 50 mA
      • Test new LLRF FW -> switch booster RF on and off a couple of times (1h)

    • {{Micha}}

      • parasitic measurements this week
      • Shift with single bunch for testing the MBFB kickers next week
        • Elettra colleagues are arriving at PSI on Monday 17th at about 13:00 and leave on Thursday 20:00

    • Machine shift schedule KW11

  4. AOB

    • SLS operator expert piquet
      • the operator IB team is only available until easter
      • to bridge the gap until the summer shutdown this team will provide an SLS operator expert piquet (tbc)
      • the idea is to lower the threshold/hesitation for the shift crew to ask for help when questions arise

Minutes written by {{Felix}}

17/02/2025

Participants: {{Micha}}, {{Michael}}, {{Karsten}}, {{Martin}}, {{Jesus}}, {{Boris}}, {{Cigdem}}, {{Jonas}}, {{Simona}}, {{Hans}}, {{Lukas}}, {{Masamitsu}}, {{Volker}}, {{Felix}}

  1. Introduction

    • Approval of last minutes

      • All those present confirm the minutes of the last meeting

    • Communication

      • Please send shift requests for coming week until Friday then I can prepare preliminary schedule for discussion in the meeting
      • For the convenience of the operators the machine shift and controlled tunnel access tables are located on dedicated subsites of the SLS 2.0 Operations Management website:
      • Machine Shift Reports
        • Please prepare shift reports in elog. These will be linked in the machine shifts table.
        • For SLS 2.0 commissioning shifts a template for the elog entries is prepared and will be automatically loaded when chosing the project "SLS-2 Commissioning" in the SLS Development Logbook

  2. Reports

    • Operation / Vacuum Conditioning by {{Felix}}

      • Machine state after weekend (08:00 AM today)
        • ??? quote "Plots" Image{ align=left } Image{ align=left } Image{ align=left } Image{ align=left } Image{ align=left } Image{ align=left } Image{ align=left } Image{ align=left } Image{ align=left }
        • Beam Current ~25 mA @ 5 h lifetime
        • Lifetime * Beam Current ~120 mAh
        • Beam dose ~4.1 Ah
        • Injection efficiency ~40 %
      • Machine Protection
        • Besides the prerequisites for high current (beam dump kicker, 3HC tuning with streak camera and fast interlocks for orbit and CBI) that we focused on in the last meeting, we also need to focus on improvement of our losses during scrubbing and in general
          • injection losses -> we should put more effort into injection optimization (as long as we are below 50 % we are accumulating more losses from injection than from lifetime and interlocks combined)
          • interlock losses -> please follow up on interlock beam dumps

    • Alignment by {{Karsten}}

      • Karsten presents an overview of the aligment campaign results as of now: download
      • Reproducibility of Mis- and realignment of triplet in Arcs 04,05,06 & 08 on the order of 200 um
        • 10 μm if enough time is given
        • if done in shutdown -> 3 weeks before testing is possible
        • values for required shifts could be given by BD
        • test different strategies in different arcs ?
        • do it today?
          • alignment group needs ~2 h preparation but is ready

    • Linac Optimization by {{Volker}}

      • 2 Settings for low and high charge established with operators
      • error bars for transmission very significant at low charge -> go to high charge for optimization

    • Storage Ring Commissioning by {{Masamitsu}}

      • elog
        • Residual ORM difference model/machine optimized down to ~3 % in comparison to SLS-1 at ~1 %
        • In model correction of optics using matching quads (separate from optics defining quads in contrast to SLS-1) was always possible thus the goal of getting below 1 % is reasonable
        • Orbit contribution cannot be excluded

    • Diagnostics by {{Cigdem}}

      • Pi-Pol measurement required before shutdown? -> no
        • 6 μm beam height measured
        • easily increased by increasing coupling
        • coupling and vertical spurious dispersion contribute to vertical emittance

    • RF by {{Lukas}}

      • 3HC warm up this Wednesday

    • BPMS by {{Boris}}

      • Storage ring BPM measurement dominated by booster magnet ramps until this weekend
        • introduction of 25 dB supression of this 3 Hz signal significantly improved the ring BPM measurement with booster magnets ramping
      • Real peak to peak orbit motion on the order of 10 μm vertically over some hours observed
        • betatron oscillation at 20 mA much stronger than at 4 mA
      • thermal drift
      • alignment vs bba
      • CBI requires single bunch shift -> after shutdown
      • Orbit interlock prepared, today check parasitically and tomorrow live

    • Pulsed Magnets by {{Martin}}

      • FoCusing on beam dump kicker

  3. Requests

    • Tunnel Access

      • Today for alignment of taper at end of injection straight after kicker 4
      • Soon for attempt of correcting triplet alignment
        • misalignment of triplet preferred radially to the inside otherwise collision of chamber and triplet risk and difficult tooling situation
        • towards outside is required by beam dynamics
        • The attempt shall be performed today in ARS06 with one triplet upstream of central triplet to be moved 300 μm towards the outside (on second girder)
        • Results alignment group: Image{ align=left }
        • Results beam dynamics: SLS-LOG 60030

    • Machine shift schedule KW08

Minutes written by {{Felix}}

10/02/2025

Participants: {{Jonas}}, {{Michael}}, {{Martin}}, {{Simona}}, {{Jesus}}, {{RomainG}}, {{Masamitsu}}, {{Felix}}

  1. Introduction

    • Approval of last minutes

      • All those present confirm the minutes of the last meeting

    • Communication

      • Please send shift requests for coming week until Friday then I can prepare preliminary schedule for discussion in the meeting
      • For the convenience of the operators the machine shift and controlled tunnel access tables are located on dedicated subsites of the SLS 2.0 Operations Management website:
      • Machine Shift Reports
        • Please prepare shift reports in elog. These will be linked in the machine shifts table.
        • For SLS 2.0 commissioning shifts a template for the elog entries is prepared and will be automatically loaded when chosing the project "SLS-2 Commissioning" in the SLS Development Logbook

  2. Reports

    • Operation / Vacuum Conditioning by {{Felix}}

      • Machine state after weekend (07:15 AM today)
        • Conditioning Tool
        • Beam Current ~23 .5mA @ 3.1 h lifetime
        • Lifetime * Beam Current ~80 mAh
        • Beam dose ~1.85 Ah
        • Injection rates to Ring ~0.5 mA/min at 185 V Gun Grid
      • Tunnel Access
        • After every tunnel access the expert groups must
          • bring their systems back to the state they were before, i.e., turn on and bring to old set values
          • report relevant changes they have made to the control room
      • Consolidation
        • Jonas and I are working on a list, please let us know if you have anything to be added

    • Linac Optimization by {{Volker}}

      • Injection optimization studies on SM-E
        • observation of lost beam every 2 minutes or so implies strong drifting/instability of the Linac
      • looking into low charge operation, i.e., 20 pC as now in use
        • adjustment of gun fine delay (i.e., in reference to other linac RF) required
      • In general the stability of the Linac does not meet the expectations

    • Booster/BRTL Optimization by {{Jonas}}

      • Booster decoupling
        • large coupling in booster results in large vertical emittance
        • decoupling minimizes vertical emittance
        • required for emittance exchange
        • so far not working as well as expected, i.e., C=0.07 at the moment

    • Storage Ring Commissioning by {{Masamitsu}}

      • Orbit correction still limited (peak 150 um)
      • optics correction nevertheless started
        • quick LOCO measurements using TbT data
        • seems to be converging
        • vertical plane good
        • horizontal plane beta beat upto +- 100% for bare machine
      • TbT data observations (does not affect stage2 based closed orbit measurements)
        • taking every 8th point of waveform as agreed with Boris/Jonas (8 MS/s) done so far is now in question
          • beam not lost at half integer resonance
          • synchrotron tune factor 2 off compared to expectation from model
          • synchrotron oscillation frequency measured on BPM TbT data factor 2 off compared to spectrometer measurement by Lucas during excitation
        • taking every 4th point (i.e., 4 MS/s) leads to factor 2 for measured tunes
      • AN Magnet close to most strongly excited corrector/BPM to be moved during tunnel access this week
        • ARC06
        • good exercise to check orbit correction by misalignment

    • Diagnostics by {{Volker}}

      • PCT measurement should be looked into by AEK
        • Higher resolution ADC should be used (bit resolution of 16 bit is much smaller than analog resolution of PCT)
      • Repair of frontends X01DD and X08DB
        • discussion this Thursday
        • feedthrough of both has too little range
        • horizontal motion of slits was not limited and now the elements are deformed
        • prolonging shutdown might be required for this
        • streak camera measurement in X08DB should not be affected and implies priority for X08DB
        • implications for other frontends unlikely, i.e., designed by other people

  3. Requests

    • General Remarks by {{Felix}}

      • Machine shift schedule KW07

      • General commissioning schedule for KW07

        • Operations does vacuum conditioning from 18:00 until 08:00
        • Operator training from 08:00 until 09:00
        • Linac/Booster Optimization until 10:00
        • Storage Ring Commissioning until 18:00
        • RF, diagnostics and BPM development mostly in parallel

      • Tunnel Access

      • Timing

        • FW upgrade during tunnel access --> to be tested afterwards
        • Switch from 125 to 100 MHz was not done during last tunnel access and remains to be done
          • will require recommissioning of timing after tunnel access

  4. AOB

    • Status display

      • status display panel is available
        • server for publishing to internet is on cluster that is down
        • publication via Wica under development
      • for now maybe still:
        • nx-term.psi.ch
        • ssh sls-lc
        • launcher
        • SLS Launcher > Panels in Arbeit > Strahlwaschen

    • Machine Risk: Kicker Bump

      • Accidentally misadjusting the 4 kicker bump can easily lead to loss of the entire beam at the thin septum blade
        • dedicated meeting for this topic

Minutes written by {{Felix}}

03/02/2025

Participants: {{Boris}}, {{Felix}}, {{Jesus}},{{Masamitsu}}, {{Simona}}, {{Jonas}}, {{Michael}}, {{Micha}}, {{Lukas}}, {{Hans}}

  1. Introduction

    • Approval of last minutes

      • All those present confirm the minutes of the last meeting

    • Communication

      • Please send shift requests for coming week until Friday then I can prepare preliminary schedule for discussion in the meeting
      • For the convenience of the operators the machine shift and controlled tunnel access tables are located on dedicated subsites of the SLS 2.0 Operations Management website:
      • Machine Shift Reports
        • Please prepare shift reports in elog. These will be linked in the machine shifts table.
        • For SLS 2.0 commissioning shifts a template for the elog entries is prepared and will be automatically loaded when chosing the project "SLS-2 Commissioning" in the SLS Development Logbook

  2. Reports

    • Operation / Vacuum Conditioning by {{Felix}}

      • Machine state after weekend (07:15 AM today)
        • Conditioning Tool
        • Beam Current > 17 mA
        • Lifetime ~1.5 h
        • Beam dose ~600 mAh
        • Transmission BRTL to Ring ~60 %
      • Machine protection
        • First priority is beam dump kicker (prerequisite for phase 5)
        • Other open points
          • Achieve stable high injection efficiency
            • Stability of pulsed magnets, especially booster extraction septum
            • Orbit and optics correction storage ring
            • SOFB storage ring
            • Tune FB storage ring
            • Matching BRTL
            • Orbit correction BRTL (OFB?)
          • Measurement and interlock of CBI, i.e., MBFB
            • Cables missing until Feb. shutdown
            • No calibration and thus absolute measurement possible until then
            • Empirically determined threshold for interlock
          • Control of filling pattern
          • Fast interlock for super-3HC (also requires beam dump kicker)
            • New LLRF available soon, temperature readout in control system still missing

    • Booster/BRTL Optimization by {{Jonas}}

      • Tunes at ramp beginning of ramp improved
      • Chromaticity measured over ramp
        • small positive Chromx
        • small negative Chromy
      • BRTL not optimized since January
        • Matching needs to be done
          • Quad scan done but matching not implemented
        • Orbit not yet optimized

    • Storage Ring Commissioning by {{Masamitsu}}

      • Frequency adjustments
      • Orbit Correction
        • BBA done
        • working very well for Y (full matrix inversion)
        • horizontal plane corrector saturation for full correction
        • checking and maybe correcting alignment required for arcs 4,5,6,8 and 11
      • Optics correction
      • overall kind of stuck at end of phase 4

    • Injection Elements by {{Martin}}

      • waiting for controls preparation of expert panels for pulsed magnets
        • temperature sensors need to be connected
      • working on monitoring output of all pulsed magnets
      • working on first section of beam dump kicker
        • several offers for caps
        • order today
        • delivery times on order of 20-30 weeks
        • backup solution with 50% until thee
        • get caps from somewhere else?
          • very specific low inductance, high current and voltage caps -> difficult to find
          • old PFN caps from RF
          • confirmation of required field in first section required and coming this week
          • other labs?
            • not widely asked
            • felix attaches specsheet: here
      • neck injury of colleague might slow done control system HW
        • working 25 % from home
      • kicker bump leakage
        • probably forgotten to check alignment in roll direction -> needs to be done
        • working with non-symmetric bump new situation
        • measure roll for each kicker by kicking individually and measuring beam based the ratio of horizontal and vertical kick

    • RF by {{Lukas}}

      • Storage Ring Main RF
        • Bring up voltages
        • Align SR 3 with beam (might take some time since off for one week)
        • go to 1.4 MV
        • synchrotron tune measurement modulating cavities possible
          • measuring synchrotron frequency at dispersive BPM possible
      • Super-3HC
        • Alignment during tunnel access wanted but lower priority than alignment check of arcs
        • ETA for cooling readout in EPICS not yet known, ASAP
      • Booster RF
        • shielding work for RF to reduce disturbing BPM measurements
      • Linac
        • replacement of charging unit for PFN A1 planned for tunnel access tomorrow

    • Machine expert piquet

      • Call by operators on Saturday
      • Increasing charge from gun requires thorough checking of the injection efficiency into the storage ring
      • Cause often is the booster extraction elements

    • Diagnostics by {{Cigdem}}

      • Fill pattern monitor ADC not locking to clock
      • Ring PCTs
        • First one kind of ok while running at 1 Hz
          • not good enough for calculation of injection efficiency or lifetime -> further improvement required!
        • Second one ADC saturated
      • Frontends
        • X01DD only see reflections
          • suspicious candidates
            • crotch absorber opening too small
            • alignment
          • investigations
            • setup camera outside to investigate
            • shift with pointing adjustment from stored beam
            • important also to avoid requiring large orbit bumps for beamlines
            • should be understood soon since maybe relevant for all beamlines
        • X08DB beam being cut somewhere -> essentially same story as X01DD

    • BPMs by {{Boris}}

      • 2 BPMS in close vicinity to storage ring RF show noise
        • same shielding
      • Some BPM measurements shown
        • injection bump not well closed and vertical leakage visible
        • visible during open and after closing of bump
        • synchrotron period around 300 turns instead of expected 500, i.e., frequency factor two too high
        • Frequency spectrum shows
          • Orbit motion 10 micron peak to peak at 3 Hz indicates users will not be happy without FOFB
            • probably related to booster magnets ramping
            • 3 stages: 8 MS/s TbT, 20 Khz, 20S/s 5Hz for closed orbit and last stage BW could be changed to 1 Hz to get rid of this
            • at the moment problems at 300 μm
      • Booster RF leakage supressed by factor 50
        • connecting outer shields of individual patch cables
        • tightening SMA connectors (many loose)
      • FOFB interface not yet ready (DSP group outstanding work)
        • Goran preparing slow EPICS OFB
      • FPFB measurement working well
        • every 12th bucket filled and this weekend neighbouring bucket of these too
      • Felix points out that lifetime and injection efficiency are calculated using the BPM intensity measurement and thus please inform before changing gain/calibration factors

  3. Requests

    • General Remarks by {{Felix}}

      • Shift schedule

      • General commissioning schedule for KW06

        • Operations does vacuum conditioning from 18:00 until 08:00
        • Operator training from 08:00 until 09:00
        • Linac/Booster Optimization until 10:00
        • Storage Ring Commissioning until 18:00
        • RF, diagnostics and BPM development mostly in parallel

      • Tunnel Access

      • Timing

        • Switch from 125 to 100 MHz during tunnel access
        • will require recommissioning of timing after tunnel access

    • {{Jonas}}

      • Booster beam decoupling: 4 hours
        • Parallel SR operation OK but booster RF must be on. Refills can be done with 10 minutes notice.
      • Booster emittance exchange: 4 hours
        • Parallel SR operation OK but booster RF must be on. Refills can be done with 10 minutes notice.
      • BRTL adjustment + energy spread measurement: 2 hours
        • Parallel SR operation OK but booster RF must be on. Refills not possible.
      • Availability:
        • Monday: 10:30 -> end of day
        • Tuesday-Friday: 9:30 -> end of day

    • {{Lukas}}

      • Phase scan for SR 3 cavity and keeping all cavities on
      • Investigate synchrotron frequency

    • {{Cigdem}}

      • Orbit variation to see light in X01DD

    • Table KW04

      Time
      		 Description
      ELOG
      Contact
      00:00 - 08:00 OP Shift Summary ... Shift Crew
      07:00 - 11:00 Tunnel Access {: colspan=3}
      11:00 - 18:00 Recommissioning of the timing system ... {{Romain}}

  4. AOB

    • Status display
      • status webpage coming soon...
      • for now maybe:
        • nx-term.psi.ch
        • ssh sls-lc
        • launcher
        • SLS Launcher > Panels in Arbeit > Strahlwaschen

Minutes written by {{Felix}}

27/01/2025

Participants:

{{Boris}}, {{Felix}}, {{Jesus}},{{Masamitsu}}, {{Simona}}, {{Jonas}}, {{Michael}}, {{Micha}}, {{Lukas}}

  1. Introduction

    • Approval of last minutes

      • All those present confirm the minutes of the last meeting

    • Communication

      • Please send shift requests for coming week until Friday then I can prepare preliminary schedule for discussion in the meeting
      • For the convenience of the operators the machine shift and controlled tunnel access tables are located on dedicated subsites of the SLS 2.0 Operations Management website:
      • Machine Shift Reports
        • Please prepare shift reports in elog. These will be linked in the machine shifts table.
        • For SLS 2.0 commissioning shifts a template for the elog entries is prepared and will be automatically loaded when chosing the project "SLS-2 Commissioning" in the SLS Development Logbook

  2. Reports

    • Linac/LTB Optimization by {{Volker}}

      • ...

    • Booster/BRTL Optimization by {{Jonas}}

      • Thursday/Friday the injector was drifting a lot
        • Amplitude of Linac modulator A2 easily recovered the transmission
        • Toggling gun fine delay up and down recovers 30 to 40 % of the transmission
      • Main suspect is Linac modulator A2
      • For the booster the extraction energy was increased by 0.7 %
        • this may require some further tune optimization
        • dispersive orbit in storage ring now looks much better than before
        • new DPC2 do not recover old values but goe to 0 or lowest value of 20.0 for ABOMA-B after power cycling

    • Storage Ring Commissioning by {{Masamitsu}}

      • stored beam and accumulation was achieved on Thursday
      • systematic RF phasing approach on Friday was not successful
        • transverse beam orbit / optics not yet optimal, i.e., worse than Thursday
        • RF phasing not fully understood:
          • scanned each cavity individually (SR1, SR2 and SR4) with the others off
          • checked proper phase recovery after power cycling the RF
          • scanned the global phase after turning on cavities SR1, SR2 and SR4 at the individually optimized phases but did
          • scan with two cavities at half voltage confirmed the individually found phase settings
          • the beam could not be captured

    • Injection Elements by {{Martin}}

      • ...

    • RF by {{Lukas}}

      • Analysis of first beam-based SLS2 Cavity Phasing investigation
      • Analog phase measurements installed
      • Confirmed that reboot does not loose phase
      • rebooting caused other issues with lost parameters and the snapshot tool
      • original/current RF phase setting (all at 0) do not include time of flight between the cavities
      • phases per cavity should not be tuned outside of the range -180 to 180 deg

    • Diagnostics by {{Cigdem}}

      • PCT interlock
        • electricians are making the connector for the PCT to BDC link today
        • Benoit then needs to prepare the FW update for this feature
        • for calibration at least 0.5 mA required
      • X01DD measurement
        • waiting for beam
        • adjustments with beam required
      • Fill pattern monitor APD
        • raw signal available via expert panel from FW engineer
        • triggering on injection (i.e., extraction event + 52 us local delay) possible, currently set to diagnostics event 12

    • BPMs by {{Boris}}

      • Issues

        • with current settings we are seemingly injecting into a random bucket
        • remote power cycling not working for the BPM units -> rack power cycling via PDU required
        • PDU remote power cycling not working, IPs not reliable (careful not to power cycle wrong racks)
        • Booster RF is leaking into BPM measurements requiring filter intended only for injection now also required for TbT and closed orbit data
          • adjusting booster RF power confirms the suspicion
          • swap cables between BPMs to exclude the cables as source of noise
          • swap frontends to check for frontend shielding efficiency
          • improve shielding of booster RF

      • Still running on old FW for lab tests

        • all stages support BBA offsets
        • OFB interface missing
        • Known Bugs
          • synchronization of downconverters to TbT not working between all BPMS
          • switch downconverter on and off (toggle enable of downconverter) required to apply changes to filters and after IOC reboots

  3. Requests

    • Remark from {{Felix}}

      • Wait with in advance request schedule / planning until we are out of the woods with the commissioning, i.e, reproducibly can achieve stored and accumulate beam
      • Shift schedule

    • General commissioning schedule for KW05

      • Operators start RF and Booster until 7:30
      • Operator training from 7:30 until 8:30
      • Linac/Booster Optimization until 10:00
      • Storage Ring Commissioning until 18:00
      • RF, diagnostics and BPM development mostly in parallel and after 18:00

    • Priorities after stored beam achieved

      • PCT calibration
      • FPFB ADC calibration
      • Connection of APD to FPFB
      • XO1DD setup
      • as soon as 5 to 10 mA are achieved check phases and reflected power and tuning for cavities including s3HC
      • testing of EPICS based slow OFB and interlock (earliest next week)

    • Tunnel Access

      • Wednesday morning 8:00 until 11:00 for MIS PLC reboot
      • RF group uses this to check booster RF leakage

Minutes written by {{Felix}}

20/01/2025

Participants: {{Boris}}, {{Micha}}, {{Masamitsu}}, {{Jesus}}, {{Volker}}, {{Cigdem}}, {{Jonas}}, {{Felix}}, {{Lukas}}, {{Hans}}, {{Simona}}, {{Micha}}

  1. Introduction

    • Approval of last minutes

      • All those present confirm the minutes of the last meeting

    • Communication

      • Please send shift requests for coming week until Friday then I can prepare preliminary schedule for discussion in the meeting
      • For the convenience of the operators the machine shift and controlled tunnel access tables are located on dedicated subsites of the SLS 2.0 Operations Management website:
      • Machine Shift Reports
        • Please prepare shift reports in elog. These will be linked in the machine shifts table.
        • For SLS 2.0 commissioning shifts I have prepared a template for the elog entries: (Example)[https://elog-gfa.psi.ch/SLS+Development/2369]
          • Elog entry
            • Eintrag: Development
            • Projekt: SLS-2 Commissioning
            • Titel: Shift Summary - ......
          • Participants
          • Timeslot
          • Goals
          • Machine Conditions
          • Summary
          • Shift Details
          • Achievements / Conclusions
          • Identified Issues

  2. Reports

    • Linac/LTB Optimization by {{Volker}}

      • Stability issue of charging unit
      • In general working well , transmission on the order of 70 to 80% achievable
        • advisable to stay below 400 pC for good transmission
      • Current Pulser: 2nd new one with higher charge but longer pulse
        • no big effect of shorter pulses observed
        • bunch length well below 1 ns for charge below 500 pC and thus easy to compress in 3 GHz
        • maximum charge is 850 pC
        • for first new pulser very short pulses enabled operation without SPB upto 100 pC
        • SM-E shows that above 500 pC collecting of sattelites becomes a problem and the bunch becomes longer
      • Transmission of 80% into booster achieved (average SLS-1 wa on the order of ~40%)
        • bandwidth of booster PCT means that injection measurement (potentially zero current data points inside measurement) less reliable than extraction
      • Outlook
        • increase power of prebuncher (SPB)
          • would help bunching high charge bunches
        • increase stability of charging unit
        • resolve issue with interlock (rf on delay instead of falling to HV ON)
        • phase reference, readbacks

    • Booster Optimization by {{Jonas}}

      • After startup we had issue with booster instability / drifting
        • look into quad ramps and tune over ramp
        • stabelized tune into almost straight line over ramp -> stability
      • The booster optimization also contributed to the achieved transmission of 80% into the booster
      • Outlook
        • Longitudinal plane should be looked into
        • H- and V-Tune close to one another providing good starting point for emittance exchange

    • Storage Ring Commissioning by {{Masamitsu}}

      • Injection
        • BRTL
        • Thin Septum
          • at 2700 instead of 3300 Amps, i.e., ~20 % too low
          • vertival tune had to be changed by ~0.1 to avoid losing beam at thin septum blade after 4 turns
          • nominal strength for all 4 kickers
      • BPM commissioning with beam is successful so far (for Boris only just started)
        • polarity checks complete, 1 error found (cables swapped), other suspicous BPM checked but not issue found
        • only first turn beam position available so far, requires FW upgrade
      • Traejectory 1 turn
        • 1st turn trajectory measured and soft correction possible
        • Sector 6 requires unexpectedly high corrector strengths indicating alignment issue
        • BPM offsets seem to be low, but not clear for cases were high corrector current calculated
        • Indication of energy from booster being close to targeted 2.70 GeV
        • Optics close to model
      • Multiturn trajectory / Orbit
        • 8-10 turns achieved
        • losses upstream of super-3HC from tight aperture of 9 mm diameter
        • without RF max. 300 turns
        • without sextupoles max. ?? turns
        • sextupoles were increased to 20% of nominal value
      • Outlook
        • First correct alignment in ARS06 before aiming for stored beam
        • Double check alignment of 9 mm tapering upstream of super-3HC
        • Until alignment group is available look into correlation of alignment groups measurements and observed high corrector strengths
        • average orbit correction of multiple turns when BPM data available with new FW

    • Diagnostics from {{Cigdem}}

      • Aware of WAGO confusion will be looked into during tunnel access on Thursday
      • As soon as we have stored beam let Cigdem know for PCT checks which can be done in parallel (BW 20 kHZ), i.e., need only 100k turns
      • X01DD ready for beam including cameras, no light seen yet

    • Injection Elements from {{Martin}}

      • Thick septum corrector at 1.8 A indicates no correction of thick septum required
        • effects of thick septum in shielded storage ring beam pipe not yet seen, i.e., to be investigated when multiple turns of TbT BPM data becomes available
      • Still struggling to get timing right
        • not yet successful, i.e., K1 connected to different event than K2, K3 and K4
        • probably result of last minute effort to add events for pingers
        • low level panels of VME EVRs are unfortunately not available
        • Absence of timing expert unfortunate, updating config file of EVR not yet successful despite involving official substitute for timing expert
      • running without backup for thin septum pulser
      • high voltage power supplies for booster injection kickers ordered but not yet here
        • main and backup failed during commissioning
        • 6 months lead time

    • BPMs from {{Boris}}

      • HW installation finished 2 weeks ago
      • FW so far in use was intended only for lab use
        • no physical units
        • new FW postponed multiple times
        • first final version from last monday lead to IOC boot after 3 interactions
        • backporting of physical units, BBA offsets to lab FW (partly implemented in EPICS) -> ok for now
      • new FW expected ???
        • required for FOFB and Orbit interlocks (interlocks possible via workaround limited to EPICS speed)
        • 10 of 12 sectors were unexpectedly working (only supported new event protocol) since they had accidentally been connected to old event links
      • Power cycling
        • via temperature control units not yet working
        • via PDUs dangerous, i.e., no reliable IPs, no hostnames implemented, different FW versions
          • all together not reliable needs on site intervention
      • TbT data
        • observed jittering and misalignment of BPM TbT measurement, i.e., bunches of first turn observed at different and/or 2 data points of the TbT waveform data
        • potentially due to
          • injection timing error
          • BPM event timing error
          • BPM down converter issue
        • possible workaround could be setting downconverter to 4 MS (change takes 5 minutes)
        • changing filters requires toggling the downconverter enable for several BPMs after every change
      • Offsets
        • mechanical offsets from Karsten are included (dominant, upto some 100 um)
        • cable offsets from Fabio are included (usually some 10 um, <100 um)
        • electronics offsets are compensated automatically based on pilot tone
        • BBA offset can be set via EPICS

    • Frequency sweeps from {{Lukas}}

      • Frequency sweeps upto 800 Hz/s confirmed working, 100 Hz/s is max requirement
      • Booster RF needs to be looked into
        • Interlock checks --> until 11:30 today
      • Booster RF frequency after Schaltertest was rounded due to wrong value in IOC autosave/restore

  3. Requests

    • Remark from {{Felix}}

      • Wait with in advance request schedule / planning until we are out of the woods with the commissioning, i.e, depending on commissioning speed after multiturn or stored beam with tolerable lifetime achieved.
      • Shift schedule

    • General commissioning schedule for KW04

      • Operators start RF and Booster until 7:30
      • Operator training from 7:30 until 8:30
      • Linac/Booster Optimization until 10:00
      • Storage Ring Commissioning until 18:00
      • Boris BPM studies after 18:00
      • Tunnel access in controlled mode and special RP agreement for bright times party
        • No Beam from Thursday, 23.01.2025, at 12:00 until Friday, 24.01.205 at 07:00

    • To Be Investigated

      • Timing

    • Tunnel Access

      • First correct alignment in ARS06 before aiming for stored beam
      • Double check alignment of 9 mm tapering upstream of super-3HC
      • Check for suspicous magnet error source

  4. AOB

    • Operations
      • First staffed night shift from 22.01. to 23.01. (from then on staffed 24/7)
      • SwissFEL machine start-up on Wednesday, 22.01.

Minutes written by {{Felix}}

13/01/2025

Participants: {{Cigdem}}, {{Felix}}, {{Jesus}}, {{Jonas}}, {{Lukas}}, {{Martin}}, {{Masamitsu}}, {{Micha}}, {{Michael}}

  1. Introduction

    • SLS 2.0 Beam Development Meeting

      • Detailed planning and reporting of machine commissioning and development shifts.
      • Basically the well known MDM format but with another name for machine commissioning.

    • BDM Organization

      • Start with weekly MDM for planning commissioning activities and reduce frequency as we progress?
      • Suggestion: Meet in the control room kitchen and only move to WBGB/020 if we are too many?

    • Communication

      • Please send shift requests for coming week until Friday then I can prepare preliminary schedule for discussion in the meeting
      • Please prepare shift reports in elog. These will be linked in the minutes.
      • For sharing files, please upload either to elog or to the "Machine Experts" sharepoint, i.e., go to the "SLS Operation Coordation" Team, then to the "Machine Expert" Channel and then to Files

    • Approval of last minutes

      • In future here we will approve the last minutes

  2. Reports

    • Booster Commissioning by {{Jonas}}

      • Successful extraction of beam to end (before thick septum) of BRTL at 2.7 GeV, 140 pC of 450 pC
      • Matching of BRTL to be done

    • BPM Status from {{Boris}}

      • Boris sick
        • Rückfragen bzgl. Ring BPM Hardware-Status gerne direkt an Goran. Support-Angebote für EPICS/SW Debugging gerne direkt an Jonas.
      • Measurement of SLS 2.0 Ring BPM Offsets with Lambertson Method: link
      • Status Hardware:
        • Hardware in Racks installiert & verkabelt
          • Goran unterstützt die DSP Gruppe, indem er die DBPM3 Units konfiguriert (leider sind Kurts Portserver noch nicht geliefert, er muss daher mit Laptop rumlaufen …) & schaut, ob das Netzwerk funktioniert.
            • Diverse Netzwerkkabel (Glasfasern) waren defekt (von Kabelgruppe bestätigt), zum Glück hatte ich Reserve-Fasern ziehen lassen
            • Nach empirischem Rumprobieren, welche Fasern funktionieren, hat Goran in Sektor 1-10 alle bis auf drei Back-Ends erfolgreich konfiguriert & ich kann die im Netzwerk pingen. Sektor 11 & 12 folgen heute, dann wird er schauen, warum einige nicht booten (mangels Portserver muss er da mit Laptop rumlaufen …).
            • Bei den Event Links hat erstmal keiner funktioniert. Goran hat rausgefunden, dass Tx und Rx vertauscht sind. Kurt & Operateure werden das heute beheben. Dann müssen wir schauen, wie viele dann funktionieren & ob es auch defekte Fasern hat (sonst muss die Kontrollgruppe ran & in ihren Racks patchen, da sie die von mir vorgeschlagenen hot Spare Kabel als unnötig abgelehnt hatten – bei Event Master hat Romain Vallotton wohl schon Patchkabel installiert, Kurt hatte da aber am Freitag noch keine Doku der Verkabelung von Romain Vallotton gefunden …).
      • Status Software/Firmware:
        • DSP Gruppe hat bisher Bootverzeichnisse für 4 von 12 Sektoren installiert, mehr folgen heute. Leider konnte man wegen Stromabschaltung am Wochenende nicht arbeiten …
        • Ich habe am Freitag erstmals die neue Firmware/Software der DSP Gruppe getestet
          • EPICS-Kanalnamen waren falsch, hat Jonas inzwischen behoben (Templates & GUIs angepasst) – danke!
          • Ich bereite eine BPM GUI für Anzeige des Closed Orbits & Python Scripte vor, mit der man auch die DBPM3 konfigurieren & testen kann
            • Das Script meldet, dass alle Back-Ends in Sektor 1-4, die schon EPICS booten, funktionierende Back-Ends haben (500 MHz Refclock O.K., ADC PLLs locken auf 500 MHz).
            • Wenn ich das Pilotsignal einschalte, sehe ich ADC Rohdaten, aber keine dezimierten Turn-by-Turn Daten.
              • Gemäss DSP Gruppe liegt das vermutlich an EPICS (da haben sie was geändert), nicht an der FPGA Firmware, sie arbeiten mit Hochdruck daran, das Problem zu beheben. Laut Jonas werden wohl gewisse EPICS Records, die die Turn-by-Turn Daten anzeigen, nicht prozessiert (aSub Record). Er wäre dankbar, wenn ein EPICS Experte von Controls mal einen Blick drauf werfen könnte, woran das evtl. liegt. Info von Jonas: «konkret, im *-DAQ sehe ich daten ankommen, aber der ASUB bekommt sie nicht: https://git.psi.ch/epics_ioc_modules/dbpm3_but0g5/-/blob/master/DBPM3_BUT_0G5_STREAM_DAQ.template?ref_type=heads#L2-27
        • Falls alle Stricke reissen, könnte man ggf. alte Firmware vom Oktober installieren, da fehlt aber folgendes:
          • Keine Subtraktion von X/Y BBA/Kalibrationsoffsets in Turn-by-Turn Daten & FOFB Daten
            • Messung der Offsets von Kabeln & Pickup ist im Anhang (hat mir Fabio Ende letzter Woche geschickt) -> nicht allzugross, evtl. könnte man auch versuchen, den ersten Turn zu machen & dabei diese Offsets vernachlässigen.
          • Turn-by-Turn Position & Ladung nicht in physikalischen Einheiten, keine Berücksichtigung des RFFE Gains bei der Ladungsberechnung
          • Kein Support des SLS 2.0 Event Systems (im Labor konnte uns Romain Vallotton das nicht zur Verfügung stellen, sondern nur ein SwissFEL Event Master …) -> wir könnten nur auf das Strahlsignal triggern & die TBT Downconverter nicht synchronisieren.
          • BPM Namen entsprechen nicht der Namenskonvention (Hostname + BPM1/2/3 statt Heilige Liste Name, …)
            • Wäre für meine BPM GUI & Scripte kein Problem bzw. hab ich schon vorbereitet, aber vermutlich für BD Software …
      • Boris Vorschlag
        • Abwarten, wie morgen (Dienstag) früh der Status ist. Präferenz der DSP Gruppe war im Meeting letzten Donnerstag, die neue FW/SW ans Laufen zu bringen, anstatt ein Rollback zu machen.
        • In Sektor 1 kann man heute Abend gerne schon versuchen, Strahl am 1. BPM zu machen, dann kann man da zumindest schonmal die ADC Daten anschauen, und Fabio könnte mit einem Scope messen, ob das Signal der Buttons aussieht wie erwartet/simuliert (die Ring Buttons haben bisher noch nie Strahl gesehen, wurden nur simuliert).

    • Timing Status from {{Romain}}

      • New version tested on test stand, but many of you expressed concerned about this, myself included. So, I have decided not to release it.
      • Workaround found which allows us to control the FP as we want with the current version. I found a solution to limit the number of RF bucket, and Boris had a good idea for blocking the number of injections:
        1. Range of RF buckets
          • With this solution, we have to live with the first injected RF bucket being 0. Tweaking the PV won’t help, with this version, everything starts with bucket 0. However, you can change the software high limit that I had set to 479, down to whatever value. If you set it to 0, only bucket 0 will be injected. If set to 1, buckets 0 and 1 will be injected, and so on…
          • The PV name is: AGETI-CVME-MASTER-TMA:Bucket-Update_.INPD
        2. Number of injections
          • To limit the number of injections, you can set the timing master to periodic mode. In this mode, the user can choose the number of buckets to inject, and the period in seconds. The fields hold 32 bits values, so one could set the value to 2^32-1 to make sure that only the specified number of injections will happen once (every 2^32-1 seconds).
            • To change this setting, open the expert panel : Open the launcher à View à Controls expert à * under timing control * expert à Go to “Control / Status” tab
            • Set mode to periodic. 2 new fields will appear: Injection perdiod [s] and number of buckets [-]. Set the desired parameter.
            • The PV name for the injection period [s]: AGETI-CVME-MASTER-TMA:SR-Inj-Mode1-Period-SP
            • The PV name for the number of buckets injected: AGETI-CVME-MASTER-TMA:SR-Inj-Mode1-NbBucket-SP
            • You should disable the FPF status sel on this panel too. The PV is AGETI-CVME-MASTER-TMA:FPF-Status-Sel
              • Enabling this non implemented feature block the current bucket to 1. That is why Paolo had enabled it. From now on, you should disable it and use the described procedure above instead.
            • Read this PV for info: The countdown before next injection PV that also appears on the panel: AGETI-CVME-MASTER-TMA:SR-Inj-Mode1-Count-Down-I

    • Diagnostics from {{Cigdem}}

      • Auto save/restore not working -> lots of values lost after Schaltertest weekend

    • Injection Elements from {{Martin}}

      • All magnets connected and should be available
      • Control issue
        • current not in EGU, RB is correct
        • 1.5 corresponds to large current
        • valid for kicker bump, cannot be tested ATM

  3. Requests

    • Remark from {{Felix}}

      • Wait with in advance request schedule / planning until we are out of the woods with the commissioning, i.e, depending on commissioning speed after multiturn or stored beam with tolerable lifetime achieved.
      • Shift schedule

    • General commissioning schedule for KW03

      • Operators start RF in morning
      • Commissioning team from 09:00 until 18:00

  4. AOB

    • Control Room

      • First staffed night shift in night from 22.01. to 23.01. (from then on staffed 24/7)
      • Until then officially staffed only from 06:00 until 22:00
        • Control room is locked and GLS handed over to SIZ over night
        • Try to finish commissioning activities by 18:00

    • ALH

      • No alarms configured yet -> no machine babysitting over night possible
      • Minimum required are alarms for:
        • Magnet PS
        • RF
        • Vacuum
        • 3HC Cryo

    • OP IB Team

      • Tasks: Connection to night shift
      • Team: Martin, Max, Fabian, Stefan, Sascha

    • BDC

      • Place for Status: List of connected / bridged inputs
      • With interlock injection is stopped

    • MIS

      • list of bridged signals in script -> to be translated to snapshot
        • many signals bridged, e.g., most ID signals
      • GUI -> script for preparing list of active interlocks often crashed
        • relaibily should improve with the planned move of this external script to EPICS, i.e., let it run directly on the IOC

    • RF

      • must switch of every evening while control room not staffed
      • for beginning RF will take care of switching on in the morning and off in the evening
      • cool down of 3HC? -> no information yet

Minutes written by {{Felix}}

Reference in New Issue View Git Blame Copy Permalink