Sorry for very silly question.
Has anyone a user or service manual of Alcatel Crystal 102 Diffusion pump (the diffusion pump installed on SX100)?
While I maintain all our primary pumps (changing oil regularly, and getting service inspections), the Diffusion pump is quite an enigma to me. It was just working up to now, until it stopped working (I guess, or it could be wrong gauge readings). Alternative source of failure (blown window, leak) were checked and not found. The bottom part is hot while operational, thus probably it is not burnt out heating element to blame (albeit it could be failing and thus produce less heat (?)). I started to look for manual, could not find any on internet for this particular vendor, but found disturbing information in manuals of other vendor diff pumps. I.e. oil level and color should be checked every 6-9 months... from 2014 (from when I am around the lab; the pump is from 1998 - when that machine was assembled) I don't remember anyone do that. It was not inspected also during last service two years ago... Albeit I have some traces that it probably was serviced at least once (There is a small glass bottle with handwritten "diff. oil" in the wardrobe). The manuals of other vendors mentions that oil should not be stored more than 7-9 years... so I guess if it is working inside the pump it also looses its properties during time.
I have no idea how to check the oil (there are this small pipe with two screws - I guess it would be used to drain and fill oil without disassembling it from the place...?)
Neither I have any idea what kind of oil is currently filled (In case I would want to fill new oil, I should clean the diff pump from old oil, as different kind of oils should not be mixed). (ha, I actually could drain a sample and check under our new RAMAN spectrometer)
In some french vac shop I could find on sale a spare heater and dedicated silicon oil. However, having no manual I have no idea how much oil I should buy and fill (after cleaning).
Thus I am looking to buy new diff pump, at least I would get manuals and clear instructions how to proceed with it. I looked to few possible replaceable models (ISO100):
* Edwards Diffstak 100/300F as it looks compatible (probably). But the price just punch me in the face, How diffusion pump - one of most simplistic pumps in design - can cost more than dryscroll?
* Agilent HS-2 (albeit still don't know the price, but I am starting to see why Edwards design costs so much - maybe price is worth it)
For ISO100 there is also Agilent VHS-4 which I think is a complete overkill as requires 1450W for heating.
Heater power comparison:
* Alcatel Crystal 102 is 500W (at least so is rated the replacement heater part; is the original the same rated?)
* Edwards Diffstak 100/300F is 650W (larger by 150W, but the power supply wires can handle that increase in demand)
* Agilent HS-2 is 450W (the pumping speed is twice smaller 160L/s than of Edwards (280L/s); but is it smaller than Alcatel Crystal?)
P.S. is Agilent HS-2 really ISO-F 100? from pictures I see that it is only 4 places for M8 screws, but ISO-F 100 should have 8.
P.S.S.
There is other problem, 25 years is far too much for 12V battery which is used to power isolation of diff pump from the chamber and unify spect and chamber vac in case of power failure. It is 12V 125306 (vendor SAFT) 100mAh. If I measured correctly, when instrument is on-line it is charged with constant voltage of 12.8V. I am scratching my head what replacement I could drop-in. Eventually maybe I could put there something replaceable, non-chargeable with 12V and push that through diode, so it would not be charged during being on-line. I am not sure if drain from battery is cut off after isolation valve is triggered.
Other idea is to put the high density capacitor, the battery (that is why it is small) needs to be able to provide enough power for single event directly after power failure. Maybe Capacitor would have enough punch to do that. Unfortunately I have no idea about original battery (what its internal resistance, output current...) so coming up with replacement is a bit tricky.
Any advice?
Quote from: sem-geologist on July 05, 2023, 02:33:59 AM
Other idea is to put the high density capacitor, the battery (that is why it is small) needs to be able to provide enough power for single event directly after power failure. Maybe Capacitor would have enough punch to do that. Unfortunately I have no idea about original battery (what its internal resistance, output current...) so coming up with replacement is a bit tricky.
Any advice?
I was going to respond with a suggestion to put your entire instrument on a 240v 12 KW UPS because that's what we have on our SX100 (it only runs for 15 minutes, but within a few minutes of a power outage the diesel generators will kick on and they will run for days):
https://smf.probesoftware.com/index.php?topic=1288.msg10726#msg10726
but then I saw your post here:
https://smf.probesoftware.com/index.php?topic=1288.msg10727#msg10727
So, you are doing the same thing apparently? Why then do you need a separate power backup for your diffusion pump?
Quote from: Probeman on July 05, 2023, 01:24:43 PMI was going to respond with a suggestion to put your entire instrument on a 240v 12 KW UPS because that's what we have on our SX100 (it only runs for 15 minutes, but within a few minutes of a power outage the diesel generators will kick on and they will run for days):
https://smf.probesoftware.com/index.php?topic=1288.msg10726#msg10726
but then I saw your post here:
https://smf.probesoftware.com/index.php?topic=1288.msg10727#msg10727
So, you are doing the same thing apparently? Why then do you need a separate power backup for your diffusion pump?
Without diesel generator the UPS for SX100 is useless (in diff pump prevention). We have beefy UPS supplying only to our SXFiveFE where it makes sense (and that I mentioned in those other topics). However our SX100 is not under UPS protection, and neither it would make a difference.
There are few crucial differences between SXFive(FE) and SX100 which makes UPS relevant or irrelevant.
SXFiveFE:
* has Schottky tip - can be destroyed with abrupt cutting of supply
* has column-gun
motorizedpneumatically-driven separation valve
* has turbomolecular pump
* uses valve(s) to separate the vacuum between chamber and spectrometers which requires pressure and energy to stay closed (loosing power will automatically open valve unify spectrometer and chamber vacuum). irrelevant
SX100:
* W/LaB6
*
manual column-gun valve* diffusion pump
*
electric motorized valve to separate or unify chamber and spectrometer vacuum directly mechanically connected with diffusion pump inlet valve - power is needed to switch it to opened or closed states.
Case with power-failure with no UPS for SXFiveFE:
0. Power down.
1. Tip gets off abruptly (for fractions of second being hot without any field containment), ion pumps releases Ar and some other lousily buried stuff - high risk of tip contamination.
2.
motorized column-gun separation valve can't be closed as there is no power thus gun and chamber spaces keeps being connected. Pneumatic valve control is monostable - power loss ASAP will automatically close the column separation valve.
3. turbomolecular pump starts naturally to slow down - the chamber vacuum gradually approaches primary vacuum during that...
but because of point 2 UHV space of gun is getting contaminated by primary vacuum eventually.
4. valves open between spectrometer and chamber unifying the pressure
In case of P10 gas leak to spectrometer - P10 contaminates Gun chamber at that point.Thus UPS (and corresponding software solution) for SXFiveFE is not just optional - it is a must, because of FEG.
See the difference with presented case with power-failure (lets say for 4 hours) and UPS present and equipped with communication and preventive measures (it is not enough to have an UPS. The UPS communication with PC and the state of UPS needs to be accessible to custom made daemon which will correctly prevent damages in correct steps or pull out from prevention sequence):
0. Power down, UPS keeps the system fully operational for 2 hours, (but Air conditioning is not under UPS, thus it is not wise to keep tip fully operational for 2 hours).
1. 30 min after power down, decrease tip heat by 0.2 A (custom script)
2. 1h - initiate full safe tip shutdown (takes about 10 min), (at older versions close the column-gun valve with corresponding script, at newest firmware it does automatically after gun is shutdown). (there is exe for gun shutdown in newest peaksight, thus can be executed with independent UPS software)
3. if it is possible trip the chiller - that will trigger preventive shutting of electronics - two biggest power consumers out - UPS got additional few hours which it can keep whole vacuum system running. As there is loss of communication with SX at that moment PC should be also triggered to shut down which will save even more battery.
After 4 hours power is back: the vacuum was kept fully functioning. After turning FEG back on in one day system is ready back to be used.
In case power would not come back - eventually all pumps would go off, but as all valves which needs to be shut and all valves which needs to be open are correct - It would take just additional few hours to return back to functional state, and again in one day system would be ready back.
In case of no UPS - it would require baking of UHV part, and would take
at least 2 days to get back to functional state. Also it has some additional risks when engaging baking procedure.
Now lets look to sequence of events during power failure at SX100 (without UPS):
0. Power down
1. PC goes instantly off.
1. in about 0.5 second significant voltage drop triggers electronics to shutdown and cut off supply to other systems (SX100 is capable to go through very short sub second outages without a hitch due to most of integrated PSU's containing very huge capacitors).
2. Gun is forcibly off (still steaming hot, if it is LaB6 - that can be kind of catastrophic), diffusion pump heater is off (but oil does not cool instantly, it is still actively pumping for few seconds after), roughing pumps are off, ion pumps are off.
3. Pressure starts to raise in the spectrometers (as those have biggest leaks), however bottom of diffusion pump is still hot enough to boil the oil (and there is no cooling of diffusion pump as water chiller is off too).
4. The backing buffer is separated from roughing pump with electromagnetic valve which gets closed with power down. Thus diffusion pump has good vacuum reserve from backing side for cooling down. However inlet is in danger as pressure raises there.
5. And there comes this mentioned 100mA 12V battery, which powers single event of diff pump inlet valve closing, which prevents hot diffusion pump from interaction with gases from deteriorating vacuum in the chamber. In case of no leaks between spectrometer and chamber there is not such a big deal, but otherwise there is risk of deterioration of diffusion oil and its partial breakdown in reaction with contaminants from spectrometer (i.e. P10 gas).
To precise up what kind of battery I am blabbering here about, look to the pictures below.
The placement of 12V battery in SX100, here it is already taken out:
(https://smf.probesoftware.com/gallery/1607_06_07_23_2_50_33.jpeg)
and this is how battery looks from closer:
(https://smf.probesoftware.com/gallery/1607_06_07_23_2_51_03.jpeg)
marking on two lines are as follows:
10 VB 10
PC9602 REF 125306
vendor marking in background: SAFT
Now lets look how UPS with 15 min capability would help here (without diesel generator):
0. Power goes Down, UPS takes over.
1. PC can switch the Gun off. And that's all what can be achieved! (PC can also shutdown itself to prevent data-loss, albeit 15 min of LaB6 being off could make a difference for it to survive.)
2. Can't Halt vacuum (so that diff pump could cool down safely), can't do anything as all other vacuum states requires manual switching of gun-chamber valve to position 1.
3. after 15min the sequence of event is the same as in the list of events above for case without UPS... and finally it comes again to the moment where 100mA 12V battery is needed to prevent the diff pump deterioration by closing the diff pump inlet valve.
Of course if after all this, soon (~5-10min) the power will come back the valve will close automatically due to hard restart of vacuum system, thus there is a bit less of danger. The worst case (highest risks) without functional 12V battery is with long outage. So Probeman, lucky You, that Your lab/institution has well thought power backup system. At least someone at your institution thinks in advance.
Anyway we had for many years the UPS for SX100 as it helps in situations when power failure happens during work hours, but we had 3 consecutive break downs of UPS within single year, and just gave up after with UPS for SX100 (especially that it does not brings any crucial prevention).
And we are heading off-topic. 12V battery is important to prevent the diff pump oil from weak vacuum or contamination from spectrometer. The valve is complicated it is kind of double - it closes inlet of diffpump and at same time opens the inlet to spectrometers (equalizing vac between spectrometer and chamber). It is important to not deteriorate diffusion oil and probably during many last years (probe was assembled in factory in 1998) it could during some power outages.
However my main problem is Old diffusion pump itself. And as I got only single (and a bit off-topic) answer, and looking to the Cameca design I fear it is mounted for a life-time with no oil control in mind. I.e. to check the oil level the pump needs to be vented to air pressure first, and in the way how it is mounted and connected in SX100 - it looks that venting of it was never seen as any of options. Also lack of feedback means that no one probably had seen any maintenance work being done on those pumps during service visits.
Quote from: sem-geologist on July 06, 2023, 01:47:11 AM
Thus UPS (and corresponding software solution) for SXFiveFE is not just optional - it is a must.
See the difference with presented case with power-failure (lets say for 4 hours) and UPS present and equipped with communication and preventive measures (it is not enough to have an UPS. The UPS communication with PC and the state of UPS needs to be accessible to custom made daemon which will correctly prevent damages in correct steps or pull out from prevention sequence):
...
I would agree that every EPMA instrument must have a UPS. Every instrument in our lab is on a UPS because as you point out, some instruments are very sensitive!
I should also point out that it is not just the instrument that must be on the UPS. The computers, pumps, water cooler, and cryogenic compressor are all backed up by the UPS. This requires a roughly 12 KW UPS, which as I said only runs for 10 or 15 min, but it is backed up by diesel generators within a few minutes. That way, we can monitor the instrument and UPS.
Quote from: sem-geologist on July 06, 2023, 01:47:11 AM
Anyway we had for many years the UPS for SX100 as it helps in situations when power failure happens during work hours, but we had 3 consecutive break downs of UPS within single year, and just gave up after with UPS for SX100 (especially that it does not brings any crucial prevention).
Sounds like a bad UPS! >:(
In our case the UPS units require battery replacements every 3 to 5 years, but other than that they run perfectly fine. The other critically important consideration is that
the UPS be of the "on-line" design. That is, the entire instrument and support equipment is *always* running on the batteries of the UPS, which are constantly being re-charged.
That way, when there is a power outage (and we have about one power outage a year), there is not even a millisec of power interruption.
Sorry if this a bit off-topic, but I just thought I should clarify that not all UPS units are the same.
Quote from: Probeman on July 06, 2023, 06:53:46 AM
Sounds like a bad UPS! >:(
In our case the UPS units require battery replacements every 3 to 5 years, but other than that they run perfectly fine. The other critically important consideration is that the UPS be of the "on-line" design. That is, the entire instrument and support equipment is *always* running on the batteries of the UPS, which are constantly being re-charged.
That way, when there is a power outage (and we have about one power outage a year), there is not even a millisec of power interruption.
Sorry if this a bit off-topic, but I just thought I should clarify that not all UPS units are the same.
Yes it was on-line type of UPS with generation of clear single phase sinusoid from 3-phase input. We have exact same model (EATON) powering our two high resolution Zeiss FESEM and works without a hitch so far. I could not find what had caused these marvelous burn down of UPS (I was at site during last failure, it happened during power shortage) then, neither could UPS service do that (scratched the heads). However, as I had to educate myself a lot about lightning and ground protection, as new microscope (ThermoFisher) is being installed, and its requirements were bizzare....
So I think at last I know (have the most plausible explanation) what could bake them. Burned EATON (for SX100) and not burned Liebert (for SXFiveFE) are powered by the same 3 phase power line. The difference is that Liebert UPS has over-voltage protection installed before (at UPS input) and after UPS (at output), where EATON UPS had not. While output P and N is isolated from input P and N at UPS, the PE line is directly connected through both sides, so equalization of potentials in case of voltage surge will transfer to voltage change on PE at input, which also will transfer at UPS output, and UPS output side gets kicked in the guts because is not protected. The EATON UPS by our ZEISS SEM has such (both side) protection installed, and thus had not suffered through all these events. Another story is the protective earth, where intentionally designed for probes TT is unintentionally connected with TN-S... That is the price of having lab in old building where regulations, designing and execution of it take places in three different disconnected realities :o .
But What I am point out is that old SX100 due to manual Gun valve, has no way to protect itself while being on UPS from aftermatch, when UPS battery is drained down if power does not return in those 15 minutes back. Without this Cameca initially installed functional 12V battery, even if there is UPS, the diffusion pump is left unprotected. If gun valve would be motorized - then valve could be closed and vacuum "halt" executed (which would with grace power down diffusion pump, protect its inlet and let it cool down with help of circulating water). But because it is manual, even with UPS present, when its battery gets low and powering down system is happening anyway - UPS just delays problematic event and does not eliminate it. Yes it reduce risks for power blackout events taking shorter than UPS battery capacity, but if event is longer - the outcome is the same. We probably will get UPS installed again for our SX100 as the cause of burning looks plausible and there is a promising way to eliminate the cause.
Anyway, getting back to the topic of Diffusion pump.
Anyone? Had you seen Diffusion oil pump being inspected, oil level checked of Your SX100 (of course we are excluding this question from these who had Turbo pump installed instead of diffusion). Today I had dig through pile of piles of old paper scraps collected till 2015 from 2000, and found out no record that there had been any inspection of diffusion pump. Albeit I found out that heating element was replaced at least twice while SX100 was still on warranty. I think the inspection of oil level is very tricky as physically design of SX100 stands very much in the way to conduct such inspection. AFAI could get from other vendor manuals the Diffusion pump oil inlet (where stick for oil level measurement should be attached) should not be opened while pump is under vacuum, and venting of pump to atmospheric pressure is required. It is however hard to do on SX100, there is no procedure, there is no nitrogen inlet where primary pump valve to vacuum buffer is placed (contrary to primary vacuum valve for spects and chamber). Opening one of pipe junctions could do the trick of venting the diffusion pump, but that will suck the dust which is nearly impossible to get rid completely in that space of probe. Any such inspection would provide more risks to the diffusion oil than good.
Another thing which I found in papers is that this secondary pening gauge worked erratically many times. Maybe this time is again the same problem reapearing. Maybe before dismantling Diffusion pump I should borrow some three-way ISO25 junction and mount another gauge to see if Cameca gauge is not giving wrong reading.
At installation list from 2000 I see position with dibutyl phtalate with number 500 (ml?). Has anyone idea what it was used for? I just hope not as diffusion pump oil... As I see no positions with diffusion pump oil, I wonder if pump was drained during transport, or it was filled at factory (I tend to believe it was filled at factory as access for filling and draining diffusion pump in SX100 is so hindered).
1. Checked the heater resistance which is 96 ohm; that at AC 230V translates to ~520W - thus heater is rather OK (heater going bad should increase the resistance). It is also tightly attached to the pump.
Quote from: sem-geologist on July 06, 2023, 07:43:44 AM
Yes it was on-line type of UPS with generation of clear single phase sinusoid from 3-phase input. We have exact same model (EATON) powering our two high resolution Zeiss FESEM and works without a hitch so far. I could not find what had caused these marvelous burn down of UPS (I was at site during last failure, it happened during power shortage) then, neither could UPS service do that (scratched the heads). However, as I had to educate myself a lot about lightning and ground protection, as new microscope (ThermoFisher) is being installed, and its requirements were bizzare....
Could have been a grounding problem...
Quote from: sem-geologist on July 06, 2023, 07:43:44 AM
But What I am point out is that old SX100 due to manual Gun valve, has no way to protect itself while being on UPS from aftermatch, when UPS battery is drained down if power does not return in those 15 minutes back. Without this Cameca initially installed functional 12V battery, even if there is UPS, the diffusion pump is left unprotected. If gun valve would be motorized - then valve could be closed and vacuum "halt" executed (which would with grace power down diffusion pump, protect its inlet and let it cool down with help of circulating water). But because it is manual, even with UPS present, when its battery gets low and powering down system is happening anyway - UPS just delays problematic event and does not eliminate it. Yes it reduce risks for power blackout events taking shorter than UPS battery capacity, but if event is longer - the outcome is the same. We probably will get UPS installed again for our SX100 as the cause of burning looks plausible and there is a promising way to eliminate the cause.
Yes, that is exactly why we have our instruments on a "on-line" UPS *plus* diesel backup power after several minutes of a power outage! A few winters ago the entire campus went down for days, and our lab instruments continued to run just fine the entire time.
Quote from: sem-geologist on July 06, 2023, 07:57:23 AM
At installation list from 2000 I see position with dibutyl phtalate with number 500 (ml?). Has anyone idea what it was used for? I just hope not as diffusion pump oil... As I see no positions with diffusion pump oil, I wonder if pump was drained during transport, or it was filled at factory (I tend to believe it was filled at factory as access for filling and draining diffusion pump in SX100 is so hindered).
I think dibutyl phtalate is the fluid used for the P-10 gas "bubblers...
Our instrument engineer provides this advice:
500mL sounds right for that medium sized diffusion pump. Cameca loads them with Santovac 5.
You should warm the pump up on a hot plate to 45C before draining old oil so that oil viscosity lowers enough to drain properly. You should drain into a beaker so as to measure what volume of oil charge they were starting with. If the oil is slightly yellow (not clear as when it was new), that's still OK. If draining via the downward pointing fitting, you'll have to replace that O-ring since it will be hardened and no longer seal properly. Have to scrape out (with wood or plastic, never metal tools) old O-ring remnants that peeled off of old O-ring.
I wouldn't worry about checking condition of Santovac 5 for the life of your instrument since its tuff stuff. If, however, the pump was running with no cooling, it may have been ruined. Note that should you try to measure the water flowing through the DP's cooling lines, don't expect more than a trickle! That long tube really presents a lot of flow resistance. If the upper ½ of the pump body is slightly below room temperature, you're OK.
Note that if Santovac 5 is too expensive for your taste, you'll have to very thoroughly clean out all traces of Santovac 5 from the pump before switching to a silicone-based fluid.
Steve
Quote from: sem-geologist on July 06, 2023, 07:43:44 AM
Another thing which I found in papers is that this secondary pening gauge worked erratically many times. Maybe this time is again the same problem reapearing. Maybe before dismantling Diffusion pump I should borrow some three-way ISO25 junction and mount another gauge to see if Cameca gauge is not giving wrong reading.
We have the turbo on our SX100, but to quote the person I learnt from: "
Never trust the gauge!".
Adding a T piece and another penning is relatively trivial, so I'd go that route first. The penning can get contaminated and cause all sorts of chaos, whereas the diff pump is pretty simple and just... works. Especially if its hot at the bottom, as you say in your first post.
Assuming you can drop the penning as easily on a diff pump system as you can on a turbo (albeit needing to be a contortionist to get your arm in), and that the gauge is one of the Alcatel types, you can open them up easily enough to check it isn't massively contaminated. You can buy rebuild kits for the Alcatel gauges, or you can just clean up what you have and then reseal with fresh indium wire. Cameca usually just swap the whole gauge out.
What error are you actually getting from the instrument? Bad vacuum in the chamber?
Probeman and JonF,
I really appreciate Your answers and effort with consulting with your engineers. Please, give my thanks to him.
Quote from: Probeman on July 06, 2023, 07:50:38 PM
Our instrument engineer provides this advice:
500mL sounds right for that medium sized diffusion pump. Cameca loads them with Santovac 5.
You should warm the pump up on a hot plate to 45C before draining old oil so that oil viscosity lowers enough to drain properly. You should drain into a beaker so as to measure what volume of oil charge they were starting with. If the oil is slightly yellow (not clear as when it was new), that's still OK. If draining via the downward pointing fitting, you'll have to replace that O-ring since it will be hardened and no longer seal properly. Have to scrape out (with wood or plastic, never metal tools) old O-ring remnants that peeled off of old O-ring.
I wouldn't worry about checking condition of Santovac 5 for the life of your instrument since its tuff stuff. If, however, the pump was running with no cooling, it may have been ruined. Note that should you try to measure the water flowing through the DP's cooling lines, don't expect more than a trickle! That long tube really presents a lot of flow resistance. If the upper ½ of the pump body is slightly below room temperature, you're OK.
Note that if Santovac 5 is too expensive for your taste, you'll have to very thoroughly clean out all traces of Santovac 5 from the pump before switching to a silicone-based fluid.
Steve
so listening through all this, indeed, I believe he had done some maintenance of DP - That means that Diff pump on SX100 is not so fool-proof?
I am quite surprised with amount of 500mL oil, for example similarly sized pump of Edwards takes only 125mL, thus it is quite surprising for me.
As for my concern of its (oil) condition, it is due to instrument running on our site for 23 years (and there is no documented event of DP inspection), and as most of QA (quality assessment) stickers on our SX100 are from 98, I have reason to believe that it was running in the factory before it landed to our lab already two years, thus 25 years in total. Reading description of Santovac 5 there is mentioned that shelf life of oil is 5 to 7 years. How can it be better protected while working in the diff pump, where it actively goes through endless thermal cycles and entraps and releases other gas molecules through pumping process, compared to cool staying in the sealed bottle on the shelf. It is quite counter intuitive to me. Yes, I am aware about old O-rings - that is why I am reluctant opening those without thinking and consulting it over. As for Water flow, there is ratemeter mounted on the SX100, if water would flow too slow, there is logical means built-in at SX100 which would switch off electronics and vacuum system. Also water supply is connected in series between consuming parts (HV-control board, Scanning and mag power boards, condenser lenses, diffusion pump), not parallel, thus blocking the flow in the pump would stop the flow, or kill the pump in the water chiller (albeit we need to replace the pump every 4 years). It is quite cool at the top of DP when running. Also we have water filter, and replace distilled water every half a year.
Quote from: JonF on July 07, 2023, 01:36:50 AM
Quote from: sem-geologist on July 06, 2023, 07:43:44 AM
Another thing which I found in papers is that this secondary pening gauge worked erratically many times. Maybe this time is again the same problem reapearing. Maybe before dismantling Diffusion pump I should borrow some three-way ISO25 junction and mount another gauge to see if Cameca gauge is not giving wrong reading.
We have the turbo on our SX100, but to quote the person I learnt from: "Never trust the gauge!".
Adding a T piece and another penning is relatively trivial, so I'd go that route first. The penning can get contaminated and cause all sorts of chaos, whereas the diff pump is pretty simple and just... works. Especially if its hot at the bottom, as you say in your first post.
Assuming you can drop the penning as easily on a diff pump system as you can on a turbo (albeit needing to be a contortionist to get your arm in), and that the gauge is one of the Alcatel types, you can open them up easily enough to check it isn't massively contaminated. You can buy rebuild kits for the Alcatel gauges, or you can just clean up what you have and then reseal with fresh indium wire. Cameca usually just swap the whole gauge out.
What error are you actually getting from the instrument? Bad vacuum in the chamber?
Yes, I don't trust the Gauge - in particular that one. In the beginning I thought of borrowing one, but after digging through documented history of the machine yesterday, I find that it is probably most failing thing in SX100. Thus I think better idea would be to mount T junction and another independent vacuum detector permanently. This will save headache in the future and allow rapidly troubleshoot the vacuum. What could happen, the isolation in concentric cable between gauge and Cameca self-built controller could get fatigue due to age. The leak in the cable could tricks the controller to think that there is higher current flowing inside the gauge thus vacuum is worse. Contamination can be rather discarded as it is quite freshly refurbished gauge (few months). I found out from historical records that cable was already changed few times.
The error is Vacuum error, and green light at the back of vacuum box for chamber vac is not lighting up. It is not reaching the safe threshold of x*E-3 Pa, but sticks about 1.5E-3 Pa (x, as I dont remember exact value). As I am writing now, this hypothesis starts to make sense as if triggering and returning after sample exchange the vac for a brief moment (a second or two) gets down to 3E-3Pa, but then falls to 1.5E-3. As I think it is probably easily to check with some electrician tools. The resistance between axial and outer parts of the cable.
Quote from: sem-geologist on July 07, 2023, 07:23:49 AM
so listening through all this, indeed, I believe he had done some maintenance of DP - That means that Diff pump on SX100 is not so fool-proof?
Yeah, well, there was an "incident" about 10 years ago during a routine maintenance when a student helper pulled the hose off the backing pump before the sample chamber was vented... and then we had DP fluid spurting up into the sample chamber which coated the light optics and column, so the entire instrument had to be disassembled and cleaned.
So, yes, not exactly "fool proof"!
:(
Quote from: Probeman on July 07, 2023, 08:37:37 AM
Quote from: sem-geologist on July 07, 2023, 07:23:49 AM
so listening through all this, indeed, I believe he had done some maintenance of DP - That means that Diff pump on SX100 is not so fool-proof?
Yeah, well, there was an "incident" about 10 years ago during a routine maintenance when a student helper pulled the hose off the backing pump before the sample chamber was vented... and then we had DP fluid spurting up into the sample chamber which coated the light optics and column, so the entire instrument had to be disassembled and cleaned.
So, yes, not exactly "fool proof"!
:(
This is very important information concluding and letting to draw whole picture. So I was wondering why it would use 500mL of oil while other pumps of similar size use 125-150mL. The pump in this SX100 configuration is kind of boobytrap, and opening it is out of equation, as clearly outlet (backing) pipe is partly under oil. Other vendor pumps are recommended to be vented from the side of outlet backing, as also are recommended to do that while pump is still warm. Looks that following such borrowed recommendations from other vendors would lead straight to catastrophe. For the same reason as described in the incident, opening filling or draining is forbidden while pump is under vacuum. (the drain/fill pipe is always completely drowned under oil). It is much more plausible that in my case the High voltage cable of gauge got fatigued and needs to be replaced. And unless I can prove the vacuum is bad (i.e. with help of other independent gauge mounted on T-junction) I should not do anything with diffusion pump. It explains why there is no records for our machine for any service of diff pump, or why no one else ever had seen (with exception to that single catastrophic case) Cameca service doing any inspection of diffusion pump.
I'd be very wary of the 500mL number. That's very far outside of my experience of diffusion pumps of this size. A more typical value would definitely be 100-150mL. The 500mL number might be the amount of something that was ordered, however.
One of the reasons that the pump oil level has been ignored is that santovac is a much more robust diffusion pump fluid than the earlier formulations. Silicone fluids tended to break down and cake inside the pumps where as the santovac (polyphenyl ether) tended to crack into lighter components which were then pumped away. I've opened pumps that have been running for decades continuously and the fluid is perfect condition.
The largest problem I've found with diffusion pumps using santovac has been backstreaming of foreline pump oil which then mixes with the diffusion pump oil.
Quote from: JonF on July 07, 2023, 01:36:50 AM
We have the turbo on our SX100, but to quote the person I learnt from: "Never trust the gauge!".
Yes, I started to understand such narrative. But is the situation still the same as decades ago and can't we have anything better?
At first, Alcatel Penning gauge (gauge installed on early models of SX100) is indeed hard to trust - there is whole pipeline of things where stuff can go wrong... I dig up through piles of old emails (my late predecessor had printed all communications and emails, which I could look through and learn the whole history of repairs of our SX100), and learned that indeed the problems with vacuum measurements were re-emerging again and again and again... Not only gauge but also cable was changed many times. Investigation of complete construction had revealed major weaknesses of this type of gauge.
1) High Voltage is sent through coaxial cable. That is about 4kV which is constant. If dielectric material weakens somewhere in the cable it start to leak and generates some current at HV source side. The whole vacuum measuring is based on precise current measurement through shunting resistor at returning path of HV generator, so such additional cable leakage current will sum up with current generated at gauge and worsen the displayed value of vacuum. But, in case of a huge leak in cable there will be no possibility to start penning gauge at all, as there will be significant voltage drop at gauge (leakage in cable will form something like voltage divider). Even if it will be clean gauge - bad cable will hinder its functioning. As for alcatel gauge cables - these are no more produced - all available at second hand shops are of questionable quality! Making new cable (DIY) from scratch is also hindered by requirement of HV reliable cable terminations (tools, expertise), and proper cable availability on the market (There are cables more think, and expensive).
2) Penning gauge, while being in simple construction, can give easily wrong idea about vacuum when not striking. Its lack of current (no strike event) could be compensated with small leak and final reading would look as good properly working gauge value. Experienced user knows that reading is wrong - but only if user tracks vacuum readings closely after the moment the vacuum valve is opened, and tracks the vacuum value response to that event. If vacuum suddenly just goes to 5E-5Pa from very rough vacuum - that is clearly unrealistic. However, if user leaves pumping unattended, and gets back to instrument after 10 min (and cable is leaky a bit), he can see the i.e. 4E-4Pa, even if gauge had not strike. Also Penning gauge needs constant high voltage, that have tendency to deteriorate the weakened isolation material in the cable and progress the problem(s).
Thus I came up with initiative, to make a replacement card which would interface modern gauges to SX100 (giving-up alcatel penning). That would be not jumping one tier in technology (like SXFive's used Agilent IMG) but two tiers. The next technological tier, IMG (inversed magnetron gauge), is more advantageous compared to Penning, but still requires the high voltage cabling and its correct termination and custom made current sensing circuits are difficult to do properly. Interfacing stock controlers of gauges is also hard as it would require changing firmware and finding some serial port on Cameca SX100 vacuum logical board. (That is rather completely out of equation).
Inside SX100 vacuum supply box, there is small board interfacing Alcatel gauge. It produces HV supply, measures the return current and sends the calculated vacuum as log10(P) as DC signal from 0 to 10V (10V roughting, 0V -ultimate vac) through coaxial cable to Vacuum logical board.
Thus naturally my attention got stolen by active gauges, which is higher tier than normal IMG. Active gauges work with low voltage cables, and produce all required HV for integrated IMG inside the gauges integrated electronics and send out only low voltage 0-10V signals (see the pattern?). Such gauges are also flexible as they can be powered from 14.5 to 40V, and such supply is already present in the Vacuum supply box. Also it looks that few different vendors have very similar connection based on 8C8P (or FCC68, or well known RJ45 ethernet cable/sockets), with same basic pin configuration: at least I found out few such gauges from Edwards, Curt J. Lesker and Inficon with such connections.
But what are advantages?
1) No HV cable. Basically simple Ethernet cable will do the job, as only 2W +15V is required to power such gauge, and signal is 0 to +10V. Replacement cable can be easily made or bought. (but it should not age at all, differently to high voltage cables).
2) These active gauges have builtin microcontrollers and LED(s) which show(s) status of gauge (i.e. if strike was successful) - the meaning of vacuum reading is clear. Situation then strike failed, and we have low current and very low vacuum reading is easily to catch. Also Active Gauges reduce high voltage to minimum after strike - this means less contamination of gauge - longer exploitation time between need of cleaning.
3) Edwards gauges (i.e. AIM200) has special multi-strike geometries which guaranties striking even in dirty environments.
How it will work?
My idea is to translate the voltage from such modern gauge to corresponding expected DC voltage by logical vacuum board of SX100. Basically my design is few OPAMPS for DC offset, scale and clip (values out of expected range). Two potentiometers will allow to easily recalibrate board to different kind of gauges from different vendor. It would be possible even to use WRG from Edwards (albeit pirani range would not be seen). The idea is to have seamless replacement (no firmware or software changes).
So how many people would be interested in such design?
I have schematics
alreadynearly finished (see the attachement), and now I am at stage of PCB design.
I won't produce and sell the boards, the EU laws and handicaps are too enormous for me (Basically RoHS3 forbids me to make and sell reliable electronics). But I could share the design, gerber files, bill of materials and notes for proper assemblage at site overcoming RoHS hindrances. PCB when having these is possible to order in most of the world. Buying parts and assembling them on PCB should be not too difficult, board is designed to be hand solder-able (no surface mounted parts, everything "though hole" parts). Albeit design could be updated with surface mounted parts if someone would decide to produce and sell larger batch of such boards.
But how do I know what DC voltages SX vacuum logical board expects for corresponding vacuum? I did reverse engineering scanning of it. (No one would expect anything less from me I guess ::)). I fed coaxial cable of secondary gauage with different voltages while watching vacuum values shown in GUI. The setup was simple 20k potentiometer, two 9V batteries (two connected in series, so I could cover with scanning voltages up to 10V), SMB coaxial connector, small breadboard to make some T junctions to attach the voltmeter for V measurement. By changing potentiometer I scanned from 0 to 10V and wrote down corresponding vacuum values. It seems that up to 9V the relation between log(P) and U is pretty linear. Actually in normal circumstances the gauge is engaged with better vacuum so below 9V. Thus that low vacuum range (9V-10V) can be ignored, and then looking for offset and scaling values I was looking that it would cover 0.5-9V range of expected values. The attached spreadsheet contains these recalculations with estimated gain and offset values for DC. tables has two offset values, mathematical and InAmp offset (InAmp - instrumentation amplifier). Mathematically we see no difference between these two equations:
Usx = Ugauge*G + O
or
Usx = (Ugauge+O/G)*G
where Usx is expected voltage, Ugauge is voltage output of gauge, G is gain and O is offset.
However, first equation is not possible to implement in OPAMPS which would saturate at gain, where second is easier to implement. So the offset which will be need to be set by potentiometer is InAmp ref (pin) offset or O/G. Gain is then applied at next stage (the G). Attached spreadsheet shows and presents gains and offests for different kind of gauges.
And there comes a teaser picts (rendering) of ready PCB design:
(https://smf.probesoftware.com/gallery/1607_25_09_23_6_25_31.png)
(https://smf.probesoftware.com/gallery/1607_25_09_23_6_18_46.png)
Hopefully in one week I will have a real prototype. Also I am still waiting for Edwards AIM200 gauge... already for 2 months... Good It is universal and Could buy Curt Lesker active gauge or will test it with WRG gauge.
Quote from: sem-geologist on September 20, 2023, 10:14:47 AM
Quote from: JonF on July 07, 2023, 01:36:50 AM
We have the turbo on our SX100, but to quote the person I learnt from: "Never trust the gauge!".
Yes, I started to understand such narrative. But is the situation still the same as decades ago and can't we have anything better?
At first, Alcatel Penning gauge (gauge installed on early models of SX100) is indeed hard to trust - there is whole pipeline of things where stuff can go wrong... I dig up through piles of old emails (my late predecessor had printed all communications and emails, which I could look through and learn the whole history of repairs of our SX100), and learned that indeed the problems with vacuum measurements were re-emerging again and again and again... Not only gauge but also cable was changed many times. Investigation of complete construction had revealed major weaknesses of this type of gauge.
1) High Voltage is sent through coaxial cable. That is about 4kV which is constant. If dielectric material weakens somewhere in the cable it start to leak and generates some current at HV source side. The whole vacuum measuring is based on precise current measurement through shunting resistor at returning path of HV generator, so such additional cable leakage current will sum up with current generated at gauge and worsen the displayed value of vacuum. But, in case of a huge leak in cable there will be no possibility to start penning gauge at all, as there will be significant voltage drop at gauge (leakage in cable will form something like voltage divider). Even if it will be clean gauge - bad cable will hinder its functioning. As for alcatel gauge cables - these are no more produced - all available at second hand shops are of questionable quality! Making new cable (DIY) from scratch is also hindered by requirement of HV reliable cable terminations (tools, expertise), and proper cable availability on the market (There are cables more think, and expensive).
2) Penning gauge, while being in simple construction, can give easily wrong idea about vacuum when not striking. Its lack of current (no strike event) could be compensated with small leak and final reading would look as good properly working gauge value. Experienced user knows that reading is wrong - but only if user tracks vacuum readings closely after the moment the vacuum valve is opened, and tracks the vacuum value response to that event. If vacuum suddenly just goes to 5E-5Pa from very rough vacuum - that is clearly unrealistic. However, if user leaves pumping unattended, and gets back to instrument after 10 min (and cable is leaky a bit), he can see the i.e. 4E-4Pa, even if gauge had not strike. Also Penning gauge needs constant high voltage, that have tendency to deteriorate the weakened isolation material in the cable and progress the problem(s).
Thus I came up with initiative, to make a replacement card which would interface modern gauges to SX100 (giving-up alcatel penning). That would be not jumping one tier in technology (like SXFive's used Agilent IMG) but two tiers. The next technological tier, IMG (inversed magnetron gauge), is more advantageous compared to Penning, but still requires the high voltage cabling and its correct termination and custom made current sensing circuits are difficult to do properly. Interfacing stock controlers of gauges is also hard as it would require changing firmware and finding some serial port on Cameca SX100 vacuum logical board. (That is rather completely out of equation).
Inside SX100 vacuum supply box, there is small board interfacing Alcatel gauge. It produces HV supply, measures the return current and sends the calculated vacuum as log10(P) as DC signal from 0 to 10V (10V roughting, 0V -ultimate vac) through coaxial cable to Vacuum logical board.
Thus naturally my attention got stolen by active gauges, which is higher tier than normal IMG. Active gauges work with low voltage cables, and produce all required HV for integrated IMG inside the gauges integrated electronics and send out only low voltage 0-10V signals (see the pattern?). Such gauges are also flexible as they can be powered from 14.5 to 40V, and such supply is already present in the Vacuum supply box. Also it looks that few different vendors have very similar connection based on 8C8P (or FCC68, or well known RJ45 ethernet cable/sockets), with same basic pin configuration: at least I found out few such gauges from Edwards, Curt J. Lesker and Inficon with such connections.
But what are advantages?
1) No HV cable. Basically simple Ethernet cable will do the job, as only 2W +15V is required to power such gauge, and signal is 0 to +10V. Replacement cable can be easily made or bought. (but it should not age at all, differently to high voltage cables).
2) These active gauges have builtin microcontrollers and LED(s) which show(s) status of gauge (i.e. if strike was successful) - the meaning of vacuum reading is clear. Situation then strike failed, and we have low current and very low vacuum reading is easily to catch. Also Active Gauges reduce high voltage to minimum after strike - this means less contamination of gauge - longer exploitation time between need of cleaning.
3) Edwards gauges (i.e. AIM200) has special multi-strike geometries which guaranties striking even in dirty environments.
How it will work?
My idea is to translate the voltage from such modern gauge to corresponding expected DC voltage by logical vacuum board of SX100. Basically my design is few OPAMPS for DC offset, scale and clip (values out of expected range). Two potentiometers will allow to easily recalibrate board to different kind of gauges from different vendor. It would be possible even to use WRG from Edwards (albeit pirani range would not be seen). The idea is to have seamless replacement (no firmware or software changes).
So how many people would be interested in such design?
I have schematics alreadynearly finished (see the attachement), and now I am at stage of PCB design.
I won't produce and sell the boards, the EU laws and handicaps are too enormous for me (Basically RoHS3 forbids me to make and sell reliable electronics). But I could share the design, gerber files, bill of materials and notes for proper assemblage at site overcoming RoHS hindrances. PCB when having these is possible to order in most of the world. Buying parts and assembling them on PCB should be not too difficult, board is designed to be hand solder-able (no surface mounted parts, everything "though hole" parts). Albeit design could be updated with surface mounted parts if someone would decide to produce and sell larger batch of such boards.
Our instrument engineer made this comment regarding the above comment from SG:
QuoteThe penning gauge on the SX100 is pretty robust. It's easy to clean.
We don't have much trouble except that it does cause GV3 errors (vacuum system shuts down) whenever it decides to arc. Ash buildup makes it more prone to arcing, but even when no ash is present, small arcs can trigger a GV3 error if the specimen chamber pressure is higher than usual (pinhole in spectro window), which offsets the DC signal the arc voltage spike is riding on, tripping the window comparator. Such narrow spikes are supposed to be filtered out by a capacitor, but even adding more parallel capacitance does not seem to make the filter effective in stopping such spikes. That fact makes me think the arc duration is rather long, negating the effectiveness of the filter.
Putting a datalogger on this signal would answer this question. What I've done to stop these nuisance arcs from causing GV3 errors for the time being is to defeat the window comparator so that the CPU logic does not see these arc spikes. This is not ideal, but we rest easy knowing that the analog pressure reading remains active, and the system can do a shut down if that reading goes high.
The author of the post does have a point saying we need to have a replacement for the stock gauge since it is now obsolete and out of production.
Steve
I also note a post from Jeff Streger from Rave Scientific on LinkedIn noting this new product from Edwards. The APG200 Piriani gauge:
https://www.edwardsvacuum.com/content/dam/brands/edwards-vacuum/edwards-website-assets/scientific-vacuum/documents/datasheets/3601-0681-01-Active-Pirani-Gauge-APG200-Product-Datasheet.pdf
Pirani is of not much use in our case, as 1) pirani gauges are useful at atmospheric - low vacuum ranges 2) there is low vaccum gauges already, tightly integrated with Cameca SX100 vacuum logic. It is not possible to use low vacuum range of pirani without modifying logical interface of SX100 vacuum; 3) separate cold cathode and pirani (or other low vac type) are more robust. I mentioned WRG (pirani coupled with cold cathode inside single package https://www.idealvac.com/Edwards-WRG-Wide-Range-Gauge/pl/7-33-291 (https://www.idealvac.com/Edwards-WRG-Wide-Range-Gauge/pl/7-33-291)), as sometimes those are off-shelf available at vacuum shops (applied more widely), where cold cathode type gauges needs to be waited for production as it is produced in small batches, unfortunately. What I would like to get ultimately is Edwards AIM200:
https://www.edwardsvacuum.com/content/dam/brands/edwards-vacuum/edwards-website-assets/scientific-vacuum/documents/datasheets/3601-0753-01-AIM200-Active-Inverted-Magnetron-Gauge-Product-Datasheet-LR.pdf (https://www.edwardsvacuum.com/content/dam/brands/edwards-vacuum/edwards-website-assets/scientific-vacuum/documents/datasheets/3601-0753-01-AIM200-Active-Inverted-Magnetron-Gauge-Product-Datasheet-LR.pdf)
If they fail to deliver that till I get the functioning interface board, I am going then with this:
https://www.lesker.com/newweb/gauges/kjlc-cold-cathode.cfm (https://www.lesker.com/newweb/gauges/kjlc-cold-cathode.cfm)
Eventually shop could lend me temporary the WRG (but I need documentation to be sure it is safe to connect), so I would not be so upset and would wait for AIM200 a bit more. WRG is only a temporary option, and not due to pirani, but due to widely available off-shelf cold cathode gauge.
As for arcing, new generation of gauges prevents this by reducing the high voltage after started - that significantly reduces risk of arching. Albeit we are unlucky with that (had not observed this), In our case we rather have lowered voltage at gauge as our cable is partly leaking.
And mine project aims to be as much as robust and to give possibility to make reliable replacement.
1. All parts are THT, for these reasons:
a) the solder joint inspection can be done with bare eye, and is quite straight-forward
b) easiest way to mitigate RoHS enforced tin whisker and solder embrittlement problems (design uses sockets for DIP8 and DIP14 components, not because replacability, but because then IC components can be NiAuPd plated. In case directly soldering such parts it risks in forming cracking when using PbSn solder (have risk of embrittlement and cracking after some time like few years); Where other passive components (i.e. with pure Sn coating) can be dipped into PbSn solder for whisker protection, doing that with Integrated circuit components (in case of pure Sn plated) is not wise as can be damaged by thermal shock. The Not-green components (with PbSn coating) aimed at space and military are restrictively expensive and are sold in packs, thus (over-)plating passive components and using "green" NiAuPd plated ICs is the optimal solution.
c) Can be easily soldered by less experienced.
2. Aims to work with wide range of gauges (currently to my knowledge at least three vendors, and different models). Post-pandemic market fluctuations had shown how not-wise it is to rely on a single supplier of components.
3. Is not tied to single supplier of components, has alternative integrated circuit models and suppliers for circuit to work near identically.
4. No software or firmware changes - just drop-in replacement - The software or firmware will not notice it is different gauge than Alcatel.
5. You probably had noticed Open Hardware mark on schematics and board? yes, after testing the first prototype I will release it as Open Hardware (probably on github, or other repository) - that means anyone will be able to tailor and keep the design up-to-date with best market-available gauges (OH - is like open software, just for hardware). Anyone can modify and tailor for his needs, order the parts and assemble at-site.
Gauge Upgrade Complete! The gauge replacement to AIM200 Edwards gauge shows that chamber vacuum is OK (The vac was off for two weeks, and after start up yesterday currently reached 2E-4Pa, but seems still dropping). Good that I patiently waited and had not did any stupid things with diffusion pump.
There, let me give you few teasers from this new system.
One from 5 PCB's manufactured in JLCPCB (china). (I have 4 spare laying around, as minimal board number to fill the PCB standard blank PCB board is 5). The daughter board is connected through "mouse bites" with main board, so that manufacturer of PCB would treat is as single, and it is easy deatach:
(https://smf.probesoftware.com/gallery/1607_20_10_23_1_49_36.jpeg)
Old and new gauge side by side:
(https://smf.probesoftware.com/gallery/1607_20_10_23_1_56_28.jpeg)
... and their connectors, please note that Active gauge works with low voltage supply and signals thus RJ45 does the job perfectly:
(https://smf.probesoftware.com/gallery/1607_20_10_23_1_54_11.jpeg)
The original and upgrade boards side by side. Color red so it would be very clear it is not original part.
(https://smf.probesoftware.com/gallery/1607_20_10_23_1_59_11.jpeg)
Upgrade board sitting in the Vacuum supply box. It is drop-in upgrade:
(https://smf.probesoftware.com/gallery/1607_20_10_23_2_01_48.jpeg)
Getting back on the topic of this thread (The Alcatel Crystal Diffusion pump in some of SX100 models).
I have all answers which I asked initially, and more, as I was forced to go through all of this.
Below is applicable only to earlier models of SX100 equipped with
Alcatel Crystal 102 diffusion pump (pump painted in orange), for more detailed maintenance sequence instructions AND properties of Balzers PDI100‐W diffusion pump installed in later models of SX100, the info is there:
https://smf.probesoftware.com/index.php?topic=1698.msg13025#msg13025 (https://smf.probesoftware.com/index.php?topic=1698.msg13025#msg13025)
TLDR;
For
Alcatel Crystal 102 diffusion pump main maintenance parameters:
- Fill/drain O-rings replacement: 2x FFKM o-rings of size AS-568 (IDxCS: 9.19x2.62mm)
(In my case, I used Kalrez 6375 FFKM, as required size Oring with that type of rubber chemistry could been sent from the nearby shop the next day); I do not recommend using Viton (FKM; the pump originally used 9.2x2.8 mm Viton green O-rings; CS of 2.62mm Kalrez type is standard size (AS-568) for inner diameter of 9.19 mm, the smaller cross section compensates with higher thermal expansion; in case Kalrez would have 2.8mm - it could deform with thermal expansion and could lead to failure). - Amount of diffusion pump oil: 100mL
- oil wet section off dipstick of fill port plug, if DP has nominal 100mL oil filled: 10mm
- Type of oil: definitely works with 704 or 705 type silicon oils, probably would work with Santovac 5 or other similar oil.
A long/short story about vacuum trouble with 25 year old Cameca SX100. Few months ago there was planned power line of building maintenance/checkup (planned power interruptions). Our SX100 is not covered with UPS (as I already mentioned before). As such maintenance work would interrupt the power in whole building few times for few seconds, I decided to be at the safe side and to minimize the risk I completely shutdown SX100 the evening before the planned maintenance work. So the next day, afternoon, after power checkups finished, I tried to turn on the SX100 back, and... Diffusion pump could not reach the roughing vacuum required to start it up. After excluding all other possibilities, the diffusion pump was the only place where the leak could had occur.
I found that fill and drain port O-rings had hardened in 25 years (Original Viton O-rings) and so after complete cool-down with loss of elastomer compression during many years spent at high temperature, it introduced a leak. While pump was hot, the hardened O-rings were still compressing toward surfaces it seal, due to additional compression force of thermal expansion of O-rings. But as Diffusion pump cooled down, the contracted hardened ring would leak, and as diffusion pump would no more be possible to turn on (too bad roughing vacuum), it would never heat up back and would not seal the leak. I could just measure dimensions of old O-rings, order the new Viton O-rings replacement, replace an move on...
But instead I wanted to achieve a more long term fix, and so I took some time to read and learned some fascinating things about O-rings. Viton(R) or in general FKM type rubber (flourinated elastomer), while is taken for granted as one of the best elastomer rubbers, it suffers in heated environments and even if it is used below maximum rated temperature, due to very long exploitation time (years) can harden-in and loose totally the elastic properties loosing its sealing capabilities.
There is however other elastomers designed for hot environments - perfluorinated elastomers (FFKM), i.e. DuPont's Kalrez(R). The only caveat is that Kalrez has twice a thermal expansion to Viton, thus in hot environment that needs to be taken into account, when choosing Kalrez replacement inplace of Viton.
As I had to open drain port, I also had to drain oil. Less than 80mL had flown out. I could not find out what kind of oil was there - no notes what was it filled with - for sure it was not filled with Santovac 5, as it had quite a water like viscosity. It could be petrol oil or silicon oil or some other nasty thing. Raman spectrum analysis showed very mixed data, there were some benzene and some other "smoking-gun" signatures pointing to cracking products of petrol oil (or cracking of silicon oil somehow). Definite answer came from liquid density measurement showing it most probably was 704 type silicon oil. As only 80mL from required 100mL had dripped out, I decided to disassemble pump for cleaning. It was absolutely nastily dirty that it took me few days to completely clean it up (using acetone and iso-propanol alcohol only).
As for filling back with oil I had few possibilities: go for Santovac 5, or go with silicon 704 substitutes, or 705 substitutes. Santovac 5 availability had lots to wish for, lead time to be ordered was few weeks.. however I found out local 705 substitute, German manufacturer which could send me oil just right away. Another consideration was if thermo-regulation of the pump should not be tweaked in case switching from previous 704 type into santovac 5, which require higher temperature. 705 type is closer to 704 and could work without any thermal pump tweaks (and consider that having no manual on the pump), so I had chosen 705 as more safe option. The mentioned German diffusion pump oil is Indomet PENTA.
I had more troubles waiting me - the chiller failure... which postponed diffusion pump integrity testing, and so after about 1 month after initial pump failure I could finally turn it on.
There are few tricks and steps I had taken:
1.Cold dry test. After cleaning and assembling the pump (including the the new fill/drain O-rings replaced), but without refilling the pump with oil, I started up SX100 vacuum system with pump power cable still detached, so that SX100 Vacuum firmware could not energize the heater if roughing vacuum is good enough to start the diffusion pump. After pumping for a while and seeing that threshold can be reached without a problem in very short time, I also did a "vacuum halt test for a night", to check how tight the vacuum can be kept inside the diffusion pump with roughing pump cut off from the diffusion pump. It was a sharp contrast (practically vacuum stayed the same) compared to same test with previously leaky old O-rings.
2. I Filled the oil through backing vacuum pipe side (there it is attached to Vacuum buffer tank – the 90 degree elbow is easy to detach, as it is kept in place by two KF type clamps) instead of using hte dedicated fill port. Generaly, Diffusion pumps can be filled much easier through vacuum backing connection side, which on SX100 is in much more accessible position, than the fill port of the pump. Additionally I could put the glassware upside down on the pipe opening, after dripping the majority of oil and let the very last drops of oil to drip into the port. I am convinced it is easier to get it precisely 100mL that way. Otherwise, if using fill port, it would definitely require a syringe, there would be oil leftovers in beaker and syringe, and beaker should have some little excess of oil then (i.e. 102mL).
3. After waiting few (10-15) minutes for oil to level out in the pump I took the measurement of fill drain dipstick for future reference. (10mm oil-wet end of the dipstick)
4. Then I had assembled back the pump, but still had not plugged the power to the pump heater. I restarted the SX100 vacuum and let the cold degassing of fresh filled oil - in my reasoning, the oil in the shipped bottle clearly contained bubbles with entrapped air - I think it is safer to let the majority of air to degas in cold, instead in the hot diffusion oil (less possibilities to crack oil).
5. After some degassing for few hours, I stopped the vacuum, plugged back the power to the pump, and restarted the vacuum system letting it go full startup sequence. (of course in my case as chamber was at atmosphere pressure for whole 1 month, I had preventive kept Ion pump off, so it would not be prematurely too early switched on and consumed.)
6. After weekend of pumping, I had switched vacuum off, turned the breaker for ion pump power back on, restarted with full sequence and lived ever happily.
Quote from: sem-geologist on November 06, 2025, 01:43:08 PM... As only 80mL from required 100mL had dripped out, I decided to disassemble pump for cleaning. It was absolutely nastily dirty...
That above (question how so big 20% loss of diffusion pump oil could happen), and emergency fire situation in the building a month ago made me to look back into importance of backup battery which I mentioned previously in the beginning of this thread: https://smf.probesoftware.com/index.php?msg=11923 (https://smf.probesoftware.com/index.php?msg=11923)
As this diffusion pump repair had teach me a lot about the diffusion pumps, It changed my perception and recognition of the backup battery in completely different light. It is a crucial safety feature for SX100 equipped with diffusion pump (for turbo pump equipped SX100 it is not crucial or even unnecessary) - it covers most of failure cases which UPS and backup generator does not cover, and recent fire hazard event and complete cutoff of power to the building for 3 days had teached me the backup battery for Diffusion Pump inlet valve is not a "maybe", but a "must" – unless cleaning the column from deposits of diffusion oil vapor is seen as a very nice pleasant afternoon activity.
I was partially wrong in my initial reasoning - safety valve is not to protect diffusion pump oil from residual gases originating in chamber – but its protection is in opposite direction - it is to protect clean sample chamber from back-streaming of diffusion pump oil in case of abrupt power cutoff to EPMA. The reliance explicitly only on UPS/generator can be dangerous, as UPS and power generators covers only and only event of general external power blackout. In some of countries in particularly with high capacity UPS installations, UPS is prone to remote switch off at critical circumstances. In example our Polish laws and safety standards (and I believe many other European standards and laws) require to have remote switch off of UPS, which is situated near entrance of the building, and in case of any fire emergency situation those UPS power brake switches are triggered without any questions asked or any hesitations at the moment firefighters enter into the building during any fire emergency event. UPS and generators can cover only black out from the city - but that is not a single weak point for chain of power-failures leading to most important - power loss of vacuum system which is equipped with diffusion pump.
The side-lined power loss also strongly depends from how lab power topology is designed, Comonly UPS power output covers also peripherals of EPMA (chiller, air compressor) and so is roated through some distribution electric wall box. Failing peripherals , i.e. a water chiller then has very high chance to trigger RCD (in between the UPS and EPMA) cutting also power for EPMA - I had seen just few months ago this kind of event, where cooling fan motor in the a chiller, after 3 years of constant work, just developed reduced resistance between Phase Neutral and Ground and triped the RCD which triped all outputs from distribution power box (including EPMA). Looking further just into EPMA desing itself, SX100 contains quite a complex electric power system with different safety devices including RCD covering whole vacuum system, any failure in any vacuum component, which would trigger RCD, will send whole vacuum system into state of no power.
In any case of power failure of EPMA vacuum system (including fire hazard with remote UPS power cutoff, chiller failure, roughing vacuum pump engine coil isolation weakening, or weakening of isolation in coils of electrovalves, or even some random dust built-up and current leak through it on any of Vacuum PCB's with 230V on it triggering RCD) will lead to situation where previously fully operational hot diffusion pump will go through time window where oil curtains gradually stop being formed, and still hot oil vapor will escape into sample chamber through the stayed opened diffusion pump inlet valve. In case of power loss such oil vapor backstreaming can be amplified by pressure built-up at diffusion pump backing vacuum buffer side, as primary pump and outlet valves are off, for one minute still working diffusion pump (still hot oil) will keep building pressure. As soon the diffusion pump ultrasonic oil curtains start to fail (due to decreasing energy of oil and decreasing oil vapor speed from nozzle) the higher pressure of gas at backing side will very efficiently push oil vapor from diffusion pump upward into the sample chamber. It is possible that time window of vapor transport to chamber can be longer as with power loss chiller water circulation is also off - thus chances of partial trapping oil vapor on its way upward by cold diffusion pump walls is even more reduced, as diffusion pump walls also stop being cooled. The dangerous time window is probably 1-3 minutes long,
just after 1-2 minutes counting from power loss (the oil curtains will stay in motion for a minute after power cutoff to diffusion pump; this is in contrast to my initial assumption that danger occurs only about 15 minutes after the power loss). The danger of oil vapor back-streaming into chamber is real and can happen in just few minutes if inlet valve to diffusion pump is not shut.
Basically any failure occurring after UPS can cut off the SX100 vacuum system power (UPS, and generators are unable to cover those cases) - and in any of such cases the inlet valve stays open, as H-bridge used to move motor forward or backward to open/close the valve is without the power. In our case as that battery was not replaced for nearly 2 decades, every power loss of EPMA was cumulatively getting rid of diffusion oil from pump into the chamber - that explains: how 20% of oil was lost from the diffusion pump, and why a few years ago, the maintenance full disassemble of column revealed such enormous filthy dirt on all the apertures. That contamination practically killed also BSE detector, where its replacement had cost us tens of thousands of euros/dollars.
The battery replacement.
This is where backup battery comes into for prevention. It is connected with diffusion pump inlet valve motor only in one way - only to energize the movement of motor in one direction - that is to close the valve if open. It is activated utilizing the NC contacts of few relays, which closes the backup battery circuit in case there is no external power (If there is power then relays disconnect powering of motor from battery and switch it to use power from H-bridge instead). Originally battery was 12V NiCd rechargeable battery pack (inside I found 10x 1.2V NiCd cells spot-welded into a pack) of 100mAh. I had seen a few issues against replacing it with similar chemistry pack: 1. recharging the pack with no balancing would lead to premature aging of battery (it would rather not survive for 10 years, but more close to 5-6). 2. I could not find any packs of 100mAh; Commercially available 12V NiCd packs starts at much higher capacities (i.e. 2000mAh). The trickle charging circuit present on the vacuum power distribution board on SX100 would be a bit too weak in case of huge package (i.e. 2000mAh).
Thus I looked to alternatives and decided to replace it with smallest industrial Sealed Lead Battery (800mAh) I could get, and add some voltage limiter to limit charging voltage down to 13.6V - the most appropriate float charge voltage for these kind of sealed lead batteries. The circuit is just adapter to interface JST battery connection, tab type (FASTON) connectors for connecting the wires for charging from SX100 (the wires with FASTON connectors previously used to connect to NiCd battery), 2 Zener diodes of 6.8V, which connected in series would limit voltage from 14.4V (actually from 15V) down to 13.6V, and socket for a 1A slow blow fuse. Fuse is there to protect from eventual shorting of winding in motor (or motor stall for some unexpected reason) or shorting anywhere on the circuit from battery to the motor - 800mAh 12V VRLA battery if shorted would be enough to pose some fire hazard (13V * 3A = 39W; 12V * 3A = 36W), taking into account the quite thin wires used for cabling from the distribution board to the valve motor (originally use 100mAh NiCd had no such power, maybe up to 1A in short pulse, for sure not more than 0.5A continously, where VRLA can give about 3A in continous mode).
If anyone would be interested I could send the kicad project and/or gerber files, although it is such a trivial circuit (only 4 nets) that I made it on a bench with help of small modelling dremel scraping cooper from single layer PCB laminate and drilling the holes for THT components.
I had tested sudden power cut off - everything works correctly. Such battery should cover protection for about 10 years.
I just add the picture with more down-to-earth implementation.
(https://smf.probesoftware.com/gallery/1607_13_01_26_3_39_35.png)