Dell Customer Communication - Confidential
The TSR on file shows the same three drives installed as your PERC CLI output.
0 Online Samsung SSD 860 2 TB
1 Online Samsung SSD 860 2 TB
4 Online Western Digital WD80EFZX 68U 8 TB
Have you looked to see if Western Digital and Samsung have any firmware updates
for the disks already?
Regards,
Chris Sumers
Dell EMC | PG- International Product Support (IPS) Engineering
Office + 1 512 728 4685
[email protected]
Dell Technologies 200 Dell Way, RR5-3 IPS Lab, Round Rock, TX 78682
Please consider the environment before printing this email.
Confidentiality Notice | This e-mail message, including any attachments, is for
the sole use of the intended recipient(s) and may contain confidential or
proprietary
information. Any unauthorized review, use, disclosure or distribution is
prohibited. If you are not the intended recipient, immediately contact the
sender by reply e-mail and
destroy all copies of the original message.
-----Original Message-----
From: [email protected] <[email protected]>
Sent: Thursday, January 16, 2020 5:30 PM
To: Sumers, Chris
Cc: linux-poweredge-Lists
Subject: RE: [Linux-PowerEdge] iDRAC9 : Unable to set manual fan response after
iDrac v3.34.34.34
[EXTERNAL EMAIL]
Chris,
Thank you for your openness on this list. It's great to feel listened to.
Can we tell if that TSR was with the Samsung 850 (no temp sensor) or with the
Samsung 860? The latter does in fact have a temp sensor:
# megaclisas-status
[....]
-- Disk information --
-- ID | Type | Drive Model | Size
| Status | Speed | Temp | Slot ID | LSI ID
c0u0p0 | SSD | S3YUNB0KC09340D Samsung SSD 860 EVO 2TB RVT03B6Q | 1.818 TB |
Online, Spun Up | 6.0Gb/s | 21C | [32:0] | 0
c0u1p0 | HDD | R6GP40KY WDC WD80EFZX-68UW8N0 83.H0A83 | 7.276 TB |
Online, Spun Up | 6.0Gb/s | 29C | [32:4] | 4
c0u2p0 | SSD | S3YUNB0KC09173D Samsung SSD 860 EVO 2TB RVT03B6Q | 1.818 TB |
Online, Spun Up | 6.0Gb/s | 21C | [32:1] | 1
^^^^=====
Is it possible that your output is from an old TSR of mine? I wonder if the
H730P properly detects the temperature on the 860 even though the megaraid_sas
driver does detect it
properly.
Regards,
Vincent
On Thu, 16 Jan 2020, [email protected] wrote:
> Dell Customer Communication - Confidential
>
> Unfortunately, I agree with your assessment. I pulled the following content
from the provided TSR the last time I was engaged on your issue. I had to go back
and look again.
>
> The disks are driving an open loop response (not LFM) that cannot be
adjusted. This is a baseline fan speed response for a no-drive-temp config per
design. Agree there's
nothing else we can do here to mask this behavior.
>
> From the TSR:
> ----------------------------------------------------------------------
> ----------
> OPEN LOOP CONTROL
>
--------------------------------------------------------------------------------
> ALG_TYPE ID# NAME FZ1 FZ2 | PSU1
PSU2
> OL_TYPE1 2 Baseline_Amb_Any 16.90 0.00 | 0.00
0.00
> OL_TYPE1 10 HDD_No_Sensor_OL_3_5 41.75 0.00 | 0.00 0.00
<< thermal table fan response due to no HDD temp
> OL_TYPE1 16 SSD_No_Sensor_OL_2_5 0.00 0.00 | 0.00
0.00
> OL_TYPE1 27 FAC_Restriction_Single Fan 0.00 0.00 | 0.00
0.00
> OL_TYPE1 28 FAC_Restriction_NonRDNPSU 0.00 0.00 | 0.00
0.00
> OL_OTHER 5 OPEN_LOOP_BASELINE 62.80 0.00 | 0.00
0.00
>
>
> Regards,
>
> Chris Sumers
> Dell EMC | PG- International Product Support (IPS) Engineering Office
> + 1 512 728 4685 [email protected] Dell Technologies 200 Dell Way,
> RR5-3 IPS Lab, Round Rock, TX 78682
>
>
> Please consider the environment before printing this email.
>
> Confidentiality Notice | This e-mail message, including any attachments, is
for the sole use of the intended recipient(s) and may contain confidential or
proprietary
information. Any unauthorized review, use, disclosure or distribution is
prohibited. If you are not the intended recipient, immediately contact the
sender by reply e-mail and
destroy all copies of the original message.
>
> -----Original Message-----
> From: [email protected] <[email protected]>
> Sent: Thursday, January 16, 2020 4:31 PM
> To: Sumers, Chris
> Cc: linux-poweredge-Lists
> Subject: RE: [Linux-PowerEdge] iDRAC9 : Unable to set manual fan
> response after iDrac v3.34.34.34
>
>
> [EXTERNAL EMAIL]
>
>
> Here's what happens on an H730P (which has 3rd party SSDs behind it which
causes high-rpm) on which I want to disable LFMMode:
>
> /admin1-> racadm set system.PCIeSlotLFM.2.LFMMode 1
> ERROR: PCI3022: Unable to adjust the Airflow Linear Flow per Minute (LFM)
settings of the PCIe slot
> because the LFM settings can be adjusted only for installed cards that
are identified as third party cards.
>
> I'm still on 3.30.30.30
>
> ,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`
> ^`'~*-, Vincent S. Cojot, Computer Engineering. STEP project.
> _.,-*~'`^`'~*-,._.,-*~ Ecole Polytechnique de Montreal, Comite
Micro-Informatique. _.,-*~'`^`'~*-,.
> Linux Xview/OpenLook resources page _.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'
> http://step.polymtl.ca/~coyote _.,-*~'`^`'~*-,._
> [email protected]
>
> They cannot scare me with their empty spaces Between stars - on stars where
no human race is I have it in me so much nearer home
> To scare myself with my own desert places. - Robert Frost
>
>
>
> On Thu, 16 Jan 2020, [email protected] wrote:
>
>> Dell Customer Communication - Confidential
>>
>> Vincent,
>>
>> You are correct. The ipmi raw command that allows a user to bypass the Dell
EMC multi-vector cooling algorithm was exposed in iDRAC9 releases prior to iDRAC9
3.43.34.34
release. This command was not intended for public consumption on iDRAC9 and 14G
PowerEdge servers. When it was detected that this command was exposed on Arev
iDRAC firmware,
measures were taken to revoke that raw ipmi command starting in iDRAC9
3.34.34.34.
>>
>> If you are experiencing high PWM of the internal fan of your T440 due to
presence of third-party cards, there are measures that you can take. The Dell EMC fan
algorithm can
be disabled on a slot when the PCIe slot is occupied by a third party card. You
can leverage the built-in racadm utility through an SSH session to the iDRAC to
make these
changes.
>>
>> To confirm that the iDRAC detects the add-in card as a third-party card, leverage the
system.PCIeSlotLFM.x.3rdPartyCard attribute. You will need to modify "x" with the
numerical value of your PCIe slot.
>>
>> racadm>>racadm get system.PCIeSlotLFM.3.3rdPartyCard
>> [Key=system.Embedded.1#PCIeSlotLFM.3]
>> 3rdPartyCard=Yes
>> racadm>>
>>
>> If the value for this slot = yes, then you can disable the Dell EMC cooling
algorithm for that slot. You will need to modify the sytem.PCIeSlotLFM.x.LFMMode
value (x = slot
numerical value).
>>
>> racadm>>racadm set system.PCIeSlotLFM.3.LFMMode 1
>> [Key=system.Embedded.1#PCIeSlotLFM.3]
>> Object value modified successfully
>>
>> racadm>>racadm get system.PCIeSlotLFM.3.LFMMode
>> [Key=system.Embedded.1#PCIeSlotLFM.3]
>> LFMMode=Disabled
>> racadm>>
>>
>>
>> Additional details on the Dell EMC multi-vector cooling with Dell EMC
>> PowerEdge servers can be found in this whitepaper:
>> https://downloads.dell.com/manuals/common/poweredge_pcie_cooling.pdf
>>
>> Additional details on racadm attribute registry can be found in the current
Attribute Registry Guide:
>> https://topics-cdn.dell.com/pdf/idrac9-lifecycle-controller-v4x-serie
>> s
>> _reference-guide_en-us.pdf
>>
>> Additional iDRAC9 whitepapers can be found here:
>> https://www.dell.com/support/article/us/en/19/sln311300/support-for-i
>> n tegrated-dell-remote-access-controller-9-idrac9?lang=en
>>
>>
>> Regards,
>>
>> Chris Sumers
>> Dell EMC | PG- International Product Support (IPS) Engineering Office
>> + 1 512 728 4685 [email protected] Dell Technologies 200 Dell
>> + Way,
>> RR5-3 IPS Lab, Round Rock, TX 78682
>>
>>
>> Please consider the environment before printing this email.
>>
>> Confidentiality Notice | This e-mail message, including any attachments, is
for the sole use of the intended recipient(s) and may contain confidential or
proprietary
information. Any unauthorized review, use, disclosure or distribution is
prohibited. If you are not the intended recipient, immediately contact the
sender by reply e-mail and
destroy all copies of the original message.
>>
>> -----Original Message-----
>> From: linux-poweredge-bounces-Lists
>> <[email protected]> On Behalf Of
>> [email protected]
>> Sent: Monday, January 13, 2020 10:06 PM
>> To: linux-poweredge-Lists
>> Subject: [Linux-PowerEdge] iDRAC9 : Unable to set manual fan response
>> after iDrac v3.34.34.34
>>
>>
>> Hi everyone,
>>
>> Just FYI, on 14th Gen PowerEdge, with iDrac v3.34.34.34 and above,
>> Dell Engineering knowingly removed the possibilty to control fan
>> speed beyond what the iDRAC considers 'the right thing to do' for
>> your machine (as of
>> 3.34.34.34 and above, you no longer have a say in the matter).
>>
>> Please allow me to explain by giving an example:
>>
>> I own a nice T440 with dual 4110 Xeon silver and with mostly
>> low-power
>> components:
>> - 384Gb RAM in 32Gb LRDIMM sticks.
>> - PERC H730P with 2 * 2Tb Samsung 860, 1* 8Tb WD Red
>> - NVidia 1660 GTX Ti
>> - a quad-1G NIC
>> - a NVMe drive on a Supermicro PCI-E adapter.
>> - The box is running RHEL7 with a moderately conservative power profile.
>>
>> This box is somewhat low-power (110-154W under light load and 250W under
heavy).
>> I usually force the system fan to 1080rpm:
>> # /usr/bin/ipmitool raw 0x30 0x30 0x01 0x00 # /usr/bin/ipmitool raw
>> 0x30 0x30 0x02 0xff 0x0b
>>
>> ..unless the cpu temperatures go above 65C at which case the systems goes
back to 'auto' on its own (thanks to a daemon):
>> # /usr/bin/ipmitool raw 0x30 0x30 0x01 0x01
>>
>> This works well and the cpus are usually between 32C and 35C on light
>> load. I've never had any problem on either of my T440, T430 or T630
>> doing this. The script is here: [1]
>>
>> ..but because I'm using 3rd party components, the iDRAC -thinks- it -must-
set the fan to the highest rpms possible to cool my system. When left to 'auto', the
fan goes to
3700-4300rpm and I feel like I'm standing on the bridge of an aircraft carrier.
>>
>> Dell support has been unable to help with my '3rd party components' to take
the fans down (we've tried every BIOS setting).
>>
>> With 3.34.34.34 and above, the 'manual' fan speed is ignored and
>> reports
>> this:
>> # /usr/bin/ipmitool -I open raw 0x30 0x30 0x01 0x00 Unable to send
>> RAW command (channel=0x0 netfn=0x30 lun=0x0 cmd=0x30 rsp=0xd4):
>> Insufficient privilege level
>>
>> # /usr/bin/ipmitool -I open raw 0x30 0x30 0x02 0xff 0x0b Unable to
>> send RAW command (channel=0x0 netfn=0x30 lun=0x0 cmd=0x30 rsp=0xd4):
>> Insufficient privilege level
>>
>> When contacted, an escalation manager at Dell suggested that I
>> stopped using 3rd party components and that I should buy Workstations
instead.
>> He also confirmed that the removal of the 'ipmitool' 'feature' in
>> iDRAC
>> 3.34.34.34 was intentionnal because they 'had had many escalations because
of this'.
>>
>> Other users on the Dell Community forums have reported similar issues
>> with
>> T340 and T640 systems.
>>
>> Consequently, I will probably be staying on 3.30.30.30 (the last
>> working
>> version) for as long as I can.
>>
>> Here is more information:
>> [1], script (adjust for your machines):
>> https://raw.githubusercontent.com/ElCoyote27/krynn-tools/master/dellf
>> a
>> nctl
>>
>> [2]: discussions:
>> https://www.dell.com/community/Systems-Management-General/iDRAC9-Unab
>> l
>> e-to-set-manual-fan-response-after-iDrac-v3-34-34-34/m-p/7339941
>> https://www.reddit.com/r/homelab/comments/d0422n/to_anyone_considerin
>> g
>> _or_using_dell_14th_gen_for
>>
>> I used to be a big fan of Dell systems but this T440 will probably be my
last.
>>
>> I hope this helps others.
>>
>> Regards,
>>
>> Vincent (Working but not speaking for RedHat/IBM)
>>
>> _______________________________________________
>> Linux-PowerEdge mailing list
>> [email protected]
>> https://lists.us.dell.com/mailman/listinfo/linux-poweredge
>>
>