Random panic in IONVMeController about hac-mini

[07151129]

acidanthera/NVMeFix@66c9de5 should fix this kind of panics.

[osy]

Could be related to overheating issues in the NVMe #49 (comment)

[osy]

Please fix this.

There is nothing to fix as it’s an Apple side issue. Various workarounds have been proposed here. It none works for you, don’t use nvme.

[deftdawg]

Don't remember any random crashes while I was using the machine, rather one day it started regularly crashing overnight when not in use.

[otonieru]

this panic happened on one of units in my care. It's 13 inch model of early 2015 macbook pro.

main culprit is the BootRom 188.0.0.0 version introduced in Catalina 10.15.2 which seems to increase power supply to the SSD (not sure what the objective is, but i guess it's performance related) make it run hotter and crashing during IO burst (installing/copying big file/app)

doesnt matter what i did, it keep happening, even clean installation of OS will crash in the midle. I only able to install clean OS by plugging my NVME drive to external enclosure.

the drive itself is not a culprit here (in contrary with what a lot of people suggest, that drive might have defect). Because i even swap between 3 drives available (with cross brands and capacity) and any of them will crash on this particular macbook, but run just fine on other units.

what finally solved issue for me is installing 10.15.3 when it released, forcing the BootRom to go up again to 189.0.0.0 and then combined with downgrading to Mojave and run HFS+ instead of APFS.

now it run stable in almost any condition, even during high load. But just for precaution, i also installing mac fan control to monitor and keep the NVME stick cool, since i notice that when it heat up past 50 degree C, the performance seems to drop (stuttering UI, etc). This never happen with other units (i've been installing NVME stick to dozens of macbook pr and air). So, weird indeed, but luckily it solved after much frustration.

[07151129]

We've had a panic on PM981 where we observed the following:

I/O Read command (qid=1, opcode=2) timed out. We then got panic log leading to RequestAsyncEvents call. Now, I'm not sure if the panic is due to the I/O command out, or due to the RequestAsyncEvents command timing out, but if we disable RequestAsyncEvents, then we seemingly do not get the panic anymore. It also seems to be safe to do so, as IONVMeController::CompleteAsyncEvent, which is the command completion callback, does nothing in IONVMeController::AsyncEventHandler. In any case, NVMe 1.3 spec states there's no timeout for Asynchronous Event Request command, but it looks like IONVMe still uses one.

Curiously, IONVMeController::PolledIO immediately follows IONVMeController::RequestAsyncEvents, but the panic message is not from PolledIO.

We're sometimes getting exactly the same panic on a virtual machine.

Coincidentally, AppleNVMeSMARTUserClient does not seem to filter log page IDs, which may cause Apple-specific IDs to hang the controller if a user client does not check controller VID/DID. I only noticed this by accident when I incorrectly assumed the I/O command was submitted to the admin queue.

[deftdawg]

Just wanted to chime in and say the installer option for NVMe fixup helped me out after I experienced overnight crashes with my Evo 970 & AData NVMe drives (the later used as a raw disk for Virtualbox)... Thank to everyone on this thread for getting that fixed. 👍

[hostelo]

Hi.
Wast sent to this link for a Kernel Panic that started randomly happening 2 weeks ago and happened every few days.
I'm on a Early 2014 MacBook Air with the latest macOS Catalina 10.15.6 installed.

Here is the error report. Please help! Thanks.

panic(cpu 0 caller 0xffffff7f9d059231): nvme: "Fatal error occurred. CSTS=0xffffffff US[1]=0x0 US[0]=0x26 VID=0x1987 DID=0x5012
. FW Revision=ECFM12.3\n"@/AppleInternal/BuildRoot/Library/Caches/com.apple.xbs/Sources/IONVMeFamily/IONVMeFamily-470.100.17/IONVMeController.cpp:5320
Backtrace (CPU 0), Frame : Return Address
0xffffff80ae8039e0 : 0xffffff801b31a65d
0xffffff80ae803a30 : 0xffffff801b454a75
0xffffff80ae803a70 : 0xffffff801b4465fe
0xffffff80ae803ac0 : 0xffffff801b2c0a40
0xffffff80ae803ae0 : 0xffffff801b319d27
0xffffff80ae803be0 : 0xffffff801b31a117
0xffffff80ae803c30 : 0xffffff801bac1abc
0xffffff80ae803ca0 : 0xffffff7f9d059231
0xffffff80ae803cc0 : 0xffffff7f9d044362
0xffffff80ae803e20 : 0xffffff801ba32329
0xffffff80ae803e90 : 0xffffff801ba32249
0xffffff80ae803ec0 : 0xffffff801b35c605
0xffffff80ae803f40 : 0xffffff801b35c131
0xffffff80ae803fa0 : 0xffffff801b2c013e
Kernel Extensions in backtrace:
com.apple.iokit.IONVMeFamily(2.1)[28183FA3-6A50-3611-BC20-A0717B657AAC]@0xffffff7f9d036000->0xffffff7f9d078fff
dependency: com.apple.driver.AppleMobileFileIntegrity(1.0.5)[CA079DB9-6FDB-3AB5-A5E5-506459E3F12E]@0xffffff7f9bd87000
dependency: com.apple.iokit.IOPCIFamily(2.9)[B130A8B7-967F-330E-942F-E0BB93C71C56]@0xffffff7f9bf02000
dependency: com.apple.driver.AppleEFINVRAM(2.1)[D9C4809C-7B20-3663-A9C8-4DBC261AAD86]@0xffffff7f9c10a000
dependency: com.apple.iokit.IOStorageFamily(2.1)[3581A46A-F3F3-3CE7-BA52-7046E8D66C32]@0xffffff7f9bc65000
dependency: com.apple.iokit.IOReportFamily(47)[8F7948CF-5C25-33F4-A687-67F8A5B7906E]@0xffffff7f9be30000

BSD process name corresponding to current thread: kernel_task

Mac OS version:
19G73

Kernel version:
Darwin Kernel Version 19.6.0: Sun Jul 5 00:43:10 PDT 2020; root:xnu-6153.141.1~9/RELEASE_X86_64
Kernel UUID: 783946EA-6F11-3647-BF90-787AEA14B954
Kernel slide: 0x000000001b000000
Kernel text base: 0xffffff801b200000
__HIB text base: 0xffffff801b100000
System model name: MacBookAir6,2 (Mac-7DF21CB3ED6977E5)
System shutdown begun: NO
Panic diags file available: YES (0x0)

System uptime in nanoseconds: 100327317615607
last loaded kext at 82927783166: com.getdropbox.dropbox.kext 1.11.1 (addr 0xffffff7f9d751000, size 49152)
last unloaded kext at 331660542680: >!A!ILpssI2C 3.0.60 (addr 0xffffff7f9c246000, size 40960)
loaded kexts:
com.getdropbox.dropbox.kext 1.11.1
com.bitdefender.TMProtection 5.0.0
com.bitdefender.FileProtect 1
com.bitdefender.SelfProtect 1.2.16

AudioAUUC 1.70
!AGraphicsDevicePolicy 5.2.6
@AGDCPluginDisplayMetrics 5.2.6
@fileUtil 20.036.15
@filesystems.autofs 3.0
!AHV 1
|IOUserEthernet 1.0.1
|IO!BSerialManager 7.0.6f7
!APlatformEnabler 2.7.0d0
AGPM 111.4.4
X86PlatformShim 1.0.0
pmtelemetry 1
!AUpstreamUserClient 3.6.8
@Dont_Steal_Mac_OS_X 7.0.0
!A!IHD5000Graphics 14.0.7
!AHDA 283.15
eficheck 1
!AThunderboltIP 3.1.4
!ABacklight 180.3
!ASMCLMU 212
!ALPC 3.1
AirPort.BrcmNIC 1400.1.1
!ACameraInterface 7.6.0
!A!ISlowAdaptiveClocking 4.0.0
!A!IFramebufferAzul 14.0.7
!AMCCSControl 1.14
!UCardReader 489.120.1
|SCSITaskUserClient 422.120.3
!U!SCoexistentDriver 489.120.1
!AVirtIO 1.0
@filesystems.hfs.kext 522.100.5
@!AFSCompression.!AFSCompressionTypeDataless 1.0.0d1
@BootCache 40
@!AFSCompression.!AFSCompressionTypeZlib 1.0.0
!ATopCaseHIDEventDriver 3430.1
@filesystems.apfs 1412.141.1
@private.KextAudit 1.0
!ASmartBatteryManager 161.0.0
!ARTC 2.0
!AACPIButtons 6.1
!AHPET 1.8
!ASMBIOS 2.1
!AACPIEC 6.1
!AAPIC 1.7
$!AImage4 1
@nke.applicationfirewall 303
$TMSafetyNet 8
@!ASystemPolicy 2.0.0
|EndpointSecurity 1
!AGraphicsControl 5.2.6
|IOAVB!F 850.1
@kext.triggers 1.0
@plugin.IOgPTPPlugin 840.3
|IOEthernetAVB!C 1.1.0
DspFuncLib 283.15
@kext.OSvKernDSPLib 529
@!AGPUWrangler 5.2.6
!ABacklightExpert 1.1.0
|IONDRVSupport 576.1
!AHDA!C 283.15
|IOHDA!F 283.15
|IO80211!F 1200.12.2b1
mDNSOffloadUserClient 1.0.1b8
corecapture 1.0.4
|IOSkywalk!F 1
X86PlatformPlugin 1.0.0
IOPlatformPlugin!F 6.0.0d8
|IOSlowAdaptiveClocking!F 1.0.0
@!AGraphicsDeviceControl 5.2.6
|IOAccelerator!F2 438.7.3
!ASMBus!C 1.0.18d1
|IOGraphics!F 576.1
|Broadcom!BHost!CUSBTransport 7.0.6f7
|IO!BHost!CUSBTransport 7.0.6f7
|IO!BHost!CTransport 7.0.6f7
|IOUSBMass!SClass 4.0.4
usb.networking 5.0.0
usb.!UHostCompositeDevice 1.2
usb.!UHub 1.2
|IOAudio!F 300.2
@vecLib.kext 1.2.0
|IOSerial!F 11
|IOSurface 269.11
@filesystems.hfs.encodings.kext 1
!AHS!BDriver 3430.1
IO!BHIDDriver 7.0.6f7
|IO!B!F 7.0.6f7
|IO!BPacketLogger 7.0.6f7
!AMultitouchDriver 3440.1
!AInputDeviceSupport 3440.8
!AHIDKeyboard 209
!AHSSPIHIDDriver 59
|IONVMe!F 2.1.0
!AThunderboltDPInAdapter 6.2.6
!AThunderboltDPAdapter!F 6.2.6
!AThunderboltPCIDownAdapter 2.5.4
!AThunderboltNHI 5.8.6
|IOThunderbolt!F 7.6.1
!AHSSPISupport 59
!A!ILpssSpi!C 3.0.60
usb.!UXHCIPCI 1.2
usb.!UXHCI 1.2
!A!ILpssGspi 3.0.60
!A!ILpssDmac 3.0.60
usb.!UHostPacketFilter 1.0
|IOUSB!F 900.4.2
!AEFINVRAM 2.1
!AEFIRuntime 2.1
|IOSMBus!F 1.1
|IOHID!F 2.0.0
$quarantine 4
$sandbox 300.0
@kext.!AMatch 1.0.0d1
DiskImages 493.0.0
!AFDEKeyStore 28.30
!AEffaceable!S 1.0
!ASSE 1.0
!AKeyStore 2
!UTDM 489.120.1
|IOSCSIBlockCommandsDevice 422.120.3
!ACredentialManager 1.0
KernelRelayHost 1
!ASEPManager 1.0.1
IOSlaveProcessor 1
|IOTimeSync!F 840.3
|IONetworking!F 3.4
|IOUSBMass!SDriver 157.140.1
|IOSCSIArchitectureModel!F 422.120.3
|IO!S!F 2.1
|IOUSBHost!F 1.2
!UHostMergeProperties 1.2
usb.!UCommon 1.0
!ABusPower!C 1.0
|CoreAnalytics!F 1
!AMobileFileIntegrity 1.0.5
@kext.CoreTrust 1
|IOReport!F 47
!AACPIPlatform 6.1
!ASMC 3.1.9
watchdog 1
|IOPCI!F 2.9
|IOACPI!F 1.4
@kec.pthread 1
@kec.Libm 1
@kec.corecrypto 1.0

[Malumen]

@deftdawg @shilch @hostelo @travis-joe having same issues and similar kernel panic reports:

panic(cpu 0 caller ...): nvme: "Fatal error occurred. ..."@/AppleInternal/BuildRoot/Library/Caches/com.apple.xbs/Sources/IONVMeFamily/IONVMeFamily-...

#22 (comment)
above linked comment mentions just giving up and moving back to using HFS+ file format and reinstalling Mojave.

My personal experience is: SSD read/write speeds are half or less what is expected; system works fine and then when the SSD temperature rises due to load (IO burst, benchmark software, etc.) the performance and responsiveness declines; further testing/benchmarking shows the SSD read/write speeds drop to the single digits. If I reboot or shutdown, on next boot it will load with Kernel Panic report and remain sluggish/poor performance. I must boot and perform an NVram reset to fix the problem.

[KrisCris]

Ah, my system just crashed when I was using it. It never happened before.

panic(cpu 1 caller 0xffffff7f8d77d231): nvme: "Fatal error occurred. CSTS=0x1 US[1]=0x0 US[0]=0x159 VID=0x1987 DID=0x5012
. FW Revision=ECFM22.4\n"@/AppleInternal/BuildRoot/Library/Caches/com.apple.xbs/Sources/IONVMeFamily/IONVMeFamily-470.100.17/IONVMeController.cpp:5320
Backtrace (CPU 1), Frame : Return Address
0xffffffa3e422b9e0 : 0xffffff8009b1868d 
0xffffffa3e422ba30 : 0xffffff8009c52ab5 
0xffffffa3e422ba70 : 0xffffff8009c4463e 
0xffffffa3e422bac0 : 0xffffff8009abea40 
0xffffffa3e422bae0 : 0xffffff8009b17d57 
0xffffffa3e422bbe0 : 0xffffff8009b18147 
0xffffffa3e422bc30 : 0xffffff800a2bf2bc 
0xffffffa3e422bca0 : 0xffffff7f8d77d231 
0xffffffa3e422bcc0 : 0xffffff7f8d768362 
0xffffffa3e422be20 : 0xffffff800a22fb29 
0xffffffa3e422be90 : 0xffffff800a22fa49 
0xffffffa3e422bec0 : 0xffffff8009b5a645 
0xffffffa3e422bf40 : 0xffffff8009b5a171 
0xffffffa3e422bfa0 : 0xffffff8009abe13e 
      Kernel Extensions in backtrace:
         com.apple.iokit.IONVMeFamily(2.1)[2D554F70-092B-3B6B-B2AD-5C09EDB5B4F8]@0xffffff7f8d75a000->0xffffff7f8d79cfff
            dependency: com.apple.driver.AppleMobileFileIntegrity(1.0.5)[4159DFFE-7746-3327-9752-C161DC295828]@0xffffff7f8ad27000
            dependency: com.apple.iokit.IOPCIFamily(2.9)[2F37AE58-E6B9-3B18-9092-3B80D34C334B]@0xffffff7f8a531000
            dependency: com.apple.driver.AppleEFINVRAM(2.1)[10E46031-889C-3FB7-8B4B-0DECAB5AE325]@0xffffff7f8afab000
            dependency: com.apple.iokit.IOStorageFamily(2.1)[CB3CB8CA-881A-37F3-A96B-8063CAF0476D]@0xffffff7f8a820000
            dependency: com.apple.iokit.IOReportFamily(47)[72B53B80-5713-30C1-BAD8-9D55FD718DA2]@0xffffff7f8a970000

BSD process name corresponding to current thread: kernel_task
Boot args: alcid=11 -disablegfxfirmware shikigva=32 shiki-id=Mac-BE088AF8C5EB4FA2 -radcodec igfxmetal=1

Mac OS version:
19H15

Kernel version:
Darwin Kernel Version 19.6.0: Thu Oct 29 22:56:45 PDT 2020; root:xnu-6153.141.2.2~1/RELEASE_X86_64
Kernel UUID: 9B5A7191-5B84-3990-8710-D9BD9273A8E5
Kernel slide:     0x0000000009800000
Kernel text base: 0xffffff8009a00000
__HIB  text base: 0xffffff8009900000
System model name: Macmini8,1 (Mac-7BA5B2DFE22DDD8C)
System shutdown begun: NO
Panic diags file available: YES (0x0)

System uptime in nanoseconds: 695377707221178

Is this a related issue that could be fixed by enabling NvmeFix?

[osy]

This issue seems to be in OSX. People running this ssd in an adapter on real Mac hit the same issue. Waiting for Apple to fix.

[grosschmid]

Same here, coming back from sleep, or even today suddenly white typing.

Thu Sep 5 14:21:33 2019

*** Panic Report ***
panic(cpu 0 caller 0xffffff7f8dc05b30): nvme: "Fatal error occurred. CSTS=0xffffffff US[1]=0x0 US[0]=0xd VID/DID=0x2263126f
. FW Revision=R1115A0\n"@/BuildRoot/Library/Caches/com.apple.xbs/Sources/IONVMeFamily/IONVMeFamily-387.270.1/IONVMeController.cpp:5334
Backtrace (CPU 0), Frame : Return Address
0xffffff81e94b3a10 : 0xffffff800bdae6ed
0xffffff81e94b3a60 : 0xffffff800beea185
0xffffff81e94b3aa0 : 0xffffff800bedb8ba
0xffffff81e94b3b10 : 0xffffff800bd5bb40
0xffffff81e94b3b30 : 0xffffff800bdae107
0xffffff81e94b3c50 : 0xffffff800bdadf53
0xffffff81e94b3cc0 : 0xffffff7f8dc05b30
0xffffff81e94b3e20 : 0xffffff800c45f387
0xffffff81e94b3e90 : 0xffffff800c45f2a9
0xffffff81e94b3ec0 : 0xffffff800bded885
0xffffff81e94b3f40 : 0xffffff800bded425
0xffffff81e94b3fa0 : 0xffffff800bd5b0ce
Kernel Extensions in backtrace:
com.apple.iokit.IONVMeFamily(2.1)[A67B3600-6FE3-3037-AC41-8C2D353B6250]@0xffffff7f8dbf8000->0xffffff7f8dc37fff
dependency: com.apple.driver.AppleMobileFileIntegrity(1.0.5)[1D716047-7F62-3FFA-8C01-26C166B3739A]@0xffffff7f8cb2a000
dependency: com.apple.iokit.IOPCIFamily(2.9)[BFDEB8D4-50FE-3DDB-87B7-F6A504393830]@0xffffff7f8c695000
dependency: com.apple.driver.AppleEFINVRAM(2.1)[B83F29B8-24AC-303B-BBBA-CF332168FDE6]@0xffffff7f8cd00000
dependency: com.apple.iokit.IOStorageFamily(2.1)[71BB22B0-3075-35A1-B04E-FBAC574DA80D]@0xffffff7f8c98f000
dependency: com.apple.iokit.IOReportFamily(47)[0BC9F93B-456A-3D97-BE4C-69DCBB5E8A3C]@0xffffff7f8d104000

BSD process name corresponding to current thread: kernel_task

Mac OS version:
18G95

Kernel version:
Darwin Kernel Version 18.7.0: Tue Aug 20 16:57:14 PDT 2019; root:xnu-4903.271.2~2/RELEASE_X86_64
Kernel UUID: C41337A1-0EC3-3896-A954-A1F85E849D53
Kernel slide: 0x000000000ba00000
Kernel text base: 0xffffff800bc00000
__HIB text base: 0xffffff800bb00000
System model name: MacBookPro11,4 (Mac-06F11FD93F0323C5)

[osy]

What model of SSD?

[ReddestDream]

This might also be caused by PowerNap. There are reports of panics when using non-Apple NVMe with PowerNap, especially on Catalina betas.

In addition, the panic might also be more likely on Samsung NVMe drives. This might also be connected to heat since some Samsung NVMe drives can get "stuck" in a failed TRIM cycle for minutes at a time during boot up.

[osy]

It might be connected to dark wake but it can’t be “caused” by dark wake because all it does is trigger wake ups on a timer. Btw I’m assuming you’re referring to dark wake because the “power nap” feature requires special Apple hw support and doesn’t work on any hackintosh. But dark wake is just “power nap” without the power saving features brought by Apple hw.

[ReddestDream]

Btw I’m assuming you’re referring to dark wake because the “power nap” feature requires special Apple hw support and doesn’t work on any hackintosh. But dark wake is just “power nap” without the power saving features brought by Apple hw.

I'm not convinced that there is /no/ attempt by macOS to use power savings features on non-Apple hardware (for better or for worse) when PowerNap is enabled. I've read reports of fans behaving differently or not spinning (similar to what real Mac do) on particular hackintoshes during PowerNap dark wakes. But yes, I was referring to dark wake when I said "power nap" above. I apologize for my lack of clarity.

[Jase-NZ]

Just following up on this and after putting better cooling on my nvme's some time ago have not had a single issue since. In fact I have put even more cooling in and on full load to the drives the temps hardly move.

[osy]

That’s great to hear! I’ve read that Samsung drives do run pretty hot on Hackintoshes so it’s great you were able to fix it.

[grosschmid]

What model of SSD?

I bought a HatSSD, clean installed Mojave on it, crashes happen randomly even while using the machine, suddenly kernel panic.

[ivanhtp]

I had the same issue for over two years running the system with a 960EVO samsung ssd.
The issue could be started in mac OS but over time the crashes got more frequent at a point I could not boot into system and even install windows anymore. It crashed in windows, so one of these can be true (at least in my experience):

• Mac OS crashes lowers the ssd or motherboard nvme socket life expectancy over time (short circuit on each panic?) Anyone experienced that? Are the KP more frequent? Someone lost the ssd?
• The problem is on 960 evo (Samsung recognized the problem on last firmware with no feedback until this moment.
• The problem is on the mobtherboard? (some users above reported the problem on non-samsung nvme drives.

My bet is that the kernel panic comes from a wrong parameter in mac os that messes up the drive (or the motherboard socked) frying these components over time. The reason I believe that is:

1. This https://patchwork.kernel.org/patch/10542393/ (as pointed by @07151129 in this thread
2. My system running smoothly after restoring the backup on a Sandisk sata ssd.
3. Never reading reports from users having problems using 960 evo regularly on windows.
4. My drive breaking to a point it crashed on windows an it was not usable anymore (after using it for 2 years on mac)

Next month I'll buy another nvme ssd (I don't know if I try another model from samsung - 970?; or from another brand to test it). With it, I'll know if my Motherboard socket is dead (in case it still crashes with the new drive), or if the old drive was the problem (in the case it works fine).

[07151129]

I don't think the bug from Linux is relevant after all: I looked at IONVMeFamily, and haven't found any usage of FLR. Rather, PCI power states are used to reset the controller.

[osy]

Thank you for fixing Apple's bugs!

[ericmschwanke]

Excuse me for being completely not versed when it comes to Github... How on earth does one use the acidanthera/NVMeFix . I have a late 2015 iMac with a Fledging m13 turbo drive and replaced the normal 3.5 drive with a firecuda. I have reversed operating systems, clean installed, the fusion drive is set up properly. This is the only "fix" I am seeing to the random restart problem and lost and don't know how to use it.

More to the question. I have Xcode and have Cloned the code and opened it. How exactly do I put this in the /library/extensions like it says for install.

[osy]

@ericmschwanke try https://github.com/osy86/HaC-Mini/suites/646220359/artifacts/5470857 I've added an installer option

[dont-see-big-shark]

acidanthera/NVMeFix@66c9de5 should fix this kind of panics.

unfortunately, i load nvmeFix and lilu, load success, but nothing helps, ssd is 970evo

[osy]

That’s unfortunate but the issue is outside the scope of this project as it is a third party part that other hackintoshes experience the same problem with.

[ammarmallik]

I am still getting this issue. After every few hours, my Macbook shuts down after giving this error.

panic(cpu 0 caller 0xffffff7f973c6231): nvme: "Fatal error occurred. CSTS=0xffffffff US[1]=0x0 US[0]=0x20 VID=0x2646 DID=0x5008
. FW Revision=E8FK11.R\n"@/AppleInternal/BuildRoot/Library/Caches/com.apple.xbs/Sources/IONVMeFamily/IONVMeFamily-470.100.17/IONVMeController.cpp:5320

Please fix this.

[shilch]

Just wanted to chime in and say the installer option for NVMe fixup helped me out after I experienced overnight crashes with my Evo 970 & AData NVMe drives (the later used as a raw disk for Virtualbox)... Thank to everyone on this thread for getting that fixed. 👍

@deftdawg Did you also experience some random freezes before installing the fix? I'm asking because I get some freezes every now and then, and I got the Evo 970 as well.
Edit: I should note that I have a Xiaomi notebook, not an Intel NUC.

[madasar]

Hi folks, just to add, I have been experiencing the same issue as OP, documented here:

https://forums.macrumors.com/threads/upgrading-2013-2014-macbook-pro-ssd-to-m-2-nvme.2034976/page-339?post=29631464#post-29631464

The important point for me is "IONVMeController.cpp:5334" is in common with the OP. Some other panics in this bug refer to a different line in IONVMeController. For me it is always line 5334 in IONVMeController. I use to get this issue more often on old boot roms especially 188.0.0.0.0 but with newer roms it only happens every so often (every 1-3 weeks).

I know this is may be out of scope for this project but many people with macs and after market SSDs have this issue (google "IONVMeController.cpp:5334"). I have collected my kernel panic logs here (2019-2021):

https://pastebin.com/CxCEmg68
https://pastebin.com/kZ6NyzKk
https://pastebin.com/6HqWh3qK
https://pastebin.com/PEa5UXsr
https://pastebin.com/m8caez39
https://pastebin.com/8SKqt05v
https://pastebin.com/jLKdHVZi
https://pastebin.com/MUAcUiZx
https://pastebin.com/d0vXrZ52
https://pastebin.com/3RVrWC85
https://controlc.com/c3b0a59a
https://controlc.com/4f073e91
https://controlc.com/4afc7a4f
https://controlc.com/1a8ed304

We've had a panic on PM981 where we observed the following:

I/O Read command (qid=1, opcode=2) timed out. We then got panic log leading to RequestAsyncEvents call. Now, I'm not sure if the panic is due to the I/O command out, or due to the RequestAsyncEvents ...

acidanthera/NVMeFix@66c9de5 should fix this kind of panics.

@07151129 was the kernel panic for this fix triggered on line 5334 of IONVMeController.cpp? What is happening around 5334 in IONVMeController.cpp?

[xyx208]

Ah, my system just crashed when I was using it. It never happened before.

panic(cpu 1 caller 0xffffff7f8d77d231): nvme: "Fatal error occurred. CSTS=0x1 US[1]=0x0 US[0]=0x159 VID=0x1987 DID=0x5012
. FW Revision=ECFM22.4\n"@/AppleInternal/BuildRoot/Library/Caches/com.apple.xbs/Sources/IONVMeFamily/IONVMeFamily-470.100.17/IONVMeController.cpp:5320
Backtrace (CPU 1), Frame : Return Address
0xffffffa3e422b9e0 : 0xffffff8009b1868d 
0xffffffa3e422ba30 : 0xffffff8009c52ab5 
0xffffffa3e422ba70 : 0xffffff8009c4463e 
0xffffffa3e422bac0 : 0xffffff8009abea40 
0xffffffa3e422bae0 : 0xffffff8009b17d57 
0xffffffa3e422bbe0 : 0xffffff8009b18147 
0xffffffa3e422bc30 : 0xffffff800a2bf2bc 
0xffffffa3e422bca0 : 0xffffff7f8d77d231 
0xffffffa3e422bcc0 : 0xffffff7f8d768362 
0xffffffa3e422be20 : 0xffffff800a22fb29 
0xffffffa3e422be90 : 0xffffff800a22fa49 
0xffffffa3e422bec0 : 0xffffff8009b5a645 
0xffffffa3e422bf40 : 0xffffff8009b5a171 
0xffffffa3e422bfa0 : 0xffffff8009abe13e 
      Kernel Extensions in backtrace:
         com.apple.iokit.IONVMeFamily(2.1)[2D554F70-092B-3B6B-B2AD-5C09EDB5B4F8]@0xffffff7f8d75a000->0xffffff7f8d79cfff
            dependency: com.apple.driver.AppleMobileFileIntegrity(1.0.5)[4159DFFE-7746-3327-9752-C161DC295828]@0xffffff7f8ad27000
            dependency: com.apple.iokit.IOPCIFamily(2.9)[2F37AE58-E6B9-3B18-9092-3B80D34C334B]@0xffffff7f8a531000
            dependency: com.apple.driver.AppleEFINVRAM(2.1)[10E46031-889C-3FB7-8B4B-0DECAB5AE325]@0xffffff7f8afab000
            dependency: com.apple.iokit.IOStorageFamily(2.1)[CB3CB8CA-881A-37F3-A96B-8063CAF0476D]@0xffffff7f8a820000
            dependency: com.apple.iokit.IOReportFamily(47)[72B53B80-5713-30C1-BAD8-9D55FD718DA2]@0xffffff7f8a970000

BSD process name corresponding to current thread: kernel_task
Boot args: alcid=11 -disablegfxfirmware shikigva=32 shiki-id=Mac-BE088AF8C5EB4FA2 -radcodec igfxmetal=1

Mac OS version:
19H15

Kernel version:
Darwin Kernel Version 19.6.0: Thu Oct 29 22:56:45 PDT 2020; root:xnu-6153.141.2.2~1/RELEASE_X86_64
Kernel UUID: 9B5A7191-5B84-3990-8710-D9BD9273A8E5
Kernel slide:     0x0000000009800000
Kernel text base: 0xffffff8009a00000
__HIB  text base: 0xffffff8009900000
System model name: Macmini8,1 (Mac-7BA5B2DFE22DDD8C)
System shutdown begun: NO
Panic diags file available: YES (0x0)

System uptime in nanoseconds: 695377707221178

Is this a related issue that could be fixed by enabling NvmeFix?

me too ！
log:

panic(cpu 0 caller 0xffffff8014186d06): nvme: "Fatal error occurred. CSTS=0x1 US[1]=0x0 US[0]=0x97 VID=0x15b7 DID=0x5002
. FW Revision=102000WD\n"@/AppleInternal/BuildRoot/Library/Caches/com.apple.xbs/Sources/IONVMeFamily/IONVMeFamily-557.60.1/Common/IONVMeController.cpp:5472
Backtrace (CPU 0), Frame : Return Address
0xffffffa0b0e5b960 : 0xffffff8011abab4d
0xffffffa0b0e5b9b0 : 0xffffff8011bfd7e3
0xffffffa0b0e5b9f0 : 0xffffff8011bede1a
0xffffffa0b0e5ba40 : 0xffffff8011a5fa2f
0xffffffa0b0e5ba60 : 0xffffff8011aba3ed
0xffffffa0b0e5bb80 : 0xffffff8011aba6d8
0xffffffa0b0e5bbf0 : 0xffffff80122bef9a
0xffffffa0b0e5bc60 : 0xffffff8014186d06
0xffffffa0b0e5bc80 : 0xffffff801416b427
0xffffffa0b0e5bde0 : 0xffffff801221d385
0xffffffa0b0e5be50 : 0xffffff801221d286
0xffffffa0b0e5be80 : 0xffffff8011aff725
0xffffffa0b0e5bef0 : 0xffffff8011b00634
0xffffffa0b0e5bfa0 : 0xffffff8011a5f13e
Kernel Extensions in backtrace:
com.apple.iokit.IONVMeFamily(2.1)[D5DFC80E-EF7A-3660-BE57-473E67626B44]@0xffffff8014164000->0xffffff801418dfff
dependency: com.apple.driver.AppleEFINVRAM(2.1)[D6C13E44-3657-3F40-99E4-355DAA82202E]@0xffffff8012e5a000->0xffffff8012e63fff
dependency: com.apple.driver.AppleMobileFileIntegrity(1.0.5)[2A454117-CDAA-301F-B609-BA396742C91A]@0xffffff8013001000->0xffffff8013015fff
dependency: com.apple.iokit.IOPCIFamily(2.9)[BF2C5E86-1E8F-3FD4-9874-7738178FA73B]@0xffffff801441f000->0xffffff8014446fff
dependency: com.apple.iokit.IOReportFamily(47)[D3C4FAA4-8F06-3C5C-AB36-4BE632CCE051]@0xffffff8014455000->0xffffff8014457fff
dependency: com.apple.iokit.IOStorageFamily(2.1)[B5300908-BF34-3D47-8776-FB154A6DEE4C]@0xffffff801453f000->0xffffff8014550fff

Process name corresponding to current thread: kernel_task
Boot args: darkwake=1 -v

Mac OS version:
20D91

Kernel version:
Darwin Kernel Version 20.3.0: Thu Jan 21 00:07:06 PST 2021; root:xnu-7195.81.3~1/RELEASE_X86_64
Kernel UUID: C86236B2-4976-3542-80CA-74A6B8B4BA03
KernelCache slide: 0x0000000011800000
KernelCache base: 0xffffff8011a00000
Kernel slide: 0x0000000011810000
Kernel text base: 0xffffff8011a10000
__HIB text base: 0xffffff8011900000
System model name: MacBookPro13,3 (Mac-A5C67F76ED83108C)
System shutdown begun: NO
Panic diags file available: YES (0x0)
Hibernation exit count: 0

System uptime in nanoseconds: 7095782912640
Last Sleep: absolute base_tsc base_nano
Uptime : 0x000006741d9ebf59
Sleep : 0x0000002da07cf0d0 0x00000001203d9852 0x00000022066a83e9
Wake : 0x0000002dc790c734 0x000000012382e1a0 0x0000002da115b739
last started kext at 568908658819: com.parallels.kext.usbconnect 16.1.2 49151 (addr 0xffffff7fb3b5a000, size 20480)
loaded kexts:
com.parallels.kext.usbconnect 16.1.2 49151
com.parallels.kext.netbridge 16.1.2 49151
com.parallels.kext.vnic 16.1.2 49151
com.parallels.kext.hypervisor 16.1.2 49151
com.netease.nemu.kext.NemuDrv 15.2.99
as.acidanthera.BrcmPatchRAM3 2.5.5
me.kishorprins.VoodooInput 1.1.1
com.alexandred.VoodooI2CHID 1
as.acidanthera.voodoo.driver.PS2Keyboard 2.2.2
org.rehabman.driver.FakePCIID 1.3.15
com.sinet3k.Sinetek-rtsx 9.0.0
com.alexandred.VoodooI2C 2.6.5
org.coolstar.VoodooGPIO 1.1
as.acidanthera.voodoo.driver.PS2!C 2.2.2
as.vit9696.SMCProcessor 1.2.2
as.vit9696.WhateverGreen 1.4.9
com.XPS.VerbStub 1.0.3
as.lvs1974.SMCDellSensors 1.2.2
ru.usrsse2.SMCBatteryManager 1.2.2
as.vit9696.VirtualSMC 1.2.2
org.acidanthera.NVMeFix 1.0.6
as.acidanthera.BrightnessKeys 1.0.1
as.acidanthera.BrcmFirmwareStore 2.5.5
as.lvs1974.AirportBrcmFixup 2.1.2
com.alexandred.VoodooI2CServices 1
as.vit9696.!AALC 1.5.9
org.vanilla.driver.CPUFriend 1.2.3
as.vit9696.Lilu 1.5.2
@filesystems.smbfs 3.4.1

AudioAUUC 1.70
AGPM 119
!APlatformEnabler 2.7.0d0
X86PlatformShim 1.0.0
@fileUtil 20.036.15
@filesystems.autofs 3.0
@filesystems.ntfs 3.14.3
!AHDAHardwareConfigDriver 283.15
!AHDA 283.15
!AGraphicsDevicePolicy 6.2.2
@AGDCPluginDisplayMetrics 6.2.2
pmtelemetry 1
LuaHardwareAccess 1.0.16
|IOUserEthernet 1.0.1
!AUpstreamUserClient 3.6.8
usb.!UUserHCI 1
|IO!BSerialManager 8.0.3d9
@Dont_Steal_Mac_OS_X 7.0.0
!AHV 1
!ADiskImages2 1
AGDCBacklightControl 6.2.2
!A!ISlowAdaptiveClocking 4.0.0
!A!ISKLGraphics 16.0.1
!A!IPCHPMC 2.0.1
!AFIVRDriver 4.1.0
!ABacklight 180.3
!AMCCSControl 1.14
!A!ISKLGraphicsFramebuffer 16.0.1
ACPI_SMC_PlatformPlugin 1.0.0
!AFileSystemDriver 3.0.1
@filesystems.tmpfs 1
@filesystems.hfs.kext 556.60.1
@BootCache 40
@!AFSCompression.!AFSCompressionTypeZlib 1.0.0
@!AFSCompression.!AFSCompressionTypeDataless 1.0.0d1
!ASmartBatteryManager 161.0.0
!ATopCaseHIDEventDriver 4030.5
@filesystems.apfs 1677.81.1
@private.KextAudit 1.0
AirPort.BrcmNIC 1400.1.1
!AAHCIPort 346
!AACPIEC 6.1
!ARTC 2.0
!AACPIButtons 6.1
!AHPET 1.8
!ASMBIOS 2.1
!AAPIC 1.7
@!ASystemPolicy 2.0.0
@nke.applicationfirewall 310
|IOKitRegistryCompatibility 1
|EndpointSecurity 1
usb.cdc.acm 5.0.0
usb.serial 6.0.0
!UAudio 401.4
@kext.triggers 1.0
DspFuncLib 283.15
@kext.OSvKernDSPLib 529
!AGraphicsControl 6.2.2
|IOSerial!F 11
|IOAVB!F 930.1
@!AGPUWrangler 6.2.2
!ASMBusPCI 1.0.14d1
|IOSlowAdaptiveClocking!F 1.0.0
!ABacklightExpert 1.1.0
|IONDRVSupport 585
@plugin.IOgPTPPlugin 900.11
|IOEthernetAVB!C 1.1.0
!AHDA!C 283.15
|IOHDA!F 283.15
|IOAudio!F 300.6.1
@vecLib.kext 1.2.0
!ASMBus!C 1.0.18d1
|IOAccelerator!F2 439.52
@!AGraphicsDeviceControl 6.2.2
|IOGraphics!F 585
IOPlatformPluginLegacy 1.0.0
X86PlatformPlugin 1.0.0
IOPlatformPlugin!F 6.0.0d8
usb.cdc.ecm 5.0.0
usb.cdc.ncm 5.0.0
usb.IOUSBHostHIDDevice 1.2
|Broadcom!BHost!CUSBTransport 8.0.3d9
|IO!BHost!CUSBTransport 8.0.3d9
|IO!BHost!CTransport 8.0.3d9
usb.cdc 5.0.0
usb.networking 5.0.0
usb.!UHostCompositeDevice 1.2
!UMergeNub 900.4.2
!ABSDKextStarter 3
|IOSurface 289.3
@filesystems.hfs.encodings.kext 1
usb.!UHostPacketFilter 1.0
|IOUSB!F 900.4.2
!AActuatorDriver 4400.28
!AMultitouchDriver 4400.28
!AInputDeviceSupport 4400.35
!AHS!BDriver 4030.5
IO!BHIDDriver 8.0.3d9
!AXsanScheme 3
!A!ILpssI2C 3.0.60
|IONVMe!F 2.1.0
|IO80211!F 1200.12.2b1
|IOSkywalk!F 1
mDNSOffloadUserClient 1.0.1b8
corecapture 1.0.4
|IOAHCI!F 294
!A!ILpssGspi 3.0.60
usb.!UXHCIPCI 1.2
usb.!UXHCI 1.2
!AEFINVRAM 2.1
!AEFIRuntime 2.1
$!AImage4 3.0.0
|IOSMBus!F 1.1
|IOHID!F 2.0.0
|IOTimeSync!F 900.11
|IONetworking!F 3.4
DiskImages 493.0.0
|IO!B!F 8.0.3d9
|IOReport!F 47
|IO!BPacketLogger 8.0.3d9
$quarantine 4
$sandbox 300.0
@kext.!AMatch 1.0.0d1
|CoreAnalytics!F 1
!ASSE 1.0
!AKeyStore 2
!UTDM 511.60.2
|IOUSBMass!SDriver 184.40.6
|IOSCSIBlockCommandsDevice 436.40.6
|IO!S!F 2.1
|IOSCSIArchitectureModel!F 436.40.6
!AMobileFileIntegrity 1.0.5
@kext.CoreTrust 1
!AFDEKeyStore 28.30
!AEffaceable!S 1.0
!ACredentialManager 1.0
KernelRelayHost 1
|IOUSBHost!F 1.2
!UHostMergeProperties 1.2
usb.!UCommon 1.0
!ABusPower!C 1.0
!ASEPManager 1.0.1
IOSlaveProcessor 1
!AACPIPlatform 6.1
!ASMC 3.1.9
|IOPCI!F 2.9
|IOACPI!F 1.4
watchdog 1
@kec.pthread 1
@kec.corecrypto 11.1
@kec.Libm 1

[kamilbaranskicom]

I've just had this error 3 times on Apple Macbook Pro 2015 since yesterday. "panic (...) IONVMeControler.cpp:5320". I'm on Catalina and my disk is PNY CS3030 2TB. The disk temperature is about 36 Celsius and worked OK for few years (Power On Hours: 4112).

full kernel panic log:

panic(cpu` 0 caller 0xffffff7f99a08231): nvme: "Fatal error occurred. CSTS=0xffffffff US[1]=0x0 US[0]=0x48 VID=0x1987 DID=0x5012
. FW Revision=CS303224\n"@/AppleInternal/BuildRoot/Library/Caches/com.apple.xbs/Sources/IONVMeFamily/IONVMeFamily-470.100.17/IONVMeController.cpp:5320
Backtrace (CPU 0), Frame : Return Address
0xffffff9206b9b9e0 : 0xffffff8015b1b54d
0xffffff9206b9ba30 : 0xffffff8015c55d85
0xffffff9206b9ba70 : 0xffffff8015c4790e
0xffffff9206b9bac0 : 0xffffff8015ac1a40
0xffffff9206b9bae0 : 0xffffff8015b1ac17
0xffffff9206b9bbe0 : 0xffffff8015b1b007
0xffffff9206b9bc30 : 0xffffff80162c03bc
0xffffff9206b9bca0 : 0xffffff7f99a08231
0xffffff9206b9bcc0 : 0xffffff7f999f3362
0xffffff9206b9be20 : 0xffffff8016230c29
0xffffff9206b9be90 : 0xffffff8016230b49
0xffffff9206b9bec0 : 0xffffff8015b5d525
0xffffff9206b9bf40 : 0xffffff8015b5d051
0xffffff9206b9bfa0 : 0xffffff8015ac113e
Kernel Extensions in backtrace:
com.apple.iokit.IONVMeFamily(2.1)[D5E8159E-00F3-3737-AC4A-DFF9D4702B11]@0xffffff7f999e5000->0xffffff7f99a27fff
dependency: com.apple.driver.AppleMobileFileIntegrity(1.0.5)[925D3FBB-53C6-389B-A294-D24A1B42BB01]@0xffffff7f970f6000
dependency: com.apple.iokit.IOPCIFamily(2.9)[26F2BEB0-18DA-3B16-82FE-86A7E6EA9677]@0xffffff7f96531000
dependency: com.apple.driver.AppleEFINVRAM(2.1)[6B915F24-62B4-3956-ACF7-394277780D1B]@0xffffff7f9721b000
dependency: com.apple.iokit.IOStorageFamily(2.1)[77F6B260-53DF-3DC0-B89F-5205E17FF986]@0xffffff7f96aa8000
dependency: com.apple.iokit.IOReportFamily(47)[2582E4D4-95E3-35F6-9E36-3D3503E7D000]@0xffffff7f96e35000

BSD process name corresponding to current thread: kernel_task

Mac OS version:
19H2026

Kernel version:
Darwin Kernel Version 19.6.0: Tue Jun 21 21:18:39 PDT 2022; root:xnu-6153.141.66~1/RELEASE_X86_64
Kernel UUID: D5630E55-7695-313B-B468-6347805B0B6F
Kernel slide: 0x0000000015800000
Kernel text base: 0xffffff8015a00000
__HIB text base: 0xffffff8015900000
System model name: MacBookPro11,5 (Mac-06F11F11946D27C5)
System shutdown begun: NO
Panic diags file available: YES (0x0)

System uptime in nanoseconds: 36540178058288
last loaded kext at 3428686248582: @filesystems.afpfs 11.2 (addr 0xffffff7f9a8ee000, size 364544)
loaded kexts:
com.audinate.dante.driver.DanteVirtualSoundcard 1.0.0
org.virtualbox.kext.VBoxNetAdp 6.1.4
org.virtualbox.kext.VBoxNetFlt 6.1.4
org.virtualbox.kext.VBoxUSB 6.1.4
org.virtualbox.kext.VBoxDrv 6.1.4
com.uaudio.driver.UAFWAudio 4.3.1 47542
com.merging.audio.MergingRAVENNAAudioDriver 1
tc.tctechnologies.driver.Saffire 4.3.0 41017
com.waves.driver.soundgrid 14.9.56
com.uaudio.driver.UAD2System 9.11.0
com.intel.driver.EnergyDriver 3.6.0
@filesystems.afpfs 11.2
@nke.asp-tcp 8.1
@filesystems.smbfs 3.4.5
@kext.AMDFramebuffer 3.1.0
@kext.AMDRadeonServiceManager 3.1.0
@kext.AMDRadeonX4000 3.1.0

!AGraphicsDevicePolicy 5.2.7
@AGDCPluginDisplayMetrics 5.2.7
@fileUtil 20.036.15
AudioAUUC 1.70
@filesystems.autofs 3.0
!AUpstreamUserClient 3.6.8
!APlatformEnabler 2.7.0d0
AGPM 111.4.4
X86PlatformShim 1.0.0
!AHDAHardwareConfigDriver 283.15
!AHDA 283.15
!AHV 1
|IOUserEthernet 1.0.1
!A!IHD5000Graphics 14.0.7
|IO!BSerialManager 7.0.6f8
pmtelemetry 1
@Dont_Steal_Mac_OS_X 7.0.0
AGDCBacklightControl 5.2.7
eficheck 1
!ALPC 3.1
!AMuxControl 5.2.7
ACPI_SMC_PlatformPlugin 1.0.0
!ABacklight 180.3
!A!IFramebufferAzul 14.0.7
@kext.AMD7000!C 3.1.0
!AFIVRDriver 4.1.0
!AMCCSControl 1.14
|Broadcom!B20703USBTransport 7.0.6f8
!ACameraInterface 7.6.0
!A!ISlowAdaptiveClocking 4.0.0
!ASMCLMU 212
!AThunderboltIP 3.1.4
|SCSITaskUserClient 422.120.3
!ATopCaseHIDEventDriver 3430.1
!UTopCaseDriver 3430.1
!U!SCoexistentDriver 489.120.1
!UCardReader 489.120.1
|IO!BUSBDFU 7.0.6f8
@filesystems.apfs 1412.141.3
AirPort.BrcmNIC 1400.1.1
!AFileSystemDriver 3.0.1
!AVirtIO 1.0
@filesystems.hfs.kext 522.100.6
@!AFSCompression.!AFSCompressionTypeDataless 1.0.0d1
@BootCache 40
@!AFSCompression.!AFSCompressionTypeZlib 1.0.0
@private.KextAudit 1.0
!ASmartBatteryManager 161.0.0
!AACPIButtons 6.1
!AHPET 1.8
!ARTC 2.0
!ASMBIOS 2.1
!AACPIEC 6.1
!AAPIC 1.7
$!AImage4 1
@nke.applicationfirewall 303
$TMSafetyNet 8
@!ASystemPolicy 2.0.0
|EndpointSecurity 1
$SecureRemotePassword 1.0
@kext.AMDRadeonX4030HWLibs 1.0
@kext.AMDRadeonX4000HWServices 3.1.0
|IOUSBUserClient 900.4.2
@kext.triggers 1.0
DspFuncLib 283.15
@kext.OSvKernDSPLib 529
usb.cdc.acm 5.0.0
usb.serial 6.0.0
usb.cdc.ecm 5.0.0
usb.cdc.ncm 5.0.0
|IOFireWire!F 4.7.5
|IOAVB!F 850.1
@!AGPUWrangler 5.2.7
!AGraphicsControl 5.2.7
!AHDA!C 283.15
|IOHDA!F 283.15
IOPlatformPluginLegacy 1.0.0
X86PlatformPlugin 1.0.0
IOPlatformPlugin!F 6.0.0d8
!ABacklightExpert 1.1.0
|IONDRVSupport 576.2
|IOAccelerator!F2 438.7.4
@kext.AMDSupport 3.1.0
@!AGraphicsDeviceControl 5.2.7
!ASMBus!C 1.0.18d1
|Broadcom!BHost!CUSBTransport 7.0.6f8
|IO!BHost!CUSBTransport 7.0.6f8
|IO!BHost!CTransport 7.0.6f8
!ASMBusPCI 1.0.14d1
|IOSlowAdaptiveClocking!F 1.0.0
|IOGraphics!F 576.2
!AThunderboltEDMSink 4.2.3
!AThunderboltDPOutAdapter 6.2.6
@plugin.IOgPTPPlugin 840.3
|IOEthernetAVB!C 1.1.0
!AActuatorDriver 3440.1.1
!AHS!BDriver 3430.1
IO!BHIDDriver 7.0.6f8
|IO!B!F 7.0.6f8
|IO!BPacketLogger 7.0.6f8
!AMultitouchDriver 3440.1.1
!AInputDeviceSupport 3440.8
!AHIDKeyboard 209
|IOUSBMass!SClass 4.0.4
usb.IOUSBHostHIDDevice 1.2
!UAudio 323.4
usb.cdc 5.0.0
usb.networking 5.0.0
usb.!UHostCompositeDevice 1.2
!UMergeNub 900.4.2
!AXsanScheme 3
|IO80211!F 1200.12.2b1
mDNSOffloadUserClient 1.0.1b8
corecapture 1.0.4
|IOSkywalk!F 1
!A!ILpssGspi 3.0.60
|IONVMe!F 2.1.0
usb.!UXHCIPCI 1.2
usb.!UXHCI 1.2
|IOAudio!F 300.2
@vecLib.kext 1.2.0
|IOSerial!F 11
|IOSurface 269.11
@filesystems.hfs.encodings.kext 1
!AThunderboltDPInAdapter 6.2.6
!AThunderboltDPAdapter!F 6.2.6
!AThunderboltPCIDownAdapter 2.5.4
!AThunderboltNHI 5.8.6
|IOThunderbolt!F 7.6.1
usb.!UHostPacketFilter 1.0
|IOUSB!F 900.4.2
!AEFINVRAM 2.1
!AEFIRuntime 2.1
|IOSMBus!F 1.1
|IOHID!F 2.0.0
$quarantine 4
$sandbox 300.0
@kext.!AMatch 1.0.0d1
DiskImages 493.0.0
!AFDEKeyStore 28.30
!AEffaceable!S 1.0
!ASSE 1.0
!AKeyStore 2
!UTDM 489.120.1
|IOSCSIBlockCommandsDevice 422.120.3
!ACredentialManager 1.0
KernelRelayHost 1
!ASEPManager 1.0.1
IOSlaveProcessor 1
|IOUSBMass!SDriver 157.140.1
|IOSCSIArchitectureModel!F 422.120.3
|IO!S!F 2.1
|IOUSBHost!F 1.2
!UHostMergeProperties 1.2
usb.!UCommon 1.0
!ABusPower!C 1.0
|CoreAnalytics!F 1
!AMobileFileIntegrity 1.0.5
@kext.CoreTrust 1
|IOTimeSync!F 840.3
|IONetworking!F 3.4
|IOReport!F 47
!AACPIPlatform 6.1
!ASMC 3.1.9
watchdog 1
|IOPCI!F 2.9
|IOACPI!F 1.4
@kec.pthread 1
@kec.corecrypto 1.0
@kec.Libm 1