Discussion:
[Bug 211713] NVME controller failure: resetting (Samsung SM961 SSD
(too old to reply)
b***@freebsd.org
2018-04-07 11:17:10 UTC
Permalink
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=211713

***@zoho.com changed:

What |Removed |Added
----------------------------------------------------------------------------
CC| |***@zoho.com

--- Comment #59 from ***@zoho.com ---

```
nvme0: resetting controller
nvme0: controller ready did not become 0 within 30000 ms
nvme0: failing queued i/o
nvme0: READ sqid:1 cid:0 nsid: 1 lba:324015968 len:20
nvme0: ABORTED - BY REQUEST (00/07) sqid:1 cid:0 cdw0:0
```

I can observe the same on my host on resume, everything works except resuming.
Sometime it manages to reset the bloody controller after some time 5-30 sec -
then it works properly.
--
You are receiving this mail because:
You are the assignee for the bug.
b***@freebsd.org
2018-04-07 11:27:08 UTC
Permalink
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=211713

--- Comment #60 from ***@zoho.com ---
Here's actually from my system, it had woken up successfully this morning.

nvme0: Resetting controller due to a timeout.
nvme0: Resetting controller due to a timeout.
nvme0: resetting controller
nvme0: Resetting controller due to a timeout.
nvme0: aborting outstanding i/o
nvme0: WRITE sqid:1 cid:124 nsid:1 lba:302574390 len:72
nvme0: ABORTED - BY REQUEST (00/07) sqid:1 cid:124 cdw0:0
nvme0: aborting outstanding i/o
nvme0: WRITE sqid:1 cid:127 nsid:1 lba:308798193 len:8
nvme0: ABORTED - BY REQUEST (00/07) sqid:1 cid:127 cdw0:0
nvme0: aborting outstanding i/o
nvme0: READ sqid:1 cid:90 nsid:1 lba:146704418 len:5
nvme0: ABORTED - BY REQUEST (00/07) sqid:1 cid:90 cdw0:0
nvme0: aborting outstanding i/o
nvme0: READ sqid:2 cid:126 nsid:1 lba:436423099 len:54
nvme0: ABORTED - BY REQUEST (00/07) sqid:2 cid:126 cdw0:0
nvme0: aborting outstanding i/o
nvme0: READ sqid:3 cid:125 nsid:1 lba:785815849 len:14
nvme0: ABORTED - BY REQUEST (00/07) sqid:3 cid:125 cdw0:0
nvme0: aborting outstanding i/o
nvme0: READ sqid:3 cid:75 nsid:1 lba:859171570 len:2
nvme0: ABORTED - BY REQUEST (00/07) sqid:3 cid:75 cdw0:0
nvme0: aborting outstanding i/o
nvme0: WRITE sqid:4 cid:100 nsid:1 lba:306185450 len:2
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:100 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:79 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:79 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:119 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:119 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:118 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:118 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:95 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:95 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:117 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:117 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:101 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:101 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:109 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:109 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:75 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:75 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:107 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:107 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:123 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:123 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:110 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:110 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:93 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:93 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:115 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:115 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:98 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:98 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:72 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:72 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:65 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:65 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:111 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:111 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:108 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:108 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:74 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:74 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:92 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:92 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:87 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:87 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:96 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:96 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:94 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:94 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:77 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:77 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:104 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:104 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:113 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:113 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:66 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:66 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:120 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:120 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:67 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:67 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:71 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:71 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:88 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:88 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:106 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:106 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:116 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:116 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:121 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:121 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:126 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:126 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:84 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:84 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:70 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:70 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:76 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:76 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:99 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:99 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:124 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:124 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:69 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:69 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:91 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:91 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:81 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:81 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:103 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:103 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:114 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:114 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:89 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:89 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:127 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:127 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:85 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:85 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:125 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:125 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:73 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:73 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:83 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:83 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:68 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:68 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:86 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:86 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:82 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:82 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:102 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:102 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:78 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:78 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:122 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:122 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:90 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:90 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:112 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:112 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:105 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:105 cdw0:0
nvme0: aborting outstanding i/o
nvme0: DATASET MANAGEMENT sqid:4 cid:80 nsid:1
nvme0: ABORTED - BY REQUEST (00/07) sqid:4 cid:80 cdw0:0
--
You are receiving this mail because:
You are the assignee for the bug.
b***@freebsd.org
2018-04-29 15:14:05 UTC
Permalink
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=211713

Len White <***@nrw.ca> changed:

What |Removed |Added
----------------------------------------------------------------------------
CC| |***@nrw.ca

--- Comment #61 from Len White <***@nrw.ca> ---
I've recently hit the error nvme0: Missing interrupt on 10.3 and 12.0-current.
I discovered a workaround that may help lead to a proper fix, though I don't
know for certain if the Missing interrupt is related to resetting controller
message.

If I have nvme_load="YES" and nvd_load="YES" in /boot/loader.conf, I get
missing interrupt every time, the more the device gets used the more of the
messages show up. Each time that message is shown it seems the read/write
operation fails as the end result is corruption (AND oddly half the time my
intel ix card doesn't work properly when this happens it will spit out ix0:
TX(0) desc avail = 34, pidx = 87, link status stays no carrier)

If I load nvme/nvd AFTER the system finishes booting, it behaves normally and
doesn't affect ix.

So it seems loading nvme/nvd early in the boot process causes some kind of
interrupt conflict with other driver(s).
--
You are receiving this mail because:
You are the assignee for the bug.
b***@freebsd.org
2018-06-19 06:02:31 UTC
Permalink
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=211713

Ali Abdallah <***@gmail.com> changed:

What |Removed |Added
----------------------------------------------------------------------------
CC| |***@gmail.com

--- Comment #62 from Ali Abdallah <***@gmail.com> ---
Same problem on FreeBSD 11.2-RC3 on a Thinkpad T480. After resuming from
suspend the system is not usable for 10-30 seconds, showing the following
messages

nvme0: Resetting controller due to a timeout.
nvme0: Resetting controller due to a timeout.
nvme0: resetting controller
nvme0: Resetting controller due to a timeout.
nvme0: aborting outstanding i/o
nvme0: WRITE sqid:1 cid:124 nsid:1 lba:302574390 len:72
.....
.....
--
You are receiving this mail because:
You are the assignee for the bug.
Loading...