Господа, товарищи и коллеги!
Есть такая конфигурация СУБД:
Firebird 2.5.5.26952 (x64)
Windows Server 2008 R2
Сервер виртуальный
Виртуализация VMware
Нагрузки на виртуальную машину нет
Дисковое хранилище Storwize v3700
Диски SAS 10000
RAID 10 из 8 дисков
На этом же RAID есть разделы для других серверов БД, с ними проблем нет.
У нас сегодня произошла авария в другой, несвязанной, системе, но либо по совпадению, либо какие еще образом, возникла проблема и с БД.
По факту мы выяснили:
1. Соединение или не идет, или настолько медленное, что висит вечная попытка соединиться (и через IBExpert, и через нашу собственную программу в которой работают наши сотрудники)
2. На сервере, где 3 файла базы данных (каждым пользуются свои сотрудники), проблемы во всех базах. Но там, где файлы маленькие и сотрудников немного (5-10), замедление работы почти не заметно. А последний файл - он большой (108 Гб) и много пользователей (~250). При одном соединении скорость работы (ожидание отклика от вызова процедуры) такая же как и была утром, и вчера, и всегда; а вот при 3-4 уже чувствуется замедление, а при 10-15 явные тормоза. Операции, выполнявшиеся раньше 1-2 секунды, начинают выполняться по 10 секунд...
3. Лог выдал вот такое:
+ firebird.log |
FDB1-SRV Fri Oct 28 15:16:02 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 15:16:02 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 15:28:55 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 15:28:55 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 15:29:06 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 15:29:06 2016 Unable to complete network request to host "FDB1-SRV". Error writing data to the connection.
FDB1-SRV Fri Oct 28 15:29:59 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 15:29:59 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 15:30:02 2016 Unable to complete network request to host "FDB1-SRV". Error writing data to the connection.
FDB1-SRV Fri Oct 28 15:30:10 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 15:31:02 2016 SERVER/process_packet: broken port, server exiting
FDB1-SRV Fri Oct 28 15:37:22 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 15:37:22 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 15:37:34 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 15:37:34 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 15:37:48 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 15:37:48 2016 Unable to complete network request to host "FDB1-SRV". Error writing data to the connection.
FDB1-SRV Fri Oct 28 15:37:49 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 15:37:49 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 15:37:56 2016 SERVER/process_packet: broken port, server exiting
FDB1-SRV Fri Oct 28 15:57:46 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 15:57:46 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 15:57:50 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 15:58:01 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:07:19 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:07:19 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:07:21 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:07:22 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:07:48 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:07:48 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:07:52 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:07:53 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:08:10 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:08:10 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:08:14 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:08:16 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:08:21 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:08:21 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:08:21 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:08:22 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:10:03 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:10:03 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:10:11 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:10:11 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:10:15 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:10:20 2016 Unable to complete network request to host "FDB1-SRV". Error writing data to the connection.
FDB1-SRV Fri Oct 28 16:14:01 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:14:01 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:14:04 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:14:05 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:16:27 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:16:27 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:16:28 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:16:29 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:17:33 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:17:33 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:17:33 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:17:33 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:19:53 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:19:59 2016 Unable to complete network request to host "FDB1-SRV". Error writing data to the connection.
FDB1-SRV Fri Oct 28 16:22:33 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:23:23 2016 Unable to complete network request to host "FDB1-SRV". Error writing data to the connection.
FDB1-SRV Fri Oct 28 16:29:43 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:29:43 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:29:51 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:29:51 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:31:20 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:31:28 2016 Unable to complete network request to host "FDB1-SRV". Error writing data to the connection.
FDB1-SRV Fri Oct 28 16:31:50 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:31:50 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:31:52 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:31:52 2016 Unable to complete network request to host "FDB1-SRV". Error writing data to the connection.
FDB1-SRV Fri Oct 28 16:35:48 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:35:48 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:35:57 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:35:57 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:36:07 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:36:07 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:36:09 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:36:10 2016 Unable to complete network request to host "FDB1-SRV". Error writing data to the connection.
FDB1-SRV Fri Oct 28 16:38:38 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:38:39 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:41:42 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:41:42 2016 INET/inet_error: read errno = 10054
FDB1-SRV Fri Oct 28 16:41:44 2016 Unable to complete network request to host "FDB1-SRV". Error reading data from the connection.
FDB1-SRV Fri Oct 28 16:41:45 2016 Unable to complete network request to host "FDB1-SRV". Error writing data to the connection.
FDB1-SRV Fri Oct 28 16:49:12 2016 INET/inet_error: read errno = 10054
|
Мы перепробовали все известные способы: от банальной перезагрузки, от переименования файла (чтобы убедиться, что никакой процесс более его не занимает) до проверок всех смежных систем (vpn и прочее). Судя по статистике сервер (компьютер) минимально нагружен в плане процессора, памяти, дисков, сетевой активности. Казалось бы ресурсов громадьё, а мы словно пересели на Pentium I.
Что можете посоветовать в такой ситуации?