[Clustering] - Re: mod_cluster + 503 Service Temporarily Unavailable error

[babazs]

I use AJP, and when I killed a node(stop vm or ctrl+c), appear that the cluster is changed correctly in the log, then the 503 error is occurred.

View the original post : http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4262111#4262111

Reply to the post : http://www.jboss.org/index.html?module=bb&op=posting&mode=reply&p=4262111

[babazs]

At the first case(start nodes) my log httpd error_log is contains the next lines:


| [Mon Oct 26 10:36:24 2009] [notice] Advertise initialized for process 5200
| [Mon Oct 26 10:36:24 2009] [notice] Apache/2.2.13 (Win32) configured -- resuming normal operations
| [Mon Oct 26 10:36:24 2009] [notice] Server built: Aug 20 2009 04:34:10
| [Mon Oct 26 10:36:24 2009] [notice] Parent: Created child process 3728
| [Mon Oct 26 10:36:24 2009] [notice] Child 3728: Child process is running
| [Mon Oct 26 10:36:24 2009] [notice] Child 3728: Acquired the start mutex.
| [Mon Oct 26 10:36:24 2009] [notice] Child 3728: Starting 64 worker threads.
| [Mon Oct 26 10:36:24 2009] [notice] Child 3728: Starting thread to listen on port 8080.
| [Mon Oct 26 10:38:18 2009] [error] ajp_cping_cpong: apr_socket_recv failed
| [Mon Oct 26 10:38:39 2009] [error] ajp_cping_cpong: apr_socket_recv failed
| [Mon Oct 26 10:38:49 2009] [error] ajp_cping_cpong: apr_socket_recv failed
| [Mon Oct 26 10:39:10 2009] [error] ajp_cping_cpong: apr_socket_recv failed
| [Mon Oct 26 10:40:22 2009] [error] proxy: dialog to 192.168.1.140:8009 (192.168.1.140) failed
| [Mon Oct 26 10:40:22 2009] [error] proxy: dialog to 192.168.1.141:8009 (192.168.1.141) failed
| [Mon Oct 26 10:40:23 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:40:23 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:40:23 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:40:24 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:40:24 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:40:29 2009] [error] proxy: ajp: disabled connection for (192.168.1.140)
| [Mon Oct 26 10:40:29 2009] [error] proxy: ajp: disabled connection for (192.168.1.141)
| [Mon Oct 26 10:40:39 2009] [error] proxy: ajp: disabled connection for (192.168.1.140)
| [Mon Oct 26 10:40:39 2009] [error] proxy: ajp: disabled connection for (192.168.1.141)
| [Mon Oct 26 10:40:46 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:40:47 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:40:49 2009] [error] proxy: ajp: disabled connection for (192.168.1.140)
| [Mon Oct 26 10:40:49 2009] [error] proxy: ajp: disabled connection for (192.168.1.141)
| [Mon Oct 26 10:40:56 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:40:56 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:40:57 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:40:57 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:40:59 2009] [error] proxy: ajp: disabled connection for (192.168.1.140)
| [Mon Oct 26 10:40:59 2009] [error] proxy: ajp: disabled connection for (192.168.1.141)


View the original post : http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4262115#4262115

Reply to the post : http://www.jboss.org/index.html?module=bb&op=posting&mode=reply&p=4262115

[babazs]

Second case(kill then restart node):


[Mon Oct 26 10:44:09 2009] [error] proxy: ajp: disabled connection for (192.168.1.140)
| [Mon Oct 26 10:44:19 2009] [error] proxy: ajp: disabled connection for (192.168.1.140)
| [Mon Oct 26 10:44:29 2009] [error] proxy: ajp: disabled connection for (192.168.1.140)
| [Mon Oct 26 10:44:39 2009] [error] proxy: ajp: disabled connection for (192.168.1.140)
| [Mon Oct 26 10:44:49 2009] [error] proxy: ajp: disabled connection for (192.168.1.140)
| [Mon Oct 26 10:44:59 2009] [error] proxy: ajp: disabled connection for (192.168.1.140)
| [Mon Oct 26 10:47:11 2009] [error] ajp_cping_cpong: apr_socket_recv failed
| [Mon Oct 26 10:47:31 2009] [error] ajp_cping_cpong: apr_socket_recv failed
| [Mon Oct 26 10:48:19 2009] [error] [client 192.168.1.111] proxy: error processing body, referer: http://192.168.1.111:8080/dvc/inbox/write/message/cId/18
| [Mon Oct 26 10:48:19 2009] [error] proxy: dialog to 192.168.1.140:8009 (192.168.1.140) failed
| [Mon Oct 26 10:48:22 2009] [error] proxy: dialog to 192.168.1.141:8009 (192.168.1.141) failed
| [Mon Oct 26 10:48:22 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:48:27 2009] [error] proxy: ajp: disabled connection for (192.168.1.141)
| [Mon Oct 26 10:48:37 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:48:37 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:48:37 2009] [error] proxy: ajp: disabled connection for (192.168.1.141)
| [Mon Oct 26 10:48:38 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:48:38 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:48:38 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:48:38 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:48:39 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:48:39 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:48:40 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:48:40 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:48:40 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:48:40 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:48:41 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:48:41 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:48:47 2009] [error] proxy: ajp: disabled connection for (192.168.1.141)
| [Mon Oct 26 10:48:57 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:48:57 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:48:57 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:48:57 2009] [error] proxy: ajp: disabled connection for (192.168.1.141)
| [Mon Oct 26 10:48:57 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:49:02 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:49:02 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:49:03 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:49:03 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:49:03 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:49:07 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:49:07 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:49:07 2009] [error] proxy: ajp: disabled connection for (192.168.1.141)
| [Mon Oct 26 10:49:07 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:49:08 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:49:08 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:49:08 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:49:12 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:49:12 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 10:49:12 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state


View the original post : http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4262116#4262116

Reply to the post : http://www.jboss.org/index.html?module=bb&op=posting&mode=reply&p=4262116

[babazs]

and the end of the log:


[Mon Oct 26 15:55:45 2009] [error] (OS 10054)A létező kapcsolatot a távoli állomás kényszerítetten bezárta. : ajp_ilink_receive() can't receive header
| [Mon Oct 26 15:55:45 2009] [error] ajp_read_header: ajp_ilink_receive failed
| [Mon Oct 26 15:55:45 2009] [error] (120006)APR does not understand this error code: proxy: read response failed from 192.168.1.140:8009 (192.168.1.140)
| [Mon Oct 26 15:55:45 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 15:55:47 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 15:55:48 2009] [error] proxy: ajp: disabled connection for (192.168.1.141)
| [Mon Oct 26 15:55:49 2009] [error] proxy: CLUSTER: (balancer://mycluster). All workers are in error state
| [Mon Oct 26 15:55:53 2009] [error] proxy: ajp: disabled connection for (192.168.1.141)

View the original post : http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4262204#4262204

Reply to the post : http://www.jboss.org/index.html?module=bb&op=posting&mode=reply&p=4262204