许多请求的httpclient超时

时间:2016-01-21 04:45:18

标签: java apache java-ee httpclient apache-httpclient-4.x

为了模拟一个有很多用户的web应用程序,我使用了for循环,我知道它仍然非常不同,因为这将是单线程和所有这些。我的代码在

之下
public CloseableHttpClient getHttpClient() {
        try{
            SSLContext context = null;
            TrustManager[] trustAllCerts = new TrustManager[] { new X509TrustManager() {
                public java.security.cert.X509Certificate[] getAcceptedIssuers() {
                    return null;
                }

                public void checkClientTrusted(java.security.cert.X509Certificate[] certs, String authType) {
                }

                public void checkServerTrusted(java.security.cert.X509Certificate[] certs, String authType) {
                }
            } };

            try {
                context = SSLContext.getInstance("SSL");
            } catch (NoSuchAlgorithmException e1) {
                e1.printStackTrace();
            }
            try {
                context.init(null, trustAllCerts, new java.security.SecureRandom());
            } catch (KeyManagementException e1) {
                e1.printStackTrace();
            }

            SSLConnectionSocketFactory sslConnectionFactory = new SSLConnectionSocketFactory(context, SSLConnectionSocketFactory.ALLOW_ALL_HOSTNAME_VERIFIER);
            Registry<ConnectionSocketFactory> socketFactoryRegistry = RegistryBuilder.<ConnectionSocketFactory> create()
                      .register("https", sslConnectionFactory)
                      .register("http", new PlainConnectionSocketFactory()).build();

            PoolingHttpClientConnectionManager cm = new PoolingHttpClientConnectionManager(socketFactoryRegistry);
             // Increase max total connection to 200
             cm.setMaxTotal(20);
             // Increase default max connection per route to 20
             cm.setDefaultMaxPerRoute(10);
             RequestConfig defaultRequestConfig = RequestConfig.custom()
                        .setSocketTimeout(5000)
                        .setConnectTimeout(5000)
                        .setConnectionRequestTimeout(5000)
                        .build();
             CloseableHttpClient httpClient = HttpClients.custom().setConnectionManager(cm).setConnectionManagerShared(true)
                     .setDefaultRequestConfig(defaultRequestConfig).build();
            return httpClient;
        }catch(Exception ce){

        }
        return null;
    }

然后在循环中我使用它如下

try{
for(int i=0;i<500;i++){
                client = getHttpClient();
request = new HttpPost("Some https URL");
              HttpResponse response = client.execute(request);
              int statusCode = response.getStatusLine().getStatusCode();
 if (statusCode == 200 ){
                    entity = response.getEntity();
                    String content = EntityUtils.toString(entity);
}
                else{
                    entity = response.getEntity();
                    String content = EntityUtils.toString(entity);
}}
catch(Exception ce){}
finally{
                  try {
                        EntityUtils.consume(entity);
                        request.releaseConnection();
                        client.close();
                        } catch (IOException e) {
                    }
              }

我收到少量请求的响应,而少数读取超时失败,如果我增加最大连接我得到的几个失败如果我在连接管理器中保持max conn为200仍然我得到的失败但没有这个配置多少,我错过了什么。

以下的例外情况
  

java.net.SocketTimeoutException:读取超时           在java.net.SocketInputStream.socketRead0(本机方法)           在java.net.SocketInputStream.read(SocketInputStream.java:152)           在java.net.SocketInputStream.read(SocketInputStream.java:122)           at sun.security.ssl.InputRecord.readFully(InputRecord.java:442)           at sun.security.ssl.InputRecord.read(InputRecord.java:480)           at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:946)           at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:903)           at sun.security.ssl.AppInputStream.read(AppInputStream.java:102)           at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139)           at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155)           at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284)           at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)           at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)           在org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)           at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)           在org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:167)           at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)           在org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)           在org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)           在org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)           在org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)           在org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)           在org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)           在org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)           在org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)           在com.ibm.indo.serviceImpl.GenericServiceImpl.checkDomRegNew(GenericServiceImpl.java:233)           在com.ibm.indo.controller.ReportsController.checkDomRegNew(ReportsController.java:45)           at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)           at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)           at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)           at java.lang.reflect.Method.invoke(Method.java:606)           在org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:221)           在org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:137)           在org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:110)           在org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandleMethod(RequestMappingHandlerAdapter.java:776)           在org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:705)           在org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)           在org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:959)           在org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:893)           在org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:967)           在org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:869)           在javax.servlet.http.HttpServlet.service(HttpServlet.java:754)           在org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:843)           在javax.servlet.http.HttpServlet.service(HttpServlet.java:847)           在org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:329)           在org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)           在org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:275)           at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:161)           at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:153)           在org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:155)           at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)           在org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)           在org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:368)           在org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:877)           在org.apache.coyote.http11.Http11Protocol $ Http11ConnectionHandler.process(Http11Protocol.java:671)           在org.apache.tomcat.util.net.JIoEndpoint $ Worker.run(JIoEndpoint.java:930)           在java.lang.Thread.run(Thread.java:745)

2 个答案:

答案 0 :(得分:2)

您确定您的https服务器能够顺利处理200个连接吗? 我觉得,问题不在于您的httpsClient代码。服务器可能因为负载而拒绝接受少量请求?

答案 1 :(得分:1)

如下面的Exception显然httpclient无法建立套接字连接。 httpclient尝试建立连接,但在预先定义的连接建立时间内,它无法连接。

java.net.SocketTimeoutException: Read timed out at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(SocketInputStream.java:152) at java.net.SocketInputStream.read(SocketInputStream.java:122) at 

请检查

使用Apache HttpClient,why isn't my connection timeout working?

http://brian.olore.net/wp/2009/08/apache-httpclient-timeout/