https://issues.rivetlogic.com This file is an XML representation of an issue en-us 8.1.3 801003 13-09-2019 https://issues.rivetlogic.com/browse/CMA-16 Remote Alfresco API rivet Improve the readContentIntoStream(..) method in ContentService to prevent an OutOfMemoryError because the stream from Alfresco to CMA fills up faster than the stream from CMA to the client is flushing. Currently, a quick fix would be to increase the memory in the JVM running CMA, or to run CMA on a different box than Alfresco (to make it slower).<br/> <br/> With default settings for memory, and if running both JVMs on the same machine, the CMA JVM is out of memory when downloading a file of size around 32MB. CMA-16

Improve the readContentIntoStream(..) method in ContentService

Improvement Major Open Unresolved Unassigned Nazem Attar [X] Tue, 17 Jun 2008 09:43:16 -0400 Fri, 15 Oct 2010 10:50:39 -0400 CMA API 0 0 This error is probably occuring here in the RestExecuterImpl.java<br/> <br/> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;executeHttpMethod(httpMethod);<br/> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;String responseType = getResponseType(httpMethod);<br/> if (responseType.equals(CmaConstants.RESPONSE_BINARY)) {<br/> writeToStream(httpMethod.getResponseBodyAsStream(), output);<br/> <br/> When this call is made, getResponseBodyAsStream is the whole file that is already loaded into the memory.<br/> <br/> Java 1.5 HttpURLConnection supports something called setChunkedStreamingMode<br/> <br/> <a href="http://java.sun.com/j2se/1.5.0/docs/api/java/net/HttpURLConnection.html#setChunkedStreamingMode(int)">http://java.sun.com/j2se/1.5.0/docs/api/java/net/HttpURLConnection.html#setChunkedStreamingMode(int)</a><br/> <br/> Also HttpURLConnection of commons httpClient supports this from the super class.<br/> <br/> <a href="http://hc.apache.org/httpclient-3.x/apidocs/org/apache/commons/httpclient/util/HttpURLConnection.html">http://hc.apache.org/httpclient-3.x/apidocs/org/apache/commons/httpclient/util/HttpURLConnection.html</a><br/> <br/> This may solve the issue that we have with OutOfMemoryError.<br/> <br/> -Shagul<br/> &nbsp;<br/> <a href="https://issues.rivetlogic.com/browse/CMA-16" title="Improve the readContentIntoStream(..) method in ContentService" class="issue-link" data-issue-key="CMA-16">CMA-16</a> and <a href="https://issues.rivetlogic.com/browse/CMA-23" title="Uploading large files throws OutOfMemoryError for the Java heap space" class="issue-link" data-issue-key="CMA-23">CMA-23</a> are related. Solving one may solve the other. This issue is fixed and happens only while using seam with richfaces on the client side.<br/> <br/> RestExecuterImpl execute method is reading from an input stream and writing into an output stream.<br/> <br/> There is no obvious buffering.<br/> <br/> When using seam with richfaces, all output stream pass through the ajax4jsf filter which was doing the buffering.<br/> <br/> The hint was in the stackTrace.<br/> <br/> Caused by: java.lang.OutOfMemoryError: Java heap space<br/> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;at org.ajax4jsf.io.ByteBuffer.&lt;init&gt;(ByteBuffer.java:54)<br/> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;at org.ajax4jsf.io.ByteBuffer.append(ByteBuffer.java:112)<br/> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;at org.ajax4jsf.io.FastBufferOutputStream.write(FastBufferOutputStream.java:107)<br/> <br/> Adding the below to components.xml prevents the filter from being applied to /seam/resource/alfdocument* pattern.<br/> <br/> &nbsp;&nbsp;&nbsp;&lt;web:ajax4jsf-filter force-parser=&quot;true&quot; <br/> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;enable-cache=&quot;true&quot; <br/> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;log4j-init-file=&quot;log4j.xml&quot; <br/> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;regex-url-pattern=&quot;^(?:[^/]|/(?!seam/resource/alfdocument))*$&quot;<br/> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;/&gt; <br/> <br/> In earlier versions while using just ajax4jsf these filter exceptions can be placed in web.xml.<br/> <br/> Change the regular expression accordingly to avoid ajax4jsf filter.<br/> <br/> So the issue is not with Raar buffering. Further testing is being done to see if all other ajax calls from the apps are working.<br/> <br/> Any finding will be updated here.<br/> <br/> -Shagul If you get an error like <br/> <br/> java.lang.NoClassDefFoundError: org/cyberneko/html/HTMLAugmentations<br/> <br/> Add the below dependency to your seam/richfaces project.<br/> <br/> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&lt;dependency&gt;<br/> &nbsp;&nbsp; &lt;groupId&gt;nekohtml&lt;/groupId&gt;<br/> &nbsp;&nbsp; &lt;artifactId&gt;nekohtml&lt;/artifactId&gt;<br/> &nbsp;&nbsp; &lt;version&gt;0.9.5&lt;/version&gt;<br/> &lt;/dependency&gt;<br/> <br/> Any other NoClassDefFoundError, include the appropriate maven dependencies/jars.<br/> <br/> -Shagul Duplicate CMA-23 Development Rank 0|i00adr: Rank (Obsolete) 1683