Friday, February 3, 2012

Configure Adapter Threads in Oracle SOA 11G

In in earlier posting, I mentioned you can configure multiple threads of inbound (polling) adapters of Oracle SOA. However, the ways to configure multiple threads vary between adapters and product versions, and the information scatter cross multiple documentations.

Hence it is worth to consolidate them here. Below are how to configure Adapter threads in Oracle SOA 11G.


1. JMS Adapter
  • Property Name: adapter.jms.receive.threads
  • Configuration File: adapter binding at composite.xml

  • Documentation: http://docs.oracle.com/cd/E21764_01/core.1111/e10108/adapters.htm#BABCGCEC
  • Example:
<service name="dequeue" ui:wsdlLocation="dequeue.wsdl">
<interface.wsdl interface="http://xmlns.oracle.com/pcbpel/adapter/jms/textmessageusingqueues/textmessageusingqueues/dequeue%2F#wsdl.interface(Consume_Message_ptt)"/>
<binding.jca config="dequeue_jms.jca">
<property name="adapter.jms.receive.threads" type="xs:string" many="false">10</property>
</binding.jca">
</service>

2. AQ Adapter
  • Property Name: adapter.aq.dequeue.threads
  • Configuration file: composite.xml
  • Documentation: http://docs.oracle.com/cd/E21764_01/core.1111/e10108/adapters.htm#BABDEBEE
  • Example:
<service name="dequeue" ui:wsdlLocation="dequeue.wsdl">
<interface.wsdl interface="http://xmlns.oracle.com/pcbpel/adapter/aq/raw/raw/dequeue/#wsdl.interface(Dequeue_ptt)"/>
<binding.jca config="dequeue_aq.jca">
<property name="adapter.aq.dequeue.threads" type="xs:string" many="false">10</property>
</binding.jca>
</service>


3. MQ Adapter
  • Property Name: InboundThreadCount
  • Configuration File: *.jca file
  • Documentation: http://docs.oracle.com/cd/E21764_01/core.1111/e10108/adapters.htm#BABDEBEE

4. Database Adapter

It takes multiple steps to configure database adapter threads.

Step 1: Configure distributed polling. The query in the polling database adapter needs to be a distributed polling in order to avoid data duplication. Please follow the two best practices in the documentation to establish the right kind of distributed polling.

Step 2. Set activationInstances as adapter binding property at composite.xml (SOA 11G) to achieve multiple threads in database adapter.

Alternatively, you can set NumberOfThreads in the jca file (SOA 11.1.1.3 onward). Technically, activationInstances and NumberOfThreads properties work differently, in such that NumberOfThreads works in the scope of per activation agent. Before SOA 11.1.1.3, NumberOfThreads is NOT supported in clustered environment or when activationInstances>1. At SOA 11.1.1.3 onward, you can use either activationInstances or NumberOfThreads properties to achieve the multi-threading effect. But if for some reason you set both, the total concurrent threads will be activationInstances x NumberOfThreads. For example, if you activationInstances=2, and NumberOfThreads=5, that means there are are 5 threads running within each activation instance.


Step 3. Tune MaxTransactionSize and MaxRaiseSize to throttle the incoming messages along side with activationAgents/NumberOfThreads. These two properties are configured either through the DbAdapter wizard at JDeveloper, or manually directly at the *.jca file.

<endpoint-activation portType="poll_ptt" operation="receive">
<activation-spec className="oracle.tip.adapter.db.DBActivationSpec">
...
<property name="PollingStrategy" value="LogicalDeletePollingStrategy"/>
<property name="MaxRaiseSize" value="5"/>
<property name="MaxTransactionSize" value="10"/>
...
</activation-spec>
</endpoint-activation>

5. File/FTP Adapter

File/FTP adapter's threading model is a bit complex. In essence, there is a separation poller thread and processor thread, except in the "Single Threaded Model" (comparatively, JMS/AQ adapters always use the same thread to poll and process). There is always only one poller thread, while there could be multiple processor threads. Please go through the documentation thoroughly so that you can choose a threading model appropriate to your application.


Step 1: Choose a threading model

Step 2: Configure threads depending on the threading model you choose

If you choose the Default Threading Model, you can set the thread count of global processor through the oracle.tip.adapter.file.numProcessorThreads property at the pc.properties file. This pc.properties is read from the classpath. So you could, for example, copy it to some directory under ORACLE_HOME and then reference it in the WLS classpath in setDomainEnv.sh. However, the Partition Threading Model is recommended over the Default Threading Model (see below) if you do have a need to define processor threads.

If you choose the Single Threaded Model, set the SingleThreadModel=true at the *.jca file. And as the name applies, you don't worry about any thread counts.
<activation-spec className="oracle.tip.adapter.file.inbound.FileActivationSpec">
<property../>
<property name="SingleThreadModel" value="true"/>
<property../>
</activation-spec>

If you choose the Partitioned Threaded Model, you can set the thread count for processor threads per adapter at the *.jca file:
<activation-spec className="oracle.tip.adapter.file.inbound.FileActivationSpec">
<property../>
<property name="ThreadCount" value="4"/>
<property../>
</activation-spec>


Please note the value of the ThreadCount is closely related to the kind of threading model you choose:
  • If the ThreadCount property is set to 0, then the threading behavior is like that of the single threaded model.
  • If the ThreadCount property is set to -1, then the global thread pool is used, as in the default threading model.
  • The maximum value for the ThreadCount property is 40.

11 comments:

  1. Does SOA 11g now contain an e-mail adapter? I know OESB didn't in 10g but was just wondering if mediator now does. I need to extract incoming e-mail attachments for processing through SOA and was wondering if I can do this without installing OSB.

    ReplyDelete
    Replies
    1. This comment has been removed by the author.

      Delete
    2. There is one available now but only in preview mode. Search around and you will find some postings about it.

      Delete
  2. what does true do?

    how will it be different if i set NumberOfThreads=1 and activeInstances=1 ?

    ReplyDelete
    Replies
    1. The detailed explanation is in the documentation quoted above. Basically SingleThreadMode=true means "The single threaded model is a modified threaded model that enables the poller to assume the role of a processor". In other words, the poller thread and the processor thread are the same thread.

      For file adapter, do NOT use activationInstance > 1. Otherwise you will have data duplications as the multiple activation instances of inbound file adapter will not coordinate.

      Delete
    2. And NumberOfThreads do NOT apply for file adapter.

      Delete
  3. Is there any tutorial which describes how to setup Oracle JCA Adapter for JMS in a clustered environment.

    ReplyDelete
  4. http://docs.oracle.com/cd/E23943_01/core.1111/e10106/ha_soa.htm#CHDJFDAI

    ReplyDelete
  5. Hi Francis,

    I working in SOA 11g and I need to configure multiple threads in JMS Adapter. I have entered 4 in the composite.xml.
    (4 being the number of threads I am using for testing. I would like to increase it to 10 later on).
    However the problem I am facing is that the JMS consumer is reading each of the message present in topic 4 times. For example, if I am sending 4 messages to the topic one after another through JMS producer, the consumer is generating 4 instances for each of these messages i.e. total 16 instances are getting generated when my objective is to get total 4 concurrent instances, one for each message. Please suggest.

    -Lahari

    ReplyDelete