OOM cause by com.refinitiv.eta.json.util.JsonFactory Ojbect costing large memory
Hi we met OutOfMemory issue in our service. we are using dependency below :
<dependency>
<groupId>com.refinitiv.eta</groupId>
<artifactId>eta</artifactId>
<version>3.6.2.2</version>
</dependency>
<dependency>
<groupId>com.refinitiv.ema</groupId>
<artifactId>ema</artifactId>
<version>3.6.2.2</version>
</dependency>
we deployed service on our server. running sub rate from trep and posting message to trep too(every 5 mins).
after around 10 hours. OOM issue occur.
we have export the heapdump file and did some analysis.
we found that most memory used by a JsonFactory object.
for more information. big memory used by attribute in JsonFactory:
could you help provide more information about the #elementSetDefDbPool and #fieldSetDefDbPool ?
btw, we are using OmmConsumer.submit to post message. each post event we will create new OmmConsumer and release it after all AckId return backed.
PostMsg postMsg = EmaFactory.createPostMsg();
UpdateMsg nestedUpdateMsg = EmaFactory.createUpdateMsg();
FieldList fieldList = fieldListMap.get(ric).getKey();
StringBuilder fieldListStringBuilder = fieldListMap.get(ric).getValue();
nestedUpdateMsg.payload(fieldList);
long currentPostId = postId.incrementAndGet();
try {
consumer
.submit(
postMsg
.postId(currentPostId)
.serviceName(serviceName)
.name(ric)
.solicitAck(true)
.complete(true)
.payload(nestedUpdateMsg)
, loginHandle
);
Best Answer
-
Thank you for reaching out to us.
I found the issue regarding memory leak that has been fixed in EMA Java 3.6.7.L1.
Both ETA Java and EMA Java 3.6.7.L1 Issues Resolved
---------------------------------------------------
- [RTSDK-6167] - Uncaught NPE in EMA due to race condition in cleanup after timeout [Case Number: 11147646]
- [RTSDK-6259] - Support JDK and Oracle OpenJDK 1.17
- [RTSDK-6347] - Update to Jackson jar due to vulnerabilities detected
- [RTSDK-6395] - Apache commons-configuration2 version 2.7 vulnerability [GitHub #201]
- [RTSDK-6411] - Memory leak upon repeated OMMConsumer initialize and un-intialize [Case Number: 11444081]
- [RTSDK-6479] - Update to DACS 7.8
- [RTSDK-6531] - JSON Converter unexpected value with date of 2022-11 [GitHub #207]Please upgrade the application to use the latest version of EMA to avoid all known issues.
The latest version is Real-Time-SDK-2.1.1.L1 (EMA 3.7.1.L1).
0
Answers
-
Thank you for reaching out to us.
Please explain more about this statement.
we are using OmmConsumer.submit to post message. each post event we will create new OmmConsumer and release it after all AckId return backed.
Does it mean that the application regulary creates and releases OMMConsumer instances?
0 -
yes. we regulary creates and release.
I am not sure it will impact the growing of JsonFactory's elementSetDefDbPool and fieldSetDefDbPool.
0 -
@Jirapongse great thanks. I try to upgrade the SDK version. seems look good now, let me keep monitoring it for one week to verify if issue resolved.
Btw, I have an other question. when I restart my service, each publication event (post 500 page) and get all Ack Id back, it only spend around 2-3 seconds.
But when then service keep running about 1 days. the publication event time spend are came to 20+ seconds. each publication event also creating new OOMConsumer to trigger submit.
anything I should check with lib ? or I should re-raise a new ticked to ask QA ? many thinks.
0
Categories
- All Categories
- 6 AHS
- 37 Alpha
- 161 App Studio
- 4 Block Chain
- 4 Bot Platform
- 16 Connected Risk APIs
- 47 Data Fusion
- 30 Data Model Discovery
- 608 Datastream
- 1.3K DSS
- 577 Eikon COM
- 4.9K Eikon Data APIs
- 7 Electronic Trading
- Generic FIX
- 7 Local Bank Node API
- Trading API
- 2.7K Elektron
- 1.3K EMA
- 236 ETA
- 519 WebSocket API
- 33 FX Venues
- 10 FX Market Data
- 1 FX Post Trade
- 1 FX Trading - Matching
- 12 FX Trading – RFQ Maker
- 5 Intelligent Tagging
- 2 Legal One
- 20 Messenger Bot
- 2 Messenger Side by Side
- 9 ONESOURCE
- 7 Indirect Tax
- 59 Open Calais
- 264 Open PermID
- 39 Entity Search
- 2 Org ID
- PAM
- PAM - Logging
- 8.4K Private Comments
- 6 Product Insight
- Project Tracking
- ProView
- ProView Internal
- 20 RDMS
- 1.4K Refinitiv Data Platform
- 367 Refinitiv Data Platform Libraries
- 3 Refinitiv Due Diligence
- LSEG Due Diligence Portal API
- 3 Refinitiv Due Dilligence Centre
- Rose's Space
- 1.1K Screening
- 18 Qual-ID API
- 13 Screening Deployed
- 23 Screening Online
- 10 World-Check Customer Risk Screener
- 990 World-Check One
- 44 World-Check One Zero Footprint
- 45 Side by Side Integration API
- Test Space
- 3 Thomson One Smart
- 1.2K TR Internal
- Global Hackathon 2015
- 2 Specialists Who Code
- 10 TR Knowledge Graph
- 150 Transactions
- 142 REDI API
- 1.7K TREP APIs
- 4 CAT
- 21 DACS Station
- 117 Open DACS
- 1.1K RFA
- 103 UPA
- 172 TREP Infrastructure
- 224 TRKD
- 886 TRTH
- 5 Velocity Analytics
- 5 Wealth Management Web Services
- 59 Workspace SDK
- 9 Element Framework
- 5 Grid
- 13 World-Check Data File
- Yield Book Analytics
- 46 中文论坛