DSS REST API - Timeout during extraction request
Hi Team,
My client from Baader Bank AG is facing timeouts when utilizing Immediate extractions via DSS Rest API and would like to know if his request should be changed and/or can be optimized. Hopefully you can have a look and comment:
"
What the current flow of application is looking like:
1. We are collecting the array of instruments (ISINs and MICs) from our data, for which i need to resolve the prices.
2. I am querying datascope.refinitiv.com/RestApi/v1/Search/HistoricalBulkSearch API for bulk ric resolution. To do this, i am mapping MIC to MEC using fixed mapping table on my side. RIC resolution works like a charm, thank you for the hint, btw.
3. After we have a bundle of RICs, for which i need prices extracted, i am creating instrument list using datascope.refinitiv.com/RestApi/v1/Extractions/InstrumentLists
4. I am filling the created instrument list with collected instruments.
5. After all instruments are in the list, i am creating immediate extraction request. Here are the example request details:
curl --location 'https://selectapi.datascope.refinitiv.com/RestApi/v1/Extractions/ExtractRaw' \
--header 'Prefer: respond-async' \
--header 'Content-Type: application/json' \
--header 'Authorization: Token _HTE3~~~~1v9U' \
--data-raw '{
"ExtractionRequest": {
"@odata.type":
"#DataScope.Select.Api.Extractions.ExtractionRequests.TickHistoryIntradaySummariesExtractionRequest",
"ContentFieldNames": [
"High Ask",
"High Bid",
"Low Ask",
"Low Bid",
"No. Asks",
"No. Bids",
"No. Trades"
],
"IdentifierList": {
"@odata.type": "#DataScope.Select.Api.Extractions.ExtractionRequests.InstrumentListIdentifierList",
"InstrumentListId": "0x08adcfb6f0f934d2"
},
"Condition": {
"MessageTimeStampIn": "GmtUtc",
"ReportDateRangeType": "Range",
"QueryStartDate": "2023-10-26T13:00:00.000-00:00",
"QueryEndDate": "2023-10-26T14:00:00.000-00:00",
"SummaryInterval": "OneMinute",
"TimebarPersistence": true,
"DisplaySourceRIC": true
}
}
}'
Here where the problem starts. Even if I'm using list of 2 instruments, and small query window, this request takes 60 - 100 seconds to get the response with extraction id. Sometimes it takes 120+ seconds. (But, if there are errors in request body, response is received immediately). Because of that, we often getting timeouts and need to retry.
Is this expected behavior?... Looks strange for async request. Maybe some recommendations/workarounds possible? "
Best Answer
-
Thank you for reaching out to us.
I think it is timeout in the application, not in Tick History REST API.
According to the information, it is an expected behavior.
As far as I know, the API doesn't guarantee that the extraction must be completed within the finite time. There are many factors that may impact extraction, such as current active requests, server load, number of items, number of fields, and number of extracted data.
After sending the request, the application must check the HTTP status of the returned response.
If the HTTP status of the returned resposne is 202, it means that the extraction is in-progress and the API will provide the polling URL in the response's header (Location). The client needs to use this URL to poll for the data.
If the HTTP status of the returned resposne is 200, it means that the extraction is completed and the data is available to download.
For more information, please refer to the REST API Tutorial 6: On Demand intraday bars extraction tutorial.
However, if the application sends a new extraction request while the previous extraction request is in-progress, the extraction requests may overwhelm the server and all extraction requests may be delayed.
1
Categories
- All Categories
- 6 AHS
- 37 Alpha
- 161 App Studio
- 4 Block Chain
- 4 Bot Platform
- 16 Connected Risk APIs
- 47 Data Fusion
- 30 Data Model Discovery
- 608 Datastream
- 1.3K DSS
- 577 Eikon COM
- 4.9K Eikon Data APIs
- 7 Electronic Trading
- Generic FIX
- 7 Local Bank Node API
- Trading API
- 2.7K Elektron
- 1.3K EMA
- 236 ETA
- 519 WebSocket API
- 33 FX Venues
- 10 FX Market Data
- 1 FX Post Trade
- 1 FX Trading - Matching
- 12 FX Trading – RFQ Maker
- 5 Intelligent Tagging
- 2 Legal One
- 20 Messenger Bot
- 2 Messenger Side by Side
- 9 ONESOURCE
- 7 Indirect Tax
- 59 Open Calais
- 264 Open PermID
- 39 Entity Search
- 2 Org ID
- PAM
- PAM - Logging
- 8.4K Private Comments
- 6 Product Insight
- Project Tracking
- ProView
- ProView Internal
- 20 RDMS
- 1.4K Refinitiv Data Platform
- 367 Refinitiv Data Platform Libraries
- 3 Refinitiv Due Diligence
- LSEG Due Diligence Portal API
- 3 Refinitiv Due Dilligence Centre
- Rose's Space
- 1.1K Screening
- 18 Qual-ID API
- 13 Screening Deployed
- 23 Screening Online
- 10 World-Check Customer Risk Screener
- 990 World-Check One
- 44 World-Check One Zero Footprint
- 45 Side by Side Integration API
- Test Space
- 3 Thomson One Smart
- 1.2K TR Internal
- Global Hackathon 2015
- 2 Specialists Who Code
- 10 TR Knowledge Graph
- 150 Transactions
- 142 REDI API
- 1.7K TREP APIs
- 4 CAT
- 21 DACS Station
- 117 Open DACS
- 1.1K RFA
- 103 UPA
- 172 TREP Infrastructure
- 224 TRKD
- 886 TRTH
- 5 Velocity Analytics
- 5 Wealth Management Web Services
- 59 Workspace SDK
- 9 Element Framework
- 5 Grid
- 13 World-Check Data File
- Yield Book Analytics
- 46 中文论坛