missing EIA data
eikon API
get_timeseries
Python
Executing this python code, I'm trying to get EIA data starting 2015 but only get it populated starting 4/21/2021. There seems to be missing data. Could you pls fix?
fname = "RICList.csv"
riclist_df = pd.read_csv(pricespath+fname)
riclist = riclist_df["RIC"].tolist()
df_wklies = ek.get_timeseries(riclist, 'close',
start_date = '2015-01-01',
end_date = today)
df_wklies.to_csv(pricespath + "US_weeklies.csv")
RICREFCR-1-EIAREFCO-1-EIADST-OUT-1-EIAJET-OUT-1-EIADST-STK-1-EIAJET-STK-1-EIADST-IMP-1-EIAJET-IMP-1-EIADST-EXP-T-EIAJET-EXP-T-EIADST-DEL-T-EIAJET-DEL-T-EIAREFCR-2-EIAREFCO-2-EIADST-OUT-2-EIAJET-OUT-2-EIADST-STK-2-EIAJET-STK-2-EIAREFCR-3-EIAREFCO-3-EIADST-OUT-3-EIAJET-OUT-3-EIADST-STK-3-EIAJET-STK-3-EIAREFCR-4-EIAREFCO-4-EIADST-OUT-4-EIAJET-OUT-4-EIADST-STK-4-EIAJET-STK-4-EIAREFCR-5-EIAREFCO-5-EIADST-OUT-5-EIAJET-OUT-5-EIADST-STK-5-EIAJET-STK-5-EIADST-IMP-5-EIAJET-IMP-5-EIA
Best Answer
-
The reason it appears like you are receiving missing data is because you have hit the limit for a single request using get_timeseries(). According to the Eikon Data API Usage and Limits Guideline, the get_timeseries() has a limit of 3000 data points per request.
- get_timeseries: The current limit value (10-Oct-2019) is 3,000 data points (rows) for interday intervals and 50,000 data points for intraday intervals. This limit applies to the whole request, whatever the number of requested instrument.
As a result, the server is truncating the results. You will have to break your list into bundles to avoid this limit.
0
Answers
-
Here is one where I do see all the history:
ek.get_timeseries("REFCR-1-EIA", 'close',
start_date = '2015-01-01',
end_date='2022-08-05')Does the above fail for you?
0 -
Thank you. The RIC list is below. I think that some of the RICs have missing data and therefore the get_timeseries gets truncated at 4/21/22. Can you try querying for all those RICs at one time and see if you get everything starting at 1/1/2015?
- REFCR-1-EIA
- REFCO-1-EIA
- DST-OUT-1-EIA
- JET-OUT-1-EIA
- DST-STK-1-EIA
- JET-STK-1-EIA
- DST-IMP-1-EIA
- JET-IMP-1-EIA
- DST-EXP-T-EIA
- JET-EXP-T-EIA
- DST-DEL-T-EIA
- JET-DEL-T-EIA
- REFCR-2-EIA
- REFCO-2-EIA
- DST-OUT-2-EIA
- JET-OUT-2-EIA
- DST-STK-2-EIA
- JET-STK-2-EIA
- REFCR-3-EIA
- REFCO-3-EIA
- DST-OUT-3-EIA
- JET-OUT-3-EIA
- DST-STK-3-EIA
- JET-STK-3-EIA
- REFCR-4-EIA
- REFCO-4-EIA
- DST-OUT-4-EIA
- JET-OUT-4-EIA
- DST-STK-4-EIA
- JET-STK-4-EIA
- REFCR-5-EIA
- REFCO-5-EIA
- DST-OUT-5-EIA
- JET-OUT-5-EIA
- DST-STK-5-EIA
- JET-STK-5-EIA
- DST-IMP-5-EIA
- JET-IMP-5-EIA
0
Categories
- All Categories
- 6 AHS
- 39 Alpha
- 161 App Studio
- 4 Block Chain
- 4 Bot Platform
- 16 Connected Risk APIs
- 47 Data Fusion
- 30 Data Model Discovery
- 608 Datastream
- 1.3K DSS
- 577 Eikon COM
- 4.9K Eikon Data APIs
- 7 Electronic Trading
- Generic FIX
- 7 Local Bank Node API
- Trading API
- 2.7K Elektron
- 1.3K EMA
- 236 ETA
- 519 WebSocket API
- 33 FX Venues
- 10 FX Market Data
- 1 FX Post Trade
- 1 FX Trading - Matching
- 12 FX Trading – RFQ Maker
- 5 Intelligent Tagging
- 2 Legal One
- 20 Messenger Bot
- 2 Messenger Side by Side
- 9 ONESOURCE
- 7 Indirect Tax
- 59 Open Calais
- 264 Open PermID
- 39 Entity Search
- 2 Org ID
- PAM
- PAM - Logging
- 8.4K Private Comments
- 6 Product Insight
- Project Tracking
- ProView
- ProView Internal
- 20 RDMS
- 1.4K Refinitiv Data Platform
- 367 Refinitiv Data Platform Libraries
- 3 Refinitiv Due Diligence
- LSEG Due Diligence Portal API
- 3 Refinitiv Due Dilligence Centre
- Rose's Space
- 1.1K Screening
- 18 Qual-ID API
- 13 Screening Deployed
- 23 Screening Online
- 10 World-Check Customer Risk Screener
- 990 World-Check One
- 44 World-Check One Zero Footprint
- 45 Side by Side Integration API
- Test Space
- 3 Thomson One Smart
- 1.2K TR Internal
- Global Hackathon 2015
- 2 Specialists Who Code
- 10 TR Knowledge Graph
- 150 Transactions
- 142 REDI API
- 1.7K TREP APIs
- 4 CAT
- 21 DACS Station
- 117 Open DACS
- 1.1K RFA
- 103 UPA
- 172 TREP Infrastructure
- 224 TRKD
- 886 TRTH
- 5 Velocity Analytics
- 5 Wealth Management Web Services
- 59 Workspace SDK
- 9 Element Framework
- 5 Grid
- 13 World-Check Data File
- Yield Book Analytics
- 46 中文论坛