Performance issues when fetching large amounts of data

I'm using the Dex2 COM API for VBA to get fundamental and historical performance data (20 TR. fields) for about 10k instruments. It takes me from 20min up to more than 1h, depending of the time of the day, which I think it's a very long time!

Are there best-practices and concrete peak-times which we should avoid? For example, around 8am seems to be much faster than 5pm (European Time).

Second question about efficiency: i'm sending requests in batches of 500 instruments for 20 TR. fields - is that optimal or should I rather ask for batches of 2000 instruments but only 5 fields? Any experience with the best-performing combination?

Third question about efficiency: how slow is the AVAIL function? Does dividing the assets in categories (Bonds, Equities, Funds) make sense in term of efficiency, so that I can tailor the query with the assetcategory-specific fields instead of using AVAIL?

Many thanks!

Best Answer

  • @nicola.pestalozzi
    Eikon is an end user product. The amount of data you retrieve is borderline where you may want to consider using one of Thomson Reuters enterprise products specifically designed and engineered for bulk data downloads.
    As for your questions, the answer to them can only be determined empirically. At Thomson Reuters we don't do any benchmarking of Eikon for bulk data download requests. In other words data retrieval times for bulk data download requests is not a key product performance indicator that we routinely monitor for Eikon.