Make Pro Fetchers async by replacing ThreadPoolExecutor with asyncio.gather (#5822)

* init

* Update helpers.py

* filter URL on raise

* polygon, fmp done, update cassettes

* updates

* cleanup

* revert tests for now

* Update discovery_filings.py

* Update helpers.py

* add `async` overload to `Fetcher.extract_data`

* update merged fred models

* tests, improve fred series

* Update insider_trading.py

* insider

* tests

* intrinio

* Update equity_historical.py

* implement abstract async extract on Fetcher, with simple switch

* cleanup

* Update helpers.py

* Update helpers.py

* fix fmp historical deprecated urls

* Revert "fix fmp historical deprecated urls"

This reverts commit 1a760a2473.

* fix fmp `index.market` 1day url missing query params

* Update test_fmp_market_indices_fetcher.yaml

* field fixes

* `extract_data_async` -> `aextract_data`, `async_request` -> `amake_request`

* `async_requests` -> `amake_requests`

* Update company_news.py

* add sort to index `integration` params

* add `client.py` tests

* Update equity_search.py

* Add lost v in platform api version string

* Resolve linter errors here and there

---------

Co-authored-by: Theodore Aptekarev <aptekarev@gmail.com>
This commit is contained in:
teh_coderer
2023-12-08 09:41:37 -05:00
committed by GitHub
parent 40c0c9c20f
commit da7886d0a7
119 changed files with 4907 additions and 3349 deletions

View File

@@ -68,6 +68,7 @@ def test_index_constituents(params, obb):
"start_date": "2023-01-01",
"end_date": "2023-06-06",
"timeseries": 1,
"sort": "desc",
}
),
(
@@ -78,6 +79,7 @@ def test_index_constituents(params, obb):
"start_date": "2023-01-01",
"end_date": "2023-06-06",
"timeseries": 1,
"sort": "desc",
}
),
(