7b7f012aa9
* fix(finra): use persistent session to prevent TooManyRedirects Resolves #6972. The FINRA OTC data fetching functions (get_finra_weeks, get_finra_data, get_full_data) previously created new HTTP sessions for each request. When making dozens of sequential API calls to aggregate weekly data, this caused Cloudflare's bot protection on api.finra.org to trigger redirect loops, resulting in a TooManyRedirects error. Changes: - Refactored get_finra_weeks and get_finra_data to accept an optional session parameter via kwargs. - Updated get_full_data to create a single requests.Session and perform a pre-flight GET to finra.org to establish Cloudflare cookies before making API calls. - The session is reused across all requests within a single data fetch operation, preventing the redirect loop. - Removed hardcoded User-Agent from get_finra_data in favor of the platform's standard user agent set by get_requests_session. - Increased timeout for weeklyDownloadDetails from 3s to 20s for consistency and reliability. * Apply Black Formatting * perf(finra): use async requests for concurrent weekly data fetching Addresses reviewer feedback on PR #7443. The get_full_data function previously made up to 52 sequential POST requests to fetch weekly OTC data, resulting in poor performance. This commit adds async equivalents (aget_finra_weeks, aget_finra_data, aget_full_data) that use the platform's amake_request utility and asyncio.gather to fetch all weeks concurrently through a shared aiohttp session. The FinraOTCAggregateFetcher now uses aextract_data, which is natively supported by the platform's Fetcher base class. The pre-flight GET to finra.org for Cloudflare cookie establishment is preserved in the async path. * fix(finra): return all rows from data fetching instead of just the first one * run black, add symbol field to data model, and recapture test cassette * mypy --------- Co-authored-by: Danglewood <85772166+deeleeramone@users.noreply.github.com>
Open Data Platform by OpenBB (ODP) is the open-source toolset that helps data engineers integrate proprietary, licensed, and public data sources into downstream applications like AI copilots and research dashboards.
ODP operates as the "connect once, consume everywhere" infrastructure layer that consolidates and exposes data to multiple surfaces at once: Python environments for quants, OpenBB Workspace and Excel for analysts, MCP servers for AI agents, and REST APIs for other applications.
Get started with: pip install openbb
from openbb import obb
output = obb.equity.price.historical("AAPL")
df = output.to_dataframe()
Data integrations available can be found here: https://docs.openbb.co/python/reference
OpenBB Workspace
While the Open Data Platform provides the open-source data integration foundation, OpenBB Workspace offers the enterprise UI for analysts to visualize datasets and leverage AI agents. The platform's "connect once, consume everywhere" architecture enables seamless integration between the two.
You can find OpenBB Workspace at https://pro.openbb.co.
Data integration:
- You can learn more about adding data to the OpenBB workspace from the docs or this open source repository.
AI Agents integration:
- You can learn more about adding AI agents to the OpenBB workspace from this open source repository.
Integrating Open Data Platform to the OpenBB Workspace
Connect this library to the OpenBB Workspace with a few simple commands, in a Python (3.9.21 - 3.12) environment.
Run an ODP backend
- Install the packages.
pip install "openbb[all]"
- Start the API server over localhost.
openbb-api
This will launch a FastAPI server, via Uvicorn, at 127.0.0.1:6900.
You can check that it works by going to http://127.0.0.1:6900.
Integrate the ODP Backend to OpenBB Workspace
Sign-in to the OpenBB Workspace, and follow the following steps:
- Go to the "Apps" tab
- Click on "Connect backend"
- Fill in the form with: Name: Open Data Platform URL: http://127.0.0.1:6900
- Click on "Test". You should get a "Test successful" with the number of apps found.
- Click on "Add".
That's it.
Table of Contents
1. Installation
The ODP Python Package can be installed from PyPI package by running pip install openbb
or by cloning the repository directly with git clone https://github.com/OpenBB-finance/OpenBB.git.
Please find more about the installation process, in the OpenBB Documentation.
ODP CLI installation
The ODP CLI is a command-line interface that allows you to access the ODP directly from your command line.
It can be installed by running pip install openbb-cli
or by cloning the repository directly with git clone https://github.com/OpenBB-finance/OpenBB.git.
Please find more about the installation process in the OpenBB Documentation.
2. Contributing
There are three main ways of contributing to this project. (Hopefully you have starred the project by now ⭐️)
Become a Contributor
- More information on our Developer Documentation.
Create a GitHub ticket
Before creating a ticket make sure the one you are creating doesn't exist already among the existing issues
Provide feedback
We are most active on our Discord, but feel free to reach out to us in any of our social media for feedback.
3. License
Distributed under the AGPLv3 License. See LICENSE for more information.
4. Disclaimer
Trading in financial instruments involves high risks including the risk of losing some, or all, of your investment amount, and may not be suitable for all investors.
Before deciding to trade in a financial instrument you should be fully informed of the risks and costs associated with trading the financial markets, carefully consider your investment objectives, level of experience, and risk appetite, and seek professional advice where needed.
The data contained in the Open Data Platform is not necessarily accurate.
OpenBB and any provider of the data contained in this website will not accept liability for any loss or damage as a result of your trading, or your reliance on the information displayed.
All names, logos, and brands of third parties that may be referenced in our sites, products or documentation are trademarks of their respective owners. Unless otherwise specified, OpenBB and its products and services are not endorsed by, sponsored by, or affiliated with these third parties.
Our use of these names, logos, and brands is for identification purposes only, and does not imply any such endorsement, sponsorship, or affiliation.
5. Contacts
If you have any questions about the platform or anything OpenBB, feel free to email us at support@openbb.co
If you want to say hi, or are interested in partnering with us, feel free to reach us at hello@openbb.co
Any of our social media platforms: openbb.co/links
6. Star History
This is a proxy of our growth and that we are just getting started.
But for more metrics important to us check openbb.co/open.
7. Contributors
OpenBB wouldn't be OpenBB without you. If we are going to disrupt financial industry, every contribution counts. Thank you for being part of this journey.