mirror of
https://github.com/OpenBB-finance/OpenBB.git
synced 2026-11-03 07:51:49 +00:00
* Drop Python 3.10 support
Python 3.10 reached end of life on 2026-10-01, and the patched releases of
Pillow (13.0.0) and filelock (>=4.2.1) require Python >=3.11, so the 3.10
resolution fork kept vulnerable versions in every lockfile.
- requires-python = ">=3.11,<4" in all pyproject.toml files, the
cookiecutter template, and the CLI codegen project template
- CI: drop the ubuntu 3.10 matrix rows, move the macOS/Windows minimum
rows and the lint jobs to 3.11, drop 3.10 from the nox sessions
- READMEs: state 3.11 as the minimum supported version
* Relock with patched certifi, filelock, virtualenv, Pillow, and fastmcp
Regenerate all 38 uv.lock files against requires-python >=3.11 and upgrade
only the packages with open Dependabot advisories:
- certifi 2026.7.22 -> 2026.10.23 (GHSA-6q48-6c7w-9gw2, compromised emSign CAs)
- virtualenv 21.14.7 -> 21.14.13
- filelock 4.1.0/4.2.0 -> 4.2.4
- Pillow 12.3.0 -> 13.0.0
- fastmcp / fastmcp-slim 4.1.0 -> 4.1.3
All other changes are removed Python 3.10-only resolution forks; no other
package changes version for Python 3.11+.
* desktop: bump zod, @hookform/resolvers, and vitest
- zod ^3.25.76 -> ^4.6.7 (GHSA-mrhx-c7xc-m3w5; no patched 3.x exists)
- @hookform/resolvers ^3.10.0 -> ^5.9.2 for zod 4 support
- vitest ^4.1.11 -> ^4.1.12 (@vitest/mocker GHSA-qxg6-89mg-rqv8,
GHSA-xp26-3454-mjgp)
- override zod to the root version so @openbb/ui-pro, which declares
zod ^3 but never imports it, does not pull in a second, vulnerable copy
* desktop: remove Python 3.10 from environment pickers
- version pickers in InstallComponents and AddExtensionSelector start at 3.11
- create_environment_from_requirements accepts 3.11 through 3.14 and falls
back to 3.12 otherwise (previously 3.10 through 3.13)
- component tests select 3.11 instead of 3.10
* Remove Python 3.10 tomli fallbacks
With requires-python >=3.11, tomllib is always available, so the
version-conditional tomli imports are dead code.
- import tomllib directly in the cli and core config loaders, the
mcp_server and platform_api config validators, dev_install.py, and
the cli and cookiecutter tests; dev_install.py no longer pip-installs
tomli on the fly
- drop the tomli>=2.0; python_version<'3.11' dependency from cli, core,
mcp_server, and platform_api, plus platform_api's backport comment
- raise the fake-extension fixtures in cli/conftest.py,
core/integration/conftest.py, and the charting test metadata to
>=3.11
- relock cli, core, mcp_server, and platform_api; only the tomli
requires-dist entry is removed and resolution markers are reordered,
no package versions change
* Target Python 3.11 in ruff and ty for cli, core, mcp_server, platform_api, cookiecutter
With ruff target-version py310 and ty python-version 3.10, both tools
reject an unconditional `import tomllib`: ty reports it as unresolved
(exit 1) and ruff's isort classifies it as third-party. Raise the targets
in the projects that now import tomllib directly, and in the root
ruff.toml that governs dev_install.py.
- ruff target-version = "py311" and ty python-version = "3.11" in cli,
core, mcp_server, platform_api, and cookiecutter; root ruff.toml
target-version = "py311"
- UP042: OutputMode, ChartLifecycle, MCPType, and HTTPMethod become
StrEnum; every consumer uses .value or == comparisons, so only str()
and format() output change
- UP017: datetime.timezone.utc -> datetime.UTC (ruff autofix) in the cli
dispatchers, the cli test generator, and a core test
* Fix ruff and ty failures in packages this PR touches
CI installs unpinned dependencies, so the lint jobs ran against
pandas 3.1.0, ruff 0.17.2, and ty 0.0.91.
- cli/conftest.py: guard the find_spec("openbb") lookup so ty no longer
reports an Optional ModuleSpec/origin (failing Lint openbb-cli)
- quantitative: pandas 3.1 types Index.max() as object; cast max_date to
Timestamp before period_start in attribution, factors, and
risk_decomposition (failing ty)
- federal_reserve: use Series(...).dt.date instead of
DatetimeIndex.date so neither pandas 3.0 nor 3.1 needs a ty: ignore
(pandas 3.1 made the existing ignores unused, failing ty)
- core tests: type the filter_by_dates doubles as Data subclasses and
cast the deliberate bad arguments in test_helpers.py; apply ruff format
to test_docstring_generator_helpers.py
- platform_api README: apply ruff format to the Python code blocks
* Fix pandas 3.1 deprecations failing fred, sec, and eia tests
These suites turn warnings into errors, and pandas 3.1.0 adds
Pandas4Warning deprecations for several patterns they use. Every change
also passes with the locked pandas 3.0.6.
- fred, sec: replace inplace=True sort_values/reset_index/rename/
set_index/drop with reassignment
- fred balance_of_payments, sec as_filed_widget: replace fillna with a
string on float columns by astype(object).where(notna, ...)
- sec: build quarter start dates from ISO strings instead of parsing
"2024Q2"-style strings; use the DataFrame constructor instead of
DataFrame.from_records for column dicts; pad CIK lookup rows to two
fields instead of constructing a ragged DataFrame
- eia: read EIA workbooks with the calamine engine (xlrd is deprecated);
replace the xlrd dependency with python-calamine and relock; calamine
workbooks are not safe for concurrent reads, so the petroleum status
report serializes its sheet reads with a lock
* imf: fall back to the published catalog when the IMF API is unreachable
imf_cache.json.xz is generated at build time and is not committed, so
every CI build of openbb-imf needed a live api.imf.org. The only fallback
was actions/cache, and caches saved by pull_request runs are scoped to
that PR, so a new PR never had one. With api.imf.org returning
"503 no healthy upstream" during IMF's data portal maintenance window,
the build failed.
When live generation fails on a non-forced build, the hook now copies
imf_cache.json.xz from the latest openbb-imf wheel on PyPI, after
checking the wheel's sha256 against the digest PyPI publishes. Builds
with OPENBB_IMF_FORCE_CACHE_REBUILD=1, which the publish workflow sets,
still fail hard, so a release never ships a stale catalog.
---------
Co-authored-by: dlee-bq <325002271+dlee-bq@users.noreply.github.com>
223 lines
7.1 KiB
Python
223 lines
7.1 KiB
Python
"""Settings model."""
|
|
|
|
import os
|
|
from enum import Enum, StrEnum
|
|
from typing import Any, Literal
|
|
from zoneinfo import available_timezones
|
|
|
|
from dotenv import dotenv_values, set_key
|
|
from openbb_core.app.version import get_package_version
|
|
from pydantic import BaseModel, ConfigDict, Field, model_validator
|
|
|
|
all_timezones = sorted(available_timezones())
|
|
|
|
from openbb_cli.config.constants import AVAILABLE_FLAIRS, ENV_FILE_SETTINGS
|
|
|
|
VERSION = get_package_version("openbb-cli")
|
|
|
|
|
|
class OutputMode(StrEnum):
|
|
"""Output mode for displaying results."""
|
|
|
|
rich = "rich"
|
|
json = "json"
|
|
tsv = "tsv"
|
|
html = "html"
|
|
|
|
|
|
class SettingGroups(Enum):
|
|
"""Setting types."""
|
|
|
|
feature_flags = "feature_flag"
|
|
preferences = "preference"
|
|
|
|
|
|
class Settings(BaseModel):
|
|
"""Settings model."""
|
|
|
|
VERSION: str = VERSION
|
|
|
|
TEST_MODE: bool = False
|
|
DEBUG_MODE: bool = False
|
|
DEV_BACKEND: bool = False
|
|
|
|
PREVIOUS_USE: bool = False
|
|
|
|
FILE_OVERWRITE: bool = Field(
|
|
default=False,
|
|
description="whether to overwrite Excel files if they already exists",
|
|
json_schema_extra={
|
|
"command": "overwrite",
|
|
"group": SettingGroups.feature_flags.value,
|
|
},
|
|
)
|
|
SHOW_VERSION: bool = Field(
|
|
default=True,
|
|
description="whether to show the version in the bottom right corner",
|
|
json_schema_extra={
|
|
"command": "version",
|
|
"group": SettingGroups.feature_flags.value,
|
|
},
|
|
)
|
|
USE_INTERACTIVE_DF: bool = Field(
|
|
default=False,
|
|
description="display tables in interactive window (when available)",
|
|
json_schema_extra={
|
|
"command": "interactive",
|
|
"group": SettingGroups.feature_flags.value,
|
|
},
|
|
)
|
|
OUTPUT_MODE: Literal["rich", "json", "tsv", "html"] = Field(
|
|
default="tsv",
|
|
description="output display mode (rich=terminal table, json=JSON, tsv=DataFrame string, html=browser)",
|
|
json_schema_extra={
|
|
"command": "output",
|
|
"group": SettingGroups.preferences.value,
|
|
},
|
|
)
|
|
USE_CLEAR_AFTER_CMD: bool = Field(
|
|
default=False,
|
|
description="clear console after each command",
|
|
json_schema_extra={
|
|
"command": "cls",
|
|
"group": SettingGroups.feature_flags.value,
|
|
},
|
|
)
|
|
USE_DATETIME: bool = Field(
|
|
default=True,
|
|
description="whether to show the date and time before the flair",
|
|
json_schema_extra={
|
|
"command": "datetime",
|
|
"group": SettingGroups.feature_flags.value,
|
|
},
|
|
)
|
|
USE_PROMPT_TOOLKIT: bool = Field(
|
|
default=True,
|
|
description="enable prompt toolkit (autocomplete and history)",
|
|
json_schema_extra={
|
|
"command": "promptkit",
|
|
"group": SettingGroups.feature_flags.value,
|
|
},
|
|
)
|
|
ENABLE_EXIT_AUTO_HELP: bool = Field(
|
|
default=True,
|
|
description="automatically print help when quitting menu",
|
|
json_schema_extra={
|
|
"command": "exithelp",
|
|
"group": SettingGroups.feature_flags.value,
|
|
},
|
|
)
|
|
ENABLE_RICH_PANEL: bool = Field(
|
|
default=True,
|
|
description="enable colorful rich CLI panel",
|
|
json_schema_extra={
|
|
"command": "richpanel",
|
|
"group": SettingGroups.feature_flags.value,
|
|
},
|
|
)
|
|
TOOLBAR_HINT: bool = Field(
|
|
default=True,
|
|
description="displays usage hints in the bottom toolbar",
|
|
json_schema_extra={
|
|
"command": "tbhint",
|
|
"group": SettingGroups.feature_flags.value,
|
|
},
|
|
)
|
|
SHOW_MSG_OBBJECT_REGISTRY: bool = Field(
|
|
default=False,
|
|
description="show obbject registry message after a new result is added",
|
|
json_schema_extra={
|
|
"command": "obbject_msg",
|
|
"group": SettingGroups.feature_flags.value,
|
|
},
|
|
)
|
|
|
|
TIMEZONE: Literal[tuple(all_timezones)] = Field( # ty: ignore[invalid-type-form]
|
|
default="America/New_York",
|
|
description="pick timezone",
|
|
json_schema_extra={
|
|
"command": "timezone",
|
|
"group": SettingGroups.preferences.value,
|
|
},
|
|
)
|
|
FLAIR: Literal[tuple(AVAILABLE_FLAIRS)] = Field( # ty: ignore[invalid-type-form]
|
|
default=":openbb",
|
|
description="choose flair icon",
|
|
json_schema_extra={
|
|
"command": "flair",
|
|
"group": SettingGroups.preferences.value,
|
|
},
|
|
)
|
|
N_TO_KEEP_OBBJECT_REGISTRY: int = Field(
|
|
default=10,
|
|
description="define the maximum number of obbjects allowed in the registry",
|
|
json_schema_extra={
|
|
"command": "obbject_res",
|
|
"group": SettingGroups.preferences.value,
|
|
},
|
|
)
|
|
N_TO_DISPLAY_OBBJECT_REGISTRY: int = Field(
|
|
default=5,
|
|
description="define the maximum number of cached results to display on the help menu",
|
|
json_schema_extra={
|
|
"command": "obbject_display",
|
|
"group": SettingGroups.preferences.value,
|
|
},
|
|
)
|
|
RICH_STYLE: str = Field(
|
|
default="dark",
|
|
description="apply a custom rich style to the CLI",
|
|
json_schema_extra={
|
|
"command": "console_style",
|
|
"group": SettingGroups.preferences.value,
|
|
},
|
|
)
|
|
ALLOWED_NUMBER_OF_ROWS: int = Field(
|
|
default=20,
|
|
description="number of rows to show in rich table mode (does not apply to json/stdio/html modes)",
|
|
json_schema_extra={
|
|
"command": "n_rows",
|
|
"group": SettingGroups.preferences.value,
|
|
},
|
|
)
|
|
ALLOWED_NUMBER_OF_COLUMNS: int = Field(
|
|
default=5,
|
|
description="number of columns to show in rich table mode (does not apply to json/stdio/html modes)",
|
|
json_schema_extra={
|
|
"command": "n_cols",
|
|
"group": SettingGroups.preferences.value,
|
|
},
|
|
)
|
|
|
|
model_config = ConfigDict(validate_assignment=True)
|
|
|
|
def __repr__(self) -> str:
|
|
"""Return a string representation of the model."""
|
|
return f"{self.__class__.__name__}\n\n" + "\n".join(
|
|
f"{k}: {v}" for k, v in self.model_dump().items()
|
|
)
|
|
|
|
@model_validator(mode="before")
|
|
@classmethod
|
|
def from_env(cls, values: dict) -> dict:
|
|
"""Load settings from the persisted dotfile and ``OPENBB_*`` env vars.
|
|
|
|
Precedence (lowest to highest): the persisted ``.cli.env`` dotfile,
|
|
then ``OPENBB_*`` process env vars — which also carries TOML
|
|
``[settings]`` values promoted into the environment by
|
|
``apply_settings_to_env`` — then explicit constructor values.
|
|
"""
|
|
settings = {}
|
|
settings.update(dotenv_values(ENV_FILE_SETTINGS))
|
|
settings.update(
|
|
{k: v for k, v in os.environ.items() if k.startswith("OPENBB_")}
|
|
)
|
|
settings.update(values)
|
|
filtered = {k.replace("OPENBB_", ""): v for k, v in settings.items()}
|
|
return filtered
|
|
|
|
def set_item(self, key: str, value: Any) -> None:
|
|
"""Set an item in the model and save to .env."""
|
|
setattr(self, key, value)
|
|
set_key(str(ENV_FILE_SETTINGS), "OPENBB_" + key, str(value))
|