Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR contains the following updates:
>=1.10,<1.23→>=1.10,<1.24Release Notes
dlt-hub/dlt (dlt)
v1.23.0Compare Source
Breaking Changes
Streamlit dashboard removed (#3674 @rudolfix) — The legacy Streamlit-based pipeline dashboard (
dlt pipeline show) has been removed. It was a dead code for a long time.New
sources.<name>.<key>configuration lookup path (#3626 @rudolfix) — Source configuration now supports a compact layout. When a source's section name differs from its resource/source name, dlt now also looks upsources.<name>.<key>in addition to the fullsources.<section>.<name>.<key>path. For example, for a source registered under sectionchess_comwith namechess:This is breaking if you previously had values at
sources.<name>that were unrelated to this source — they will now be resolved where they were previously ignored.Highlights
AI Workbench (#3674 @rudolfix) — New
dlt aiCLI command group that turns dlt workspaces into AI-assisted development environments. Includes toolkit system for installing curated skill/rule bundles, pluggable MCP server architecture with composable features (pipeline, workspace, toolkit, secrets), and multi-agent support (Claude Code, Cursor, Codex).Relational normalizer optimization (#3626 @rudolfix) — Major performance improvements to JSON data normalization and schema evolution: 5x faster on flat data, ~2x on nested REST API data, ~1.8x on wide nested data. ISO timestamp parsing improved 2-3x by removing timezone conversions.
Iceberg table properties (#3699 @rudolfix) — Adds support for setting Iceberg table and namespace properties via the
adapterand configuration.Core Library
override_data_pathoption to DuckLake ATTACH (#3709 @udus122) — Newoverride_data_pathconfiguration option that appendsOVERRIDE_DATA_PATH trueto the ATTACH statement, allowing the currentDATA_PATHto override the path stored in catalog metadata.PageNumberPaginatorConfig,OffsetPaginatorConfig, andJSONResponseCursorPaginatorConfig.os.path.commonprefix()withos.path.commonpath()inFileStorage.is_path_in_storage()to correctly validate path containment using path segments instead of characters.dev_modeflag in pipeline local state so it persists acrossdlt.attach()calls. Detects dev→non-dev transitions and resets working folder cleanly.HF_ENDPOINTenv var for card operations.start_out_of_rangeflag withrange_start="open"(#3708 @AyushPatel101) — Correctly setsstart_out_of_range=Truewhen a row's cursor value equalsstart_valuewithrange_start="open", fixing delayedcan_close()in descending-order pipelines.dataset_name=None(#3710 @Travior) — Handles the case wheredataset_nameisNoneinLanceDBSqlClient.create_view, preventingNoneprefix in view names.Docs
New Contributors
Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR was generated by Mend Renovate. View the repository job log.