Releases: taosdata/TDengine
Releases · taosdata/TDengine
3.4.1.0
Behavior change and compatibility
Features
- feat: mcp server for TDengine TSDB
- feat: support external window query with time range explicitly specified by subquery, suitable for complex analysis scenarios such as cross-event correlation, window reuse and hierarchical filtering
- feat: support uncorrelated scalar subquery
- feat: add support for the ANY/SOME/ALL/EXISTS/NOT EXISTS operators
- feat: support batch modification of child table tag values
- feat: stream adds support for scheduled calculation by natural week, month, quarter, and year dimensions
- feat: add the timeout notification function for stream when no new data is written to source child tables/virtual child tables
- feat: subscription function adds support for metadata changes of virtual tables
- feat: data subscription supports token-based login
- feat: add identity authentication functions
- enh: add support for CAST and SUBSTR functions on BLOB type
- feat: support the lag、lead、fill_forward function
- feat: the fill clause of interval and interp supports surround time range
- feat: support scalar subqueries without the FROM clause
- feat: support non-correlated subqueries in IN operator
- feat: taosd adds support for the data repair mode
- feat: TDgpt adds support for the multivariate anomaly detection feature
- feat: taosX add task owner privileges
- feat: taosX support system & object level privileges
- feat: taosX new data-in pSpace
- feat: OPC-UA connection test support failover
- feat: kafka transformer support filter to split messages to multiple schema
- feat: KingHistorian dataset auto update
- feat: KingHistorian support non-stop migration when end timestamp set empty
- feat: go websocket subscription support token auth
- feat: Go REST connector support TOKEN auth
- feat: rust subscription support token auth
- feat: c websocket subscription support token auth
- feat: taosdump now support decimal data type
- feat: taosdump now support BLOB data type
- feat: taosgen support windows
- feat: taosgen support setting log options in config file
- feat: taosKeeper add endpoint for exporting all metrics
- feat: Explorer support token response in login
- feat: explorer support totp auth
- feat: explorer support bearer token auth
- feat: support multitple brokers in MQTT task
Enhancements
- enh: taosX now works on Windows
- enh: add support for TDgpt functionality on the Windows platform
- enh: add support for stream functionality on the Windows platform
- enh: improve the query performance of aggregate queries with GROUP BY on virtual super tables
- enh: optimize the query performance of interval、session、event windows for virtual super tables
- enh: optimize query performance when virtual tables reference many columns of physical tables
- enh: optimize the query performance of state windows for virtual super tables
- enh: push down the time filter conditions of non-correlated subqueries to improve the batch query performance of virtual tables
- enh: return clear error information when virtual table creation fails, such as type matching failure of a specific column
- enh: add reference verification capabilities between virtual tables and source tables, including reference relationship storage, source table change verification, reference relationship query and virtual table availability verification functions
- enh: improve the performance of last_row queries
- enh: support dynamic adjustment of LRU shard count to improve the execution performance of Last queries
- enh: RESTORE DNODE command supports specifying VGROUP ID
- enh: Improve the subscription speed in the scenario of interlace writing
- enh: add support for the IN operator in subqueries of stream
- enh: add support for ANY/SOME/ALL/EXISTS/NOT EXISTS operators in stream
- enh: add support for subqueries in stream computing scenarios
- enh: add support for child table addition/deletion, child table tag value modification, and column mapping relationship adjustment to the trigger mechanism of virtual super tables in stream
- enh: stream supports multi-group batch computation
- enh: support batch deletion of stream computing
- enh: add NODELAY_CREATE_SUBTABLE option for stream to create result tables in advance when no data is written
- enh: Improve the performance when subqueries are used as primary key filter conditions
- enh: optimize the fill(prev/next/near/linear) filling syntax of the interp function to support filling with non-NULL values before/after the target position
- enh: join/window join supports operations based on selection function resultsets
- enh: display query execution progress for the SHOW QURIES statement
- enh: upgrade the explain analyze function, fix the deviation in operator execution time statistics, add various operator indicators, improve result readability
- enh: optimize the reporting logic of slow logs to improve the accuracy and timeliness of reporting
- enh: provide clearer error messages for SQL statements
- enh: correct comparison results of NULL values in the IN operator
- enh: add security protection capabilities against SQL injection
- enh: add protection capabilities against Denial of Service (DoS) attacks
- enh: add protection capabilities against overflow attacks
- enh: add the capability of forced overwriting after sensitive data deletion
- enh: add support for the configuration parameter AuditSaveInSelf; when enabled, audit information is recorded without going through taoskeeper
- enh: add support for the enableGrantLegacySyntax parameter; when set to 1, the authorization syntax of v3.4 is compatible with v3.3
- enh: remove the forceReadConfig parameter
- enh: optimize the timer logic after system time changes
- enh: when the password is incorrect in the subscription scenario, return the same "Authentication failure" error message as that of taos connection
- enh: support modifying the PASSWORD_LIFE_TIME, PASSWORD_REUSE_TIME, PASSWORD_REUSE_MAX, and ALLOW_TOKEN_NUM attributes of the ROOT user, and set the minimum password validity period to 1 day by default
- enh: add the configuration item enableAdvancedSecurity (default value is 0), which disables the password expiration, strong password and password rotation policy when set to 0(this behavior is consistent with v3.3)
- enh: prohibit connection between Community Edition and Enterprise Edition
- enh: TDgpt server uses Gunicorn instead of uWSGI as the service driver
- enh: taos shell supports logging in via token
- enh: taosdump add support for stmt2
- enh: auto review session in explorer
- enh: Explorer Licence page refinement
- enh: improve explorer ui for data-in tasks and transform
- feat: explorer can enable CAPTCHA on login
- enh: Explorer auto scale json parser input
- enh: Explorer activation input auto scale
- enh: C/Rust websocket connector security enhancement
- enh: JDBC doc recommend use varcharAsString=true for taos-ws
- enh: OPC custom tag support special chars replacing
- enh: taosX backup allow backup checkout when offset checking failed
Fixes
- fix: taosX breakpoint db lock race condition issue with multiple csv
- fix: kakfa data-in use full list json instead of json items
- fix: automatically trim spaces around sub table name in transform page
- fix: long parser error mislead root cause
- fix: OPCDA dataset collection possibly interrupt
- fix: XNODE replication task can't start
- fix: unable to select target database in tsdb import task dialog
- fix: opcda retrieves empty data points
- fix: TDinsight taosX panel task info error
- fix: task not restored in other xnodes when one stopped
- fix: taosX sync error with varbinary/blob datatype
- fix: SHOW XNODE TASKS should be ordered by id
- fix: vgroups information is not included when taosdump restores the database
- fix: the SQL statement content queried from the system table ins_streams is incomplete
- fix: "Invalid value in client" error is triggered when querying virtual super tables
- fix: the query reports a "Planner slot key not found" error when querying the timestamp and data column of a virtual child table if the data column does not reference the source table
- fix: unexpected task status for query migration tasks
- fix: the filter conditions for Agg aggregation results in stream do not take effect
- fix: taosd crashes when a virtual table executes an aggregation query with the partition by tag clause
- fix: query exception caused by inconsistent column types between virtual child table and mapped source table (usually due to adding or deleting columns with the same name)
- fix: crash when querying with parameter binding on virtual tables
- fix: the occasional crash issue when querying virtual super tables
- fix: stream computing sliding(0s) incorrectly returns success
- fix: potential crash when the SAMPLE function processes data exceeding the int32 range
- fix: the IF EXISTS option does not take effect when using DROP TSMA
- fix: no results returned when explain parses subqueries
- fix: stream fails to calculate historical data when using FILL_HISTORY
- fix: schema and tag synchronization issue when the stream result table already exists
- fix: taosd crashes when executing a Last query to read BLOB type data
- fix: taosc and taosd crashes when the trim function is called in an expression or function
- fix: data is still output when the result set of queries containing JOIN operations is empty in stream
- fix: query result is incorrect when a constant is used as the start time filter condition in a st...
3.4.0.9
Behavior change and compatibility
Features
- feat: taosAdapter add token support for subscription
- feat: taosdump support import/export virtual tables
Enhancements
- enh: massive ui enhancement for explorer
- enh: optimize the impact of frequent child table tag modifications on data writing when child tables of super table have subscriptions
- enh: table name template support expression
- enh: improve performance of virtual table queries with the tbname column
- enh: reduce log files to 3
- enh: adjust the maximum value of configuration parameter supportVnodes from 4096 to 1024
- fix: CREATE XNODE TASK error message refinement
Fixes
- fix: Kafka connection check log refinement
- fix: the GRANT ALL permission does not take effect when granted to a specific stream
- fix: the START/STOP STREAM permission does not take effect after being granted
- fix: failed to drop stream when having the DROP STREAM permission
- fix: taosd crashes when querying a view without permission
- fix: the ALTER VIEW permission does not take effect after being granted
- fix: auditor fails to view the complete user information
- fix: stream crashes when reading the timestamp of a table with a varchar-type composite primary key
- fix: failed to drop role using the IF EXISTS syntax
- fix: the error message is unclear when permissions are missing
- fix: port occupancy keeps increasing on macOS when calling the taos_query method of the native connection
- fix: in stream subquery, JOIN statements falsely report the error of missing timestamp primary key when using time placeholders such as _twstart as the first column of query results
- fix: timestamp columns in query results are incorrectly set when stream subquery contain interval windows
- fix: audit database creation operations fails to return when the data encryption key is not set
- fix: ordinary users lack write permission without explicit authorization after creating ordinary tables
- fix: modify the names of newly added encryption functions to keywords to resolve the issue of keywords being incorrectly written as actual content into the database during data writing
- fix: timetruncate function occasionally returns no results
- fix: unexpected error log when create xnode
- fix: expand parser length to 48k in taosX
- fix: no response in explorer tmq connection check
- fix: str len calculation error cause create clause error with invalid raw data len
- fix: create task via agent error
- fix: Explorer alert syntax error when switching tag to share topics
- fix: xnode task stuck at created status
- fix: Grid auto scalable in Explorer
- fix: reading tinyint(1)/boolean type for mysql
- fix: memory leak caused by unreleased auto table creation requests during STMT data writing
- fix: explorer backup task create error
- fix: opcplc special point id cause data points list error
- fix: data in tasks api respond as empty after created successfully
- fix: Explorer batch operation api error
- fix: build task update sql error in explorer
- fix: fast-xml-parser CVE-2026-25896
- fix: xnoded role time check error cause exit unexpectedly
- fix: the merge logic processes data incorrectly when stream handles out-of-order data of trigger tables with primary keys
- fix: client crashes when querying decimal data type using stmt
- fix: the scan interval is judged incorrectly when sliding < interval during stream sliding trigger
- fix: during the stream trigger phase, when pending calculation requests are accumulated, max_delay triggering resets the waiting time, resulting in the calculation not being triggered for a long time
- fix: taosX compatible with 3.4.x information_schema query result changes
- fix: invalid user login cause adapter memory increase
What's Changed
- fix: group_concat type error by @dapan1121 in #34443
- fix: remove asan and split cases by @dapan1121 in #34456
- fix: assign ownerId for normal table during test_priv_basic.py refactoring by @kailixu in #34459
- fix: set main to new-framework-test.yml by @tomchon in #34470
- feat(taosdump): taosdump supports dumping in/out virtual table by @YamingPei in #34431
- chore(keeper): add license and security check by @qevolg in #34454
- enh(tmq): optimize update tablelist for topic of stable with filter when alter tag by @wangmm0220 in #34417
- docs: update release note for 3.4.0.2 in office web by @feici02 in #34461
- [6755488313]: add-check-key by @cadem in #34464
- docs: auto detect version by @danielclow in #34467
- fix: execute taos shell timeout 10->120s by @DuanKuanJun in #34466
- fix: mergeAlignedInterval pkts error by @Tony2h in #34473
- opti(tmq): update tablelist if alter tag in tmq by @wangmm0220 in #34483
- enh(test): robustness for ut case tfs_test.cpp by @kailixu in #34484
- enh(test): robustness for ut case tfs_test.cpp by @kailixu in #34485
- fix: [6769589569] test-show-vgroups-fail by @cadem in #34486
- merge: from 3.3.6 to 3.3.8 by @wangmm0220 in #34477
- docs(jdbc): release 3.8.1 and update demo by @sheyanjie-qq in #34433
- fix(xnode): increase the length of parser column and config column by @acerDebugman in #34491
- refactor(build): use conan to handle dependencies and vulnerability check by @zitsen in #34489
- fix(tmq): cases error if split vnode not completed by @wangmm0220 in #34487
- fix: parse error while use NUL without quote. by @xiao-77 in #34474
- check shell case description by @minhuinie in #33399
- fix: ci case results depend on sorting, with probability of error by @facetosea in #34496
- Update container_build.sh by @tomchon in #34500
- chore: remove avro/jansson/zlib/snappy source code by @zitsen in #34501
- fix: stream primary key issue by @JinqingKuang in #34493
- enh: [6747163479] Ts cond push down in virtual table query by @Simon9997 in #34455
- fix: timetruncate results are abnormal when offset by natural month by @facetosea in #34442
- Fix/time truncate3.6 by @facetosea in #34463
- fix(xnoded): fix error msg when creating xnode by @acerDebugman in #34503
- merge: from 3.3.6 to 3.3.8 by @guanshengliang in #34505
- fix 3.3.8 to main conflict by @Simon9997 in #34510
- enh: use default taospy for tdgpt by @jiajingbin in #34502
- Test/maim/storage encrypt by @xiao-77 in #34426
- fix: cases cases/11-Functions/01-Scalar/test_scalar_crypto.py failed. by @xiao-77 in #34508
- fix: update workflow reference and improve return value checks in CI scripts by @tomchon in #34478
- fix(rbac): refactor docs, permission error, db owner and audit table[manual-only] by @kailixu in #34498
- fix:return void by @Pengrongkun in #34507
- fix: test_sql_length_boundary by @Pengrongkun in #34511
- fix: set max value of supportVnodes from 4096 to 1024. by @xiao-77 in #34497
- fix(stream): core dump in the interface of getting last ts if there is a varchar in primary key by @wangmm0220 in #34499
- docs: add database compact parameter descriptions by @danielclow in #34515
- fix(taos): semphore is not destroy by @wangmm0220 in #34492
- merge/3.3.8tomain by @wangmm0220 in #34494
- feat(service): add OOMScoreAdjust to taosd.service for better memory management by @tomchon in #34517
- fix(tests): comment out specific test cases in cases.task by @tomchon in #34518
- fix(build): remove backup of cargo config in container build script by @tomchon in #34522
- fix: ensure OOMScoreAdjust is set for taosd service by @tomchon in #34526
- fix(rbac): catalog sub task and view/stream privileges[manual-only] by @kailixu in #34506
- fix(tmqtt/producer): fix topic producer retvals by @stephenkgu in #34525
- fix(tmqtt/logging): fix retval checkings by @stephenkgu in #34530
- fix: docs ...
3.4.0.2
Behavior change and compatibility
Features
- feat: Automatically create xnode during TSDB initialization
- feat: Explorer License page show machine code
- feat: taosX-agent support xnode ha
- feat: taosX support parquet files import
- feat: add SQL recording for STMT in adapter
- feat: Rust native connector support STMT2
- feat: support dual conditions of duration and row count for true_for judgment in event and state windows of stream and batch query
Enhancements
- enh: STMT query supports the binding of the interval parameter
- enh: provide clearer error messages for SQL statements
- enh: add column created_by/labels for XNODE TASK
- enh: optimize the login verification logic to force root users who log in with the default password to change their passwords
- enh: improve the processing mechanism of data encryption for bse and other files
- enh: add notification mechanism related to user tokens
- enh: support upgrading clusters with old-version data encryption mechanism to new-version one
- enh: support creating TOTP secrets using the create totp_secret syntax
- enh: Support both IPv4 & IPv6 protocol stacks
- enh: support updating expiration time and policy for data encryption keys
- enh: allow any chars in MQTT topic
- enh: rename lag function to fill_forward and redevelop Lag function compatible with MySQL in follow-up
- enh: improve performance of cols + last queries on virtual tables with only one original table
- enh: support modifying permission control for users
- enh: improve permission control for views and audits
- enh: handle permission compatibility from version 3.3 to 3.4
- enh: prohibit users from tampering with configuration files after data encryption takes effect
- enh: optimize the notification content of stream period triggers by adding the trigger start time and end time fields (retaining the windowStart and windowEnd field names)
- enh: adjust the upper limit of the original tables referenced by virtual tables from 1000 to 2000
- enh: reduce the computing latency when stream query statements contain virtual table tag filter conditions
- enh: optimize the syntax of stream statements to support the use of placeholders such as _twstart in the ORDER BY clause
- enh: optimize the execution logic of outer join queries to resolve the issue where limit does not take effect when order by is not specified
Fixes
- fix: incorrect results when executing the show create table statement on virtual tables
- fix: null pointer error when InfluxDB schema changes
- fix: crash in stream caused by improper handling of heartbeat messages after mnode leader switchover
- fix: memory leak that occurs when UDF function initialization fails
- fix: influxdb error with backslash syntax in taosX
- fix: incorrect results when invoking the concat function in stream
- fix: taoskeeper allow special chars in password
- fix: inaccurate scheduled execution time for multi-level storage migration tasks
- fix: migrate stuck in AVEVA Historian data-in
- fix: incorrect results when the data in individual group windows is all NULL values during multi-group processing in state windows
- fix: abnormal calculation results after deleting and rebuilding the result subtable of stream
- fix: the client may crash when the concurrent write volume of STMT is high
- fix: incorrect default time configuration issue for password reuse restrictions
- fix: error while performing JOIN operations with subqueries without the FROM clause
- fix: MySQL DataIn task may blocking when few data rows
- fix: remove duplicate error details
- fix: trigger logic error of the true_for option in stream when out-of-order data is written
- fix: taosX native connection tmq error message
- fix: possibly stuck on systemctl stop taosd caused by xnoded
- fix: subscriptions created by a user cannot be canceled after the user is deleted
- fix: crash while combined use of group_concat function and count_window
- fix: fix create task error for opc
- fix: failed to set user permissions in taosExplorer of v3.4.0 version
What's Changed
- docs: update xnode port by @zitsen in #34152
- docs: update release note for 3.4.0.0 in office web by @feici02 in #34153
- docs: minor corrections by @danielclow in #34159
- feat(docs): add taosx datain Pulsar/Pulsar-Tuya docs by @acerDebugman in #34161
- enh: privilege parse and check create stream by @kailixu in #34143
- chore(jdbc): update jdbc version by @sheyanjie-qq in #34157
- fix(udf): destory data block in the error case by @stephenkgu in #34140
- fix(stream): add resetting tagScan logic & fix parse value error if value is integer & fix tmqError.py by @wangmm0220 in #34124
- feat: support create/drop totp_secret statement by @localvar in #34162
- enh: update keyword list by @localvar in #34177
- fix: groupagg with slimit by @facetosea in #34083
- docs: add connector compatibility desc by @sheyanjie-qq in #34181
- docs: remove tools and old downloads by @danielclow in #33927
- fix: enhance memory leak detection by adding ignore patterns and refactoring count functions by @tomchon in #34176
- Merge stream performance scene test script by @DuanKuanJun in #34139
- fix:add 3.3.8 ci test by @tomchon in #34189
- docs: update 2026 roadmap by @guanshengliang in #34194
- merge: from 3.3.6 to 3.3.8 by @guanshengliang in #34186
- fix: update branch references to 3.3.8 in workflow files by @tomchon in #34192
- fix: 6574866934 by @Pengrongkun in #34171
- fix:insert into stb subquery cross dnodes by @Pengrongkun in #34131
- merge: from 3.3.8 to main branch by @guanshengliang in #34196
- fix(udf): no decoding with error rsp by @stephenkgu in #34180
- fix: failed to run test_write_insert_select.py by @guanshengliang in #34211
- fix: no from query subplan type error by @dapan1121 in #34199
- docs: format udf doc by @danielclow in #34210
- fix:clientHbReq deserialize problem by @Pengrongkun in #34198
- fix: explain with no aggregate function window crash issue by @dapan1121 in #34201
- feat:stmt2 query free result by adapter by @Pengrongkun in #34155
- enh:stmt2 query free result by adapter by @Pengrongkun in #34214
- feat:stmt2 query free result by adapter by @Pengrongkun in #34200
- fix: correct syntax for checking existence of docs-c-test log file by @tomchon in #34191
- docs(log): modify doc of monitor by @wangmm0220 in #34213
- fix(client): heartbeat msg incompatible by @wangmm0220 in #34207
- fix(client): heartbeat msg incompatible by @wangmm0220 in #34208
- fix(client): fix the logic of reading slow log file if thers are \0\0 or other datas format in slow log file by @wangmm0220 in #34206
- Fix:client hb core by @Pengrongkun in #34221
- fix: wrong default value for password reuse time by @localvar in #34212
- feat: add option to force change default password by @localvar in #34165
- fix(stream/fetch): fix stream data fetching from runner by @stephenkgu in #34178
- fix(stream/fetch): fix stream data fetching from runner by @stephenkgu in #34170
- merge: from 3.3.6 to 3.3.8 by @guanshengliang in #34222
- fix: 3 bugs related to token and user by @localvar in #34219
- merge: from 3.3.8 to main by @guanshengliang in #34225
- fix: big offset error by @facetosea in #34183
- feat: add generate encrypt key at test framework. by @xiao-77 in #34182
- fix: allow_datetime cannot be set during create user by @localvar in #34226
- merge: from 3.3.6 to 3.3.8 branch by @guanshengliang in #34231
- enh(meta entry cache): cache switch and size control by @stephenkgu in #34014
- fix(query): init the stt block reader when returning the clean stt/da… by @hjxilinx in #34076
- case: submit test_user_security.py by @DuanKuanJun in https://github.com/taosdata/TDengine/pull...
3.4.0.0
Behavior change and compatibility
Features
- feat: adapter add connector info attribute in ws connection
- feat: C websocket support ssl/tls connection params
- feat: support taosAdapter instances register and query
- feat: parse and write any JSON data to database
- feat: add rust connector benchmark tool
- feat: support taosX high-availability and Kafka task load balancing
- feat: TDgpt supports row correlation analysis functions such as dtw, dtw_path and tlcc
- feat: data transmission supports SASL mechanism and resource control [Enterprise Edition]
- feat: data storage supports full transparent encryption [Enterprise Edition]
- feat: support multi-factor authentication (MFA) and multiple login security policies [Enterprise Edition]
- feat: support RBAC-based permission architecture [Enterprise Edition]
- feat: support hierarchical auditing and permission control [Enterprise Edition]
- feat: Support SM4_ENCRYPT, SM4_DECRYPT, AES_ENCRYPT, AES_DECRYPT, MD5, SHA, SHA1, SHA2, MASK_FULL, MASK_PARTIAL, MASK_NONE, FROM_BASE64 and TO_BASE64 functions
- feat: event window triggering of stream supports sub-event windows
- feat: Explorer add support for OAuth 2.0 and OIDC SSO
- feat: taosAdapter support customized SQL rejection rules
- feat: add identity authentication functions
Enhancements
- enh: increase the maximum number of columns supported by virtual tables to 32767
- enh: prohibit sorting by aggregate functions in non-aggregate queries
- enh: state windows now support specifying a "zero state" via zeroth_state, skipping computation and output for windows in this state.
- enh: optimize the error message when taosc initialization fails due to insufficient write permissions for the log file directory
- enh: stream now supports interp and percentile functions
- enh: reduce resource consumption of trigger data and computation data reading in stream computing
- enh: prohibit the use of duplicate timestamps in state_window, count_window and event_window on super tables
- enh: improved the exit handling logic of taosmqtt to achieve a more graceful shutdown and resource release
- enh: set the global timezone to reduce lock contention related to time conversion during concurrent queries and writes
- enh: window query do not require mandatory aggregate functions, support including only pseudo-columns like _wstart and tbname
- enh: Linux tar package supports non-root installation of TDengine TSDB with custom install path
- enh: after modifying tag columns, support data subscription to take effect without reconstruction by executing the RELOAD TOPIC command
- enh: support recording operations such as query and deletion in audit logs
- enh: add the client version number field to the show connections command.
- enh: add status and note fields to the ins_anodes_full table for real-time feedback on model and algorithm status
- enh: add two Hints parameters (WIN_OPTIMIZE_BATCH and WIN_OPTIMIZE_SINGLE) to improve the state window query performance of virtual tables
- enh: support encryption algorithm management [Enterprise Edition]
- enh: add clock check mechanism for communication between clusters
- enh: add support for virtual table queries in stmt2
- enh: compact command now support the force option
- enh: improve the query performance of aggregate and selection functions for virtual super tables
- enh: support for user login failure policies
- enh: optimize OPC-DA collection and auto-reconnection
- enh: execution plan supports displaying tag indexes
- enh: add the 'is_ready' column to the show vgroups command
- enh: add bool type validation during stmt2 writing
- enh: adjust the logs of stmt2 to facilitate problem troubleshooting
- enh: event window of stream generates window opening notifications only when the true_for condition is met
- enh: optimize the usage logic of read-write locks in RPC communication
- enh: return immediately when updating sub-table tags if the tag value remains unchanged, avoiding frequent updates to the sub-table set of data subscriptions
Fixes
- fix: the latest WAL version number was not used when stream triggered data recalculation, resulting in incorrect calculation results
- fix: query error when col in order by abs(col) exists in result set instead of table
- fix: the results of show create table and SELECT distinct tbname, json_tag_name are not as expected when the TAG column is of JSON type
- fix: when parsing the output table tag name in the stream creation statement, the backtick (`) was mistakenly taken as part of the column name, which did not match the column name of the table created manually via SQL, resulting in the "Ou
- fix: resolve incorrect query results when subqueries in nested queries use descending sorting, no sorting, or sorting by non-time primary key
- tix: concurrency issue caused by modifying tdb while data subscription is in progress
- fix: OPCUA download data points not work when edit
- fix: support import alert dashboard for Grafana 12.x
- fix: the cache_load field of ins_vgroups is displayed as a negative value when it exceeds the maximum value of int32
- fix: potential crash risks during query memory control
- fix: stream fails to calculate historical data when using FILL_HISTORY
- fx: stream errors when reading data cause subsequent computing tasks to wait
- fix: no longer require sorting when the time primary key of sub-tables in JOIN syntax is a constant
- fix: Kafka extract/split with depth error
- fix: schema and tag synchronization issue when the stream result table already exists
- fix: resolve the issue of failed rawdata data subscription
- fix: Explorer upload monitor to taoskeeper by default
- fix: crash caused by excessively long table names during STMT2 automatic table creation on write
- fix: "Invalid value in client" error is triggered when querying virtual super tables
- fix: KingHistorian subscription not work
- fix: incorrect tbname processing logic when writing data via the insert into stable syntax
- fix: the issue of probabilistic failure when stream sends event notifications via WebSocket
- fix: taosX req_id can't find in other components
- fix: node.js support no timezone on window
- fix: Explorer login error without subpath
- fix: transactions cannot end when modifying global variables
- fix: fix latency issue in opc-ua
- fix: logic error caused by columns of multiple virtual tables using the same original table column
- fix: taosAdapter crash caused by callback function not being called after stmt query returns
- fix: taosX my cause sql too long with 100k message per row
- fix: data is written to an incorrect dnode and triggers the "Vnode is closed" error when executing insert into select statements
- fix: coredump occurs when the join query in stream subquery contains the tag==%%n condition
- fix: unexpected split result in transform
- fix: field_type error in c ws taos_stmt2_get_fields
- fix: incorrect data source was invoked when using anomaly detection in stream
- fix: the issue that query processes get stuck when both dbname and tbname are set to
?in query statements executed via stmt2 - fix: InfluxDB no tag measurements data in error
- fix: errors occurring when modifying the internal table structure concurrently during schemaless writing
- fix: incorrect results when querying with state window and partition by
- fix: errors in the outer cols function of nested queries
- fix: AVEVA Historian data in configration error
- fix: resolve the crash issue when querying virtual tables that reference data columns of the same name but different types in sub-tables
- fix: abnormal data loading issue when upgrading from version 3.3.6.32-3.3.6.36 to 3.3.8.6-3.3.8.10
- fix: crash occurs occasionally during disk flushing for decimal-type data with NULL values when caching is enabled
- fix: client cannot perceive table schema modifications made by other clients
- fix: PI/PI-Backfill ingestion error with period sign
- fix: fix not found model in dsn error while creating pi tasks
- fix: fix taosgen coredump in case of inccorect csv format
- fix: crash occurs when stream triggers table creation without carrying written data
What's Changed
- merge: from main to 3. 0 branch by @guanshengliang in #33174
- merge: from main to 3.0 branch by @guanshengliang in #33202
- enh: add stream log by @facetosea in #33201
- Case verify stream bugs on branch 3.0 by @DuanKuanJun in #33193
- fix: test case by @facetosea in #33221
- enh: support interp and percentile functions in stream by @dapan1121 in #33150
- fix: stream interp and percentile description by @dapan1121 in #33237
- merge: from main to 3.0 branch by @guanshengliang in #33254
- enh: Code Optimization by @facetosea in #33283
- fix(stream): reset tableScan operator by @wangmm0220 in #33225
- feat: support zeroth state in state window by @Tony2h in #33294
- fix: check dnodes status until ready by @SallyHuo-TAOS in #33366
- enh: rename windows ci cases files name by @tomchon in #33368
- fix(stream): tsdb reader reset error by @wangmm0220 in https://github.com...
3.3.8.8
Behavior change and compatibility
Features
- feat: taosX add KingHistorian data-in
- feat: taosX add new datasource: pulsar & tuya
Enhancements
- enh: active-active support enable WAL marker to lock WAL
- enh: C WebSocket connector performance optimized
- enh: improve startup speed of stream with historical data
- enh: support caching filter results of tag equality conditions in stream
- enh: c/rust websocket connection support conn_timeout
- enh: clarified error messages for white noise check failures in the data completion algorithm
- enh: enhanced error messages for unresolvable or unreachable hostnames to indicate the root cause more clearly
- enh: TDgpt's imputation function supports arbitrary sampling intervals
- enh: taosX data migration supports conn_timeout
- enh: Add debug commands like vi, ps, etc. to Docker
- enh: improve corner case memory usage to avoid oom
- enh: taosX improve mem usage and speedup for flat stream
- enh: Explorer extracted columns can be extracted in chain
- enh: add maxSQLLength to set the maximum length of SQL statements
- enh: Rust websocket connection support read timeout
- enh: taosX archive file size and count limit
- enh: simplified the retry logic in the query process, and uniformly used maxRetryWaitTimes to control the maximum retry time
- enh: remove info log for points in opcda
- enh: OpenTSDB data-in support customized table name
- enh: speedup perf when table not exist for tmq to td
- enh: taosX import csv in batches
- enh: improve recovery speed after restart in clusters with multiple vnodes requiring data synchronization
- enh: allow TMQ subscription to TSDB v3.1.x
- enh: taosX support migration with additional WHERE condition
- enh: taosX support reclaim memory by interval or sighup
Fixes
- fix: event window of stream does not create output table when no data output.
- fix: taosX data synchronization included extra non-qualifying table structures.
- fix: fix a mem-leak issue of taosBenchmark
- fix: stream trigger incorrectly handles NULL values during DELETE-triggered recalculation
- fix: historical data triggering of stream state window does not support the extend parameter
- fix: stream compatibility issues when upgrading from version 3.3.7 to 3.3.8
- fix: incorrect calculation result of the state window when the data block boundary is a null value
- fix: incorrect window splitting in RSMA function when the timestamp is negative
- fix: leader switchover failure of dual-replica mnode.
- fix: election during snapshot transmission in the synchronization module causes a deadlock
- fix: stream sliding windows for virtual super tables lacked sub-table names in message notifications
- fix: resolve the issue where virtual super tables do not support SELECT DISTINCT TAGS queries
- fix: resolve the issue where a UNION query returns incorrect results if one of its subqueries contains only constant conditions in the WHERE clause
- fix: memory leak when MQTT subscription exits
- fix: resolve the memory leak issue when referencing virtual tables in stream
- fix: resolve the issue where virtual super tables do not support SELECT COUNT(1) queries
- fix: resolve the issue where the DERIVATIVE function returns an extra row in the result set when the query includes the tbname column
- fix: Resolved Docker image upgrade start-up failure after changing the taosd password, affecting versions 3.3.8.0–3.3.8.4
- fix: virtual table stream does not trigger computing as expected
- fix: time resolution processing error in TDgpt's Prophet algorithm model
- fix: query result error when the state window's extend value is 1 and the end of the window is all empty data
- fix: explorer input eroro when extract or filter preview
- fix: taosX fix mem increase and panic in archive in case of taosd errors
- fix: fix schema only backup restore error
- fix: crash caused by memory cleanup when sync message sending fails
- fix: TSDB Lite Explorer loading is slow
- fix: fix description attribute error in some special OPC-UA servers
- fix: multiple selections of namespaces cause error
- fix: fix unexpected taosX filtered metrics
- fix: query does not return the correct error code when it is killed
- fix: precision error in decimal constant conversion
- fix: stream cannot restart after adding new column mappings to the virtual table
- fix: failed to restore vnode when there are a large number of null values
- fix: resolved issue where virtual table queries failed after adding or removing Schema in their corresponding sub-tables.
- fix: time precision error in the last_compact column of the ins_filesets system table
- fix: stream repeatedly reports window opening events after restart
- fix: upgrade arrow dependencies for jdk21
- fix: reduce OpenTSDB log file size for taosX
- fix: InfluxDB data source table name inconsistent with disorder tags
- fix: error writing BLOB data type via super table auto-creation statements
What's Changed
- enh(stream): merge from main by @wangmm0220 in #33284
- enh(test): insert data in parallel by @kailixu in #33429
- test: support multi vm run CI by @SallyHuo-TAOS in #33436
- fix(docker): remove openjdk-17-jre-headless entry from Dockerfile.base by @tomchon in #33445
- Enh/stream/only createtable supported main2 by @facetosea in #33420
- fix explore-sys metric's sub table name by @sheyanjie-qq in #33441
- fix: Fix Docker command port mapping in documentation by @tomchon in #33449
- docs: update release note for 3.3.8.4 in office web by @feici02 in #33456
- enh/TD-38474-modify-sdb-data by @cadem in #33457
- ci: update branch configuration for taoskeeper build workflow by @qevolg in #33443
- feat(csv): docs update #TS-7450 by @zyyang90 in #33461
- enh: use TAOS_FQDN to start taosd by @tomchon in #33462
- feat: optimize the usage instructions of taosdump by @YamingPei in #33460
- enh: Remove macOS 13 from build matrix because of image Deprecated by @tomchon in #33466
- avoid cpu occupied by @yihaoDeng in #33465
- Fix/TS-7588 by @yihaoDeng in #33468
- merge: from 3.3.6 to main branch by @guanshengliang in #33474
- feat(taos): add connector info for perf_connections by @wangmm0220 in #33458
- fix: state window handle all-null datablock error by @Tony2h in #33439
- fix/TD-38490-reset-heartbeat-after-mnode-leader-restart by @cadem in #33473
- fix(rsma): window split for negative ts by @kailixu in #33467
- feat: write results of the super table query to a json file by @YamingPei in #33470
- case: tidy up cases (10.31) Migrate system-test by @DuanKuanJun in #33444
- merge: from 3.3.6 to main branch by @guanshengliang in #33486
- docs: update network by @guanshengliang in #33488
- fix[TD-38515]: fix ci return value check issue by @localvar in #33489
- docs: add window interval description by @dapan1121 in #33493
- fix/TS-7542-double-free by @cadem in #33494
- docs: update network by @guanshengliang in #33492
- feat:auth server by @Pengrongkun in #33469
- fix/TD-38495-snapshot-start-receiver-writer-error by @cadem in #33477
- merge: from 3.3.6 to main branch by @guanshengliang in #33503
- refactor(query): refactor failed task retry control procedure. by @hjxilinx in #33498
- refactor(query): refactor query task redirect process. by @hjxilinx in #33502
- merge: from 3.3.6 to main branch by @guanshengliang in #33504
- docs: update the Python documentation and upgrade taos-ws-py by @qevolg in #33496
- test: enhance the debugging information and exception handlingcapabilities by @YamingPei in #33497
- fix:stmt2 ut by @Pengrongkun in #33505
- Enh/add stream latency marks by @wangmm0220 in #33518
- Enh/add stream latency marks by @wangmm0220 in #33527
- fix: possible snapshot message size error and log info by @hzcheng in #33526
- Fix/336/csv-parse-error by @xiao-77 in #33500
- fix: possible snapshot message size error and log info by @hzcheng in #33525
- Enh/add stream latency marks by @wangmm0220 in https://github.com...
3.3.8.4
Behavior change and compatibility
Features
- feat: taosX support OPC failover endpoint
Enhancements
- enh: taosX allow sync from higher precision to lower eg. ns to ms
- enh: Adapter support connection management and request limit
- enh: improve performance for last_row + composite queries
- enh: taosws taos_stmt_num_params support selects
- enh: improve log and error code display during mnode startup
- enh: refine document for error codes
- enh: reduced CPU usage for stream when reading data
- enh: speedup small queries in C/Rust websocket connection
- enh: REST API response will use null for nan/inf instead of error
- enh: no longer retry timed-out RPC messages
- enh: improve performance for last_row + tags queries
- enh: Improved query performance for virtual super tables
- enh: Explorer Grid canvas suppot plotting with DECIMAL
- enh: OpenTSDB data-in support timestamp/value field rename
- enh: unify login-register process in enterprise & community
- enh: add configuration parameter rpcRecvLogThreshold to set the threshold for warning logs in the rpc module
- en: Explorer Dashboard node table now is sortable
Fixes
- fix: tmq_get_json_meta behaves unexpectedly when the tags of subscribed meta messages contain empty strings.
- fix: decode overflow interior page returns wrong pgno
- fix: free() invalid pointer in taos-connector-rust
- fix: the retention task does not exit when drop and recreate database with the same name while RSMA exists
- fix: clearing user_ip in taos_options_connection does not take effect
- fix: slow leader election when a single node in a dual-replica setup loses network connectivity
- fix: crash occurred when querying a virtual supertable without including the timestamp primary key
- fix: fixed the rare issue of inconsistent config parameter values across dnodes after modifying dnode parameters.
- fix: incorrect result issue when the stream statement contains tag=%%1.
- fix: state window fails to properly handle data with NULL states
- fix: crash when concurrent writes and last queries are performed simultaneously.
- fix: new values cannot be immediately queried after updating server configuration parameters
- fix: fix C WebSocket stmt2 automatic reconnection
- fix: subscription failure when the WAL version number exceeds the maximum value of int32
- fix: startup failure on CPUs with 200 cores or more
- fix: explorer query NaN as null
- fix: show create table command execute error when the tag value is an empty string
- fix: crash caused by memory cleanup when sync message sending fails
- fix: incorrect _wduration result in time window queries with sliding.
- fix: invalid sttblockreader initialization actions in window queries.
- fix: resolved incorrect end_point information in perf_connections
What's Changed
- enh: optimize stable event window plan by @dapan1121 in #33195
- fix: TD-38212 by @cadem in #33186
- docs: update release note for 3.3.8.1 in office web by @feici02 in #33216
- fix: type conversion error by @menshibin in #32844
- feat: complete version number character copying by @menshibin in #33206
- docs: update python ws version history by @qevolg in #33222
- fix: fix tdgpt timemoe model directory by @SallyHuo-TAOS in #33213
- enh(last): enable reading cache when select last and tags by @Tony2h in #33204
- enh: TD-38163-mnode-open-log by @guanshengliang in #33160
- fix: clearing user_ip in taos_options_connection does not take effect by @yihaoDeng in #33229
- fix: clearing user_ip in taos_options_connection does not take effect by @yihaoDeng in #33228
- enh: rsma docs and task monitor by @kailixu in #33219
- fix: TS-7219-handle-status-req-timeout by @cadem in #33210
- merge: from 3.3.6 to main branch by @guanshengliang in #33235
- fix: get stream tasks list crash issue by @dapan1121 in #33238
- feat: unique getBuildPath invoke and ignore .git branch name contain … by @SallyHuo-TAOS in #33233
- enh: TD-38278-print-error-code by @cadem in #33231
- enh(last): enable using cache when select last and composite key by @Tony2h in #33234
- Fix/test case/err desc main by @facetosea in #33246
- enh: add and apply trigger latency config by @dapan1121 in #33245
- fix(stream): fix memory leak in vtable data merge by @JinqingKuang in #33194
- enh(last): enable reading cache when select last and tags by @Tony2h in #33236
- Docs for error codes Prefix Categories by @DuanKuanJun in #33250
- merge: from 3.3.6 to main by @guanshengliang in #33255
- fix: TD-37490 ci case by @facetosea in #33187
- docs: update conntector and error code page, remove rest connect type by @sheyanjie-qq in #33266
- fix: add thread create debug log by @dapan1121 in #33262
- Wrapper Library Add Hint Message by @DuanKuanJun in #33257
- fix(stream): fix trigger waking for available runner by @JinqingKuang in #33264
- docs: update c native stmt2 example by @qevolg in #33272
- fix[TD-38121]: fix two tdb bugs for 3.3.6 by @localvar in #33274
- fix[TD-38121]: fix two tdb bugs by @localvar in #33260
- enh(stream): reset table scan in reader by @wangmm0220 in #33247
- alter cron time by @happyguoxy in #33286
- fix(tref): increase TSDB_REF_OBJECTS from 100 to 2000 for improved reference handling by @yihaoDeng in #33281
- fix(tref): increase TSDB_REF_OBJECTS from 100 to 2000 for improved reference handling by @yihaoDeng in #33282
- feat: add rpcRecvLogThreshold configuration for logging threshold by @yihaoDeng in #33277
- feat: add rpcRecvLogThreshold configuration for logging threshold by @yihaoDeng in #33241
- fix: memleak by @facetosea in #33280
- fix: adjust rocksdb log by @yihaoDeng in #33013
- enh: optimize vtable scan by @Simon9997 in #33232
- enh: Wrapper Library Add Hint Message(3.3.6 branch) by @DuanKuanJun in #33270
- docs: add libtaosws.so and libtaosnative.so load failed resolution by @DuanKuanJun in #33276
- docs: jdbc release 3.7.6 by @sheyanjie-qq in #33293
- merge: from 3.3.6 to main branch by @guanshengliang in #33290
- docs: update roadmap by @guanshengliang in #33307
- tidy up CI case for link function by @DuanKuanJun in #33253
- Update to the nvl2 function description by @liuyq-617 in #33314
- fix(stream): tsdbReader is null by @wangmm0220 in #33306
- enh: Modify maximum TSMA num from 3 to 10. by @Simon9997 in #33145
- fix(stream): cases error in sometimes by @wangmm0220 in #33243
- enh: optimize log in vnodeQuery.c for better debug info by @hzcheng in #33267
- Fix/fixMemleak336 by @yihaoDeng in #33261
- enh: Add error logging when scan meta entry fails to decode by @hzcheng in #33279
- docs: add taos_print_row desc by @qevolg in #33310
- test: tidy up cases on main branch by @DuanKuanJun in #33317
- fix: Support external window for subquery. by @Simon9997 in #33320
- fix(tmq): [TS-7468] position is negative because overflow by @wangmm0220 in #33304
- fix(tmq): [TS-7468] position is negative because overflow by @wangmm0220 in #33305
- enh(stream): fix trim block error by @wangmm0220 in #33299
- fix: [TD-38315] Fix virtual supertable scan wrong tsSlotId. by @Simon9997 in #33288
- enh:remove obsolete test case files for long-running and TD-GPT tests from the parallel_test directory by @tomchon in #33327
- change log level of http by @yihaoDeng in https://github.com/taosda...
3.3.8.1
Behavior change and compatibility
Features
Enhancements
- enh: support for alter RSMA
Fixes
- fix: incorrect results were returned when executing first and last functions on the timestamp column simultaneously
- fix: precision loss when taosX synchronizes decimal data
- fix: incorrect first window calculation results after taosd restart when stream is triggered periodically.
- fix: show local variables like 'timezone' displayed incorrectly on the Windows platform
- fix: resolved issue where no error was reported after specifying the DELETE_RECALC option for count window in stream
- fix: fix some Explorer typos
- fix: move_to failed since cross-dev
- fix: crash occurs while WebSocket reconnects when using STMT
- fix: the disk flush thread may deadlock during heavy write and query operations
- fix: resolved incorrect end_point information in perf_connections
- fix: tag filtering did not take effect when subscribing to a topic with tag selection conditions
What's Changed
- test: remove check for period recalc. by @xiao-77 in #33146
- feat: add status check on compatibility cases. by @xiao-77 in #33065
- fix: order by errors by @Tony2h in #33058
- fix: correct log message formatting in taosd startup by @tomchon in #33157
- docs: update release note for 3.3.8.0 in office web by @feici02 in #33155
- fix: resolved incorrect end_point information in perf_connections by @yihaoDeng in #33159
- docs: update pkg to 3.3.8.0 and use pkgType to get version url by @tomchon in #33162
- docs: update pkg to 3.3.8.0 by @tomchon in #33163
- fix: last error by @facetosea in #33151
- docs: update TDengine package version to 3.3.8.0 by @tomchon in #33164
- fix: [TD-38160] Disable delete_recalc when trigger window is count wi… by @Simon9997 in #33132
- Docs/ipv6Update by @yihaoDeng in #33167
- test:move docs tests and unit tests to new framework by @tomchon in #33148
- fix: remove unsupported branches from pull request triggers in workflow by @tomchon in #33169
- fix: last ERROR by @facetosea in #33166
- enh(stream): remove synchronous wait for runner by @JinqingKuang in #33154
- fix: dead lock caused by pthread_cond_destroy by @kailixu in #33168
- merge: from 3.3.6 to main branch by @guanshengliang in #33171
- fix: remove unnecessary jsonPath attribute and add tdgpt download url by @tomchon in #33175
- docs: support rollup sma by @kailixu in #33176
- Uncatalog 1-insert/2-query case migrate to catalog by @DuanKuanJun in #32977
- fix: update links to issue references in release notes for clarity by @tomchon in #33179
- refactor(gpt): update doc and error msg. by @hjxilinx in #33156
- fix: replace DocCardList with SortedDocCardList in release notes by @tomchon in #33183
- fix(tz): timezone display error in windows by @wangmm0220 in #33170
- fix(tz): timezone display error in windows by @wangmm0220 in #33190
- fix(tmq): [ts7402]tag filter do not work if topic is stable with filter by @wangmm0220 in #33191
- fix(tmq): [ts7402]tag filter do not work if topic is stable with filter by @wangmm0220 in #33143
- fix(stream): [TD35698]decimal data error if snapshot is true by @wangmm0220 in #33189
- fix(stream): [TD35698]decimal data error if snapshot is true by @wangmm0220 in #33149
- enh(rsma): support alter/decimal/composite key by @kailixu in #33177
- docs: fix desc errors in taosgen's document by @YamingPei in #33172
- fix:stmt core by @Pengrongkun in #33196
- merge: from 3.3.6 to main by @guanshengliang in #33200
- docs: fix python examples error by @menshibin in #33199
- fix: conditionally copy scripts and update configuration instructions for non-lite package mode by @tomchon in #33188
Full Changelog: ver-3.3.8.0...ver-3.3.8.1
3.3.8.0
Behavior change and compatibility
Features
- feat: taosX performance report
- feat: support for TLS certificate-based authentication and transmission
- feat: add 'timezone' option in rust websocket connection
- feat: stream now supports the delete_output_table option
- feat: state_window in stream now supports performing operations on the state column
- feat: stream supports the recognition of virtual table changes
- feat: partition by tag now supports string operations
- feat: JDBC WebSocket support multiple endpoints for load balance
- feat: re-implement TSMA using the refactored stream
- feat: stream computing now supports notification filtering mechanism
- feat: support PROPHET algorithm in TDgpt
- feat: support Pearson correlation coefficient function
- feat: taosX support parsing
keylike value in kafka - feat: support for the date function
- feat: support for functions: IF, ISNULL, ISNOTNULL, NVL, COALESCE, NULLIF, IFNULL
- feat: support for functions: std variance stddev_samp var_samp group_concat
- feat: support Rollup SMA.
- feat: support scanning the integrity of time-series data files using the scan command
- feat: add C connector performance benchmark
- feat: support for find_in_set, like_in_set, regexp_in_set functions
- feat: JDBC reduce query times for high-efficient validation
- feat: TDgpt support imputation function
- feat: explorer report metrics to taoskeeper
Enhancements
- enh: support configuration of state window start and end points
- enh: keep agent online by default even if taosX disconnected
- enh: improve C WebSocket STMT2 performance
- enh: add show ssmigrate command to show the progress of shared storage migration
- enh: optimize the performance of stream computing.
- enh: add perf parameters for influxdb in Explorer-DataIn
- enh: taos shell supports argument values immediately following names on Windows
- enh: optimize db size & query speed in taosX start up
- enh: cache validation result to reduce license query times
- enh: notify statement in stream supports using column aliases
- enh: add cpu usage percentage of taosAdapter metric
- enh: taosgen add support for write TDengine with individual queues
- enh: explorer support contains_bad parameter in OPCDA
- enh: enhance error handling for subscribe error in Adapter
- enh: STMT2 support decimal type
- enh: support for BSS (Byte-Stream-Split) encoding on floating-point data
- enh: optimized the "Balance Vgroup Leader" command to achieve a more uniform distribution of VGroup leader
- enh: separate data query and metadata query processing threads
- enh: change default database params to vgroups=4, duration=10 in Explorer
- enh: support for REDISTRIBUTE command on dual-replica databases
- enh: update standard deviation calculation to prevent potential numeric overflow
- enh: show field names even though all values are null in UDT
- enh: allow explorer create database with replica
- enh: adapter recording sql csv add appName and srcPort
- enh: improve the efficiency of event_window queries grouped by tbname
- enh: alert udt error when running with rhai udt scripts in taosX
Fixes
- fix: out-of-bounds error in table name/Tag calculation during stream processing
- fix: data subscription cannot obtain the creation events of normal tables generated by stream
- fix: resolved issue where calling the forecast function on super virtual tables failed
- fix: taosX special params(sparse/realtime/stables) cause 'No valid epSet' error
- fix: taosX-influxdb process not exit when task done
- fix: unexpected agent activities in explorer
- fix: write part column is not work
- fix: incorrect watermark judgment when the ignore_disorder option is enabled in stream
- fix: RAND function returns different values even seed is same on windows
- fix: the output of 'leastsquares' is inconsistent across compilers
- fix: taosd crash when triggered by virtual table with tbname used as a prefilter
- fix: inconsistent data and log directories on windows
- fix: websocket connection not closed after taos_close
- fix: fix the same filename for log to c native
- fix: memory leak caused by STMT query errors
- fix: taosAdapter json serialization contains unexpected escapes
- fix: create taosX task for pi error via Explorer
- fix: incorrect calculation in the first window when the FILL_HISTORY option is enabled in stream computing
- fix: resolved manual recalculation logic errors in stream
- fix: incorrect calculation results in stream when data is out-of-order or deleted
- fix: consumer.recv_timeout block runtime in rust connector
- fix: STMT2 reports error when binding empty nchar type
- fix: cloud taosX license validation issue
- fix: crash issue caused by commit thread suspending queries on composite primary keys of Varchar type
- fix: fix taosX/explorer too many open files in linux
- fix: fix poll deadline elapsed issue when timeout=never in rust taos-ws
- fix: taosd crash when executing a large number of concurrent last queries
- fix: the cols function returns incorrect results when fetching multiple timestamps
- fix: remove stream creation wizard in explorer, use sql directly
- fix: TDgpt may fail during concurrent forecast
- fix: the issue that ss_keeplocal cannot be set to 1440m
- fix: fix cases in explorer permission management
- fix: no need to alert when taosX_sys not exist in TDLite
- fix: fix influxdb stopping stuck in taosX
- fix: explicitly show the database name is case-sensitive
- fix: Explorer favorite SQL should be case-sensitive
- fix: influxdb multi tags with same ts would cause data lost
- fix: Explorer should use COMPOSITE KEY instead of PRIMARY KEY
- fix: taosAdapter did not report metrics continuously
- fix: ODBC timestamp precision error in ADB UPDATE with ms or ns ts
- fix: Kafka data source validation error after upgrading with SASL config
- fix: fix deadlock issue in concurrent influxdb migration tasks
- fix: preview table contains old fields after payload schema changed in Explorer
- fix: crash in ss-migration when fileset does not exist
- fix: taosBenchmark interlace_rows param not work if non_stop_mode=yes
- fix: consumer recv_timeout cause tmq2local file not completed
- fix: cancel restore task not work
What's Changed
- mereg: from main to 3.0 branch by @guanshengliang in #32343
- enh: grant support for data source ORC by @kailixu in #32377
- fix: modify the execution order of compatibility test cases. by @xiao-77 in #32386
- merge: from main to 3.0 branch by @guanshengliang in #32399
- fix: update dnode state from offline to online by @kailixu in #32422
- feat(stmt):add more cases by @Pengrongkun in #32453
- fix: correct regex pattern for Python case detection and update allure path by @tomchon in #32490
- case: test_idmp_meters.py stream8 fixed (3.0) by @DuanKuanJun in #32513
- fix: merge sort in column insert mode by @kailixu in #32502
- enh[ts-6869]: support using file system as shared storage by @localvar in #32483
- merge: from main to 3.0 branch by @guanshengliang in #32542
- feat(stream): opti thread mode of stream reader by @wangmm0220 in #32546
- support stmt2 test cases by @minhuinie in #32533
- merge: from main to 3.0 branch by @guanshengliang in #32624
- fix: add maxRetryWaitTime to configuration dictionary by @tomchon in #32630
- fix: increase pytest timeout from 1000 to 1200 seconds by @tomchon in #32663
- enh: support for BSS (Byte-Stream-Split) encoding on floating-point data by @hzcheng in #32447
- feat[TD-37210]: trigger scan plan optimize by @Simon9997 in #32633
- enh[TS-6867]: support for REDISTRIBUTE command on dual-replica databases by @cadem in #32468
- fix(agg/stddev): variance overflow by @stephenkgu in #32456
- fix: use new url to download tdengine in compatibility case. by @xiao-77 in #32668
- fix testcases on windows by @minhuinie in #32683
- feat: support for the date function by @Tony2h in #32545
- enh: clarify the return value format of the date function by @Tony2h in #32690
- enh[TD-37432]: add variable 'syncApplyQueueSize' by @localvar in #32562
- merge: from main to 3.0 branch by @guanshengliang in #32686
- feat(stmt2): support insert decimal type by @Pengrongkun in #32563
- Fix win cases by @minhuinie in #32728
- merge: from main to 3.0 branch by @guanshengliang in #32722
- enh: change float/double default encoding to byte_stream_split by @hzcheng in https://github.com/taosdata/TDengin...
3.3.7.5
Behavior change and compatibility
Features
- feat: taosX support importing ORC format
- feat: C WebSocket connection-level timezone
- feat: [TD-37437]: incorrect database targeting when creating streams containing virtual table queries
- feat: support ADO interface in ODBC
- feat: taosAdapter support recording sql to csv
Enhancements
- enh: set EXPLORER_SKIP_REGISTER=true to skip register in Explorer
- enh: reduce taosX binary size for nearly ~60M(plain, 15M compressed)
- enh: explorer will trim spaces in user name
- enh: C WebSocket support configuration options for auto reconnect
- enh: support for formatting time using DDD on Windows.
- enh: disable alert in dashboard on explorer oss
- enh: add verifyPeer parameter to allow users to skip certificate verification during S3 data upload.
- enh: enhance the state control mechanism for S3 data migration to improve precision and efficiency
- enh: explorer can config requret timeout in opcua
- enh: Show Create Table does not output compression information.
- enh: shared storage supports NAS
- enh: support retries in taosBenchmark via ws
- enh: improve kafka datain performance
- enh: taosX not started cause ui undefined error
Fixes
- fix: speedup influxdb 1.x querying and fix oom in taosX influxdb datasource
- fix: create data replication error in explorer with non-default password
- fix: crash caused by race conditions during memory reclamation in long-running queries
- fix: non-exist file cause unstopped failed to open file error in restore
- fix: intermittent “stream task lost” error when creating stream tasks in batches.
- fix: delete stream cause 'Database not specified' in explorer
- fix: varbinary database mapping in explorer transform
- fix: panic in case of decimal converting from oracle
- fix: trigger table tags being null causes crash
- fix: mqtt get sample data timeout if frequency too low
- fix: taosdump export by time range error in case of us/ns precision
- fix: crash issue when using CALC_NOTIFY_ONLY option in stream computing
- fix: taoskeeper audit log error with
value too long for column/tag: client_addressin taoskeeper - fix: import csv with value field in explorer cause error
- fix: explorer cascading tag table list error in case of same values in multi tag fields
- fix: taosX got unexpected null values in case of different types in single field
- fix: nginx service restart cause explorer error
What's Changed
- Feat/ts 6100 3.0 by @wangmm0220 in #32326
- merge: from main to stream by @guanshengliang in #32342
- test: verify bug4 merge case to vehicle.py by @DuanKuanJun in #32328
- feat: rename docker image by @feici02 in #32346
- test: modify recalc ci cases. by @xiao-77 in #32318
- test: update tese case of blob by @yihaoDeng in #32330
- test: modify case test_recalc_manual_with_options.py. by @xiao-77 in #32348
- fix invalide read epset by @yihaoDeng in #32344
- docs: count_window by @facetosea in #32349
- enh: update show creata table by @yihaoDeng in #32320
- test: modify case by @plum-lihui in #32290
- enh: set queryUseMemoryPool to 0 by @jiajingbin in #32351
- fix(stream): fix recalculation range by @JinqingKuang in #32332
- test: add recalc manual to ci. by @xiao-77 in #32361
- fix: split dead loop issue by @dapan1121 in #32354
- fix(stream): fix memory leak of stream notify content by @JinqingKuang in #32364
- fix: [TD-37133] Forbid use %%trows multi times in union query. by @Simon9997 in #32366
- Feat/ts 6100 3.0 ming by @wangmm0220 in #32362
- docs: update release note for 3.3.7.0 in office web by @feici02 in #32359
- test: create vtable stable from 150100 by @DuanKuanJun in #32360
- docs: update stream doc by @guanshengliang in #32374
- docs: add example cases for datatype tests in cases.task by @tomchon in #32379
- docs: update zh introduction with new name by @danielclow in #32382
- merge: from stream branch to main by @guanshengliang in #32375
- enh: grant support for data source ORC by @kailixu in #32370
- enh: grant support for data source ORC by @kailixu in #32378
- fix: wrong col_id in ins_columns by @Tony2h in #32358
- fix: modify the execution order of compatibility test cases. by @xiao-77 in #32385
- test: remove un checked case by @guanshengliang in #32388
- fix: failed to write blob data using STMT2 in inefficient mode by @yihaoDeng in #32365
- fix(parser): subquery use last_row can't found the colname by @hongzhenliu335 in #32353
- test: [TS-6100] Reopen UTs by @Simon9997 in #32363
- docs: explanation of timezone by @wangmm0220 in #32390
- feat(entrypoint): add wait for serverPort and create snode on dnode by @tomchon in #32345
- feat(stmt):add update syntax support for stmt1 by @Pengrongkun in #32367
- docs:update download link in 01-tdengine.md by @tomchon in #32373
- test: [TS-6100] Reopen stream ut by @Simon9997 in #32396
- enh(TD-36909: adjust sync timer routine log by @cadem in #32309
- enh(TD-36909: adjust sync timer routine log by @cadem in #32098
- fix: wrong table number statistics by @hzcheng in #32391
- Fix/hzcheng/3.3.6/TD-37201 by @hzcheng in #32392
- chore: trigger doc build by @feici02 in #32411
- docs: stream upgrade by @guanshengliang in #32408
- fix(gpt): support scalar function in forecast function. by @hjxilinx in #32409
- test: reproduce bug by @guanshengliang in #32414
- chore: trigger doc build by @feici02 in #32416
- docs: add blank line for better readability in product classificationsection by @tomchon in #32417
- docs: escape_character parameter in document classification error by @menshibin in #32421
- test: mute recalc manual case. by @xiao-77 in #32413
- merge: from 3.3.6 to main branch by @guanshengliang in #32389
- docs: update WebSocket connection API support status and usage restrictions by @qevolg in #32393
- fix: fix taoskeeper version by @qevolg in #32425
- fix: fix taoskeeper version by @qevolg in #32429
- fix: enhance removal logic to check for non-empty install directory before deletion by @tomchon in #32430
- fix: update dnode state from offline to online by @kailixu in #32423
- fix: update dnode state from offline to online by @kailixu in #32424
- feat: add taosmqtt support in packaging scripts and cleanup routines by @tomchon in #32431
- doc: simplify get started for docker by @feici02 in #32434
- fix: enhance removal script to handle empty service names and add directory cleanup by @tomchon in #32435
- docs(taosx): update Data-In tasks name to TDengine Subscription and T… by @acerDebugman in #32433
- merge: from 3.3.6 to main branch by @guanshengliang in #32439
- test: reproduce bugs by @guanshengliang in #32446
- fix(tmq): [TD-37063] array capacity is too large in sometimes by @wangmm0220 in #32445
- fix: [TD-37190] Disable ignore_nodata_trigger when window type is not interval/sliding or period. by @Simon9997 in #32405
- docs: add odbc connector support ado by @menshibin in #32460
- fix: Datainserter supports concurrent writing to the same group by @facetosea in #32384
- fix: wildcards pattern match bug in like clause by @Tony2h in #32404
...
3.3.7.0
Behavior change and compatibility
Features
- feat: new version of stream computing
- feat: supports BLOB data type
- feat: multi-level storage supports the adoption of shared storage
- feat: data subscription supports the MQTT protocol.
- feat: support for data mounting
- feat: support audo reconnect in rust websocket and libtaosws
- feat: go connector support blob data type
- feat: support BLOB data type in taos-ws-py
- feat: rust connector support new blob data type
- feat: Go WebSocket connections support IPv6
- feat: support IPv6 connection in C#
- feat: support version compatible check
- feat: libtaosws support adapterList for failover
- feat: table name in transform support expression calc
- feat: taosAdapter support new BLOB data type
- feat: C WebSocket connector support BLOB data type
- feat: taosX all data sources support decimal now
- feat: C# connector support decimal type
- feat: C websocket connector auto-reconnect and failover
- feat: subscribe from TDengine to MQTT in taosX
- feat: support MQTT sparkplug B datain in taosX
- feat: support OpenMetrics collection endpoints
- feat: new go connector benchmark tool
- feat: refactor artifact of taosBenchmark with better perf and functionality: tsgen
- feat: support writing query results to super tables.
- feat: generate unique timestamp using now in taosX
- feat: new plugin for ontop system
- feat: C websocket connector support multi-address failover
- feat: allow specify columns in count window
Enhancements
- enh: added grant items such as storage capacity and number of vnodes.
- enh: taosBenchmark support reading tbname/tags in csv
- enh: taosX support more datetime format in between_time_range
- enh: STMT2 supports setting fixed values for specified columns
- enh: websocket poll enhancement
- enh: Python WebSocket connections support automatic reconnection.
- enh: support multiple target frameworks in C#
- enh: downgrade gcc to 7.x for Hisoon database adapter
- enh: OPC CSV points config can add tags values with template
- enh: signed taosExplorer cannot start on mac
- enh: c websocket ws/wss protocol detection
- enh: support sml to get affected rows in rust connector
- enh: reduce info logs
- enh: support more write performance monitoring metrics
- enh: support encrypting user passwords using the SM4 algorithm
- enh: enables automatic detection and repair of WAL file corruption during startup
- enh: STMT2 supports duplicate table name binding
- enh: support varbinary data type in taosX
- enh: taosBenchmark output perf metrics into json file
- enh: raise exception in case of data convertion error
- enh: taosX transform plugin included in release
- enh: taosX restore from local dir support 'watch' parameter for watching file changes
- enh: disable external usage of :6060/rest/sql in Explorer
Fixes
- fix: memory leak occurs when subscribing to time-series data without metadata in Database topic
- fix: taosd fails to start after modifying a single mount point in multi-level storage
- fix: smallint type could not return query results when using the in ('1') condition for filtering.
- fix: incorrect authentication cause taosAdapter mem leak
- fix: single mount point failure in a multi-replica database cannot be recovered
- fix: vrtual table write requests did not report errors
- fix: support show tags on virtual table
- fix: taosBenchmark REST never support vgroup bindings
- fix: set timezone as same as JVM default does not work in websocket connection
- fix: csv to decimal cause taosX panic
- fix: fix decimal to double error when replicating with tmq
- fix: fix opcua error in cli mode of taosX
- fix: fix fetch_rows_a error in libtaows
- fix: superset name typo in english of explorer tools docs
- fix: OSS Explorer drop database error
- fix: taosX consume messages with formatted json cause error
- fix: ipv6 with zone info cause taosAdapter error on windows
- fix: agent sometimes panic on ipc ack reader
- fix: crash may occur when executing the show db.disk_info command
- fix: taos -h reports an error when entering an IPv6 address.
- fix: explorer sql query error should be visible
- fix: TDB file corruption caused by concurrent data subscription scenarios.
- fix: fFailed to query virtual tables in BI mode
- fix: nchar tag index is not taking effect
- fix: fix JDK caused panic on Kylin customized JDK for InfluxDB
- fix: transform invalid column name error
- fix: sorting fields of type double may cause the program to crash.
- fix: configuration parameter update failure during system upgrade
- fix: taosX tmq to td too many 'show subscriptions' queries cause taosd stuck
- fix: datain page disappear in explorer
- fix: taosX kafka datain will drop and logging non-utf8 input
- fix: explorer table display error
- fix: taosX support self-signed cert to adapter
- fix: kafka udt support nested array like
[{"data":[{"k":"v"}]}] - fix: sysinfo 0.33.1 cause slab mem increament on Kylin V10 os
- fix: taosBenchmark connection number increases when check sql not set
- fix: explorer slowsql query condition of timerange
- fix: provide tool to manually rebuild the last cache quietly
- fix: S3 upload failure caused by an abnormal compact operation.
- fix: SQL error detail should display in Explorer logs
- fix: drop topic will affect other consumers' subscriptions
- fix: error occurs when the parameter string length of forecast exceeds 512
- fix: resolved the time precision issue in the timediff function.
- fix: incorrect results when using to_char function in a nanosecond-precision database
- fix: error when reading composite primary key data from memory and STT, causing duplicate IDs.#31509
- fix: client crashes when use STMT2 to the newly added column
- fix: extremely rare race-condition crash when printing logs.#31688
What's Changed
- feat: [TS-6100] Support ast create for create stream. by @Simon9997 in #30815
- fix: [TS-6100] Fix compile on mac and add toJson/jsonTo func. by @Simon9997 in #30872
- Feat/new stream cache sink by @facetosea in #30868
- fix: [TS-6100] Remove useless code and fix bugs by @Simon9997 in #30883
- feat: [TS-6100] Fix compile error. by @Simon9997 in #30902
- feat: [TS-6100] Process SCMCreateStreamReq by @Simon9997 in #30918
- feat: [TS-6100] Process SCMCreateStreamReq by @Simon9997 in #30924
- feat: [TS-6100] Process SCMCreateStreamReq ver-3 by @Simon9997 in #30930
- feat(stream): add logic of stream reader by @wangmm0220 in #30932
- Feat/ts 6100 3.0 by @wangmm0220 in #30936
- feat: [TS-6100] Process SCMCreateStreamReq by @Simon9997 in #30940
- Feat/ts 6100 3.0 by @wangmm0220 in #30945
- Feat/ts 6100 marks new by @wangmm0220 in #30946
- feat(stream): add thread worker for stream reader by @wangmm0220 in #30954
- feat: [TS-6100] Process SCMCreateStreamReq ver-5 by @Simon9997 in #30964
- feat: [TS-6100] Process SCMCreateStreamReq ver-6 by @Simon9997 in #30982
- feat: [TS-6100] Process SCMCreateStreamReq : Add unit test and fix bugs. by @Simon9997 in #30986
- feat: [TS-6100] Process SCMCreateStreamReq : Fix subplan to string. by @Simon9997 in #30990
- feat: [TS-6100] Parse create stream sql: Fix syntax error when using … by @Simon9997 in #31001
- feat: [TS-6100] Parse create stream sql: Add out stb sversion. by @Simon9997 in #31014
- feat: [TS-6100] Parse create stream sql: change out stb version's dat… by @Simon9997 in #31017
- feat: [TS-6100] Parse create stream sql: Fix bugs and add create check. by @Simon9997 in #31030
- feat: [TS-6100] Parse create stream sql: Fix wrong readFromCache value by @Simon9997 in #31035
- feat: [TS-6100] Parse create stream sql: Collect placeholder function… by @Simon9997 in #31038
- feat: [TS-6100] Parse create stream sql: Fix out table wrong column n… by @Simon9997 in #31040
- feat: [TS-6100] Parse create stream sql: Fix out table wrong column n… by @Simon9997 in #31043
- feat: [TS-6100] Parse create stream sql: Add Unit Test. by @Simon9997 in #31047
- feat: [TS-6100] Fix mac cmake error. by @Simon9997 in #31057
- feat: [TS-6100] Parse create stream sql: Add unit test. by @Simon9997 in #31063
- feat: [TS-6100] Parse create stream sql: Fix partition by tbname error. by @Simon9997 in #31066
- feat: [TS-6100] Parse create stream sql: Fix wrong subplan num...