Merge branch 'master' into janez/flaky-test-fixes

Author: janezpodhostnik

CHANGELOG.md

@@ -0,0 +1,7 @@
+# Changelog
+
+Release notes and version history for flow-go are tracked via GitHub Releases:
+
+- https://github.com/onflow/flow-go/releases
+
+For user-facing changes per version, see the Releases page. Each release page contains the tag, release notes, and links to the associated commits and milestones.

CITATION.cff

@@ -0,0 +1,25 @@
+cff-version: 1.2.0
+message: "If you use flow-go in your research or reference it in a publication, please cite it as below."
+title: "flow-go: Flow Network Reference Implementation in Go"
+abstract: "flow-go is the Go reference implementation of the Flow network, a Layer 1 proof-of-stake blockchain. It implements HotStuff consensus, a multi-role node architecture (Access, Collection, Consensus, Execution, Verification), the Flow Virtual Machine, ledger, networking, and cryptography subsystems."
+authors:
+  - name: "Flow Foundation"
+    website: "https://flow.com"
+repository-code: "https://github.com/onflow/flow-go"
+url: "https://flow.com"
+license: AGPL-3.0-only
+type: software
+keywords:
+  - flow
+  - flow-network
+  - blockchain
+  - layer-1
+  - proof-of-stake
+  - consensus
+  - hotstuff
+  - byzantine-fault-tolerance
+  - cadence
+  - smart-contracts
+  - reference-implementation
+  - distributed-systems
+  - go

README.md

@@ -1,7 +1,22 @@
-# Flow [![GoDoc](https://godoc.org/github.com/onflow/flow-go?status.svg)](https://godoc.org/github.com/onflow/flow-go)
+# flow-go — Flow Network Reference Implementation in Go
 
-Flow is a fast, secure, and developer-friendly blockchain built to support the next generation of games, apps and the
-digital assets that power them. Read more about it [here](https://github.com/onflow/flow).
+[![GoDoc](https://godoc.org/github.com/onflow/flow-go?status.svg)](https://godoc.org/github.com/onflow/flow-go)
+[![License: AGPL v3](https://img.shields.io/badge/License-AGPL_v3-blue.svg)](https://www.gnu.org/licenses/agpl-3.0)
+[![Release](https://img.shields.io/github/v/release/onflow/flow-go)](https://github.com/onflow/flow-go/releases)
+[![Discord](https://img.shields.io/badge/Discord-Flow-7289DA?logo=discord&logoColor=white)](https://discord.gg/flow)
+[![Built on Flow](https://img.shields.io/badge/Built_on-Flow-00EF8B)](https://flow.com)
+
+Reference implementation of the [Flow network](https://flow.com) in Go. Flow is a Layer 1 proof-of-stake blockchain built for consumer apps, AI Agents, and DeFi at scale. This repo hosts the node software — consensus, execution, verification, access, and collection roles — and the Cadence VM integration used on mainnet, testnet, and local networks.
+
+## TL;DR
+
+- **What:** flow-go is the Go reference implementation of the Flow network, a Layer 1 proof-of-stake blockchain.
+- **Who it's for:** protocol contributors, node operators, and teams building infrastructure on or adjacent to Flow.
+- **Why use it:** canonical source of truth for Flow consensus (HotStuff), multi-role architecture, Cadence VM integration, and Flow EVM.
+- **Status:** see [Releases](https://github.com/onflow/flow-go/releases) for the latest version. Live on mainnet.
+- **License:** AGPL-3.0
+- **Related repos:** [cadence](https://github.com/onflow/cadence) (language) · [flow-cli](https://github.com/onflow/flow-cli) (CLI) · [fcl-js](https://github.com/onflow/fcl-js) (JS client) · [flow-go-sdk](https://github.com/onflow/flow-go-sdk) (Go client)
+- The reference Go implementation for the Flow network, open-sourced since 2019.
 
 <!-- START doctoc generated TOC please keep comment here to allow auto update -->
 <!-- DON'T EDIT THIS SECTION, INSTEAD RE-RUN doctoc TO UPDATE -->
@@ -192,3 +207,35 @@ type StateMachineEventsTelemetryFactory interface {
     config:
       dir: "state/protocol/protocol_state/mock"
 ```
+
+## FAQ
+
+### What is flow-go?
+flow-go is the Go reference implementation of the Flow network — a Layer 1 proof-of-stake blockchain. It implements the node software (Access, Collection, Consensus, Execution, Verification roles), the HotStuff consensus algorithm, ledger, storage, networking, and cryptography subsystems.
+
+### How does flow-go differ from the Cadence repo?
+flow-go is the **protocol / node** implementation. [`onflow/cadence`](https://github.com/onflow/cadence) is the **Cadence smart contract language** (compiler, interpreter, type system). flow-go embeds the Cadence VM to execute transactions, but the language itself is developed in the Cadence repo.
+
+### What are the five node roles in Flow?
+Access, Collection, Consensus, Execution, and Verification. Each has its own entry point under `/cmd/`. There is also an Observer service for staking-free read-only access.
+
+### Which Go version does flow-go require?
+Go 1.25 or later. See the [Installation](#installation) section for the full environment setup.
+
+### Where is the consensus algorithm implemented?
+Under [`/consensus/hotstuff`](/consensus/hotstuff). HotStuff is the BFT consensus family used by Flow.
+
+### How do I run a local Flow network?
+See the [Local Network Guide](/integration/localnet/README.md) for a full local multi-role network suitable for integration testing.
+
+### Where do I report a security issue?
+See [SECURITY.md](/SECURITY.md) for the responsible disclosure policy.
+
+## About Flow
+
+This repo is the Go reference implementation of the [Flow network](https://flow.com), a Layer 1 blockchain built for consumer applications, AI Agents, and DeFi at scale.
+
+- Developer docs: https://developers.flow.com
+- Cadence language: https://cadence-lang.org
+- Community: [Flow Discord](https://discord.gg/flow) · [Flow Forum](https://forum.flow.com)
+- Governance: [Flow Improvement Proposals](https://github.com/onflow/flips)

cmd/access/node_builder/access_node_builder.go

@@ -1763,6 +1763,10 @@ func (builder *FlowAccessNodeBuilder) extraFlags() {
 			return errors.New("execution-data-indexing-enabled must be set if store-tx-result-error-messages is enabled")
 		}
 
+		if builder.stateStreamConf.MaxGlobalStreams == 0 {
+			return errors.New("state-stream-global-max-streams must be greater than 0")
+		}
+
 		return nil
 	})
 }

cmd/observer/node_builder/observer_builder.go

@@ -945,6 +945,10 @@ func (builder *ObserverServiceBuilder) extraFlags() {
 			return errors.New("rest-max-request-size must be greater than 0")
 		}
 
+		if builder.stateStreamConf.MaxGlobalStreams == 0 {
+			return errors.New("state-stream-global-max-streams must be greater than 0")
+		}
+
 		return nil
 	})
 }

cmd/scaffold.go

@@ -56,6 +56,7 @@ import (
 	netcache "github.com/onflow/flow-go/network/cache"
 	"github.com/onflow/flow-go/network/channels"
 	"github.com/onflow/flow-go/network/converter"
+	"github.com/onflow/flow-go/network/message"
 	"github.com/onflow/flow-go/network/p2p"
 	p2pbuilder "github.com/onflow/flow-go/network/p2p/builder"
 	p2pbuilderconfig "github.com/onflow/flow-go/network/p2p/builder/config"
@@ -691,6 +692,13 @@ func (fnb *FlowNodeBuilder) InitFlowNetworkWithConduitFactory(
 		SlashingViolationConsumerFactory: func(adapter network.ConduitAdapter) network.ViolationsConsumer {
 			return slashing.NewSlashingViolationsConsumer(fnb.Logger, fnb.Metrics.Network, adapter)
 		},
+		UnicastStreamAuthorizer: func() func(flow.Role, flow.Role) bool {
+			if fnb.ObserverMode {
+				// observer mode uses public network where peers are not authorized based on role
+				return message.AlwaysAuthorizedUnicastSenderRole
+			}
+			return nil // use default (IsAuthorizedUnicastSenderRole)
+		}(),
 	}, networkOptions...)
 	if err != nil {
 		return nil, fmt.Errorf("could not initialize network: %w", err)

cmd/util/cmd/checkpoint-collect-stats/cmd.go

@@ -19,8 +19,8 @@ import (
 
 	"github.com/onflow/flow-go/cmd/util/ledger/reporters"
 	"github.com/onflow/flow-go/cmd/util/ledger/util"
+	"github.com/onflow/flow-go/fvm/environment"
 	"github.com/onflow/flow-go/fvm/evm/emulator/state"
-	"github.com/onflow/flow-go/fvm/evm/handler"
 	"github.com/onflow/flow-go/ledger"
 	"github.com/onflow/flow-go/ledger/common/pathfinder"
 	"github.com/onflow/flow-go/ledger/complete"
@@ -465,9 +465,9 @@ func getRegisterType(key ledger.Key) string {
 		return "account storage ID"
 	case state.CodesStorageIDKey:
 		return "code storage ID"
-	case handler.BlockStoreLatestBlockKey:
+	case environment.BlockStoreLatestBlockKey:
 		return "latest block"
-	case handler.BlockStoreLatestBlockProposalKey:
+	case environment.BlockStoreLatestBlockProposalKey:
 		return "latest block proposal"
 	}
 

cmd/util/cmd/inspect-token-movements/cmd.go

@@ -81,7 +81,7 @@ func run(*cobra.Command, []string) {
 	}()
 
 	// Create the token changes inspector with default search tokens for this chain
-	inspector := inspection.NewTokenChangesInspector(inspection.DefaultTokenDiffSearchTokens(chain, true), chainID)
+	inspector := inspection.NewTokenChangesInspector(inspection.DefaultTokenDiffSearchTokens(chain), chainID)
 
 	var from, to uint64
 

cmd/util/cmd/verify_execution_result/cmd.go

@@ -88,27 +88,58 @@ func run(*cobra.Command, []string) {
 		lg.Info().Msgf("look for 'could not verify' in the log for any mismatch, or try again with --stop_on_mismatch true to stop on first mismatch")
 	}
 
+	var totalStats verifier.BlockVerificationStats
+
 	if flagFromTo != "" {
 		from, to, err := parseFromTo(flagFromTo)
 		if err != nil {
 			lg.Fatal().Err(err).Msg("could not parse from_to")
 		}
 
 		lg.Info().Msgf("verifying range from %d to %d", from, to)
-		err = verifier.VerifyRange(lockManager, from, to, chainID, flagDatadir, flagChunkDataPackDir, flagWorkerCount, flagStopOnMismatch, flagtransactionFeesDisabled, flagScheduledTransactionsEnabled)
+		totalStats, err = verifier.VerifyRange(
+			lockManager,
+			from,
+			to,
+			chainID,
+			flagDatadir,
+			flagChunkDataPackDir,
+			flagWorkerCount,
+			flagStopOnMismatch,
+			flagtransactionFeesDisabled,
+			flagScheduledTransactionsEnabled,
+		)
 		if err != nil {
 			lg.Fatal().Err(err).Msgf("could not verify range from %d to %d", from, to)
 		}
-		lg.Info().Msgf("finished verified range from %d to %d", from, to)
+		lg.Info().Msgf("finished verifying range from %d to %d", from, to)
 	} else {
 		lg.Info().Msgf("verifying last %d sealed blocks", flagLastK)
-		err := verifier.VerifyLastKHeight(lockManager, flagLastK, chainID, flagDatadir, flagChunkDataPackDir, flagWorkerCount, flagStopOnMismatch, flagtransactionFeesDisabled, flagScheduledTransactionsEnabled)
+		var err error
+		totalStats, err = verifier.VerifyLastKHeight(
+			lockManager,
+			flagLastK,
+			chainID,
+			flagDatadir,
+			flagChunkDataPackDir,
+			flagWorkerCount,
+			flagStopOnMismatch,
+			flagtransactionFeesDisabled,
+			flagScheduledTransactionsEnabled,
+		)
 		if err != nil {
 			lg.Fatal().Err(err).Msg("could not verify last k height")
 		}
 
-		lg.Info().Msgf("finished verified last %d sealed blocks", flagLastK)
+		lg.Info().Msgf("finished verifying last %d sealed blocks", flagLastK)
 	}
+
+	lg.Info().Msgf("matching chunks: %d/%d. matching transactions: %d/%d",
+		totalStats.MatchedChunkCount,
+		totalStats.MatchedChunkCount+totalStats.MismatchedChunkCount,
+		totalStats.MatchedTransactionCount,
+		totalStats.MatchedTransactionCount+totalStats.MismatchedTransactionCount,
+	)
 }
 
 func parseFromTo(fromTo string) (from, to uint64, err error) {

context7.json

@@ -0,0 +1,4 @@
+{
+  "url": "https://context7.com/onflow/flow-go",
+  "public_key": "pk_EZ8p3YOFzJRKvdNkXGanl"
+}