Skip to content

HadoopArchives.java polishing#29

Closed
alexVengrovsk wants to merge 4 commits intoapache:trunkfrom
alexVengrovsk:HADOOP-OVENGR
Closed

HadoopArchives.java polishing#29
alexVengrovsk wants to merge 4 commits intoapache:trunkfrom
alexVengrovsk:HADOOP-OVENGR

Conversation

@alexVengrovsk
Copy link
Copy Markdown

HadoopArchives.java was edited.

mekasone pushed a commit to mekasone/hadoop that referenced this pull request Feb 19, 2017
passaro added a commit to passaro/hadoop that referenced this pull request Nov 24, 2022
saxenapranav pushed a commit to saxenapranav/hadoop that referenced this pull request Apr 25, 2023
Fixing Azcopy Helper FileSystem Issue
NyteKnight pushed a commit to NyteKnight/hadoop that referenced this pull request Jun 25, 2024
…pache#5118) (apache#29)

* HADOOP-18427. Improve ZKDelegationTokenSecretManager#startThead With recommended methods. (apache#4812)

* HADOOP-18452. Fix TestKMS#testKMSHAZooKeeperDelegationToken Failed By Hadoop-18427. (apache#4885)

Co-authored-by: slfan1989 <55643692+slfan1989@users.noreply.github.com>
Co-authored-by: Melissa You <myou@linkedin.com>

Co-authored-by: slfan1989 <55643692+slfan1989@users.noreply.github.com>
singer-bin pushed a commit to singer-bin/hadoop that referenced this pull request Dec 19, 2024
The binary dictionary writers keep track of written values in memory to
deduplicate and write dictionary pages periodically. If the written
values are changed by the caller, then this corrupts the dictionary
without an error message. This adds a defensive copy to fix the problem.

Author: Ryan Blue <rblue@cloudera.com>

Closes apache#29 from rdblue/PARQUET-62-fix-dictionary-bug and squashes the following commits:

42b6920 [Ryan Blue] PARQUET-62: Fix binary dictionary write bug.
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jan 4, 2026

We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable.
If you feel like this was a mistake, or you would like to continue working on it, please feel free to re-open it and ask for a committer to remove the stale tag and review again.
Thanks all for your contribution.

@github-actions github-actions Bot added the Stale label Jan 4, 2026
@github-actions github-actions Bot closed this Jan 5, 2026
LuciferYang added a commit to LuciferYang/hadoop that referenced this pull request Apr 16, 2026
Second complex-mutation RPC. Uses PATH_WRITE + nested BM write
(same nesting as truncate). Exercises lease acquisition via
recoverLeaseInternal and block-level mutation via
prepareFileForAppend.

RPC apache#29 — append (PATH_WRITE + BM write + lease):
  - Pre-resolved-IIP overload added to FSDirAppendOp. Skips
    resolvePath; preserves all internal logic: permission check,
    directory rejection, striped/lazy-persist handling, lease
    recovery, last-block sufficiency check, prepareFileForAppend,
    getFileInfo for stat. hasWriteLock(GLOBAL) assertions pass via
    HELD_IIP_WRITE.
  - BM write lock nested under PATH_WRITE in appendFilePilot.
  - logSync in a finally block (mirrors legacy shape for
    StandbyException skip-sync handling).

Pilot envelope:
  - canUsePilotPathWrite (Phase A)
  - target exists, is a file, ancestorsAllowMutate (Phase B)

Tests (4 new in TestFSNamesystemFGLIIP):
  - appendToExistingFile — 64 + 32 = 96 bytes
  - appendToMissingPathFails — IOException
  - appendToDirectoryFails — IOException
  - multipleSequentialAppends — 5 sequential appends accumulate

Verification:
  mvn test -pl hadoop-hdfs-project/hadoop-hdfs -o \
    -Dtest='TestFSNamesystemFGLIIP'
  => Tests run: 129, Failures: 0, Errors: 0, Skipped: 0

Post-gate RPC counter: 29 migrated.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant