Skip to content

Removes cached file status on error - #6620

Merged
ddanielr merged 1 commit into
apache:2.1from
keith-turner:accumulo-6617
Oct 29, 2026
Merged

ddanielr merged 1 commit into
apache:2.1from
keith-turner:accumulo-6617

Conversation

@keith-turner

Copy link
Copy Markdown
Contributor

The bulk import code uses cached file status objects to open files. When any error occurs reading a file this change removes the cached file status in case stale information in the file status was causing a problem. This change may fix #6617.

The bulk import code uses cached file status objects to open files. When any
error occurs reading a file this change removes the cached file status in case
stale information in the file status was causing a problem. This change
may fix apache#6617.
@keith-turner keith-turner added this to the 2.1.7 milestone Oct 28, 2026
Collections.synchronizedSortedMap(new TreeMap<>());

final Map<Path,FileStatus> fileStatuses = new HashMap<>();
final Map<Path,FileStatus> fileStatuses = new ConcurrentHashMap<>();

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Noticed multiple threads were interacting w/ this map so changed the type to ensure threads see what other threads put in the map.

@dlmarion dlmarion linked an issue Oct 29, 2026 that may be closed by this pull request
@ddanielr
ddanielr merged commit 5cab67b into apache:2.1 Oct 29, 2026
9 checks passed
@keith-turner
keith-turner deleted the accumulo-6617 branch October 29, 2026 18:42
keith-turner added a commit that referenced this pull request Oct 30, 2026
Changes in #6620 introduced a potential NPE when status is removed from map.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Bulk import can retry indefinitely after repeated exception

3 participants