You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
During the UpsertCompactionTaskGenerator, we check whether the ZK metadata CRC of a segment matches the CRC we fetch from the validDocID bitmap response from the servers (Ref).
If a scenario is present where the CRCs do not match across replicas and we use the CRC from the validDocID bitmap response from a replica server that has not updated the ZK metadata, we will end up not considering that segment for compaction.
Tracking this issue for making this generation process more robust.
The text was updated successfully, but these errors were encountered:
During the UpsertCompactionTaskGenerator, we check whether the ZK metadata CRC of a segment matches the CRC we fetch from the validDocID bitmap response from the servers (Ref).
If a scenario is present where the CRCs do not match across replicas and we use the CRC from the validDocID bitmap response from a replica server that has not updated the ZK metadata, we will end up not considering that segment for compaction.
Tracking this issue for making this generation process more robust.
The text was updated successfully, but these errors were encountered: