Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🐛 BUG: Import an D1 exported DB cannot be imported in local - HashIndex detected hash table inconsistency #8153

Open
lakano opened this issue Feb 15, 2025 · 1 comment
Labels
bug Something that isn't working

Comments

@lakano
Copy link

lakano commented Feb 15, 2025

Which Cloudflare product(s) does this pertain to?

D1

What versions are you using?

3.108.0

What operating system and version are you using?

Arch Linux

Please provide a link to a minimal reproduction

No response

Describe the Bug

Hi,

After an export of our D1 database on remote ( wrangler d1 export dbname --remote --output export.sql ), I'm trying to import it on local ( wrangler d1 execute --local --file export.sql ), but I got a lot of errors.

After theses long list of errors I also got a generic « ✘ [ERROR] internal error », and none of the INSERT request are executed.
The file contain ~3000 INSERT with each request could expand until 12000 characters each (JSON content), if I split the files in multiples files of ~200 INSERT, I could be able to import all the file, wittout the « ✘ [ERROR] internal error » but still with the repeated errors « HashIndex detected hash table inconsistency ».

Please provide any relevant error logs

kj/table.c++:57: error: HashIndex detected hash table inconsistency. This can happen if you create a kj::Table with a hash index and you modify the rows in the table post-indexing in a way that would change their hash. This is a serious bug which will lead to undefined behavior.
stack: ; kj::getStackTrace() = /workers/node_modules/@cloudflare/workerd-linux-64/bin/workerd@2b4cc7d /workers/node_modules/@cloudflare/workerd-linux-64/bin/workerd@2b4868c /workers/node_modules/@cloudflare/workerd-linux-64/bin/workerd@2b4b0ab /workers/node_modules/@cloudflare/workerd-linux-64/bin/workerd@2277fc0 /workers/node_modules/@cloudflare/workerd-linux-64/bin/workerd@39d1109 /workers/node_modules/@cloudflare/workerd-linux-64/bin/workerd@39d0edd /workers/node_modules/@cloudflare/workerd-linux-64/bin/workerd@38358f5

@lakano lakano added the bug Something that isn't working label Feb 15, 2025
@github-project-automation github-project-automation bot moved this to Untriaged in workers-sdk Feb 15, 2025
@mrankine
Copy link

mrankine commented Feb 15, 2025

I am also seeing this, after upgrading from 3.103.2 to 3.109.1.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something that isn't working
Projects
Status: Untriaged
Development

No branches or pull requests

2 participants