Batch bulk upload limits

[ashleymichal]

As much as possible we should analyze payloads before sending them to prevent wrangler spinning on impossible loads for no reason. In the case of a bulk upload using a json file (the basic bulk write method), this means the following:

The entire request size must be 100 megabytes or less.

Wrangler should check that the payload is less than 100MB, and bail with a message if it is not. Future optimizations would include streaming a file and chunking it appropriately, but this is really stupid hard with json.

Body should be an array of up to 10,000 key-value pairs

If the first parameter is satisfied, Wrangler should batch requests to meet the 10,000 key limit.

(Bonus)

(keys) The name may be at most 512 bytes

Assert that all keys are 512B maximum

(values) A UTF-8 encoded string to be stored, up to 2 MB in length.

Assert that all values are 2MB maximum

https://api.cloudflare.com/#workers-kv-namespace-write-multiple-key-value-pairs

(separate issue to be filed for "bucket" behavior)

[gabbifish]

We still are dependent on cloudflare/cloudflare-rs#32 before we can close this issue.

[ashleymichal]

should probably split out the parts of this issue that are dependent on cloudflare-rs to their own issue and track them separately.

[ashleymichal]

opening new issue to track overall size: #476