ORACLE OCI - Object Storage Multi Part Upload

In some cases we may have to upload larger file and uploading larger file may take more time and bandwidth.  In such cases we can split the file into multi parts and upload them in parallel. 

We can use the following steps to split and upload the files to object storage. 

• First split the file based on the required size using split command. 
• split -b 5M -d /tmp/bigfilename.txt /tmp/bigfilename.split
• Create a multi part upload request. 
• POST
• /n/{namespaceName}/b/{bucketName}/u
• Request Payload

{

  "object": "example_object1"

}

• Response Payload 

{

  "namespace": "ansh8lvru1zp",

  "bucket": "MyBucket",

  "object": "MyObject1",

  "uploadId": "c892336f-ccvb-1bb8-6e75-a5649fd91178"

}

•  Use the above upload Id to upload the files. 
• Loop over each file and upload the files 
• PUT
• /n/{namespaceName}/b/{bucketName}/u/{FinalFileName}?uploadid={UploadID}&uploadPartNum={partNum/SequenceNum}
• After Upload , get all the multi part upload details. 
• GET
• /n/{namespaceName}/b/{bucketName}/u/{FinalFileName}?uploadid={UploadID}
• Sample Response

[

  {

    "partNumber": 1,

    "etag": "3d240a5a-a2b0-45b2-bcvb-2ac6a02b422c",

    "md5": "rvr3UC1SmUw7cvb2NqPN0g==",

    "size": 8

  },

  {

    "partNumber": 2,

    "etag": "15de104e-7cvb-3513-8da1-3b5e75a65ad7",

    "md5": "3poFVtJezCVBOi8RzhUB8Q==",

    "size": 8

  }

]

• Finally commit the upload. 
• POST
• /n/{namespaceName}/b/{bucketName}/u/{FinalFileName}?uploadid={UploadID}
• Request Payload

 

{

  "partsToCommit": [

    {

      "partNum": 1,

      "etag": "3d240a5a-a2b0-45b2-bcvb-2ac6a02b422c"

    },

    {

      "partNum": 2,

      "etag" : "15de104e-7cvb-3513-8da1-3b5e75a65ad7"

    }

  ]

}