Bulk Export

This article explains Treasure Data’s bulk-export feature, which lets you dump data into your Amazon S3 bucket.

At Treasure Data, we believe that your data belongs to you, even after importing it to our platform. We believe that vendor-lockin MUST be stopped.

Table of Contents

Prerequisites

  • Basic knowledge of Treasure Data, including the toolbelt.
  • Amazon AWS account and Amazon S3 bucket.

Table Dump

The td table:export command will dump all the data uploaded to TD into your Amazon S3 bucket. Please specify the database and table from which to dump your data.

The dump is performed via MapReduce jobs.

usage:
  $ td table:export <db> <table>

example:
  $ td table:export example_db table1 --s3-bucket mybucket -k KEY_ID -s SECRET_KEY

description:
  Dump logs in a table to the specified storage

options:
  -f, --from TIME                  export data which is newer than or same with the TIME
  -t, --to TIME                    export data which is older than the TIME
  -b, --s3-bucket NAME             name of the destination S3 bucket (required)
  -k, --aws-key-id KEY_ID          AWS access key id to export data (required)
  -s, --aws-secret-key SECRET_KEY  AWS secret access key to export data (required)

If this article is incorrect or outdated, or omits critical information, please let us know. For all other issues, please see our support channels. Live chat with our staffs also work well.