Accessing IEEE DataPort Dataset Files through Amazon Web Services (AWS)

Background

  • IEEE DataPort dataset files are stored on Amazon Simple Storage Service (S3) file storage
  • To find IEEE DataPort files and metadata, please see the Instructions for Accessing a Dataset found on the IEEE DataPort site.
  • Users may download dataset files or access these files “in the cloud” using tools and services that support the AWS S3 protocol (see below for examples and links).  These instructions address accessing IEEE DataPort datasets files through AWS. 


Prerequisites


Instructions

  1. Login to IEEE DataPort (the login link is located in the upper right of the website)
  2. Click on the Account link on the upper right
  3. Find and record your personal AWS Access Key ID.
  4. Click the Show AWS Secret Access Key link.
  5. Find and record the AWS Secret Access Key, which will be shown in a dialog.
  6. Now find the dataset you would like to access or analyze. See our Instructions for Accessing a Dataset for more information.
  7. Copy the S3 URIs of the dataset files you wish to access.
    1. When you click on individual files under the AWS S3 tab, the S3 URI will be automatically selected. You may then copy (Ctrl-C, Cmd-C) and paste the URI.
    2. To copy all of the URIs for your dataset you may also click the Copy All URIs to the Clipboard link at the bottom of the AWS S3 tab. Note: some browsers do not support this feature, in which case a dialog is opened with all S3 URI’s listed and highlighted for easy copying.
  8. Using your AWS Keys and the S3 URIs you copied, you will now be able to access these files using a number of tools, scripts, and services that support AWS S3. 
  9. See below for links to some of the methods of accessing S3 files using your AWS keys. Note: the appropriate tool/service/script is dependent on the format of the dataset files you are trying to access. Instructions available on the dataset page may be helpful in selecting the appropriate tools.


Links to Tools and Services supporting S3