Bucket
FileName
Value
Content-type
Values
Bucket
Path
Bucket
Path
logs
you had three folders: 2018
, 2019
, and errors
. Using the pattern \d\d\d\d/.*
, you could exclude all the files in the errors
folder, because \d\d\d\d
applies to the folders, and .*
applies to the files under them. If you're not sure what regular expression to use, leave this field blank, and YAP will synchronize everything under the prefix. If you're feeling particularly bold, you can learn to write your own regular expression..*json
will synchronize from an archive folder only those files that end a JSON file extension..csv
, .tsv
, .json
, .avro
, or .log
) what to synchronize. If you do choose a file type, every file examined by YAP will be interpreted as the file type you select, so make sure everything YAP synchronizes has the same file type.\N
to represent null. Note: text is un-escaped before the null sequence is matched, so don't use the escape character in your null sequence. Only use this field if you are sure your CSVs have a null sequence.My Security Credentials
:Roles
> Create role:
Another AWS Account
.
Ask your YAP manager ([email protected]) to provide you with Account ID and External ID.
Input YAP's Amazon S3 Account ID.
Select the Require external ID box. Enter an External ID
and record this down, you will also use this in the connection settings when creating an Amazon S3 connection with YAP.
Click Next: Permissions.AmazonS3FullAccess
.