I have created a utility to export data from dynamo db into a csv file without using AWS data pipeline. This utility queries dynamo for all the records and creates a csv file. Please note that this will be counted against the read capacity (number of reads) of your dynamo table. If you are interested in looking at code, it's on my GitHub repo. This utility uses dynamo's scan operation. You can read about scan operation on AWS documentation.
Nice explanation and good readable code! This utility should be plug n play where we need to export the data in file.
ReplyDeleteI have a question - Can this be updated to support multiple file formats or csv is the most preferred one? Also, can we have toggled version to read from files and upload back data in DynamoDB? Not sure about the practical usage but things like SQL loaders do same while updating/inserting data in relational DB's like Oracle. Just a thought..
Thanks!