Exchange of Data between GitHub and S3 Using Amazon AppFlow

“ I have checked the documents of AWS to exchange of data between github and s3 using amazon appflow. Amazon AppFlow service makes exchange of data between saas and amazon. In terms of cost, the solution is cheaper and secure.”

Amazon AppFlow is a fully managed integration service that enables you to securely exchange data between software as a service applications such as salesforce and AWS services such as Amazon Simple Storage Service and Amazon Redshift. For example, you can ingest contact records from salesforce to Amazon Redshift or pull support tickets from Zendesk to an Amazon S3 bucket.

In this post, you will experience the exchange of data between github and s3 using amazon appflow. Here I have created a s3 bucket, amazon appflow and repository in github.

Prerequisites

You’ll need an Amazon Simple Storage Service for this post. Getting started with Amazon Simple Storage Service provides instructions on how to create a bucket in simple storage service.

Architecture Overview

The architecture diagram shows the overall deployment architecture with data flow, s3 bucket, amazon appflow and github.

Solution overview

The blog post consists of the following phases:

1. Create a Amazon AppFlow with Source GitHub and Destination Amazon S3
2. Output of Flow Run in Amazon S3

I have a repository created in GitHub and a bucket created in AWS S3 →

Phase 1: Create a Amazon AppFlow with Source GitHub and Destination Amazon S3

1. Open the amazon appflow console, create a flow named “appflow-demo”. Configure flow with source as github with personal access token and required repository. Configure destination as amazon s3 with on-demand trigger action set.

Phase 2: Output of Flow Run in Amazon S3

Clean-up

S3 bucket, amazon appflow, github repo.

Pricing

I review the pricing and estimated cost of this example.

Cost of Simple Storage Service = $0.01

Cost of Amazon AppFlow (DataProcessing + ExecuteFlow) = $0.0

Total Cost = $0.01

Summary

In this post, I showed “how to exchange of data between github and s3 using amazon appflow”.

For more details on Amazon AppFlow, Checkout Get started Amazon AppFlow, open the Amazon AppFlow console. To learn more, read the Amazon AppFlow documentation.

Thanks for reading!

Connect with me: Linkedin