- This event has passed.
App for Data Movement (HDFS to S3) On-prem to Cloud/AWS
June 22, 2017 @ 9:00 am - 10:00 am
Presenter -Chaitanya Chebolu
DataTorrent AppHub (link to https://www.datatorrent.com/apphub/) has a series of application templates. These templates are meant to reduce your total cost of ownership. This is achieved by ensuring bulk of the functional development is done, specifically in terms of connectiors to and from Hadoop. You would need to however put in your custom logic. The templates are also certified from an operational point of view. Benchmarking, end-to-end exactly once, scale, fault tolerance is certified and verified with Cloudera, Hortonworks, and MapR. Using these templates thus reduces your total cost of ownership.
This talk will be about how to download and launch the HDFS to S3 app template.
HDFS to S3 App: The HDFS to S3 Application Template continuously ingest files from HDFS as blocks to Amazon S3 by using multi-part upload feature.
Chaitanya Chebolu is a Software Development Engineer at DataTorrent and committer at Apache Apex. He has been working with DataTorrent from past 2 years.
Please register for the webinar at :
After registering, you will receive a confirmation mail containing information about joining the webinar.
To reduce time to market and total cost of ownership, look at operable solutions factory – that you can quickly import and launch. Examples: HDFS to HDFS & HDFS-Line-Copy (back-up, replication, disaster-recovery, distcp replacement); Kafka to HDFS (ingest, transform); S3 to HDFS (cloud to on-prem); HDFS to Kafka (data lake to event stream, big data log streaming); Database to HDFS (db offload); Database to Database (change data capture, customer 360); Kafka to Database (ingest, transform & load); Kinesis to S3 (Cloud ingest, transform, & load).
Templates include ability to parse, error check, transform, and act on before loading. Additionally, You can add/modify your custom logic on transform, alerts, and actions. Templates include real-time dashboarding for instant views and historical views.
Free DataTorrent Enterprise Edition for qualifying startups. Check it out!
Free DataTorrent Enterprise Edition for Universities. Check it out!
Brought to you by DataTorrent, creators of Apache Apex.