I will suggest to also look at TPT from teradata which is much faster than sqoop
On 01-Aug-2016 6:17 pm, "Gmail" <[email protected]> wrote: > Hi Bhagaban > > I have seen more efficient way of data transfer by fast exporting the data > and put them directly in HDFS. And then create structure as per the data in > HIVE or PIG. We have developed DDL transformation script using shell script > which can convert the TERADATA DDL to Hive DDL. This automation effort will > not take much time . We have faced some challenges while converting the > timestamp and date data type in parquet format. But later those resolved > with higher version of hive. I will also suggest to check TERADATA > connector for Hadoop the tool developed by TERADATA which is self efficient > to choose different data transfer strategies. > > Thanks > Asim > > Sent from my iPhone > > On Aug 1, 2016, at 7:37 AM, Rakesh Radhakrishnan <[email protected]> > wrote: > > Hi Bhagaban, > > Perhaps, you can try "Apache Sqoop" to transfer data to Hadoop from > Teradata. Apache Sqoop provides an efficient approach for transferring > large data between Hadoop related systems and structured data stores. It > allows support for a data store to be added as a so-called connector and > can connect to various databases including Oracle etc. > > I hope the below links will be helpful to you, > http://sqoop.apache.org/ > > http://blog.cloudera.com/blog/2012/01/cloudera-connector-for-teradata-1-0-0/ > http://hortonworks.com/blog/round-trip-data-enrichment-teradata-hadoop/ > > http://dataconomy.com/wp-content/uploads/2014/06/Syncsort-A-123ApproachtoTeradataOffloadwithHadoop.pdf > > Below are few data ingestion tools, probably you can dig more into it, > https://www.datatorrent.com/product/datatorrent-ingestion/ > > https://www.datatorrent.com/dtingest-unified-streaming-batch-data-ingestion-hadoop/ > > Thanks, > Rakesh > > On Mon, Aug 1, 2016 at 4:54 PM, Bhagaban Khatai <[email protected]> > wrote: > >> Hi Guys- >> >> I need a quick help if anybody done any migration project in TD into >> hadoop. >> We have very tight deadline and I am trying to find any tool (online or >> paid) for quick development. >> >> Please help us here and guide me if any other way is available to do the >> development fast. >> >> Bhagaban >> > >
