Free Form Query In Sqoop 5 New Thoughts About Free Form Query In Sqoop That Will Turn Your World Upside Down
A diffuse title. I know.
Cutting to the chase, I bare to alteration abstracts from my RDBMS to a Hadoop array and I alone had admission to Hue/Oozie (since I’m not an admin). I knew that I could use Sqoop to do it — but I’ve never absolutely done it before.
It was freaking hard/annoying!
So to advice others out there who ability be in a agnate asperity as I was, actuality are some 101.
2. Drag a Sqoop activity from the console aloft and bang OK.
3. You’ll get some pre-filled sqoop command in there which you can use as reference. Hop to Apache Sqoop to apprentice added about all accessible arguments you can use.
4. There’s 2 way you can go about entering the Sqoop command from actuality on out. You can either blazon in the Sqoop command in the altercation box, OR if you’re cerebration of application a concern in your command, my advocacy is to use the altercation window. The closing is based on a column from SO, area some guys had issues back application the free-form concern in Sqoop/Oozie.
5. Change the amount of the acreage sqoop.connection.factories to your agnate DB. In my case I’m demography abstracts from a Netezza, so beneath is my setting.
6. Accommodate hive-site.xml into your Sqoop workflow. Refer to key credibility area in this commodity for added account as to why we charge to accommodate the book into our workflow.
7. You’re all set. You may now run your workflow.
8. If the aloft doesn’t work, try blockage out the stdout logs and actuate area it could’ve went wrong. In my case, I’m application the username HAFIDZ but the table (in Netezza) was created by DBA. To fix this, we charge to accommodate the action forth with the table name in the ‘table’ parameter. For example, DBA.<tablename>.
References (in no accurate order):
 Sqoop User Guide : https://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html
 How to Oozie Sqoop Hive: http://ingest.tips/2014/11/27/how-to-oozie-sqoop-hive/
 Sqoop Free-form Concern Causing Unrecognized Arguments in Hue/Oozie : http://stackoverflow.com/questions/25770698/sqoop-free-form-query-causing-unrecognized-arguments-in-hue-oozie
Free Form Query In Sqoop 5 New Thoughts About Free Form Query In Sqoop That Will Turn Your World Upside Down – free form query in sqoop
| Encouraged to the blog, in this time I am going to provide you with with regards to keyword. And from now on, here is the initial photograph: