๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ
๐Ÿ’ปTech/๐Ÿ˜hadoop

Oozie ๋ช…๋ น์–ด ์ •๋ฆฌ

by _viper_ 2019. 7. 5.
๋ฐ˜์‘ํ˜•

 


oozie๋ž€ Apache Hadoop ์ž‘์—…์„ ๊ด€๋ฆฌํ•˜๋Š” ์›Œํฌํ”Œ๋กœ์šฐ ์Šค์ผ€์ค„๋Ÿฌ ์‹œ์Šคํ…œ

  • ๋ฐ์ดํ„ฐ ์ถ”์ถœ,๋ณ€ํ™˜,์ ์žฌ ์ž‘์—…์ธ ETL(Extraction Transformation Loading)์„ ์ˆ˜ํ–‰ํ•˜๊ธฐ ์œ„ํ•ด ์‚ฌ์šฉํ•ฉ๋‹ˆ๋‹ค.

 

โ—พ coordinator ๋“ฑ๋ก

  • coordinator job์„ ์‹คํ–‰
oozie job -config $job.properties -run

 

โ—พ coordinator ์กฐํšŒ

  • ๋“ฑ๋ก๋˜์–ด ์žˆ๋Š” coordinator job ๋ชฉ๋ก์„ ์กฐํšŒ
oozie jobs -jobtype coord

 

โ—พ coordinator update

  • coordinator์˜ ๋‚ด์šฉ(coordinator.xml) ์ˆ˜์ • ํ›„ ์—…๋ฐ์ดํŠธ
oozie job -config $job.properties -update $coordinator_job_id)
ex) oozie job -config aa_job.properties -update 0054885-170318140345166-oozie-hado-C


โ—พ ๋กœ๊ทธ ์กฐํšŒ

  • job ๋กœ๊ทธ ํ™•์ธ (์—๋Ÿฌ ๋‚ด์šฉ ํ™•์ธ ๊ฐ€๋Šฅ)
oozie job -log $workflowID


โ—พ job ์žฌ์ฒ˜๋ฆฌ

  • ์ค‘์ง€/์‹คํŒจํ•œ job์„ ์žฌ์ˆ˜ํ–‰ (์˜ต์…˜ failnodes=true : ์‹คํŒจํ•œ job๋งŒ ์žฌ์ˆ˜ํ–‰)
oozie job -rerun $workflowID -Doozie.wf.rerun.failenodes=true


โ—พ info ์กฐํšŒ

  • workflow ์ƒํƒœ ํ™•์ธ
oozie job -info $workflowID

 

โ—พ job KILL

  • PREP, SUSPEND, RUNNING ์ƒํƒœ์˜ job์„ ์ค‘๋‹จ
oozie job -kill $workflowID