๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ

๐Ÿ’ปTech159

[HIVE] Delimiter \u001E \u001E -> \036 [record seperator] ROW FORMAT DELIMITED FIELDS TERMINATED BY '\036' ์œผ๋กœ ์„ค์ • ํ›„ Desc ์กฐํšŒํ•˜๋ฉด \u001E ํ—ฅ์‚ฌ๊ฐ’์œผ๋กœ ๋‚˜์˜ต๋‹ˆ๋‹ค. ์•„๋ž˜ site ์•„์Šคํ‚คํ‘œ ์ฐธ๊ณ ํ•˜๋ฉด hive ๋”œ๋ฆฌ๋ฏธํ„ฐ ๊ด€๋ จํ•˜์—ฌ ์ดํ•ดํ•˜๊ธฐ ์‰ฝ์Šต๋‹ˆ๋‹ค. 2016. 11. 30.
[Hive] ํ…Œ์ด๋ธ” ์‚ญ์ œํ•˜์ง€ ์•Š๊ณ  drop database ํ•˜๋Š” ๋ฐฉ๋ฒ• temp ๋ฐ์ดํ„ฐ ๋ฒ ์ด์Šค๋กœ ํ…Œ์ด๋ธ” ๋ช…์„ ๋ณ€๊ฒฝํ•˜๊ณ  ์‚ญ์ œํ•ด์ฃผ๋ฉด ๋ฉ๋‹ˆ๋‹ค. CREATE DATABASE temp; USE targetDB; ALTER TABLE targetTable RENAME TO temp.targetTable ; DROP DATABASE targetDB; 2016. 10. 18.
[Hive] ๋ฐ์ดํ„ฐ๋ฒ ์ด์Šค ์Šคํ‚ค๋งˆ ์ „์ฒด ์ถ”์ถœ โ—พ hive์—์„œ ๋ฐ์ดํ„ฐ๋ฒ ์ด์Šค ์Šคํ‚ค๋งˆ๋ฅผ ํ†ต์งธ๋กœ(ํ•˜์œ„ ํ…Œ์ด๋ธ”๋“ค๊นŒ์ง€) ์ƒ์„ฑํ•˜๋Š” shell script #!/bin/bash OPTION="--showHeader=false --outputformat=tsv2" DATABASE_NM=`hive ${OPTION} -e "show databases;"` for database in $DATABASE_NM do TABLE_NM=`hive ${OPTION} -e "use ${database}; show tables;"` for table in $TABLE_NM do hive ${OPTION} -e "show create table ${database}.${table}" >> ${database}_schema.hql echo ";" >> ${database}_schema.. 2016. 10. 4.
Error writing to output [influxdb]: Could not write to any InfluxDB server in cluster influxDB ์ตœ์‹  ๋ฒ„์ „์œผ๋กœ ์„ค์น˜ํ•ด ์ฃผ์„ธ์š”. ์ €๋Š” influxdb-0.9.6.1-1.x86_64.rpm ์„ค์น˜ํ–ˆ๋Š”๋ฐ ์œ„์™€ ๊ฐ™์€ ์—๋Ÿฌ๊ฐ€ ๋‚˜์„œ ์ตœ์‹  ๋ฒ„์ „ influxdb-0.12.2.1-1.x86_64.rpm ์„ค์น˜ํ•ด ์ฃผ๋‹ˆ๊นŒ ๋ฌธ์ œ ํ•ด๊ฒฐ๋์Šต๋‹ˆ๋‹ค. 2016. 8. 26.
[Hive] Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient โ–ถHive exception 16/07/18 11:00:43 WARN Hive: Failed to access metastore. This class should not accessed in runtime. org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient at org.apache.hadoop.hive.ql.metadata.Hive.getAllDatabases(Hive.java:1236) at org.apache.hadoop.hive.ql.metadata.Hive.re.. 2016. 7. 18.
[Java] TarArchiveInputStream error detected parsing the header ๐Ÿšซ ERROR java.io.IOException: Error detected parsing the header FileInputStream fin = null; BufferedInputStream bis = null; GzipCompressorInputStream gzIn = null; TarArchiveInputStream tarIn = null; InputStreamReader is = null; BufferedReader br = null; fin = new FileInputStream(); bis = new BufferedInputStream(fin); tarIn = new TarArchiveInputStream(bis); is = new InputStreamReader(tarIn, "UTF-8.. 2016. 7. 11.
[Java] ๋ฌธ์ž์—ด์—์„œ date ํŠน์ • ํŒจํ„ด ๊ฐ€์ ธ์˜ค๊ธฐ ๐Ÿ‘จ‍๐Ÿ’ป ๋ฌธ์ž์—ด์—์„œ ํŠน์ • ํŒจํ„ด์˜ date ๊ฒ€์ถœํ•˜๋Š” ๋ฐฉ๋ฒ• ๋ฌธ์ž์—ด์—์„œ ์ •๊ทœ์‹์„ ์ด์šฉํ•˜์—ฌ Date yyMMdd ํ˜•ํƒœ์˜ ํŒจํ„ด ๊ฒ€์ถœ String yyMMdd = "(19|20)\\d{2}(0[1-9]|1[012])(0[1-9]|[12][0-9]|3[01])"; String date = "20160620date"; String src = ""; Pattern pattern = Pattern.compile(yyMMdd); Matcher matcher = pattern.matcher(date); while(matcher.find()){ src = matcher.group(); } System.out.println("src: " + src); ๊ฒฐ๊ณผ ๊ฐ’ : 20160620 2016. 6. 20.
[SOLVED] wget: unable to resolve host address Error ๋ฆฌ๋ˆ…์Šค์—์„œ wget ์‚ฌ์šฉํ•˜์—ฌ ํŒŒ์ผ ๋‹ค์šด๋กœ๋“œํ•  ๊ฒฝ์šฐ ๋‚˜๋Š” ์—๋Ÿฌ์ž…๋‹ˆ๋‹ค. ์ €๋Š” 2๊ฐ€์ง€ ์—๋Ÿฌ๊ฐ€ ๋‚˜์„œ ์ •๋ฆฌํ•ด ๋ดค์–ด์š”. ๐Ÿšซ Error 1 wget: unable to resolve host address ๐Ÿ’ก SOLVED 1 resolv.conf ๋ฌธ์„œ์— nameserver 8.8.8.8 ์ถ”๊ฐ€ํ•ด์ค๋‹ˆ๋‹ค. sudo vi /etc/resolv.conf nameserver 8.8.8.8 ----->์ถ”๊ฐ€ nameserver 8.8.8.8๋Š” ๊ตฌ๊ธ€ DNS ์ฃผ์†Œ์ž…๋‹ˆ๋‹ค. ๊ตฌ๊ธ€ DNS๋ฅผ ์ด์šฉํ•ด์„œ ๋‹ค์šด๋ฐ›์„ ์ˆ˜ ์žˆ๋Š” ๋ฐฉ๋ฒ• ๊ฐ™์Šต๋‹ˆ๋‹ค. ๋„ค์ž„์„œ๋ฒ„๋ฅผ ์ถ”๊ฐ€ํ•ด ์ฃผ๊ณ  wget์„ ์ด์šฉํ•˜์—ฌ ๋‹ค์‹œ ๋‹ค์šด ๋ฐ›์Šต๋‹ˆ๋‹ค. ๊ทธ๋Ÿฌ๋‹ค ๋ณด๋ฉด ๋˜ ๋‹ค๋ฅธ ์—๋Ÿฌ๊ฐ€ ๋ฐœ์ƒํ•ฉ๋‹ˆ๋‹ค... ์ € ๊ฐ™์€ ๊ฒฝ์šฐ๋Š”... ๐Ÿšซ ERROR 2 cannot verify archive.apache.org's.. 2016. 5. 20.

ํ‹ฐ์Šคํ† ๋ฆฌํˆด๋ฐ”