๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ

๐Ÿ’ปTech160

[๋ฆฌ๋ˆ…์Šค] ์—ฌ๋Ÿฌ jar ํŒŒ์ผ์•ˆ์— class ๋ชฉ๋ก ํ•œ๋ฒˆ์— ์ถœ๋ ฅ ll | grep log4j | awk '{print $9}' | xargs -d '\n' -n 1 jar -tvf find . -name "*.jar" -exec echo ==\ {} \; -exec jar tf {} \;|grep -E "==|HiveMetaStore" 2022. 8. 4.
[Microsoft] AZ-900 ํ•ฉ๊ฒฉ ํ›„๊ธฐ (5์‹œ๊ฐ„ ๊ณต๋ถ€) ์š”์ฆ˜ ์—ฌ๋Ÿฌ ๊ธฐ์—…์—์„œ Cloud ์š”๊ฑด๋“ค์ด ๋งŽ์•„์ง€๊ณ  ์žˆ์–ด ์ทจ์—…์ด๋‚˜ ์ด์ง์‹œ Cloud ์ž๊ฒฉ์ฆ ํ•œ ๊ฐœ์ฏค ๊ฐ€์ง€๊ณ  ์žˆ์œผ๋ฉด ๋„์›€์ด ๋งŽ์ด ๋  ๊ฒ๋‹ˆ๋‹ค. ๊ทธ๋ž˜์„œ ์งง์€ ์‹œ๊ฐ„ ํˆฌ์žํ•ด์„œ ์‰ฝ๊ฒŒ ์ทจ๋“ํ•  ์ˆ˜ ์žˆ๋Š” Microsoft AZ-900 ์ž๊ฒฉ์„ ์ถ”์ฒœ๋“œ๋ ค์š”. ์‹œํ—˜๋„ ๋ฌด๋ฃŒ๋กœ ๋ณผ ์ˆ˜ ์žˆ์–ด ์‹œ๊ฐ„๋งŒ ํˆฌ์žํ•˜๋ฉด ๋ฉ๋‹ˆ๋‹ค. ์ €๋Š” 2021/12์— ์‹œํ—˜์„ ๋ดค์—ˆ์Šต๋‹ˆ๋‹ค. ๊ฒฐ๋ก ๋ถ€ํ„ฐ ๋ง์”€๋“œ๋ฆฌ๋ฉด ์•„๋ž˜ ๋งํฌ์˜ ๋คํ”„์—์„œ 90ํ”„๋กœ ์ด์ƒ ๋ฌธ์ œ๊ฐ€ ๋™์ผํ•˜๊ฒŒ ๋‚˜์˜ต๋‹ˆ๋‹ค. ๋ฌธ์ œ๋ž‘ ๋‹ต ์œ„์ฃผ๋กœ ๊ณต๋ถ€ํ•˜์‹œ๋ฉด ์ถฉ๋ถ„ํ•ฉ๋‹ˆ๋‹ค. ์ € ๊ฐ™์€ ๊ฒฝ์šฐ๋Š” ์ดํ‹€ ๋™์•ˆ 5์‹œ๊ฐ„ ์ •๋„ ํˆฌ์žํ•ด์„œ ํ•ฉ๊ฒฉํ–ˆ์Šต๋‹ˆ๋‹ค. ์•„๋ž˜ ์‚ฌ์ดํŠธ ์ ‘์†ํ•˜๋ฉด ๋ฌธ์ œ๊ฐ€ 230๊ฐœ ์ •๋„ ๋˜๋Š”๋ฐ 1๋ฒˆ๋งŒ ์ •๋…ํ•˜๋Š”๋ฐ๋„ ์‹œ๊ฐ„์ด ๊ฝค ๋งŽ์ด ์†Œ์š”๋ฉ๋‹ˆ๋‹ค. ๊ทธ๋ž˜์„œ ์ €๋Š” 100๋ฌธ์ œ๊นŒ์ง€๋งŒ ๋ฐ˜๋ณตํ•˜์—ฌ ๋ณด๋ฉด์„œ ๋ˆˆ์— ์ตํžˆ๋„๋ก 3๋ฒˆ ํšŒ๋…ํ–ˆ์Šต๋‹ˆ๋‹ค. (์ดํ‹€ ๋™์•ˆ 2์‹œ๊ฐ„, .. 2022. 5. 28.
[๋ฆฌ๋ˆ…์Šค] ํ•˜์œ„ ๋””๋ ‰ํ† ๋ฆฌ ๊ฐ ์‚ฌ์ด์ฆˆ ๋‚ด๋ฆผ์ฐจ์ˆœ ์ถœ๋ ฅ $ du -h --max-depth=1 | sort -rh ----------------------------------------- 138G . 137G ./dfs 1.3G ./yarn 284M ./hadoop-ozone 193M ./kudu ----------------------------------------- 2022. 4. 25.
[SOLVED] Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-build-on0urr/pip/ ๐Ÿšซ ERROR pip ํŒจํ‚ค์ง€ ์„ค์น˜ ๊ณผ์ •์—์„œ ์•„๋ž˜ ์—๋Ÿฌ๊ฐ€ ๊ณ„์† ๋ฐœ์ƒํ•˜์—ฌ ๊ฒ€์ƒ‰ํ•ด ๋ณด๋‹ˆ pip, setuptools ์—…๊ทธ๋ ˆ์ด๋“œํ•˜๋ผ๊ณ  ๋‚˜์˜ต๋‹ˆ๋‹ค Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-build-on0urr/pip/ ๊ทธ๋ž˜์„œ ์—…๊ทธ๋ ˆ์ด๋“œ๋ฅผ ์ง„ํ–‰ํ•˜๋ ค๊ณ  'pip install --upgrade pip' ๋ช…๋ น์–ด๋ฅผ ์‹คํ–‰ํ–ˆ๋Š”๋ฐ ๋‹ค๋ฅธ ์—๋Ÿฌ๊ฐ€ ๋ฐœ์ƒํ•˜๋„ค์š” ๐Ÿ˜ฅ [root@localhost ~] pip install --upgrade pip Collecting pip Using cached https://files.pythonhosted.org/packages/33/c9/e2164122d365d8f823213a53970fa3005eb16218ed.. 2022. 4. 12.
[๋ฆฌ๋ˆ…์Šค] ๋กœ๊ทธ ์ถ”์ถœ ๋ฐ ์‚ญ์ œ์ฃผ๊ธฐ ์„ค์ • ๐Ÿ“Œ /var/log/message ์˜ ์Œ“์ด๋Š” docker log ๋ณ„๋„ ์ €์žฅ ๋ฐ ์‚ญ์ œ ์ฃผ๊ธฐ ์„ค์ • $ vi /etc/rsyslog.d/10-docker.conf # Docker logging *.* { /var/log/docker/docker.log stop } $ systemctl restart rsyslog $ vi /etc/logrotate.d/docker /var/log/docker/docker.log { size 100M rotate 10 missingok compress } 2022. 3. 4.
impala-shell ํŒจ์Šค์›Œ๋“œ ์ž…๋ ฅ์—†์ด Ldap ๋กœ๊ทธ์ธํ•˜๋Š” ๋ฐฉ๋ฒ• impala-shell์—์„œ ์•„๋ž˜ 2๊ฐ€์ง€ ๋‚ด์šฉ์— ๋Œ€ํ•ด ํ•ด๊ฒฐํ•˜๋Š” ๋ฐฉ๋ฒ•์ž…๋‹ˆ๋‹ค impala-shell ๋ช…๋ น์–ด ์‹คํ–‰์‹œ ํ•ด๋‹น ๊ณ„์ •์œผ๋กœ ์˜ต์…˜ ์ž…๋ ฅ์—†์ด ๋กœ๊ทธ์ธํ•˜๋Š” ๋ฐฉ๋ฒ• impala-shell ๋ช…๋ น์–ด ์‹คํ–‰์‹œ Ldap ๋กœ๊ทธ์ธ ํŒจ์Šค์›Œ๋“œ ์ž…๋ ฅ์—†์ด ์‹คํ–‰์‹œํ‚ค๋Š” ๋ฐฉ๋ฒ• 1. ํ•ด๋‹น ๊ณ„์ •์˜ .impalarc ํŒŒ์ผ ์ƒ์„ฑ $ vi /home/user1/.impalarc 2. ์•„๋ž˜ ์‚ฌ์ดํŠธ์—์„œ Command-Line Option๊ณผ Configuration File Setting ๋น„๊ตํ•˜์—ฌ .impalarc ํŒŒ์ผ ์ž‘์„ฑ ๐Ÿ”— ์ฐธ๊ณ  ์‚ฌ์ดํŠธ: https://impala.apache.org/docs/build/html/topics/impala_shell_options.html 3. impalarc ํŒŒ์ผ ์ž‘์„ฑ โ—พ ์‹คํ–‰ํ•˜๋ ค๋Š” impala-shell ๋ช…๋ น์–ด i.. 2021. 11. 25.
์„œ๋ฒ„ reboot ์ดํ›„ MariaDB ์‹คํ–‰ ์•ˆ๋˜๋Š” ๋ฌธ์ œ ๐Ÿšซ ๋ฌธ์ œ ์›์ธ MariaDB ์„œ๋ฒ„๋ฅผ ์žฌ๊ธฐ๋™ํ•  ๊ฒฝ์šฐ pid ๋””๋ ‰ํ† ๋ฆฌ(/var/run/mariadb/)๋ฅผ ์ƒ์„ฑํ•˜์ง€ ๋ชปํ•ด ๋ฌธ์ œ๊ฐ€ ๋ฐœ์ƒ $ cat /etc/my.cnf.d/server.cnf -------------------------------------- [server] pid-file=/var/run/mariadb/mariadb.pid -------------------------------------- ๐Ÿ’ก ํ•ด๊ฒฐ ๋ฐฉ๋ฒ• (2๊ฐ€์ง€ ๋ฐฉ๋ฒ•) 1. pid-file ๊ฒฝ๋กœ๋ฅผ ๋ณ„๋„์˜ ๊ฒฝ๋กœ๋กœ (์‚ญ์ œ๋˜์ง€ ์•Š๋Š”) ์ง€์ •ํ•ด ์คŒ $ vi /etc/my.cnf.d/server.cnf ---------------------------------- [server] pid-file=/var/lib/mysql/mariadb.pid ---.. 2021. 9. 3.
impala ๋ช…๋ น์–ด ์ •๋ฆฌ โ—พ Impala ์˜ต์…˜ ๊ฐ’ ํ™•์ธSET ALL; โ—พ ํŒŒ์ผ์„ ๋ถ„ํ• ํ•˜์ง€ ์•Š๊ณ  1๊ฐœ ํŒŒ์ผ๋กœ ์ƒ์„ฑํ•˜๊ณ  ์‹ถ์„ ๋•Œ ์•„๋ž˜ ์˜ต์…˜ ์ ์šฉ ํ›„ insert ์ฟผ๋ฆฌ ์‹คํ–‰SET NUM_NODES=1;โ—พ impala shell ์ ‘์†impala-shell -i impala.host.com:21000 -d default -l -u admin --auth_creds_ok_in_clear โ—พ ํ…Œ์ด๋ธ” ํ†ต๊ณ„ ์ •๋ณด ์ˆ˜์ง‘ (์ฟผ๋ฆฌ ์„ฑ๋Šฅ ํ–ฅ์ƒ, memory ๋ถ€์กฑ ์˜ค๋ฅ˜ ๋ฐœ์ƒ ์˜ˆ๋ฐฉ)COMPUTE STATS {TABLE_NM} โ—พ ๊ฐ„๋žตํ•œ ํ…Œ์ด๋ธ” ์ •๋ณด ํ™•์ธ (Rows, ํŒŒ์ผ ์ˆ˜, ํ…Œ์ด๋ธ” size ๋“ฑ ์ •๋ณด ํ™•์ธ) SHOW TABLE STATS {TABLE_NM} โ—พ ํ…Œ์ด๋ธ” ์ƒ์„ธ ์ •๋ณด ํ™•์ธDESCRIBE FORMATTED {TABLE_NM} โ—พ SQL ์ˆ˜ํ–‰ ์ „ .. 2021. 8. 24.