๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ

๐Ÿ’ปTech159

conda keyerror 'channels' is not in the 'channels' key of the config file conda config --remove channel ์‹คํ–‰์‹œ ์•„๋ž˜ ์—๋Ÿฌ ๋ฐœ์ƒํ•  ๊ฒฝ์šฐ ์กฐ์น˜ ๋ฐฉ๋ฒ•์ž…๋‹ˆ๋‹ค. ๐Ÿšซ ERROR conda keyerror 'channels' is not in the 'channels' key of the config file ๐Ÿ’ก SOLVED 1. conda config --show channels 2. conda config --remove channel CHANNEL_NAME 2021. 7. 16.
Git clone/push LDAP ์ธ์ฆ ๋ฌธ์ œ (http 500 ์—๋Ÿฌ) ๐Ÿšซ ERROR fatal: unable to access 'https://localhost:8800/admin1/init_test.git/': The requested URL returned error: 500 ๐Ÿ’ก SOLVED 1. ์•„๋ž˜ git ์„ค์ • ํ•ด์ค˜์•ผ clone/push ์ธ์ฆ ํ•  ๋•Œ AD ๊ณ„์ • ์ธ์ฆ ๋ฉ๋‹ˆ๋‹ค. ## ์„ค์ • ์ ์šฉ $ vi /etc/gitlab/gitlab.rb -------------------------------- encryption = 'plain' -------------------------------- 2. ์„ค์ • ํ›„ ์žฌ๊ธฐ๋™ $ gitlab-ctl reconfigure ๐Ÿ”Ž ์ฐธ๊ณ  https://forum.gitlab.com/t/unable-to-clone-in-https-using.. 2021. 7. 9.
pip install (ํ์‡„๋ง ๋กœ์ปฌ whl ํŒŒ์ผ ์ง์ ‘ ์„ค์น˜) โ—พ whl ํŒŒ์ผ ์ง์ ‘ ์„ค์น˜ user ์˜ต์…˜์€ ์„ค์น˜๋ฅผ ์ง„ํ–‰ํ•˜๋Š” ํ•ด๋‹น ๊ณ„์ •์— ํŒจํ‚ค์ง€ ์„ค์น˜ํ•œ๋‹ค๋Š” ์˜๋ฏธ user ์˜ต์…˜์„ ๋ถ™์ด์ง€ ์•Š์œผ๋ฉด root ๊ณ„์ •์œผ๋กœ ์ง„ํ–‰ํ•ด์•ผํ•จ pip3 install --no-index --find-links . ํŒŒ์ผ๋ช….whl --user โ—พ requirements.txt ํŒŒ์ผ์— ์„ค์น˜ ํŒจํ‚ค์ง€ ๋ชฉ๋ก ์ž‘์„ฑํ•˜์—ฌ ์‹คํ–‰ pip3 install --no-index --find-links . -r requirements.txt --user 2021. 6. 18.
[Hive] sequence ์ปฌ๋Ÿผ ์ƒ์„ฑ ๋ฐฉ๋ฒ• ๐Ÿ™†‍โ™‚๏ธ ROW_NUMBER() OVER() ๊ตฌ๋ฌธ์„ ์‚ฌ์šฉํ•ด์„œ seq ๋ฒˆํ˜ธ๋ฅผ ์ €์žฅ ## ๊ธฐ์กด ํ…Œ์ด๋ธ”์—์„œ seq ์ปฌ๋Ÿผ์„ ์ถ”๊ฐ€ํ•œ ํ…Œ์ด๋ธ” ์ƒ์„ฑ CREATE TABLE new_table( seq int, code string, description string, total_emp int, salary int ) STORE AS parquet; ## ๊ธฐ์กด ํ…Œ์ด๋ธ”์— ROW_NUMBER() OVER() ํ•ฉ์ˆ˜ ์‚ฌ์šฉํ•ด์„œ seq ์ปฌ๋Ÿผ ์ถ”๊ฐ€ํ•œ ๋ฐ์ดํ„ฐ insert insert overwrite table new_table select * from ( select ROW_NUMBER() OVER() as RNUM, * from old_table) a where a.RNUM 2021. 4. 28.
[MariaDB] Replication ๊ธฐ๋Šฅ ์ ์šฉ ๋ฐฉ๋ฒ• MariaDB Replication ๊ธฐ๋Šฅ์€ DB ๋ฐ์ดํ„ฐ ๋ฐฑ์—… ์šฉ๋„๋กœ ์‚ฌ์šฉ (์ด์ค‘ํ™”๊ฐ€ ์•„๋‹˜) 1. Master ์„œ๋ฒ„ 1) mariaDB stop & DB ๋ฐฑ์—… $ systemctl stop mariadb $ mysqldump -uroot -p hue > hue.sql 2) server.cnf ์„ค์ • ์ถ”๊ฐ€ vi /etc/my.conf.d/server.cnf ----------------------------- [mysqld] log_bin=mysql-bin server-id=1 ----------------------------- 3) systemctl start mariadb 4) mysql ์ ‘์† ํ›„ ์•„๋ž˜ ๋ช…๋ น์–ด ์‹คํ–‰ > GRANT REPLICATION SLAVE, REPLICATION CLIENT ON *.. 2021. 4. 20.
[Ranger] REST API Query History (hiveServer2, impala) ๐ŸŒ  REST API URL http://localhost:6080/service/assets/accessAudit?page=0&pageSize=25&total_pages=55&totalCount=1363&startIndex=0&sortBy=eventTime&excludeServiceUser=true&startDate=03%2F30%2F2021 [ํŒŒ๋ผ๋ฏธํ„ฐ ์„ค๋ช…] > startDate=03%2F30%2F2021 (03/30/2021) > ์กฐํšŒ ๊ฒฐ๊ณผ agentID์— hiveServer2, impala๋กœ ์ฟผ๋ฆฌ ๊ตฌ๋ถ„ ๊ฐ€๋Šฅ 2021. 4. 8.
[๋ฆฌ๋ˆ…์Šค] ์—ฌ๋Ÿฌ ์„œ๋ฒ„ ์›๊ฒฉ ์ž‘์—… (parallel-ssh, ssh remote shell) ๋ฆฌ๋ˆ…์Šค์—์„œ ์—ฌ๋Ÿฌ ์„œ๋ฒ„๋“ค ๋™์‹œ์— ์ž‘์—…ํ•  ๋•Œ ์œ ์šฉํ•œ 2๊ฐ€์ง€ ๋ฐฉ๋ฒ•์ž…๋‹ˆ๋‹ค. (parallel-ssh๋ฅผ ์ถ”์ฒœ) โ—พ parallel-ssh ์„ค์น˜ ๋ฐ ์‚ฌ์šฉ 1. ๋‹ค์šด ๋ฐ ์„ค์น˜ pssh-2.3.1.tar.gz ๋‹ค์šด (https://code.google.com/archive/p/parallel-ssh/downloads/) tar xvzf pssh-2.3.1.tar.gz cd pssh-2.3.1 python setup.py install 2. ์ž‘์—… host ํŒŒ์ผ ์ž‘์„ฑ vi allnodes ------------------------------ cdpwork01 cdpwork02 cdpwork03 ------------------------------ 3. keygen ์ƒ์„ฑ ๋ฐ ๋ฐฐํฌ ssh-keygen chmod 700 ... 2021. 3. 4.
CDSW jobs api ํ˜ธ์ถœ Python ์ฝ”๋“œ โ—พ start import sys, requests if len(sys.argv) > 1: job_id = sys.argv[1] else : print ("Please Input Job ID") exit() url = "http://cdsw.local.com/api/v1/projects/admin/python-example/jobs/" + job_id + "/start" user = "ua64c7h1ghddrbyexf5rf9svbbwhnsl1" password = "" headers = {'Content-Type': 'application/json; charset=utf-8'} r = requests.post(url, auth=(user,password), headers=headers) if r.stat.. 2021. 2. 19.

ํ‹ฐ์Šคํ† ๋ฆฌํˆด๋ฐ”