import maplotlib.pylab as plt import matplotlib # 한글 깨짐 plt.rcParams['font.famlity'] = 'D2 Coding' plt.rcParams['font.size'] = '11' # 마이너스 깨짐 (matplotrc 에서 수정하면 이후에 수정할 필요 없음) matplotlib.rcParams['...
[Airflow] Your Airflow administrator chose not to expose the configuration, most likely for security reasons.
Airflow Configuration ____________ _____________ ____ |__( )_________ __/__ /________ __ ____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / / ___ ___ | / _ / _ __/ _ / / /_/...
[Bash] Overwrite builtin command (rm, ls, echo)
ls #!/bin/bash # override 'ls' command for 'ls -ltr' ls () { command ls -ltr } ls date #!/bin/bash # override 'ls' command for 'ls -ltr' echo () { builtin echo -n `date +"[%m-%d %H:...
[Bash] String 포함되었는지 확인하는 방법
string='My string'; if [[ $string =~ "My" ]]; then echo "It's there!" fi
[Airflow] 에러 발생시 Slack으로 알림 주기
Slack Token 생성 https://api.slack.com/custom-integrations/legacy-tokens airflow slack operator pip install apache-airflow-providers-slack from airflow.operators.slack_operator import SlackA...
[Airflow] Python 스크립트 BashOperator로 실행
version: '3' x-airflow-common: &airflow-common image: ${AIRFLOW_IMAGE_NAME:-apache/airflow:2.1.0} environment: &airflow-common-env AIRFLOW__CORE__EXECUTOR: CeleryExecutor ...
[Airflow] bashOperator 사용시에 jinja2.exceptions.TemplateNotFound
단순히 스크립트 실행인데 아래와 같이 에러가 났다. jinja2.exceptions.TemplateNotFound: sh /forkrane/scrap.sh t2 = BashOperator( task_id='ingest', depends_on_past=False, bash_command='cd /f...
[FastAPI] 시작하기
https://fastapi.tiangolo.com/ pip install fastapi pip install "uvicorn[standard]" # ASGI server 가 필요해서 설치 (A) Example (GET) from typing import Optional from fastapi import FastAPI app = ...
[FastAPI] MySQL 연동
Peewee python에서 mysql 접속을 위해서 peewee를 사용 # Python peewee.ImproperlyConfigured: MySQL driver not installed pip install pymysql from peewee import * user = 'root' password = '**' db_name = '**' ...
[Airflow] Docker로 실행하기 Apple Silicon
docker-compose # https://airflow.apache.org/docs/apache-airflow/stable/start/docker.html curl -LfO 'https://airflow.apache.org/docs/apache-airflow/2.2.1/docker-compose.yaml' docker compose up -d...