๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ

๋ฐ˜์‘ํ˜•

์ „์ฒด ๊ธ€

(34)
[Python]Pandas _ Merge, Concat โœ… Data Load # Data Load (df1, df2) DataUrl = 'https://raw.githubusercontent.com/Datamanim/pandas/main/mergeTEst.csv' df = pd.read_csv(DataUrl) df = df.set_index('Location') df1 = df.iloc[:4,:] df2 = df.iloc[4:,:] display(df1) display(df2) โœ… df1, df2 ๋ฐ์ดํ„ฐ๋ฅผ ํ•˜๋‚˜์˜ ๋ฐ์ดํ„ฐ ํ”„๋ ˆ์ž„์œผ๋กœ ํ•ฉ์น˜๊ธฐ # df1, df2 ๋ฐ์ดํ„ฐ๋ฅผ ํ•˜๋‚˜์˜ ๋ฐ์ดํ„ฐ ํ”„๋ ˆ์ž„์œผ๋กœ ํ•ฉ์น˜๊ธฐ total = pd.concat([df1,df2]) Ans = total Ans โœ… df3๊ณผ df4 ๋ฐ์ดํ„ฐ๋ฅผ ํ•˜๋‚˜์˜ ๋ฐ์ดํ„ฐ ํ”„๋ ˆ์ž„์œผ๋กœ ํ•ฉ์น˜๊ธฐ # df3๊ณผ df4 ๋ฐ..
[Python] Pandas _ Pivot โœ… Data Load & ์ปฌ๋Ÿผ ์‚ญ์ œ ๋ฐ ์ˆ˜์ • # Data Load # Indicator์„ ์‚ญ์ œํ•˜๊ณ  First Tooltip ์ปฌ๋Ÿผ์—์„œ ์‹ ๋ขฐ๊ตฌ๊ฐ„์— ํ•ด๋‹นํ•˜๋Š” ํ‘œํ˜„์„ ์ง€์šฐ๊ธฐ DataUrl = 'https://raw.githubusercontent.com/Datamanim/pandas/main/under5MortalityRate.csv' df = pd.read_csv(DataUrl) df.drop('Indicator', axis=1, inplace=True) df['First Tooltip'] = df['First Tooltip'].map(lambda x : float(x.split("[")[0])) Ans = df Ans.head(4) โœ… ํŠน์ • ์ผ€์ด์Šค ์ถ”์ถœ # ๋…„๋„๊ฐ€ 2015๋…„ ์ด์ƒ, Dim1์ด Both sex..
[Python] Pandas _ Time Series โœ… Data Load # Data Load / Data type ํŒŒ์•… DataUrl = 'https://raw.githubusercontent.com/Datamanim/pandas/main/timeTest.csv' df = pd.read_csv(DataUrl) Ans = df.info() RangeIndex: 6574 entries, 0 to 6573 Data columns (total 13 columns): # Column Non-Null Count Dtype --- ------ -------------- ----- 0 Yr_Mo_Dy 6574 non-null object 1 RPT 6568 non-null float64 2 VAL 6571 non-null float64 3 ROS 6572 non-nu..
[Python] Pandas _ Apply, Map โœ… Data Load # Data Load & ๋ฐ์ดํ„ฐ ํ–‰, ์—ด์˜ ๊ฐฏ์ˆ˜ ์ถœ๋ ฅ DataUrl = 'https://raw.githubusercontent.com/Datamanim/pandas/main/BankChurnersUp.csv' df = pd.read_csv(DataUrl) Ans = df.shape Ans (10127, 19) โœ… Mapping # Income_Category์˜ ์นดํ…Œ๊ณ ๋ฆฌ๋ฅผ map ํ•จ์ˆ˜๋ฅผ ์ด์šฉํ•˜์—ฌ ๋‹ค์Œ๊ณผ ๊ฐ™์ด ๋ณ€๊ฒฝํ•˜์—ฌ newIncome ์ปฌ๋Ÿผ์— ๋งคํ•‘ํ•˜๋ผ # Unknown : N # Less than $40K : a # $40K - $60K : b # $60K - $80K : c # $80K - $120K : d # $120K + : e dic = { 'Unknown' : 'N', 'Les..
[Statistics] ๋กœ์ง€์Šคํ‹ฑ ํšŒ๊ท€๋ถ„์„ (Logistic Regression Analysis) ๐Ÿ– ๋กœ์ง€์Šคํ‹ฑ ํšŒ๊ท€๋ถ„์„์„ ํ•˜๊ธฐ ์œ„ํ•ด ์•Œ์•„๋‘ฌ์•ผ ํ•  2๊ฐ€์ง€ - ๋…๋ฆฝ๋ณ€์ˆ˜ : ์—ฐ์†ํ˜•, ๋ฒ”์ฃผํ˜• ๊ตฌ๋ถ„ - OR(Odds Ratio, ์˜ค์ฆˆ๋น„) ๋˜๋Š” Exp(B) : OR โ‰ฅ 1 (b=์–‘์ˆ˜), OR < 1 (b=์Œ์ˆ˜) ๋”ฐ๋ผ์„œ, ์ด 4๊ฐ€์ง€์˜ ๊ฒฝ์šฐ์˜ ์ˆ˜๋กœ ํ•ด์„ํ•˜๊ฒŒ ๋œ๋‹ค. โ‘  ๋…๋ฆฝ๋ณ€์ˆ˜(์—ฐ์†), OR โ‰ฅ 1 (b=์–‘์ˆ˜) โ‘ก ๋…๋ฆฝ๋ณ€์ˆ˜(์—ฐ์†), OR
[Deep Learning] ์ธ๊ณต ์‹ ๊ฒฝ๋ง ๐ŸŽˆ ์ธ๊ณต ์‹ ๊ฒฝ๋ง (artificial neural network) ๐ŸŽฒ ์‚ฌ๋žŒ์˜ ๋‡Œ ์† ๋‰ด๋Ÿฐ์˜ ์ž‘์šฉ์„ ๋ณธ๋–  ํŒจํ„ด์„ ๊ตฌ์„ฑํ•œ ์ปดํ“จํŒ… ์‹œ์Šคํ…œ์˜ ์ผ์ข… ๐ŸŽˆ ์ธ๊ณต ์‹ ๊ฒฝ๋ง ๋‰ด๋Ÿฐ ๐Ÿ‘‰ ์ƒ๋ฌผํ•™์ ์ธ ๋‰ด๋Ÿฐ์„ ์ˆ˜ํ•™์ ์œผ๋กœ ๋ชจ๋ธ๋งํ•œ ๊ฒƒ ๐Ÿ‘‰ ์—ฌ๋Ÿฌ ์ž…๋ ฅ๊ฐ’์„ ๋ฐ›์•„์„œ ์ผ์ • ์ˆ˜์ค€์ด ๋„˜์–ด์„œ๋ฉด ํ™œ์„ฑํ™”๋˜์–ด ์ถœ๋ ฅ๊ฐ’์„ ๋‚ด๋ณด๋ƒ„ ๐ŸŽฒ ํ•˜๋‚˜์˜ ์ธ๊ณต ๋‰ด๋Ÿฐ(๋…ธ๋“œ, node) ์—์„œ ๋‹ค์ˆ˜์˜ ์ž…๋ ฅ ์‹ ํ˜ธ๋ฅผ ๋ฐ›์•„์„œ ํ•˜๋‚˜์˜ ์‹ ํ˜ธ๋ฅผ ์ถœ๋ ฅ ๐ŸŽฒ ๋‰ด๋Ÿฐ์˜ ๋Œ๊ธฐ๊ฐ€ ์‹ ํ˜ธ๋ฅผ ์ „๋‹ฌํ•˜๋Š” ์—ญํ• ์„ ํ•˜๋“ฏ์ด ์ธ๊ณต ๋‰ด๋Ÿฐ์—์„œ๋Š” ๊ฐ€์ค‘์น˜(weight) ๊ฐ€ ๊ทธ ์—ญํ• ์„ ํ•จ ๊ฐ ์ž…๋ ฅ์‹ ํ˜ธ์—๋Š” ๊ณ ์œ ํ•œ ๊ฐ€์ค‘์น˜๊ฐ€ ๋ถ€์—ฌ๋˜๋ฉฐ ๊ฐ€์ค‘์น˜๊ฐ€ ํด์ˆ˜๋ก ํ•ด๋‹น ์‹ ํ˜ธ๊ฐ€ ์ค‘์š”ํ•˜๋‹ค๊ณ  ํ•  ์ˆ˜ ์žˆ์Œ ๐ŸŽˆ ์ธ๊ณต ์‹ ๊ฒฝ๋ง์˜ ์ž‘๋™ ์›๋ฆฌ ๐Ÿ‘‰ ์ž…๋ ฅ์‹ ํ˜ธ๋ฅผ ํ†ตํ•œ ์ถœ๋ ฅ๊ฐ’์€ hฮ˜ ํ•จ์ˆ˜ ๋กœ ํ‘œํ˜„๋˜๋ฉฐ, ํ™œ์„ฑํ™” ํ•จ์ˆ˜ (Activation Function) ๋ผ๊ณ  ํ•จ ๐ŸŽˆ..
Streamlit / BigQuery ๋ฅผ ํ™œ์šฉํ•œ ๋ฐฐํฌ (API) ๐ŸŽˆ ์‹ค์Šต ์ˆœ์„œ ๐Ÿ‘‰ ์„œ์šธ์‹œ ๋ถ€๋™์‚ฐ ์‹ค๊ฑฐ๋ž˜๊ฐ€ API ํฌ๋กค๋ง์œผ๋กœ ๊ฐ€์ ธ์˜ค๊ธฐ ๐Ÿ‘‰ JSON ํ˜•ํƒœ์˜ ๋ฐ์ดํ„ฐ๋ฅผ pandas ๋ฐ์ดํ„ฐํ”„๋ ˆ์ž„์œผ๋กœ ๋ณ€ํ™˜ํ•˜๊ธฐ ๐Ÿ‘‰ ๋ฐ์ดํ„ฐํ”„๋ ˆ์ž„์„ BigQuery์— ์ „์ฒด ๋ฐ์ดํ„ฐ๋ฅผ ์ €์žฅํ•˜๊ธฐ ๐Ÿ‘‰ ์ €์žฅ๋œ ๋ฐ์ดํ„ฐํ”„๋ ˆ์ž„์„ BigQuery์—์„œ ์ผ๋ถ€ ์ปฌ๋Ÿผ๋งŒ ๋ถˆ๋Ÿฌ์˜ค๊ธฐ ๐ŸŽˆ ์‹ค์Šต 1 - API ํฌ๋กค๋ง์—์„œ BigQuery๋กœ ๋ฐ์ดํ„ฐ ์ €์žฅ ๐ŸŽฒ .streamlit/secrets.toml ์„ ์—ด๊ณ  ์•„๋ž˜์™€ ๊ฐ™์ด ์„ค์ •ํ•˜๊ธฐ ๐ŸŽฒ seoul_api_key : ์„œ์šธ ์—ด๋ฆฐ๋ฐ์ดํ„ฐ ๊ด‘์žฅ api key ๋ฅผ ์˜๋ฏธ ๐ŸŽฒ gcp_service_account ์•„๋ž˜ ๋‚ด์šฉ์€ api key ๋ฅผ json ํŒŒ์ผ๋กœ ์—ด๋ฉด ํ™•์ธ ๊ฐ€๋Šฅ # .streamlit/secrets.toml [public_data_api] seoul_api_key = 'your_api_key'..
๊ตฌ๊ธ€ ํด๋ผ์šฐ๋“œ BigQuery ํ™œ์šฉ์„ ์œ„ํ•œ ์„ธํŒ… (API) โœ‹ ์ƒˆ ํ”„๋กœ์ ํŠธ ๋งŒ๋“ค๊ธฐ โœ‹ API ๋ฐ ์„œ๋น„์Šค โœ‹ API ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ - Bigquery API ๊ฒ€์ƒ‰ โœ‹ ์‚ฌ์šฉ์ž ์ธ์ฆ ์ •๋ณด ๋งŒ๋“ค๊ธฐ โœ‹ ๋กœ์ปฌ / Streamlit ์—์„œ ์‚ฌ์šฉ ๊ฐ€๋Šฅํ•˜๋„๋ก Key ๋ฐ›๊ธฐ

๋ฐ˜์‘ํ˜•