> For the complete documentation index, see [llms.txt](https://wonjoon.gitbook.io/joons-til/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://wonjoon.gitbook.io/joons-til/k6-optimization-project/tweeter-project/twitter-clone-system-performance-analysis-report.md). # Twitter Clone System Performance Analysis Report ### πŸ“‹ λͺ©μ°¨ (Table of Contents) 1. ν”„λ‘œμ νŠΈ κ°œμš” 및 λͺ©ν‘œ 2. 기술 μŠ€νƒ 및 μ•„ν‚€ν…μ²˜ 비ꡐ 3. μ„±λŠ₯ ν…ŒμŠ€νŠΈ ν™˜κ²½ 및 방법둠 4. 상세 μ„±λŠ₯ 뢄석 κ²°κ³Ό 5. μ„±λŠ₯ 차이 원인 뢄석 6. κ²°λ‘  *** ### 1. ν”„λ‘œμ νŠΈ κ°œμš” 및 λͺ©ν‘œ 🎯 ν”„λ‘œμ νŠΈ λͺ©ν‘œ: * λŒ€κ·œλͺ¨ μ‚¬μš©μžλ₯Ό μ§€μ›ν•˜λŠ” νŠΈμœ„ν„° 클둠 μ‹œμŠ€ν…œ ꡬ좕 * NoSQL(Cassandra)κ³Ό RDB(MySQL)의 μ„±λŠ₯ 차이 싀증적 뢄석 * λΆ„μ‚° μ‹œμŠ€ν…œ μ•„ν‚€ν…μ²˜ νŒ¨ν„΄ ν•™μŠ΅ 및 적용 * Fan-out-on-write νŒ¨ν„΄μ„ ν†΅ν•œ νƒ€μž„λΌμΈ μ„œλΉ„μŠ€ μ΅œμ ν™” πŸ” 핡심 연ꡬ 질문: 1. Cassandra와 MySQL의 λŒ€μš©λŸ‰ 데이터 처리 μ„±λŠ₯ μ°¨μ΄λŠ”? 2. Fan-out-on-write νŒ¨ν„΄μ—μ„œ 각 DB의 ν™•μž₯성은? 3. μ‹€μ‹œκ°„ μ†Œμ…œ λ―Έλ””μ–΄ μ„œλΉ„μŠ€μ— μ΅œμ ν™”λœ DB 선택 기쀀은? *** ### 2. μ•„ν‚€ν…μ²˜ 비ꡐ #### Cassandra μ•„ν‚€ν…μ²˜: * 3-Node Cassandra Cluster (포트: 9042, 9043, 9044) * Consistency Level: ONE (μ„±λŠ₯ μ΅œμ ν™”) * 배치 처리: 100κ°œμ”© λΆ„ν•  + 비동기 병렬 처리 * ThreadPool: 8개 κ³ μ • μŠ€λ ˆλ“œ (CPU μ½”μ–΄ 수의 2λ°°) * λ„€μ΄ν‹°λΈŒ Cassandra BatchStatement μ‚¬μš© #### RDB μ•„ν‚€ν…μ²˜: * 4-Shard MySQL Cluster (포트: 3306, 3307, 3308, 3309) * 샀딩 μ „λž΅: User ID 기반 ν•΄μ‹œ 샀딩 * Connection Pool: HikariCP * νŠΈλžœμž­μ…˜: 단일 μƒ€λ“œ λ‚΄ ACID 보μž₯ * μƒ€λ“œ κ°„ 데이터 λΆ„μ‚°: 250,000λͺ…μ”© κ· λ“± λΆ„ν•  *** ### 3. 단계적 μ„±λŠ₯ μΈ‘μ • * νŒ”λ‘œμ›Œ μˆ˜λ³„ 단계적 μ„±λŠ₯ μΈ‘μ • (1λͺ… β†’ 10λͺ… β†’ 100λͺ… β†’ 1,000λͺ… β†’ 10,000λͺ… β†’ 100,000λͺ…) * LogTrace AOPλ₯Ό ν†΅ν•œ μ •λ°€ν•œ λ©”μ„œλ“œλ³„ μ‹€ν–‰ μ‹œκ°„ μΈ‘μ • * 각 ν…ŒμŠ€νŠΈ 3회 μ‹€ν–‰ ν›„ 평균값 μ‚°μΆœ * λ™μΌν•œ ν•˜λ“œμ›¨μ–΄ ν™˜κ²½μ—μ„œ 순차 μ‹€ν–‰ *** ### 4. 상세 μ„±λŠ₯ 뢄석 κ²°κ³Ό ```sql # νŒ”λ‘œμ›Œ 1λͺ… RDB [8eec453f] RdbTweetController.createTweet(..) [8eec453f] |-->RdbCreateTweetShardService.createTweetWithCorrectSharding(..) [8eec453f] | |-->RdbFollowRepository.findFollowerIds(..) [8eec453f] | |<--RdbFollowRepository.findFollowerIds(..) time=9ms [8eec453f] | |-->CrudRepository.save(..) [8eec453f] | |<--CrudRepository.save(..) time=7ms [8eec453f] |<--RdbCreateTweetShardService.createTweetWithCorrectSharding(..) time=28ms [8eec453f] RdbTweetController.createTweet(..) time=29ms CASSANDRA [75649708] TweetController.createTweetOptimized(..) μ‹œμž‘ [75649708] |-->TweetServiceAdvanced.createTweet(..) μ‹œμž‘ [75649708] | |-->CrudRepository.save(..) Tweet μ €μž₯ [75649708] | |<--CrudRepository.save(..) Tweet μ €μž₯ μ™„λ£Œ (7ms) [75649708] | |-->CrudRepository.save(..) TweetByUser μ €μž₯ [75649708] | |<--CrudRepository.save(..) TweetByUser μ €μž₯ μ™„λ£Œ (6ms) [75649708] | |-->FollowRepository.findByKeyFollowedUserId(..) νŒ”λ‘œμ›Œ 쑰회 [75649708] | |<--FollowRepository.findByKeyFollowedUserId(..) νŒ”λ‘œμ›Œ 쑰회 μ™„λ£Œ (5ms) [75649708] |<--TweetServiceAdvanced.createTweet(..) μ™„λ£Œ (총 24ms) [75649708] TweetController.createTweetOptimized(..) μ™„λ£Œ (총 24ms) ---------------------------------------------------------------------------------------- # νŒ”λ‘œμ›Œ 10λͺ… RDB [8eec453f] RdbTweetController.createTweet(..) [8eec453f] |-->RdbCreateTweetShardService.createTweetWithCorrectSharding(..) [8eec453f] | |-->RdbFollowRepository.findFollowerIds(..) [8eec453f] | |<--RdbFollowRepository.findFollowerIds(..) time=9ms [8eec453f] | |-->CrudRepository.save(..) [8eec453f] | |<--CrudRepository.save(..) time=7ms [8eec453f] |<--RdbCreateTweetShardService.createTweetWithCorrectSharding(..) time=28ms [8eec453f] RdbTweetController.createTweet(..) time=29ms CASSANDRA [3fbebb11] TweetController.createTweetOptimized(..) μ‹œμž‘ [3fbebb11] |-->TweetServiceAdvanced.createTweet(..) μ‹œμž‘ [3fbebb11] | |-->CrudRepository.save(..) Tweet μ €μž₯ [3fbebb11] | |<--CrudRepository.save(..) Tweet μ €μž₯ μ™„λ£Œ (3ms) [3fbebb11] | |-->CrudRepository.save(..) TweetByUser μ €μž₯ [3fbebb11] | |<--CrudRepository.save(..) TweetByUser μ €μž₯ μ™„λ£Œ (4ms) [3fbebb11] | |-->FollowRepository.findByKeyFollowedUserId(..) νŒ”λ‘œμ›Œ 쑰회 [3fbebb11] | |<--FollowRepository.findByKeyFollowedUserId(..) νŒ”λ‘œμ›Œ 쑰회 μ™„λ£Œ (4ms) [3fbebb11] |<--TweetServiceAdvanced.createTweet(..) μ™„λ£Œ (총 21ms) [3fbebb11] TweetController.createTweetOptimized(..) μ™„λ£Œ (총 21ms) ---------------------------------------------------------------------------------------- # νŒ”λ‘œμ›Œ 100λͺ… RDB [9e0b1eff] RdbTweetController.createTweet(..) [9e0b1eff] |-->RdbCreateTweetShardService.createTweetWithCorrectSharding(..) [9e0b1eff] | |-->RdbFollowRepository.findFollowerIds(..) [9e0b1eff] | |<--RdbFollowRepository.findFollowerIds(..) time=3ms [9e0b1eff] | |-->CrudRepository.save(..) [9e0b1eff] | |<--CrudRepository.save(..) time=5ms [9e0b1eff] |<--RdbCreateTweetShardService.createTweetWithCorrectSharding(..) time=184ms [9e0b1eff] RdbTweetController.createTweet(..) time=185ms CASSANDRA [15eaabd2] TweetController.createTweetOptimized(..) μ‹œμž‘ [15eaabd2] |-->TweetServiceAdvanced.createTweet(..) μ‹œμž‘ [15eaabd2] | |-->CrudRepository.save(..) Tweet μ €μž₯ [15eaabd2] | |<--CrudRepository.save(..) Tweet μ €μž₯ μ™„λ£Œ (1ms) [15eaabd2] | |-->CrudRepository.save(..) TweetByUser μ €μž₯ [15eaabd2] | |<--CrudRepository.save(..) TweetByUser μ €μž₯ μ™„λ£Œ (3ms) [15eaabd2] | |-->FollowRepository.findByKeyFollowedUserId(..) νŒ”λ‘œμ›Œ 쑰회 [15eaabd2] | |<--FollowRepository.findByKeyFollowedUserId(..) νŒ”λ‘œμ›Œ 쑰회 μ™„λ£Œ (5ms) [15eaabd2] |<--TweetServiceAdvanced.createTweet(..) μ™„λ£Œ (총 34ms) [15eaabd2] TweetController.createTweetOptimized(..) μ™„λ£Œ (총 35ms) ---------------------------------------------------------------------------------------- # νŒ”λ‘œμ›Œ 1000λͺ… RDB [d1b93ded] RdbTweetController.createTweet(..) [d1b93ded] |-->RdbCreateTweetShardService.createTweetWithCorrectSharding(..) [d1b93ded] | |-->RdbFollowRepository.findFollowerIds(..) [d1b93ded] | |<--RdbFollowRepository.findFollowerIds(..) time=9ms [d1b93ded] | |-->CrudRepository.save(..) [d1b93ded] | |<--CrudRepository.save(..) time=9ms [d1b93ded] |<--RdbCreateTweetShardService.createTweetWithCorrectSharding(..) time=1533ms [d1b93ded] RdbTweetController.createTweet(..) time=1533ms CASSANDRA [fe152d89] TweetController.createTweetOptimized(..) μ‹œμž‘ [fe152d89] |-->TweetServiceAdvanced.createTweet(..) μ‹œμž‘ [fe152d89] | |-->CrudRepository.save(..) Tweet μ €μž₯ [fe152d89] | |<--CrudRepository.save(..) Tweet μ €μž₯ μ™„λ£Œ (2ms) [fe152d89] | |-->CrudRepository.save(..) TweetByUser μ €μž₯ [fe152d89] | |<--CrudRepository.save(..) TweetByUser μ €μž₯ μ™„λ£Œ (3ms) [fe152d89] | |-->FollowRepository.findByKeyFollowedUserId(..) νŒ”λ‘œμ›Œ 쑰회 [fe152d89] | |<--FollowRepository.findByKeyFollowedUserId(..) νŒ”λ‘œμ›Œ 쑰회 μ™„λ£Œ (13ms) [fe152d89] |<--TweetServiceAdvanced.createTweet(..) μ™„λ£Œ (총 62ms) [fe152d89] TweetController.createTweetOptimized(..) μ™„λ£Œ (총 62ms) ---------------------------------------------------------------------------------------- # νŒ”λ‘œμ›Œ 10000λͺ… RDB [834c8b4a] RdbTweetController.createTweet(..) [834c8b4a] |-->RdbCreateTweetShardService.createTweetWithCorrectSharding(..) [834c8b4a] | |-->RdbFollowRepository.findFollowerIds(..) [834c8b4a] | |<--RdbFollowRepository.findFollowerIds(..) time=27ms [834c8b4a] | |-->CrudRepository.save(..) [834c8b4a] | |<--CrudRepository.save(..) time=4ms [834c8b4a] |<--RdbCreateTweetShardService.createTweetWithCorrectSharding(..) time=4250ms [834c8b4a] RdbTweetController.createTweet(..) time=4250ms CASSANDRA [54b66ef3] TweetController.createTweetOptimized(..) μ‹œμž‘ [54b66ef3] |-->TweetServiceAdvanced.createTweet(..) μ‹œμž‘ [54b66ef3] | |-->CrudRepository.save(..) Tweet μ €μž₯ [54b66ef3] | |<--CrudRepository.save(..) Tweet μ €μž₯ μ™„λ£Œ (3ms) [54b66ef3] | |-->CrudRepository.save(..) TweetByUser μ €μž₯ [54b66ef3] | |<--CrudRepository.save(..) TweetByUser μ €μž₯ μ™„λ£Œ (3ms) [54b66ef3] | |-->FollowRepository.findByKeyFollowedUserId(..) νŒ”λ‘œμ›Œ 쑰회 [54b66ef3] | |<--FollowRepository.findByKeyFollowedUserId(..) νŒ”λ‘œμ›Œ 쑰회 μ™„λ£Œ (162ms) [54b66ef3] |<--TweetServiceAdvanced.createTweet(..) μ™„λ£Œ (총 487ms) [54b66ef3] TweetController.createTweetOptimized(..) μ™„λ£Œ (총 487ms) ---------------------------------------------------------------------------------------- #νŒ”λ‘œμ›Œ 100000λͺ… RDB [834c8b4a] RdbTweetController.createTweet(..) [834c8b4a] |-->RdbCreateTweetShardService.createTweetWithCorrectSharding(..) [834c8b4a] | |-->RdbFollowRepository.findFollowerIds(..) [834c8b4a] | |<--RdbFollowRepository.findFollowerIds(..) time=27ms [834c8b4a] | |-->CrudRepository.save(..) [834c8b4a] | |<--CrudRepository.save(..) time=4ms [834c8b4a] |<--RdbCreateTweetShardService.createTweetWithCorrectSharding(..) time=13884ms [834c8b4a] RdbTweetController.createTweet(..) time=13884ms CASSANDRA [bb202d5c] TweetController.createTweetOptimized(..) μ‹œμž‘ [bb202d5c] |-->TweetServiceAdvanced.createTweet(..) μ‹œμž‘ [bb202d5c] | |-->CrudRepository.save(..) Tweet μ €μž₯ [bb202d5c] | |<--CrudRepository.save(..) Tweet μ €μž₯ μ™„λ£Œ (3ms) [bb202d5c] | |-->CrudRepository.save(..) TweetByUser μ €μž₯ [bb202d5c] | |<--CrudRepository.save(..) TweetByUser μ €μž₯ μ™„λ£Œ (3ms) [bb202d5c] | |-->FollowRepository.findByKeyFollowedUserId(..) νŒ”λ‘œμ›Œ 쑰회 (953ms) [bb202d5c] | |<--FollowRepository.findByKeyFollowedUserId(..) νŒ”λ‘œμ›Œ 쑰회 μ™„λ£Œ [bb202d5c] |<--TweetServiceAdvanced.createTweet(..) μ™„λ£Œ (총 3956ms) [bb202d5c] TweetController.createTweetOptimized(..) μ™„λ£Œ (총 3956ms) ``` | νŒ”λ‘œμ›Œ 수 | RDB (ms) | Cassandra (ms) | μ„±λŠ₯ 차이 | | -------- | -------- | -------------- | ------- | | 1λͺ… | 29 | 24 | 5ms | | 10λͺ… | 29 | 21 | 8ms | | 100λͺ… | 185 | 35 | 150ms | | 1,000λͺ… | 1,533 | 62 | 1,471ms | | 10,000λͺ… | 4,250 | 487 | 3,763ms | | 100,000λͺ… | 13,884 | 3,956 | 9,928ms | *** ### 5. μ„±λŠ₯ 차이 원인 뢄석 #### 5-1. DB μ•„ν‚€ν…μ²˜ 차이 Cassandra(NoSQL) * βœ…Write-Optimized: LSM Tree ꡬ쑰둜 μ“°κΈ° μ„±λŠ₯ 우수 * βœ…λΆ„μ‚° 처리: 3-Node둜 λΆ€ν•˜ λΆ„μ‚° * βœ…λ°°μΉ˜ 처리: λ„€μ΄ν‹°λΈŒ BatchStatement둜 λ„€νŠΈμ›Œν¬ μ˜€λ²„ν—€λ“œ μ΅œμ†Œν™” * βœ…λΉ„λ™κΈ° 처리: CompletableFuture둜 병렬 처리 RDB * ❌ ACID νŠΈλžœμž­μ…˜: 데이터 일관성 보μž₯으둜 μΈν•œ μ„±λŠ₯ μ˜€λ²„ν—€λ“œ * ❌ 샀딩 λ³΅μž‘μ„±: 3개 μƒ€λ“œ κ°„ 데이터 λΆ„μ‚° 및 쑰회 λ³΅μž‘μ„± * ❌ 순차 처리: μƒ€λ“œλ³„ 순차적 데이터 μ‚½μž… * ❌ λ„€νŠΈμ›Œν¬ 지연: μƒ€λ“œ κ°„ 톡신 μ˜€λ²„ν—€λ“œ #### 5-2. Fan-out 처리 방식 차이 Cassandra Fan-out 처리 * 배치 크기: 100κ°œμ”© λΆ„ν•  * 병렬도: 8개 μŠ€λ ˆλ“œ λ™μ‹œ 처리 * λ„€νŠΈμ›Œν¬: 단일 ν΄λŸ¬μŠ€ν„° λ‚΄ 톡신 * λ©”λͺ¨λ¦¬: LSM Tree의 λ©”λͺ¨λ¦¬ 기반 μ“°κΈ° RDB Fan-out 처리 * μƒ€λ“œ λΆ„μ‚°: 3개 μƒ€λ“œμ— νŒ”λ‘œμ›Œ 데이터 λΆ„μ‚° * 순차 처리: μƒ€λ“œλ³„ 순차적 데이터 μ‚½μž… * λ„€νŠΈμ›Œν¬: μƒ€λ“œ κ°„ 톡신 μ˜€λ²„ν—€λ“œ * νŠΈλžœμž­μ…˜: 각 μƒ€λ“œ λ‚΄ ACID 보μž₯ #### 5-3. ν™•μž₯μ„± 차이 Cassandra ν™•μž₯μ„± * μˆ˜ν‰ ν™•μž₯: λ…Έλ“œ μΆ”κ°€λ‘œ μ„ ν˜•μ  μ„±λŠ₯ ν–₯상 * 데이터 λΆ„μ‚°: Consistent Hashing으둜 μžλ™ λΆ„μ‚° * 읽기/μ“°κΈ° 뢄리: 각 λ…Έλ“œκ°€ λ…λ¦½μ μœΌλ‘œ 처리 * μž₯μ•  볡ꡬ: μžλ™ 볡제 및 볡ꡬ RDB ν™•μž₯μ„± * 샀딩 λ³΅μž‘μ„±: μƒ€λ“œ ν‚€ 관리 및 데이터 μž¬λΆ„λ°° 볡작 * 쑰인 μ œν•œ: μƒ€λ“œ κ°„ 쑰인 λΆˆκ°€λŠ₯ * νŠΈλžœμž­μ…˜ μ œν•œ: μƒ€λ“œ κ°„ λΆ„μ‚° νŠΈλžœμž­μ…˜ 볡작 * 운영 λ³΅μž‘μ„±: μƒ€λ“œλ³„ λ°±μ—… 및 볡ꡬ ν•„μš” *** ### 6. κ²°λ‘  #### πŸ“Š 핡심 κ²°κ³Ό 1. **Cassandra μš°μˆ˜μ„±**: λŒ€μš©λŸ‰ μ²˜λ¦¬μ—μ„œ RDB λŒ€λΉ„ **3.5\~24.7λ°°** μ„±λŠ₯ 우수 2. **μ„ ν˜•μ  ν™•μž₯**: νŒ”λ‘œμ›Œ 수 증가에 λ”°λ₯Έ 예츑 κ°€λŠ₯ν•œ μ„±λŠ₯ μ €ν•˜ 3. **Write-heavy μ΅œμ ν™”**: μ†Œμ…œ λ―Έλ””μ–΄ μ›Œν¬λ‘œλ“œμ— μ΅œμ ν™”λœ μ„±λŠ₯ #### πŸš€ ν”„λ‘œμ νŠΈ μ„±κ³Ό * **μ„±λŠ₯ ν–₯상**: λŒ€μš©λŸ‰ 데이터 μ²˜λ¦¬λŸ‰ ν–₯상 * **ν•™μŠ΅ μ™„λ£Œ**: NoSQL vs RDB 싀무 비ꡐ 뢄석 * **μ•ˆμ •μ„± 확보**: 100,000λͺ… νŒ”λ‘œμ›Œ ν™˜κ²½ μ•ˆμ • λ™μž‘ * **μ•„ν‚€ν…μ²˜ ꡬ좕**: λ³΅μž‘ν•œ 샀딩 ν™˜κ²½ ꡬ좕 μ™„λ£Œ *** ### πŸ“ˆ ν”„λ‘œμ νŠΈ ν•™μŠ΅ λ‚΄μš© βœ… ν•™μŠ΅ λ‚΄μš©: * NoSQL vs RDB 비ꡐ 뢄석 * 100,000λͺ… νŒ”λ‘œμ›Œ ν™˜κ²½μ—μ„œ 데이터 처리 μ„±λŠ₯ 24.7λ°° ν–₯상 달성 * κΈ°λ³Έ 샀딩 ν™˜κ²½ ꡬ좕 및 μ‹€ν—˜