Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. Weโ€™ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Performance] ๐Ÿ”ด MTTFB[p99] - 31.13% ์„ฑ๋Šฅ๊ฐ์†Œ by Lettuce Connection Pool ์ฆ๊ฐ€ - POST /api-chat/chat #364

Open
ghkdqhrbals opened this issue Jan 4, 2024 · 1 comment
Assignees
Labels
feature: performance performance improvement status: help! Help to solving this problem

Comments

@ghkdqhrbals
Copy link
Owner

ghkdqhrbals commented Jan 4, 2024

  • Implements
    • Redis Lettuce CP ์ตœ์ ํ™”
  • ๊ธฐ์กด(max-active:8, max-idle: 8, min-idle: 0) = Original

    TPS ํ‰๊ท : 362.60
    TPS p95: 438.80
    TPS p99: 494.42
    MTTFB ํ‰๊ท : 590.52 ms
    MTTFB p95: 875.44 ms
    MTTFB p99: 1167.77 ms
    MTTFB ์ฐจ์ด ํ‰๊ท  : 78.26 ms
    MTTFB ํ‰๊ท ์ ์ธ ๋ณ€๋™๋ฅ : 11.81%

  • ๋ณ€๊ฒฝ(max-active:100, max-idle: 50, min-idle: 10) = Change1

    TPS ํ‰๊ท : 342.94
    TPS p95: 450.15
    TPS p99: 502.65
    MTTFB ํ‰๊ท : 599.58 ms
    MTTFB p95: 1131.07 ms
    MTTFB p99: 1531.29 ms
    MTTFB ์ฐจ์ด ํ‰๊ท  : 122.83 ms
    MTTFB ํ‰๊ท ์ ์ธ ๋ณ€๋™๋ฅ : 19.00%

  • ๋ณ€๊ฒฝ(max-active:150, max-idle: 70, min-idle: 50) = Change2

    TPS ํ‰๊ท : 338.45
    TPS p95: 433.25
    TPS p99: 491.85
    MTTFB ํ‰๊ท : 600.22 ms
    MTTFB p95: 1012.68 ms
    MTTFB p99: 1241.76 ms
    MTTFB ์ฐจ์ด ํ‰๊ท  : 104.21 ms
    MTTFB ํ‰๊ท ์ ์ธ ๋ณ€๋™๋ฅ : 16.47%

Metric Change1 (%) Change2 (%)
TPS_Average -5.42%๐Ÿ”ด -6.66%๐Ÿ”ด
TPS_p95 2.59% ๐Ÿ”ด -1.26% ๐Ÿ”ด
TPS_p99 1.66% ๐Ÿ”ด -0.52% ๐Ÿ”ด
MTTFB_Average -1.53% ๐Ÿ”ด -1.64% ๐Ÿ”ด
MTTFB_p95 -29.20% ๐Ÿ”ด -15.68% ๐Ÿ”ด
MTTFB_p99 -31.13% ๐Ÿ”ด -6.34% ๐Ÿ”ด

image

๊ฒฐ๊ณผ๋ถ€ํ„ฐ ๋ง์”€๋“œ๋ฆฌ๋ฉด ๋‚ฎ์€ CP ๊ฐ€ ์˜คํžˆ๋ ค ์„ฑ๋Šฅ์ง€ํ‘œ๊ฐ€ ๋” ์ข‹๊ฒŒ ๋‚˜์™”์Šต๋‹ˆ๋‹ค.

์—ฌ์ „ํžˆ Redis Repository Latency ๊ฐ€ ๋‹ค๋ฅธ RDB Latency ๋ณด๋‹ค ๋†’์Šต๋‹ˆ๋‹ค ใ…œใ…œ ๐Ÿ˜‚ ๊ทธ๋ž˜๋„ ์‚ด์ง ๊ฐ์†Œํ•œ ๋ชจ์Šต์€ ํ™•์ธํ•  ์ˆ˜ ์žˆ์—ˆ์Šต๋‹ˆ๋‹ค! ํ•˜์ง€๋งŒ ์˜ค์ฐจ๋ฒ”์œ„ ๋‚ด๋ผ๊ณ  ์ƒ๊ฐํ•ฉ๋‹ˆ๋‹ค.

refreshToken ํ™•์ธํ•˜๋Š” interceptor ์ง€์—ฐ์‹œ๊ฐ„ ์ด์ „๊ณผ ์ดํ›„

image

image

Repository ์ง€์—ฐ์‹œ๊ฐ„ ์ด์ „๊ณผ ์ดํ›„

image

image

Repository ์ง€์—ฐ์‹œ๊ฐ„ max time ์ด์ „๊ณผ ์ดํ›„

image

image
  • CP ์ฆ๊ฐ€ ์ดํ›„
image
@ghkdqhrbals ghkdqhrbals added status: in-progress This issue is currently in progress feature: performance performance improvement labels Jan 4, 2024
@ghkdqhrbals ghkdqhrbals self-assigned this Jan 4, 2024
@ghkdqhrbals ghkdqhrbals changed the title [Performance] Redis Lettuce CP ์ฆ๊ฐ€ ์‹œ ์ง€ํ‘œ ๊ด€์ฐฐ [Performance] ๐Ÿ”ด MTTFB ์ฐจ์ดํ‰๊ท  - 40.79% by Lettuce CP ์ฆ๊ฐ€ Jan 4, 2024
@ghkdqhrbals
Copy link
Owner Author

์™œ ์˜คํžˆ๋ ค ๊ฐ์†Œํ•˜์ง€? :(

  • ๋„คํŠธ์›Œํฌ bandwidth X
    โ†’ ๋„คํŠธ์›Œํฌ 1.5Mbps ๋งŒ ์จ์„œ ๋งค์šฐ ์ถฉ๋ถ„ ๐Ÿ˜Ÿ
  • cpu usage X
    image
    โ†’ cpu usage ๊ทธ๋ž˜ํ”„ ํ™•์ธํ•ด๋ณด๋ฉด ๊ฑฐ์˜ ์‚ฌ์šฉ๋Ÿ‰์ด ๋งค์šฐ ๋‚ฎ์Œ
  • ๋ฉ”๋ชจ๋ฆฌ fragementation ? X ์•„๋‹ˆ๋ฉด ๋ฉ”๋ชจ๋ฆฌ ์‚ฌ์šฉ๋Ÿ‰์ด ๋„ˆ๋ฌด ๋†’์€๊ฐ€?
    image
    โ†’ ์ž”์—ฌ ๋ฉ”๋ชจ๋ฆฌ๊ฐ€ 40% ์ด์ƒ ๋‚จ์•„์žˆ์Œ. ๊ทธ๋ž˜์„œ ๋‹จํŽธํ™”๋Š” ์ œ์™ธ
  • Key indexing ์ด ์ œ๋Œ€๋กœ ์•ˆ๋˜์–ด์žˆ์–ด์„œ ์ฐพ๊ธฐ๊ฐ€ ํž˜๋“ ๊ฐ€?
    image
    Redis HASH search O(1) ๋กœ ๋น ๋ฅด๊ฒŒ ์ฐพ์Œโ€ฆ ๊ทธ๋Ÿฌ๋‹ˆ๊นŒ indexing ์€ ์ œ๋Œ€๋กœ ๋˜์–ด์žˆ์–ด์š”

์–ด๋–ค ๋ฌธ์ œ์ผ๊นŒ์š”?

@ghkdqhrbals ghkdqhrbals changed the title [Performance] ๐Ÿ”ด MTTFB ์ฐจ์ดํ‰๊ท  - 40.79% by Lettuce CP ์ฆ๊ฐ€ [Performance] ๐Ÿ”ด MTTFB ์ฐจ์ดํ‰๊ท  - 40.79% ์„ฑ๋Šฅ๊ฐ์†Œ by Lettuce CP ์ตœ์ ํ™” Jan 5, 2024
@ghkdqhrbals ghkdqhrbals changed the title [Performance] ๐Ÿ”ด MTTFB ์ฐจ์ดํ‰๊ท  - 40.79% ์„ฑ๋Šฅ๊ฐ์†Œ by Lettuce CP ์ตœ์ ํ™” [Performance] ๐Ÿ”ด MTTFB ์ฐจ์ดํ‰๊ท  - 40.79% ์„ฑ๋Šฅ๊ฐ์†Œ by Lettuce Connection Pool ์ฆ๊ฐ€ Jan 5, 2024
@ghkdqhrbals ghkdqhrbals changed the title [Performance] ๐Ÿ”ด MTTFB ์ฐจ์ดํ‰๊ท  - 40.79% ์„ฑ๋Šฅ๊ฐ์†Œ by Lettuce Connection Pool ์ฆ๊ฐ€ [Performance] ๐Ÿ”ด MTTFB ์ฐจ์ดํ‰๊ท  - 40.79% ์„ฑ๋Šฅ๊ฐ์†Œ by Lettuce Connection Pool ์ฆ๊ฐ€ - POST /api-chat/chat Jan 5, 2024
@ghkdqhrbals ghkdqhrbals added status: help! Help to solving this problem and removed status: in-progress This issue is currently in progress labels Jan 7, 2024
@ghkdqhrbals ghkdqhrbals changed the title [Performance] ๐Ÿ”ด MTTFB ์ฐจ์ดํ‰๊ท  - 40.79% ์„ฑ๋Šฅ๊ฐ์†Œ by Lettuce Connection Pool ์ฆ๊ฐ€ - POST /api-chat/chat [Performance] ๐Ÿ”ด MTTFB[p99] - 31.13% ์„ฑ๋Šฅ๊ฐ์†Œ by Lettuce Connection Pool ์ฆ๊ฐ€ - POST /api-chat/chat Jan 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature: performance performance improvement status: help! Help to solving this problem
Projects
None yet
Development

No branches or pull requests

1 participant