-
Notifications
You must be signed in to change notification settings - Fork 477
ci: have riot use pre-built wheels to install base venvs #15971
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
Codeowners resolved as |
Performance SLOsComparing candidate brettlangdon/riot.wheel.source (41419d1) with baseline main (8bb5f11) 📈 Performance Regressions (3 suites)📈 iastaspects - 118/118✅ add_aspectTime: ✅ 103.348µs (SLO: <130.000µs 📉 -20.5%) vs baseline: +2.1% Memory: ✅ 42.625MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +4.8% ✅ add_inplace_aspectTime: ✅ 100.917µs (SLO: <130.000µs 📉 -22.4%) vs baseline: +0.5% Memory: ✅ 42.585MB (SLO: <43.250MB 🟡 -1.5%) vs baseline: +4.8% ✅ add_inplace_noaspectTime: ✅ 28.364µs (SLO: <40.000µs 📉 -29.1%) vs baseline: +0.7% Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.1% ✅ add_noaspectTime: ✅ 48.684µs (SLO: <70.000µs 📉 -30.5%) vs baseline: -0.3% Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.8% ✅ bytearray_aspectTime: ✅ 258.927µs (SLO: <400.000µs 📉 -35.3%) vs baseline: +1.1% Memory: ✅ 42.703MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +5.1% ✅ bytearray_extend_aspectTime: ✅ 652.552µs (SLO: <800.000µs 📉 -18.4%) vs baseline: -0.3% Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.8% ✅ bytearray_extend_noaspectTime: ✅ 266.147µs (SLO: <400.000µs 📉 -33.5%) vs baseline: -0.5% Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.9% ✅ bytearray_noaspectTime: ✅ 140.223µs (SLO: <300.000µs 📉 -53.3%) vs baseline: +0.4% Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.6% ✅ bytes_aspectTime: ✅ 220.977µs (SLO: <300.000µs 📉 -26.3%) vs baseline: ~same Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +5.0% ✅ bytes_noaspectTime: ✅ 134.646µs (SLO: <200.000µs 📉 -32.7%) vs baseline: ~same Memory: ✅ 42.703MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +4.9% ✅ bytesio_aspectTime: ✅ 3.856ms (SLO: <5.000ms 📉 -22.9%) vs baseline: +0.5% Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.6% ✅ bytesio_noaspectTime: ✅ 323.391µs (SLO: <420.000µs 📉 -23.0%) vs baseline: +0.8% Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.8% ✅ capitalize_aspectTime: ✅ 90.373µs (SLO: <300.000µs 📉 -69.9%) vs baseline: +0.3% Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +5.0% ✅ capitalize_noaspectTime: ✅ 251.054µs (SLO: <300.000µs 📉 -16.3%) vs baseline: +0.3% Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.7% ✅ casefold_aspectTime: ✅ 89.635µs (SLO: <500.000µs 📉 -82.1%) vs baseline: -0.9% Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.1% ✅ casefold_noaspectTime: ✅ 308.114µs (SLO: <500.000µs 📉 -38.4%) vs baseline: -0.5% Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.0% ✅ decode_aspectTime: ✅ 87.701µs (SLO: <100.000µs 📉 -12.3%) vs baseline: +0.7% Memory: ✅ 42.762MB (SLO: <43.500MB 🟡 -1.7%) vs baseline: +5.3% ✅ decode_noaspectTime: ✅ 151.927µs (SLO: <210.000µs 📉 -27.7%) vs baseline: -0.7% Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +5.0% ✅ encode_aspectTime: ✅ 85.036µs (SLO: <200.000µs 📉 -57.5%) vs baseline: -0.2% Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.9% ✅ encode_noaspectTime: ✅ 137.052µs (SLO: <200.000µs 📉 -31.5%) vs baseline: -2.0% Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.8% ✅ format_aspectTime: ✅ 14.704ms (SLO: <19.200ms 📉 -23.4%) vs baseline: ~same Memory: ✅ 42.723MB (SLO: <43.250MB 🟡 -1.2%) vs baseline: +4.8% ✅ format_map_aspectTime: ✅ 16.486ms (SLO: <21.500ms 📉 -23.3%) vs baseline: +0.3% Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.5% ✅ format_map_noaspectTime: ✅ 372.449µs (SLO: <500.000µs 📉 -25.5%) vs baseline: +1.3% Memory: ✅ 42.585MB (SLO: <43.250MB 🟡 -1.5%) vs baseline: +4.7% ✅ format_noaspectTime: ✅ 304.891µs (SLO: <500.000µs 📉 -39.0%) vs baseline: -0.7% Memory: ✅ 42.684MB (SLO: <43.250MB 🟡 -1.3%) vs baseline: +5.1% ✅ index_aspectTime: ✅ 133.261µs (SLO: <300.000µs 📉 -55.6%) vs baseline: +7.8% Memory: ✅ 42.664MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +5.1% ✅ index_noaspectTime: ✅ 40.545µs (SLO: <300.000µs 📉 -86.5%) vs baseline: -0.3% Memory: ✅ 42.703MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +5.2% ✅ join_aspectTime: ✅ 218.532µs (SLO: <300.000µs 📉 -27.2%) vs baseline: +0.4% Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.6% ✅ join_noaspectTime: ✅ 148.647µs (SLO: <300.000µs 📉 -50.5%) vs baseline: -0.5% Memory: ✅ 42.625MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +4.9% ✅ ljust_aspectTime: ✅ 573.737µs (SLO: <700.000µs 📉 -18.0%) vs baseline: 📈 +14.6% Memory: ✅ 42.664MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +5.1% ✅ ljust_noaspectTime: ✅ 254.820µs (SLO: <300.000µs 📉 -15.1%) vs baseline: -0.4% Memory: ✅ 42.625MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +4.9% ✅ lower_aspectTime: ✅ 303.590µs (SLO: <500.000µs 📉 -39.3%) vs baseline: -1.0% Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.9% ✅ lower_noaspectTime: ✅ 233.335µs (SLO: <300.000µs 📉 -22.2%) vs baseline: -0.2% Memory: ✅ 42.625MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +5.1% ✅ lstrip_aspectTime: ✅ 0.271ms (SLO: <3.000ms 📉 -91.0%) vs baseline: -0.3% Memory: ✅ 42.566MB (SLO: <43.250MB 🟡 -1.6%) vs baseline: +4.7% ✅ lstrip_noaspectTime: ✅ 0.178ms (SLO: <3.000ms 📉 -94.1%) vs baseline: -1.4% Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.8% ✅ modulo_aspectTime: ✅ 14.296ms (SLO: <18.750ms 📉 -23.8%) vs baseline: -0.6% Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.6% ✅ modulo_aspect_for_bytearray_bytearrayTime: ✅ 14.847ms (SLO: <19.350ms 📉 -23.3%) vs baseline: ~same Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.5% ✅ modulo_aspect_for_bytesTime: ✅ 14.521ms (SLO: <18.900ms 📉 -23.2%) vs baseline: ~same Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.5% ✅ modulo_aspect_for_bytes_bytearrayTime: ✅ 14.681ms (SLO: <19.150ms 📉 -23.3%) vs baseline: ~same Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +5.4% ✅ modulo_noaspectTime: ✅ 0.356ms (SLO: <3.000ms 📉 -88.1%) vs baseline: -0.2% Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.7% ✅ replace_aspectTime: ✅ 18.468ms (SLO: <24.000ms 📉 -23.1%) vs baseline: ~same Memory: ✅ 42.723MB (SLO: <44.000MB -2.9%) vs baseline: +5.1% ✅ replace_noaspectTime: ✅ 284.726µs (SLO: <300.000µs -5.1%) vs baseline: ~same Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.9% ✅ repr_aspectTime: ✅ 316.240µs (SLO: <420.000µs 📉 -24.7%) vs baseline: -0.6% Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.8% ✅ repr_noaspectTime: ✅ 46.688µs (SLO: <90.000µs 📉 -48.1%) vs baseline: -0.6% Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.7% ✅ rstrip_aspectTime: ✅ 380.063µs (SLO: <500.000µs 📉 -24.0%) vs baseline: +0.7% Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.9% ✅ rstrip_noaspectTime: ✅ 180.312µs (SLO: <300.000µs 📉 -39.9%) vs baseline: -1.5% Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.9% ✅ slice_aspectTime: ✅ 182.329µs (SLO: <300.000µs 📉 -39.2%) vs baseline: +0.2% Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.7% ✅ slice_noaspectTime: ✅ 53.583µs (SLO: <90.000µs 📉 -40.5%) vs baseline: -0.9% Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +5.0% ✅ stringio_aspectTime: ✅ 4.475ms (SLO: <5.000ms 📉 -10.5%) vs baseline: 📈 +14.4% Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.7% ✅ stringio_noaspectTime: ✅ 353.985µs (SLO: <500.000µs 📉 -29.2%) vs baseline: -0.1% Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.9% ✅ strip_aspectTime: ✅ 268.854µs (SLO: <350.000µs 📉 -23.2%) vs baseline: -0.9% Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.7% ✅ strip_noaspectTime: ✅ 178.977µs (SLO: <240.000µs 📉 -25.4%) vs baseline: ~same Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.7% ✅ swapcase_aspectTime: ✅ 343.752µs (SLO: <500.000µs 📉 -31.2%) vs baseline: -0.4% Memory: ✅ 42.703MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +5.0% ✅ swapcase_noaspectTime: ✅ 272.157µs (SLO: <400.000µs 📉 -32.0%) vs baseline: +0.2% Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.1% ✅ title_aspectTime: ✅ 332.903µs (SLO: <500.000µs 📉 -33.4%) vs baseline: -0.6% Memory: ✅ 42.703MB (SLO: <43.000MB 🟡 -0.7%) vs baseline: +4.9% ✅ title_noaspectTime: ✅ 257.820µs (SLO: <400.000µs 📉 -35.5%) vs baseline: ~same Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.8% ✅ translate_aspectTime: ✅ 501.585µs (SLO: <700.000µs 📉 -28.3%) vs baseline: +0.7% Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.8% ✅ translate_noaspectTime: ✅ 423.440µs (SLO: <500.000µs 📉 -15.3%) vs baseline: -1.4% Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.0% ✅ upper_aspectTime: ✅ 308.698µs (SLO: <500.000µs 📉 -38.3%) vs baseline: -0.7% Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.9% ✅ upper_noaspectTime: ✅ 235.334µs (SLO: <400.000µs 📉 -41.2%) vs baseline: ~same Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +5.0% 📈 iastaspectsospath - 24/24✅ ospathbasename_aspectTime: ✅ 503.092µs (SLO: <700.000µs 📉 -28.1%) vs baseline: 📈 +19.3% Memory: ✅ 42.271MB (SLO: <43.500MB -2.8%) vs baseline: +4.9% ✅ ospathbasename_noaspectTime: ✅ 423.734µs (SLO: <700.000µs 📉 -39.5%) vs baseline: -0.4% Memory: ✅ 42.330MB (SLO: <43.500MB -2.7%) vs baseline: +4.7% ✅ ospathjoin_aspectTime: ✅ 620.068µs (SLO: <700.000µs 📉 -11.4%) vs baseline: -0.9% Memory: ✅ 42.389MB (SLO: <43.500MB -2.6%) vs baseline: +5.2% ✅ ospathjoin_noaspectTime: ✅ 630.394µs (SLO: <700.000µs -9.9%) vs baseline: +0.4% Memory: ✅ 42.153MB (SLO: <43.500MB -3.1%) vs baseline: +4.5% ✅ ospathnormcase_aspectTime: ✅ 352.791µs (SLO: <700.000µs 📉 -49.6%) vs baseline: +0.2% Memory: ✅ 42.330MB (SLO: <43.500MB -2.7%) vs baseline: +4.7% ✅ ospathnormcase_noaspectTime: ✅ 355.710µs (SLO: <700.000µs 📉 -49.2%) vs baseline: -0.6% Memory: ✅ 42.448MB (SLO: <43.500MB -2.4%) vs baseline: +5.1% ✅ ospathsplit_aspectTime: ✅ 483.701µs (SLO: <700.000µs 📉 -30.9%) vs baseline: -1.1% Memory: ✅ 42.271MB (SLO: <43.500MB -2.8%) vs baseline: +4.8% ✅ ospathsplit_noaspectTime: ✅ 492.913µs (SLO: <700.000µs 📉 -29.6%) vs baseline: -1.0% Memory: ✅ 42.251MB (SLO: <43.500MB -2.9%) vs baseline: +4.5% ✅ ospathsplitdrive_aspectTime: ✅ 370.857µs (SLO: <700.000µs 📉 -47.0%) vs baseline: -0.6% Memory: ✅ 42.467MB (SLO: <43.500MB -2.4%) vs baseline: +5.2% ✅ ospathsplitdrive_noaspectTime: ✅ 72.839µs (SLO: <700.000µs 📉 -89.6%) vs baseline: -0.4% Memory: ✅ 42.349MB (SLO: <43.500MB -2.6%) vs baseline: +4.8% ✅ ospathsplitext_aspectTime: ✅ 461.507µs (SLO: <700.000µs 📉 -34.1%) vs baseline: +0.7% Memory: ✅ 42.408MB (SLO: <43.500MB -2.5%) vs baseline: +5.1% ✅ ospathsplitext_noaspectTime: ✅ 458.694µs (SLO: <700.000µs 📉 -34.5%) vs baseline: -1.4% Memory: ✅ 42.290MB (SLO: <43.500MB -2.8%) vs baseline: +4.8% 📈 telemetryaddmetric - 30/30✅ 1-count-metric-1-timesTime: ✅ 3.466µs (SLO: <20.000µs 📉 -82.7%) vs baseline: 📈 +13.6% Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +5.1% ✅ 1-count-metrics-100-timesTime: ✅ 200.234µs (SLO: <220.000µs -9.0%) vs baseline: -0.5% Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.5% ✅ 1-distribution-metric-1-timesTime: ✅ 3.394µs (SLO: <20.000µs 📉 -83.0%) vs baseline: +0.4% Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.9% ✅ 1-distribution-metrics-100-timesTime: ✅ 213.929µs (SLO: <230.000µs -7.0%) vs baseline: -0.3% Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.5% ✅ 1-gauge-metric-1-timesTime: ✅ 2.275µs (SLO: <20.000µs 📉 -88.6%) vs baseline: +0.1% Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.6% ✅ 1-gauge-metrics-100-timesTime: ✅ 139.119µs (SLO: <150.000µs -7.3%) vs baseline: +0.2% Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.8% ✅ 1-rate-metric-1-timesTime: ✅ 3.218µs (SLO: <20.000µs 📉 -83.9%) vs baseline: +0.4% Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.0% ✅ 1-rate-metrics-100-timesTime: ✅ 212.441µs (SLO: <250.000µs 📉 -15.0%) vs baseline: -1.0% Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0% ✅ 100-count-metrics-100-timesTime: ✅ 19.996ms (SLO: <22.000ms -9.1%) vs baseline: -0.3% Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.8% ✅ 100-distribution-metrics-100-timesTime: ✅ 2.237ms (SLO: <2.550ms 📉 -12.3%) vs baseline: +0.5% Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.2% ✅ 100-gauge-metrics-100-timesTime: ✅ 1.425ms (SLO: <1.550ms -8.1%) vs baseline: +1.6% Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.7% ✅ 100-rate-metrics-100-timesTime: ✅ 2.178ms (SLO: <2.550ms 📉 -14.6%) vs baseline: -0.2% Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.0% ✅ flush-1-metricTime: ✅ 4.472µs (SLO: <20.000µs 📉 -77.6%) vs baseline: -0.8% Memory: ✅ 35.252MB (SLO: <35.500MB 🟡 -0.7%) vs baseline: +5.0% ✅ flush-100-metricsTime: ✅ 173.441µs (SLO: <250.000µs 📉 -30.6%) vs baseline: -0.6% Memory: ✅ 35.370MB (SLO: <35.500MB 🟡 -0.4%) vs baseline: +4.7% ✅ flush-1000-metricsTime: ✅ 2.181ms (SLO: <2.500ms 📉 -12.8%) vs baseline: -0.2% Memory: ✅ 36.078MB (SLO: <36.500MB 🟡 -1.2%) vs baseline: +4.9% 🟡 Near SLO Breach (15 suites)🟡 coreapiscenario - 10/10 (1 unstable)
|
Description
Testing
Risks
Additional Notes