We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
When reducing the default concurrency to 1 we pool connections which should be more efficient since we are running effectively as a sidecar.
1
When we attempted this we saw an increase in 500 responses due to connection pools getting reseted.
Stats before:
cluster_manager.cds.version_text: "" listener_manager.lds.version_text: "" cluster.workers_cluster.assignment_stale: 0 cluster.workers_cluster.assignment_timeout_received: 0 cluster.workers_cluster.bind_errors: 0 cluster.workers_cluster.circuit_breakers.default.cx_open: 0 cluster.workers_cluster.circuit_breakers.default.cx_pool_open: 0 cluster.workers_cluster.circuit_breakers.default.rq_open: 0 cluster.workers_cluster.circuit_breakers.default.rq_pending_open: 0 cluster.workers_cluster.circuit_breakers.default.rq_retry_open: 0 cluster.workers_cluster.circuit_breakers.high.cx_open: 0 cluster.workers_cluster.circuit_breakers.high.cx_pool_open: 0 cluster.workers_cluster.circuit_breakers.high.rq_open: 0 cluster.workers_cluster.circuit_breakers.high.rq_pending_open: 0 cluster.workers_cluster.circuit_breakers.high.rq_retry_open: 0 cluster.workers_cluster.default.total_match_count: 6160 cluster.workers_cluster.external.upstream_rq_200: 116299 cluster.workers_cluster.external.upstream_rq_2xx: 116299 cluster.workers_cluster.external.upstream_rq_401: 33 cluster.workers_cluster.external.upstream_rq_429: 234 cluster.workers_cluster.external.upstream_rq_4xx: 267 cluster.workers_cluster.external.upstream_rq_500: 31 cluster.workers_cluster.external.upstream_rq_504: 1 cluster.workers_cluster.external.upstream_rq_5xx: 32 cluster.workers_cluster.external.upstream_rq_completed: 116598 cluster.workers_cluster.health_check.attempt: 5773 cluster.workers_cluster.health_check.degraded: 0 cluster.workers_cluster.health_check.failure: 11 cluster.workers_cluster.health_check.healthy: 35 cluster.workers_cluster.health_check.network_failure: 11 cluster.workers_cluster.health_check.passive_failure: 0 cluster.workers_cluster.health_check.success: 5762 cluster.workers_cluster.health_check.verify_cluster: 0 cluster.workers_cluster.http1.dropped_headers_with_underscores: 0 cluster.workers_cluster.http1.metadata_not_supported_error: 0 cluster.workers_cluster.http1.requests_rejected_with_underscores_in_headers: 0 cluster.workers_cluster.http1.response_flood: 0 cluster.workers_cluster.internal.upstream_rq_200: 7 cluster.workers_cluster.internal.upstream_rq_2xx: 7 cluster.workers_cluster.internal.upstream_rq_completed: 7 cluster.workers_cluster.lb_healthy_panic: 0 cluster.workers_cluster.lb_local_cluster_not_ok: 0 cluster.workers_cluster.lb_recalculate_zone_structures: 0 cluster.workers_cluster.lb_subsets_active: 0 cluster.workers_cluster.lb_subsets_created: 0 cluster.workers_cluster.lb_subsets_fallback: 0 cluster.workers_cluster.lb_subsets_fallback_panic: 0 cluster.workers_cluster.lb_subsets_removed: 0 cluster.workers_cluster.lb_subsets_selected: 0 cluster.workers_cluster.lb_zone_cluster_too_small: 0 cluster.workers_cluster.lb_zone_no_capacity_left: 0 cluster.workers_cluster.lb_zone_number_differs: 0 cluster.workers_cluster.lb_zone_routing_all_directly: 0 cluster.workers_cluster.lb_zone_routing_cross_zone: 0 cluster.workers_cluster.lb_zone_routing_sampled: 0 cluster.workers_cluster.max_host_weight: 1 cluster.workers_cluster.membership_change: 35 cluster.workers_cluster.membership_degraded: 0 cluster.workers_cluster.membership_excluded: 0 cluster.workers_cluster.membership_healthy: 35 cluster.workers_cluster.membership_total: 35 cluster.workers_cluster.original_dst_host_invalid: 0 cluster.workers_cluster.retry_or_shadow_abandoned: 0 cluster.workers_cluster.update_attempt: 6160 cluster.workers_cluster.update_empty: 0 cluster.workers_cluster.update_failure: 0 cluster.workers_cluster.update_no_rebuild: 6125 cluster.workers_cluster.update_success: 6160 cluster.workers_cluster.upstream_cx_active: 108 cluster.workers_cluster.upstream_cx_close_notify: 31 cluster.workers_cluster.upstream_cx_connect_attempts_exceeded: 0 cluster.workers_cluster.upstream_cx_connect_fail: 0 cluster.workers_cluster.upstream_cx_connect_timeout: 0 cluster.workers_cluster.upstream_cx_connect_with_0_rtt: 0 cluster.workers_cluster.upstream_cx_destroy: 150 cluster.workers_cluster.upstream_cx_destroy_local: 34 cluster.workers_cluster.upstream_cx_destroy_local_with_active_rq: 3 cluster.workers_cluster.upstream_cx_destroy_remote: 116 cluster.workers_cluster.upstream_cx_destroy_remote_with_active_rq: 0 cluster.workers_cluster.upstream_cx_destroy_with_active_rq: 3 cluster.workers_cluster.upstream_cx_http1_total: 258 cluster.workers_cluster.upstream_cx_http2_total: 0 cluster.workers_cluster.upstream_cx_http3_total: 0 cluster.workers_cluster.upstream_cx_idle_timeout: 0 cluster.workers_cluster.upstream_cx_max_duration_reached: 0 cluster.workers_cluster.upstream_cx_max_requests: 0 cluster.workers_cluster.upstream_cx_none_healthy: 0 cluster.workers_cluster.upstream_cx_overflow: 0 cluster.workers_cluster.upstream_cx_pool_overflow: 0 cluster.workers_cluster.upstream_cx_protocol_error: 0 cluster.workers_cluster.upstream_cx_rx_bytes_buffered: 2385405 cluster.workers_cluster.upstream_cx_rx_bytes_total: 2421450826 cluster.workers_cluster.upstream_cx_total: 258 cluster.workers_cluster.upstream_cx_tx_bytes_buffered: 0 cluster.workers_cluster.upstream_cx_tx_bytes_total: 689598271 cluster.workers_cluster.upstream_flow_control_backed_up_total: 0 cluster.workers_cluster.upstream_flow_control_drained_total: 0 cluster.workers_cluster.upstream_flow_control_paused_reading_total: 104 cluster.workers_cluster.upstream_flow_control_resumed_reading_total: 87 cluster.workers_cluster.upstream_http3_broken: 0 cluster.workers_cluster.upstream_internal_redirect_failed_total: 0 cluster.workers_cluster.upstream_internal_redirect_succeeded_total: 0 cluster.workers_cluster.upstream_rq_0rtt: 0 cluster.workers_cluster.upstream_rq_200: 116306 cluster.workers_cluster.upstream_rq_2xx: 116306 cluster.workers_cluster.upstream_rq_401: 33 cluster.workers_cluster.upstream_rq_429: 234 cluster.workers_cluster.upstream_rq_4xx: 267 cluster.workers_cluster.upstream_rq_500: 31 cluster.workers_cluster.upstream_rq_504: 1 cluster.workers_cluster.upstream_rq_5xx: 32 cluster.workers_cluster.upstream_rq_active: 13 cluster.workers_cluster.upstream_rq_cancelled: 0 cluster.workers_cluster.upstream_rq_completed: 116605 cluster.workers_cluster.upstream_rq_maintenance_mode: 0 cluster.workers_cluster.upstream_rq_max_duration_reached: 0 cluster.workers_cluster.upstream_rq_pending_active: 0 cluster.workers_cluster.upstream_rq_pending_failure_eject: 0 cluster.workers_cluster.upstream_rq_pending_overflow: 0 cluster.workers_cluster.upstream_rq_pending_total: 258 cluster.workers_cluster.upstream_rq_per_try_idle_timeout: 0 cluster.workers_cluster.upstream_rq_per_try_timeout: 0 cluster.workers_cluster.upstream_rq_retry: 0 cluster.workers_cluster.upstream_rq_retry_backoff_exponential: 0 cluster.workers_cluster.upstream_rq_retry_backoff_ratelimited: 0 cluster.workers_cluster.upstream_rq_retry_limit_exceeded: 0 cluster.workers_cluster.upstream_rq_retry_overflow: 0 cluster.workers_cluster.upstream_rq_retry_success: 0 cluster.workers_cluster.upstream_rq_rx_reset: 0 cluster.workers_cluster.upstream_rq_timeout: 1 cluster.workers_cluster.upstream_rq_total: 116618 cluster.workers_cluster.upstream_rq_tx_reset: 0 cluster.workers_cluster.version: 0 cluster_manager.active_clusters: 1 cluster_manager.cds.init_fetch_timeout: 0 cluster_manager.cds.update_attempt: 1 cluster_manager.cds.update_failure: 0 cluster_manager.cds.update_rejected: 0 cluster_manager.cds.update_success: 1 cluster_manager.cds.update_time: 1682970036371 cluster_manager.cds.version: 17241709254077376921 cluster_manager.cluster_added: 1 cluster_manager.cluster_modified: 0 cluster_manager.cluster_removed: 0 cluster_manager.cluster_updated: 2 cluster_manager.cluster_updated_via_merge: 2 cluster_manager.update_merge_cancelled: 0 cluster_manager.update_out_of_merge_window: 2 cluster_manager.warming_clusters: 0 dns.cares.get_addr_failure: 0 dns.cares.not_found: 0 dns.cares.pending_resolutions: 0 dns.cares.resolve_total: 6160 dns.cares.timeouts: 0 envoy.overload_actions.reset_high_memory_stream.count: 0 filesystem.flushed_by_timer: 87 filesystem.reopen_failed: 0 filesystem.write_buffered: 46 filesystem.write_completed: 6 filesystem.write_failed: 0 filesystem.write_total_buffered: 0 http.admin.downstream_cx_active: 1 http.admin.downstream_cx_delayed_close_timeout: 0 http.admin.downstream_cx_destroy: 2 http.admin.downstream_cx_destroy_active_rq: 0 http.admin.downstream_cx_destroy_local: 0 http.admin.downstream_cx_destroy_local_active_rq: 0 http.admin.downstream_cx_destroy_remote: 2 http.admin.downstream_cx_destroy_remote_active_rq: 0 http.admin.downstream_cx_drain_close: 0 http.admin.downstream_cx_http1_active: 1 http.admin.downstream_cx_http1_total: 3 http.admin.downstream_cx_http2_active: 0 http.admin.downstream_cx_http2_total: 0 http.admin.downstream_cx_http3_active: 0 http.admin.downstream_cx_http3_total: 0 http.admin.downstream_cx_idle_timeout: 0 http.admin.downstream_cx_max_duration_reached: 0 http.admin.downstream_cx_max_requests_reached: 0 http.admin.downstream_cx_overload_disable_keepalive: 0 http.admin.downstream_cx_protocol_error: 0 http.admin.downstream_cx_rx_bytes_buffered: 81 http.admin.downstream_cx_rx_bytes_total: 243 http.admin.downstream_cx_ssl_active: 0 http.admin.downstream_cx_ssl_total: 0 http.admin.downstream_cx_total: 3 http.admin.downstream_cx_tx_bytes_buffered: 0 http.admin.downstream_cx_tx_bytes_total: 48217 http.admin.downstream_cx_upgrades_active: 0 http.admin.downstream_cx_upgrades_total: 0 http.admin.downstream_flow_control_paused_reading_total: 0 http.admin.downstream_flow_control_resumed_reading_total: 0 http.admin.downstream_rq_1xx: 0 http.admin.downstream_rq_2xx: 3 http.admin.downstream_rq_3xx: 0 http.admin.downstream_rq_4xx: 0 http.admin.downstream_rq_5xx: 0 http.admin.downstream_rq_active: 1 http.admin.downstream_rq_completed: 3 http.admin.downstream_rq_failed_path_normalization: 0 http.admin.downstream_rq_header_timeout: 0 http.admin.downstream_rq_http1_total: 3 http.admin.downstream_rq_http2_total: 0 http.admin.downstream_rq_http3_total: 0 http.admin.downstream_rq_idle_timeout: 0 http.admin.downstream_rq_max_duration_reached: 0 http.admin.downstream_rq_non_relative_path: 0 http.admin.downstream_rq_overload_close: 0 http.admin.downstream_rq_redirected_with_normalized_path: 0 http.admin.downstream_rq_rejected_via_ip_detection: 0 http.admin.downstream_rq_response_before_rq_complete: 0 http.admin.downstream_rq_rx_reset: 0 http.admin.downstream_rq_timeout: 0 http.admin.downstream_rq_too_large: 0 http.admin.downstream_rq_total: 3 http.admin.downstream_rq_tx_reset: 0 http.admin.downstream_rq_ws_on_non_ws_route: 0 http.admin.rs_too_large: 0 http.async-client.no_cluster: 0 http.async-client.no_route: 0 http.async-client.passthrough_internal_redirect_bad_location: 0 http.async-client.passthrough_internal_redirect_no_route: 0 http.async-client.passthrough_internal_redirect_predicate: 0 http.async-client.passthrough_internal_redirect_too_many_redirects: 0 http.async-client.passthrough_internal_redirect_unsafe_scheme: 0 http.async-client.rq_direct_response: 0 http.async-client.rq_redirect: 0 http.async-client.rq_reset_after_downstream_response_started: 0 http.async-client.rq_total: 0 http.monoceros_proxy_http.downstream_cx_active: 151 http.monoceros_proxy_http.downstream_cx_delayed_close_timeout: 0 http.monoceros_proxy_http.downstream_cx_destroy: 72649 http.monoceros_proxy_http.downstream_cx_destroy_active_rq: 2 http.monoceros_proxy_http.downstream_cx_destroy_local: 3779 http.monoceros_proxy_http.downstream_cx_destroy_local_active_rq: 0 http.monoceros_proxy_http.downstream_cx_destroy_remote: 68870 http.monoceros_proxy_http.downstream_cx_destroy_remote_active_rq: 2 http.monoceros_proxy_http.downstream_cx_drain_close: 0 http.monoceros_proxy_http.downstream_cx_http1_active: 151 http.monoceros_proxy_http.downstream_cx_http1_total: 72800 http.monoceros_proxy_http.downstream_cx_http2_active: 0 http.monoceros_proxy_http.downstream_cx_http2_total: 0 http.monoceros_proxy_http.downstream_cx_http3_active: 0 http.monoceros_proxy_http.downstream_cx_http3_total: 0 http.monoceros_proxy_http.downstream_cx_idle_timeout: 0 http.monoceros_proxy_http.downstream_cx_max_duration_reached: 0 http.monoceros_proxy_http.downstream_cx_max_requests_reached: 0 http.monoceros_proxy_http.downstream_cx_overload_disable_keepalive: 0 http.monoceros_proxy_http.downstream_cx_protocol_error: 0 http.monoceros_proxy_http.downstream_cx_rx_bytes_buffered: 832942 http.monoceros_proxy_http.downstream_cx_rx_bytes_total: 687366155 http.monoceros_proxy_http.downstream_cx_ssl_active: 0 http.monoceros_proxy_http.downstream_cx_ssl_total: 0 http.monoceros_proxy_http.downstream_cx_total: 72800 http.monoceros_proxy_http.downstream_cx_tx_bytes_buffered: 0 http.monoceros_proxy_http.downstream_cx_tx_bytes_total: 2427361258 http.monoceros_proxy_http.downstream_cx_upgrades_active: 0 http.monoceros_proxy_http.downstream_cx_upgrades_total: 0 http.monoceros_proxy_http.downstream_flow_control_paused_reading_total: 0 http.monoceros_proxy_http.downstream_flow_control_resumed_reading_total: 0 http.monoceros_proxy_http.downstream_rq_1xx: 0 http.monoceros_proxy_http.downstream_rq_2xx: 116306 http.monoceros_proxy_http.downstream_rq_3xx: 0 http.monoceros_proxy_http.downstream_rq_4xx: 267 http.monoceros_proxy_http.downstream_rq_5xx: 32 http.monoceros_proxy_http.downstream_rq_active: 13 http.monoceros_proxy_http.downstream_rq_completed: 116605 http.monoceros_proxy_http.downstream_rq_failed_path_normalization: 0 http.monoceros_proxy_http.downstream_rq_header_timeout: 0 http.monoceros_proxy_http.downstream_rq_http1_total: 116618 http.monoceros_proxy_http.downstream_rq_http2_total: 0 http.monoceros_proxy_http.downstream_rq_http3_total: 0 http.monoceros_proxy_http.downstream_rq_idle_timeout: 0 http.monoceros_proxy_http.downstream_rq_max_duration_reached: 0 http.monoceros_proxy_http.downstream_rq_non_relative_path: 0 http.monoceros_proxy_http.downstream_rq_overload_close: 0 http.monoceros_proxy_http.downstream_rq_redirected_with_normalized_path: 0 http.monoceros_proxy_http.downstream_rq_rejected_via_ip_detection: 0 http.monoceros_proxy_http.downstream_rq_response_before_rq_complete: 0 http.monoceros_proxy_http.downstream_rq_rx_reset: 2 http.monoceros_proxy_http.downstream_rq_timeout: 0 http.monoceros_proxy_http.downstream_rq_too_large: 0 http.monoceros_proxy_http.downstream_rq_total: 116618 http.monoceros_proxy_http.downstream_rq_tx_reset: 0 http.monoceros_proxy_http.downstream_rq_ws_on_non_ws_route: 0 http.monoceros_proxy_http.no_cluster: 0 http.monoceros_proxy_http.no_route: 0 http.monoceros_proxy_http.passthrough_internal_redirect_bad_location: 0 http.monoceros_proxy_http.passthrough_internal_redirect_no_route: 0 http.monoceros_proxy_http.passthrough_internal_redirect_predicate: 0 http.monoceros_proxy_http.passthrough_internal_redirect_too_many_redirects: 0 http.monoceros_proxy_http.passthrough_internal_redirect_unsafe_scheme: 0 http.monoceros_proxy_http.rq_direct_response: 0 http.monoceros_proxy_http.rq_redirect: 0 http.monoceros_proxy_http.rq_reset_after_downstream_response_started: 0 http.monoceros_proxy_http.rq_total: 116618 http.monoceros_proxy_http.rs_too_large: 0 http.monoceros_proxy_http.tracing.client_enabled: 0 http.monoceros_proxy_http.tracing.health_check: 0 http.monoceros_proxy_http.tracing.not_traceable: 0 http.monoceros_proxy_http.tracing.random_sampling: 0 http.monoceros_proxy_http.tracing.service_forced: 0 http.monoceros_proxy_http.user_agent.ios.downstream_cx_destroy_remote_active_rq: 0 http.monoceros_proxy_http.user_agent.ios.downstream_cx_total: 20866 http.monoceros_proxy_http.user_agent.ios.downstream_rq_total: 20866 http1.dropped_headers_with_underscores: 0 http1.metadata_not_supported_error: 0 http1.requests_rejected_with_underscores_in_headers: 0 http1.response_flood: 0 listener.0.0.0.0_9090.downstream_cx_active: 151 listener.0.0.0.0_9090.downstream_cx_destroy: 72649 listener.0.0.0.0_9090.downstream_cx_overflow: 0 listener.0.0.0.0_9090.downstream_cx_overload_reject: 0 listener.0.0.0.0_9090.downstream_cx_total: 72800 listener.0.0.0.0_9090.downstream_cx_transport_socket_connect_timeout: 0 listener.0.0.0.0_9090.downstream_global_cx_overflow: 0 listener.0.0.0.0_9090.downstream_listener_filter_error: 0 listener.0.0.0.0_9090.downstream_listener_filter_remote_close: 0 listener.0.0.0.0_9090.downstream_pre_cx_active: 0 listener.0.0.0.0_9090.downstream_pre_cx_timeout: 0 listener.0.0.0.0_9090.extension_config_missing: 0 listener.0.0.0.0_9090.http.monoceros_proxy_http.downstream_rq_1xx: 0 listener.0.0.0.0_9090.http.monoceros_proxy_http.downstream_rq_2xx: 116306 listener.0.0.0.0_9090.http.monoceros_proxy_http.downstream_rq_3xx: 0 listener.0.0.0.0_9090.http.monoceros_proxy_http.downstream_rq_4xx: 267 listener.0.0.0.0_9090.http.monoceros_proxy_http.downstream_rq_5xx: 32 listener.0.0.0.0_9090.http.monoceros_proxy_http.downstream_rq_completed: 116605 listener.0.0.0.0_9090.no_filter_chain_match: 0 listener.0.0.0.0_9090.worker_0.downstream_cx_active: 151 listener.0.0.0.0_9090.worker_0.downstream_cx_total: 72800 listener.admin.downstream_cx_active: 1 listener.admin.downstream_cx_destroy: 2 listener.admin.downstream_cx_overflow: 0 listener.admin.downstream_cx_overload_reject: 0 listener.admin.downstream_cx_total: 3 listener.admin.downstream_cx_transport_socket_connect_timeout: 0 listener.admin.downstream_global_cx_overflow: 0 listener.admin.downstream_listener_filter_error: 0 listener.admin.downstream_listener_filter_remote_close: 0 listener.admin.downstream_pre_cx_active: 0 listener.admin.downstream_pre_cx_timeout: 0 listener.admin.http.admin.downstream_rq_1xx: 0 listener.admin.http.admin.downstream_rq_2xx: 3 listener.admin.http.admin.downstream_rq_3xx: 0 listener.admin.http.admin.downstream_rq_4xx: 0 listener.admin.http.admin.downstream_rq_5xx: 0 listener.admin.http.admin.downstream_rq_completed: 3 listener.admin.main_thread.downstream_cx_active: 1 listener.admin.main_thread.downstream_cx_total: 3 listener.admin.no_filter_chain_match: 0 listener_manager.lds.init_fetch_timeout: 0 listener_manager.lds.update_attempt: 1 listener_manager.lds.update_failure: 0 listener_manager.lds.update_rejected: 0 listener_manager.lds.update_success: 1 listener_manager.lds.update_time: 1682970036377 listener_manager.lds.version: 17241709254077376921 listener_manager.listener_added: 1 listener_manager.listener_create_failure: 0 listener_manager.listener_create_success: 1 listener_manager.listener_in_place_updated: 0 listener_manager.listener_modified: 0 listener_manager.listener_removed: 0 listener_manager.listener_stopped: 0 listener_manager.total_filter_chains_draining: 0 listener_manager.total_listeners_active: 1 listener_manager.total_listeners_draining: 0 listener_manager.total_listeners_warming: 0 listener_manager.workers_started: 1 main_thread.watchdog_mega_miss: 0 main_thread.watchdog_miss: 0 runtime.admin_overrides_active: 0 runtime.deprecated_feature_seen_since_process_start: 0 runtime.deprecated_feature_use: 0 runtime.load_error: 0 runtime.load_success: 1 runtime.num_keys: 0 runtime.num_layers: 0 runtime.override_dir_exists: 0 runtime.override_dir_not_exists: 1 server.compilation_settings.fips_mode: 0 server.concurrency: 1 server.days_until_first_cert_expiring: 4294967295 server.debug_assertion_failures: 0 server.dropped_stat_flushes: 0 server.dynamic_unknown_fields: 0 server.envoy_bug_failures: 0 server.hot_restart_epoch: 0 server.hot_restart_generation: 1 server.live: 1 server.main_thread.watchdog_mega_miss: 0 server.main_thread.watchdog_miss: 0 server.memory_allocated: 11356776 server.memory_heap_size: 102760448 server.memory_physical_size: 121497954 server.parent_connections: 0 server.seconds_until_first_ocsp_response_expiring: 0 server.state: 0 server.static_unknown_fields: 0 server.stats_recent_lookups: 1515 server.total_connections: 147 server.uptime: 876 server.version: 11741999 server.wip_protos: 0 server.worker_0.watchdog_mega_miss: 0 server.worker_0.watchdog_miss: 0 vhost.local_service.vcluster.other.upstream_rq_retry: 0 vhost.local_service.vcluster.other.upstream_rq_retry_limit_exceeded: 0 vhost.local_service.vcluster.other.upstream_rq_retry_overflow: 0 vhost.local_service.vcluster.other.upstream_rq_retry_success: 0 vhost.local_service.vcluster.other.upstream_rq_timeout: 0 vhost.local_service.vcluster.other.upstream_rq_total: 0 workers.watchdog_mega_miss: 0 workers.watchdog_miss: 0 cluster.workers_cluster.external.upstream_rq_time: P0(3,0) P25(16.96875,18.812555066079295) P50(47.166666666666664,46.47908163265306) P75(95.08333333333333,90.43671875) P90(308.9999999999998,322.37011494252886) P95(468.6249999999998,562.3143939393931) P99(1324.5000000000005,1191.295121951219) P99.5(1524.5000000000005,1433.877483443708) P99.9(1962.4500000000012,2223.943750000035) P100(2000,6300) cluster.workers_cluster.internal.upstream_rq_time: P0(nan,22) P25(nan,35.75) P50(nan,47.5) P75(nan,64.25) P90(nan,553) P95(nan,556.5) P99(nan,559.3) P99.5(nan,559.65) P99.9(nan,559.93) P100(nan,560) cluster.workers_cluster.upstream_cx_connect_ms: P0(0,0) P25(0,0) P50(0,0) P75(0,0) P90(0,0) P95(0,0) P99(0,0) P99.5(0,0) P99.9(0,1.0742000000000018) P100(0,1.1) cluster.workers_cluster.upstream_cx_length_ms: P0(360000,33000) P25(362500,123125) P50(365000,261666.66666666666) P75(367500,403750) P90(369000,582200) P95(369500,625499.9999999999) P99(369900,755099.9999999999) P99.5(369950,762550) P99.9(369990,768510) P100(370000,770000) cluster.workers_cluster.upstream_rq_time: P0(3,0) P25(16.96875,18.814096916299558) P50(47.166666666666664,46.47959183673469) P75(95.08333333333333,90.434375) P90(308.9999999999998,322.37701149425305) P95(468.6249999999998,562.2878787878785) P99(1324.5000000000005,1191.2780487804891) P99.5(1524.5000000000005,1433.8543046357586) P99.9(1962.4500000000012,2223.899999999958) P100(2000,6300) cluster_manager.cds.update_duration: No recorded values http.admin.downstream_cx_length_ms: P0(nan,1) P25(nan,1.025) P50(nan,1.05) P75(nan,1.075) P90(nan,1.09) P95(nan,1.095) P99(nan,1.099) P99.5(nan,1.0995) P99.9(nan,1.0999) P100(nan,1.1) http.admin.downstream_rq_time: P0(nan,0) P25(nan,0) P50(nan,0) P75(nan,0) P90(nan,0) P95(nan,0) P99(nan,0) P99.5(nan,0) P99.9(nan,0) P100(nan,0) http.monoceros_proxy_http.downstream_cx_length_ms: P0(3,1) P25(1177.6785714285713,1162.4315224834513) P50(1396,1377.0799011532126) P75(1903.5714285714287,1911.8435300487276) P90(2743.333333333334,2696.504751847941) P95(3445.999999999999,3328.4464751958217) P99(5132.999999999998,4811.983333333337) P99.5(5282.999999999998,5500.351851851856) P99.9(7456.599999999998,7953.966666666868) P100(7500,200000) http.monoceros_proxy_http.downstream_rq_time: P0(3,1) P25(17.234375,19.024436090225564) P50(47.416666666666664,46.66896918172157) P75(96.08333333333333,90.61972891566265) P90(308.9999999999998,322.59862385321105) P95(468.6249999999998,562.4924812030071) P99(1324.5000000000005,1191.9877750611238) P99.5(1524.5000000000005,1434.944078947372) P99.9(1962.4500000000012,2230.1437500000247) P100(2000,16000) http.monoceros_proxy_http.user_agent.ios.downstream_cx_length_ms: P0(950,11) P25(1268.3333333333333,1215.7719435736676) P50(1610,1453.0719719133997) P75(2125,2007.2080291970804) P90(2730,2764.2276422764226) P95(3197.4999999999995,3382.6271186440677) P99(5178.999999999999,4770) P99.5(7439.5,5410.416666666667) P99.9(7487.900000000001,7212.5) P100(7500,34000) listener.0.0.0.0_9090.downstream_cx_length_ms: P0(3,1) P25(1177.6785714285713,1162.4158201118594) P50(1396,1377.0492928738158) P75(1903.5714285714287,1911.7830086580086) P90(2743.333333333334,2696.504751847941) P95(3445.999999999999,3328.4464751958217) P99(5132.999999999998,4811.983333333337) P99.5(5282.999999999998,5500.351851851856) P99.9(7456.599999999998,7953.966666666868) P100(7500,200000) listener.admin.downstream_cx_length_ms: P0(nan,1) P25(nan,1.025) P50(nan,1.05) P75(nan,1.075) P90(nan,1.09) P95(nan,1.095) P99(nan,1.099) P99.5(nan,1.0995) P99.9(nan,1.0999) P100(nan,1.1) listener_manager.lds.update_duration: No recorded values server.initialization_time_ms: P0(nan,16) P25(nan,16.25) P50(nan,16.5) P75(nan,16.75) P90(nan,16.9) P95(nan,16.95) P99(nan,16.99) P99.5(nan,16.995) P99.9(nan,16.999) P100(nan,17)
Stats after:
cluster_manager.cds.version_text: "" listener_manager.lds.version_text: "" cluster.workers_cluster.assignment_stale: 0 cluster.workers_cluster.assignment_timeout_received: 0 cluster.workers_cluster.bind_errors: 0 cluster.workers_cluster.circuit_breakers.default.cx_open: 0 cluster.workers_cluster.circuit_breakers.default.cx_pool_open: 0 cluster.workers_cluster.circuit_breakers.default.rq_open: 0 cluster.workers_cluster.circuit_breakers.default.rq_pending_open: 0 cluster.workers_cluster.circuit_breakers.default.rq_retry_open: 0 cluster.workers_cluster.circuit_breakers.high.cx_open: 0 cluster.workers_cluster.circuit_breakers.high.cx_pool_open: 0 cluster.workers_cluster.circuit_breakers.high.rq_open: 0 cluster.workers_cluster.circuit_breakers.high.rq_pending_open: 0 cluster.workers_cluster.circuit_breakers.high.rq_retry_open: 0 cluster.workers_cluster.default.total_match_count: 7665 cluster.workers_cluster.external.upstream_rq_200: 145824 cluster.workers_cluster.external.upstream_rq_2xx: 145824 cluster.workers_cluster.external.upstream_rq_401: 58 cluster.workers_cluster.external.upstream_rq_403: 1 cluster.workers_cluster.external.upstream_rq_429: 282 cluster.workers_cluster.external.upstream_rq_4xx: 341 cluster.workers_cluster.external.upstream_rq_500: 34 cluster.workers_cluster.external.upstream_rq_504: 2 cluster.workers_cluster.external.upstream_rq_5xx: 36 cluster.workers_cluster.external.upstream_rq_completed: 146201 cluster.workers_cluster.health_check.attempt: 7259 cluster.workers_cluster.health_check.degraded: 0 cluster.workers_cluster.health_check.failure: 11 cluster.workers_cluster.health_check.healthy: 35 cluster.workers_cluster.health_check.network_failure: 11 cluster.workers_cluster.health_check.passive_failure: 0 cluster.workers_cluster.health_check.success: 7248 cluster.workers_cluster.health_check.verify_cluster: 0 cluster.workers_cluster.http1.dropped_headers_with_underscores: 0 cluster.workers_cluster.http1.metadata_not_supported_error: 0 cluster.workers_cluster.http1.requests_rejected_with_underscores_in_headers: 0 cluster.workers_cluster.http1.response_flood: 0 cluster.workers_cluster.internal.upstream_rq_200: 7 cluster.workers_cluster.internal.upstream_rq_2xx: 7 cluster.workers_cluster.internal.upstream_rq_completed: 7 cluster.workers_cluster.lb_healthy_panic: 0 cluster.workers_cluster.lb_local_cluster_not_ok: 0 cluster.workers_cluster.lb_recalculate_zone_structures: 0 cluster.workers_cluster.lb_subsets_active: 0 cluster.workers_cluster.lb_subsets_created: 0 cluster.workers_cluster.lb_subsets_fallback: 0 cluster.workers_cluster.lb_subsets_fallback_panic: 0 cluster.workers_cluster.lb_subsets_removed: 0 cluster.workers_cluster.lb_subsets_selected: 0 cluster.workers_cluster.lb_zone_cluster_too_small: 0 cluster.workers_cluster.lb_zone_no_capacity_left: 0 cluster.workers_cluster.lb_zone_number_differs: 0 cluster.workers_cluster.lb_zone_routing_all_directly: 0 cluster.workers_cluster.lb_zone_routing_cross_zone: 0 cluster.workers_cluster.lb_zone_routing_sampled: 0 cluster.workers_cluster.max_host_weight: 1 cluster.workers_cluster.membership_change: 35 cluster.workers_cluster.membership_degraded: 0 cluster.workers_cluster.membership_excluded: 0 cluster.workers_cluster.membership_healthy: 35 cluster.workers_cluster.membership_total: 35 cluster.workers_cluster.original_dst_host_invalid: 0 cluster.workers_cluster.retry_or_shadow_abandoned: 0 cluster.workers_cluster.update_attempt: 7665 cluster.workers_cluster.update_empty: 0 cluster.workers_cluster.update_failure: 0 cluster.workers_cluster.update_no_rebuild: 7630 cluster.workers_cluster.update_success: 7665 cluster.workers_cluster.upstream_cx_active: 109 cluster.workers_cluster.upstream_cx_close_notify: 34 cluster.workers_cluster.upstream_cx_connect_attempts_exceeded: 0 cluster.workers_cluster.upstream_cx_connect_fail: 0 cluster.workers_cluster.upstream_cx_connect_timeout: 0 cluster.workers_cluster.upstream_cx_connect_with_0_rtt: 0 cluster.workers_cluster.upstream_cx_destroy: 184 cluster.workers_cluster.upstream_cx_destroy_local: 38 cluster.workers_cluster.upstream_cx_destroy_local_with_active_rq: 4 cluster.workers_cluster.upstream_cx_destroy_remote: 146 cluster.workers_cluster.upstream_cx_destroy_remote_with_active_rq: 0 cluster.workers_cluster.upstream_cx_destroy_with_active_rq: 4 cluster.workers_cluster.upstream_cx_http1_total: 293 cluster.workers_cluster.upstream_cx_http2_total: 0 cluster.workers_cluster.upstream_cx_http3_total: 0 cluster.workers_cluster.upstream_cx_idle_timeout: 0 cluster.workers_cluster.upstream_cx_max_duration_reached: 0 cluster.workers_cluster.upstream_cx_max_requests: 0 cluster.workers_cluster.upstream_cx_none_healthy: 0 cluster.workers_cluster.upstream_cx_overflow: 0 cluster.workers_cluster.upstream_cx_pool_overflow: 0 cluster.workers_cluster.upstream_cx_protocol_error: 0 cluster.workers_cluster.upstream_cx_rx_bytes_buffered: 2893729 cluster.workers_cluster.upstream_cx_rx_bytes_total: 3045792734 cluster.workers_cluster.upstream_cx_total: 293 cluster.workers_cluster.upstream_cx_tx_bytes_buffered: 0 cluster.workers_cluster.upstream_cx_tx_bytes_total: 863182592 cluster.workers_cluster.upstream_flow_control_backed_up_total: 0 cluster.workers_cluster.upstream_flow_control_drained_total: 0 cluster.workers_cluster.upstream_flow_control_paused_reading_total: 118 cluster.workers_cluster.upstream_flow_control_resumed_reading_total: 99 cluster.workers_cluster.upstream_http3_broken: 0 cluster.workers_cluster.upstream_internal_redirect_failed_total: 0 cluster.workers_cluster.upstream_internal_redirect_succeeded_total: 0 cluster.workers_cluster.upstream_rq_0rtt: 0 cluster.workers_cluster.upstream_rq_200: 145831 cluster.workers_cluster.upstream_rq_2xx: 145831 cluster.workers_cluster.upstream_rq_401: 58 cluster.workers_cluster.upstream_rq_403: 1 cluster.workers_cluster.upstream_rq_429: 282 cluster.workers_cluster.upstream_rq_4xx: 341 cluster.workers_cluster.upstream_rq_500: 34 cluster.workers_cluster.upstream_rq_504: 2 cluster.workers_cluster.upstream_rq_5xx: 36 cluster.workers_cluster.upstream_rq_active: 17 cluster.workers_cluster.upstream_rq_cancelled: 0 cluster.workers_cluster.upstream_rq_completed: 146208 cluster.workers_cluster.upstream_rq_maintenance_mode: 0 cluster.workers_cluster.upstream_rq_max_duration_reached: 0 cluster.workers_cluster.upstream_rq_pending_active: 0 cluster.workers_cluster.upstream_rq_pending_failure_eject: 0 cluster.workers_cluster.upstream_rq_pending_overflow: 0 cluster.workers_cluster.upstream_rq_pending_total: 293 cluster.workers_cluster.upstream_rq_per_try_idle_timeout: 0 cluster.workers_cluster.upstream_rq_per_try_timeout: 0 cluster.workers_cluster.upstream_rq_retry: 0 cluster.workers_cluster.upstream_rq_retry_backoff_exponential: 0 cluster.workers_cluster.upstream_rq_retry_backoff_ratelimited: 0 cluster.workers_cluster.upstream_rq_retry_limit_exceeded: 0 cluster.workers_cluster.upstream_rq_retry_overflow: 0 cluster.workers_cluster.upstream_rq_retry_success: 0 cluster.workers_cluster.upstream_rq_rx_reset: 0 cluster.workers_cluster.upstream_rq_timeout: 2 cluster.workers_cluster.upstream_rq_total: 146225 cluster.workers_cluster.upstream_rq_tx_reset: 0 cluster.workers_cluster.version: 0 cluster_manager.active_clusters: 1 cluster_manager.cds.init_fetch_timeout: 0 cluster_manager.cds.update_attempt: 1 cluster_manager.cds.update_failure: 0 cluster_manager.cds.update_rejected: 0 cluster_manager.cds.update_success: 1 cluster_manager.cds.update_time: 1682970036371 cluster_manager.cds.version: 17241709254077376921 cluster_manager.cluster_added: 1 cluster_manager.cluster_modified: 0 cluster_manager.cluster_removed: 0 cluster_manager.cluster_updated: 2 cluster_manager.cluster_updated_via_merge: 2 cluster_manager.update_merge_cancelled: 0 cluster_manager.update_out_of_merge_window: 2 cluster_manager.warming_clusters: 0 dns.cares.get_addr_failure: 0 dns.cares.not_found: 0 dns.cares.pending_resolutions: 0 dns.cares.resolve_total: 7665 dns.cares.timeouts: 0 envoy.overload_actions.reset_high_memory_stream.count: 0 filesystem.flushed_by_timer: 109 filesystem.reopen_failed: 0 filesystem.write_buffered: 46 filesystem.write_completed: 6 filesystem.write_failed: 0 filesystem.write_total_buffered: 0 http.admin.downstream_cx_active: 1 http.admin.downstream_cx_delayed_close_timeout: 0 http.admin.downstream_cx_destroy: 5 http.admin.downstream_cx_destroy_active_rq: 0 http.admin.downstream_cx_destroy_local: 0 http.admin.downstream_cx_destroy_local_active_rq: 0 http.admin.downstream_cx_destroy_remote: 5 http.admin.downstream_cx_destroy_remote_active_rq: 0 http.admin.downstream_cx_drain_close: 0 http.admin.downstream_cx_http1_active: 1 http.admin.downstream_cx_http1_total: 6 http.admin.downstream_cx_http2_active: 0 http.admin.downstream_cx_http2_total: 0 http.admin.downstream_cx_http3_active: 0 http.admin.downstream_cx_http3_total: 0 http.admin.downstream_cx_idle_timeout: 0 http.admin.downstream_cx_max_duration_reached: 0 http.admin.downstream_cx_max_requests_reached: 0 http.admin.downstream_cx_overload_disable_keepalive: 0 http.admin.downstream_cx_protocol_error: 0 http.admin.downstream_cx_rx_bytes_buffered: 81 http.admin.downstream_cx_rx_bytes_total: 486 http.admin.downstream_cx_ssl_active: 0 http.admin.downstream_cx_ssl_total: 0 http.admin.downstream_cx_total: 6 http.admin.downstream_cx_tx_bytes_buffered: 0 http.admin.downstream_cx_tx_bytes_total: 121188 http.admin.downstream_cx_upgrades_active: 0 http.admin.downstream_cx_upgrades_total: 0 http.admin.downstream_flow_control_paused_reading_total: 0 http.admin.downstream_flow_control_resumed_reading_total: 0 http.admin.downstream_rq_1xx: 0 http.admin.downstream_rq_2xx: 6 http.admin.downstream_rq_3xx: 0 http.admin.downstream_rq_4xx: 0 http.admin.downstream_rq_5xx: 0 http.admin.downstream_rq_active: 1 http.admin.downstream_rq_completed: 6 http.admin.downstream_rq_failed_path_normalization: 0 http.admin.downstream_rq_header_timeout: 0 http.admin.downstream_rq_http1_total: 6 http.admin.downstream_rq_http2_total: 0 http.admin.downstream_rq_http3_total: 0 http.admin.downstream_rq_idle_timeout: 0 http.admin.downstream_rq_max_duration_reached: 0 http.admin.downstream_rq_non_relative_path: 0 http.admin.downstream_rq_overload_close: 0 http.admin.downstream_rq_redirected_with_normalized_path: 0 http.admin.downstream_rq_rejected_via_ip_detection: 0 http.admin.downstream_rq_response_before_rq_complete: 0 http.admin.downstream_rq_rx_reset: 0 http.admin.downstream_rq_timeout: 0 http.admin.downstream_rq_too_large: 0 http.admin.downstream_rq_total: 6 http.admin.downstream_rq_tx_reset: 0 http.admin.downstream_rq_ws_on_non_ws_route: 0 http.admin.rs_too_large: 0 http.async-client.no_cluster: 0 http.async-client.no_route: 0 http.async-client.passthrough_internal_redirect_bad_location: 0 http.async-client.passthrough_internal_redirect_no_route: 0 http.async-client.passthrough_internal_redirect_predicate: 0 http.async-client.passthrough_internal_redirect_too_many_redirects: 0 http.async-client.passthrough_internal_redirect_unsafe_scheme: 0 http.async-client.rq_direct_response: 0 http.async-client.rq_redirect: 0 http.async-client.rq_reset_after_downstream_response_started: 0 http.async-client.rq_total: 0 http.monoceros_proxy_http.downstream_cx_active: 134 http.monoceros_proxy_http.downstream_cx_delayed_close_timeout: 0 http.monoceros_proxy_http.downstream_cx_destroy: 90786 http.monoceros_proxy_http.downstream_cx_destroy_active_rq: 2 http.monoceros_proxy_http.downstream_cx_destroy_local: 4673 http.monoceros_proxy_http.downstream_cx_destroy_local_active_rq: 0 http.monoceros_proxy_http.downstream_cx_destroy_remote: 86113 http.monoceros_proxy_http.downstream_cx_destroy_remote_active_rq: 2 http.monoceros_proxy_http.downstream_cx_drain_close: 0 http.monoceros_proxy_http.downstream_cx_http1_active: 134 http.monoceros_proxy_http.downstream_cx_http1_total: 90920 http.monoceros_proxy_http.downstream_cx_http2_active: 0 http.monoceros_proxy_http.downstream_cx_http2_total: 0 http.monoceros_proxy_http.downstream_cx_http3_active: 0 http.monoceros_proxy_http.downstream_cx_http3_total: 0 http.monoceros_proxy_http.downstream_cx_idle_timeout: 0 http.monoceros_proxy_http.downstream_cx_max_duration_reached: 0 http.monoceros_proxy_http.downstream_cx_max_requests_reached: 0 http.monoceros_proxy_http.downstream_cx_overload_disable_keepalive: 0 http.monoceros_proxy_http.downstream_cx_protocol_error: 0 http.monoceros_proxy_http.downstream_cx_rx_bytes_buffered: 797939 http.monoceros_proxy_http.downstream_cx_rx_bytes_total: 860335509 http.monoceros_proxy_http.downstream_cx_ssl_active: 0 http.monoceros_proxy_http.downstream_cx_ssl_total: 0 http.monoceros_proxy_http.downstream_cx_total: 90920 http.monoceros_proxy_http.downstream_cx_tx_bytes_buffered: 0 http.monoceros_proxy_http.downstream_cx_tx_bytes_total: 3053203344 http.monoceros_proxy_http.downstream_cx_upgrades_active: 0 http.monoceros_proxy_http.downstream_cx_upgrades_total: 0 http.monoceros_proxy_http.downstream_flow_control_paused_reading_total: 0 http.monoceros_proxy_http.downstream_flow_control_resumed_reading_total: 0 http.monoceros_proxy_http.downstream_rq_1xx: 0 http.monoceros_proxy_http.downstream_rq_2xx: 145831 http.monoceros_proxy_http.downstream_rq_3xx: 0 http.monoceros_proxy_http.downstream_rq_4xx: 341 http.monoceros_proxy_http.downstream_rq_5xx: 36 http.monoceros_proxy_http.downstream_rq_active: 17 http.monoceros_proxy_http.downstream_rq_completed: 146208 http.monoceros_proxy_http.downstream_rq_failed_path_normalization: 0 http.monoceros_proxy_http.downstream_rq_header_timeout: 0 http.monoceros_proxy_http.downstream_rq_http1_total: 146225 http.monoceros_proxy_http.downstream_rq_http2_total: 0 http.monoceros_proxy_http.downstream_rq_http3_total: 0 http.monoceros_proxy_http.downstream_rq_idle_timeout: 0 http.monoceros_proxy_http.downstream_rq_max_duration_reached: 0 http.monoceros_proxy_http.downstream_rq_non_relative_path: 0 http.monoceros_proxy_http.downstream_rq_overload_close: 0 http.monoceros_proxy_http.downstream_rq_redirected_with_normalized_path: 0 http.monoceros_proxy_http.downstream_rq_rejected_via_ip_detection: 0 http.monoceros_proxy_http.downstream_rq_response_before_rq_complete: 0 http.monoceros_proxy_http.downstream_rq_rx_reset: 2 http.monoceros_proxy_http.downstream_rq_timeout: 0 http.monoceros_proxy_http.downstream_rq_too_large: 0 http.monoceros_proxy_http.downstream_rq_total: 146225 http.monoceros_proxy_http.downstream_rq_tx_reset: 0 http.monoceros_proxy_http.downstream_rq_ws_on_non_ws_route: 0 http.monoceros_proxy_http.no_cluster: 0 http.monoceros_proxy_http.no_route: 0 http.monoceros_proxy_http.passthrough_internal_redirect_bad_location: 0 http.monoceros_proxy_http.passthrough_internal_redirect_no_route: 0 http.monoceros_proxy_http.passthrough_internal_redirect_predicate: 0 http.monoceros_proxy_http.passthrough_internal_redirect_too_many_redirects: 0 http.monoceros_proxy_http.passthrough_internal_redirect_unsafe_scheme: 0 http.monoceros_proxy_http.rq_direct_response: 0 http.monoceros_proxy_http.rq_redirect: 0 http.monoceros_proxy_http.rq_reset_after_downstream_response_started: 0 http.monoceros_proxy_http.rq_total: 146225 http.monoceros_proxy_http.rs_too_large: 0 http.monoceros_proxy_http.tracing.client_enabled: 0 http.monoceros_proxy_http.tracing.health_check: 0 http.monoceros_proxy_http.tracing.not_traceable: 0 http.monoceros_proxy_http.tracing.random_sampling: 0 http.monoceros_proxy_http.tracing.service_forced: 0 http.monoceros_proxy_http.user_agent.ios.downstream_cx_destroy_remote_active_rq: 0 http.monoceros_proxy_http.user_agent.ios.downstream_cx_total: 26208 http.monoceros_proxy_http.user_agent.ios.downstream_rq_total: 26208 http1.dropped_headers_with_underscores: 0 http1.metadata_not_supported_error: 0 http1.requests_rejected_with_underscores_in_headers: 0 http1.response_flood: 0 listener.0.0.0.0_9090.downstream_cx_active: 134 listener.0.0.0.0_9090.downstream_cx_destroy: 90786 listener.0.0.0.0_9090.downstream_cx_overflow: 0 listener.0.0.0.0_9090.downstream_cx_overload_reject: 0 listener.0.0.0.0_9090.downstream_cx_total: 90920 listener.0.0.0.0_9090.downstream_cx_transport_socket_connect_timeout: 0 listener.0.0.0.0_9090.downstream_global_cx_overflow: 0 listener.0.0.0.0_9090.downstream_listener_filter_error: 0 listener.0.0.0.0_9090.downstream_listener_filter_remote_close: 0 listener.0.0.0.0_9090.downstream_pre_cx_active: 0 listener.0.0.0.0_9090.downstream_pre_cx_timeout: 0 listener.0.0.0.0_9090.extension_config_missing: 0 listener.0.0.0.0_9090.http.monoceros_proxy_http.downstream_rq_1xx: 0 listener.0.0.0.0_9090.http.monoceros_proxy_http.downstream_rq_2xx: 145831 listener.0.0.0.0_9090.http.monoceros_proxy_http.downstream_rq_3xx: 0 listener.0.0.0.0_9090.http.monoceros_proxy_http.downstream_rq_4xx: 341 listener.0.0.0.0_9090.http.monoceros_proxy_http.downstream_rq_5xx: 36 listener.0.0.0.0_9090.http.monoceros_proxy_http.downstream_rq_completed: 146208 listener.0.0.0.0_9090.no_filter_chain_match: 0 listener.0.0.0.0_9090.worker_0.downstream_cx_active: 134 listener.0.0.0.0_9090.worker_0.downstream_cx_total: 90920 listener.admin.downstream_cx_active: 1 listener.admin.downstream_cx_destroy: 5 listener.admin.downstream_cx_overflow: 0 listener.admin.downstream_cx_overload_reject: 0 listener.admin.downstream_cx_total: 6 listener.admin.downstream_cx_transport_socket_connect_timeout: 0 listener.admin.downstream_global_cx_overflow: 0 listener.admin.downstream_listener_filter_error: 0 listener.admin.downstream_listener_filter_remote_close: 0 listener.admin.downstream_pre_cx_active: 0 listener.admin.downstream_pre_cx_timeout: 0 listener.admin.http.admin.downstream_rq_1xx: 0 listener.admin.http.admin.downstream_rq_2xx: 6 listener.admin.http.admin.downstream_rq_3xx: 0 listener.admin.http.admin.downstream_rq_4xx: 0 listener.admin.http.admin.downstream_rq_5xx: 0 listener.admin.http.admin.downstream_rq_completed: 6 listener.admin.main_thread.downstream_cx_active: 1 listener.admin.main_thread.downstream_cx_total: 6 listener.admin.no_filter_chain_match: 0 listener_manager.lds.init_fetch_timeout: 0 listener_manager.lds.update_attempt: 1 listener_manager.lds.update_failure: 0 listener_manager.lds.update_rejected: 0 listener_manager.lds.update_success: 1 listener_manager.lds.update_time: 1682970036377 listener_manager.lds.version: 17241709254077376921 listener_manager.listener_added: 1 listener_manager.listener_create_failure: 0 listener_manager.listener_create_success: 1 listener_manager.listener_in_place_updated: 0 listener_manager.listener_modified: 0 listener_manager.listener_removed: 0 listener_manager.listener_stopped: 0 listener_manager.total_filter_chains_draining: 0 listener_manager.total_listeners_active: 1 listener_manager.total_listeners_draining: 0 listener_manager.total_listeners_warming: 0 listener_manager.workers_started: 1 main_thread.watchdog_mega_miss: 0 main_thread.watchdog_miss: 0 runtime.admin_overrides_active: 0 runtime.deprecated_feature_seen_since_process_start: 0 runtime.deprecated_feature_use: 0 runtime.load_error: 0 runtime.load_success: 1 runtime.num_keys: 0 runtime.num_layers: 0 runtime.override_dir_exists: 0 runtime.override_dir_not_exists: 1 server.compilation_settings.fips_mode: 0 server.concurrency: 1 server.days_until_first_cert_expiring: 4294967295 server.debug_assertion_failures: 0 server.dropped_stat_flushes: 0 server.dynamic_unknown_fields: 0 server.envoy_bug_failures: 0 server.hot_restart_epoch: 0 server.hot_restart_generation: 1 server.live: 1 server.main_thread.watchdog_mega_miss: 0 server.main_thread.watchdog_miss: 0 server.memory_allocated: 10821960 server.memory_heap_size: 104857600 server.memory_physical_size: 123648354 server.parent_connections: 0 server.seconds_until_first_ocsp_response_expiring: 0 server.state: 0 server.static_unknown_fields: 0 server.stats_recent_lookups: 1524 server.total_connections: 106 server.uptime: 1091 server.version: 11741999 server.wip_protos: 0 server.worker_0.watchdog_mega_miss: 0 server.worker_0.watchdog_miss: 0 vhost.local_service.vcluster.other.upstream_rq_retry: 0 vhost.local_service.vcluster.other.upstream_rq_retry_limit_exceeded: 0 vhost.local_service.vcluster.other.upstream_rq_retry_overflow: 0 vhost.local_service.vcluster.other.upstream_rq_retry_success: 0 vhost.local_service.vcluster.other.upstream_rq_timeout: 0 vhost.local_service.vcluster.other.upstream_rq_total: 0 workers.watchdog_mega_miss: 0 workers.watchdog_miss: 0 cluster.workers_cluster.external.upstream_rq_time: P0(1,0) P25(17.285714285714285,18.83414295628036) P50(46.333333333333336,46.91815235008104) P75(87.8,92.43103448275862) P90(361.0000000000002,328.3629893238434) P95(626.0000000000002,573.6746987951807) P99(1325.999999999999,1223.7659033078867) P99.5(1587.9999999999995,1480.0507614213257) P99.9(2735.1999999999975,2589.2500000001746) P100(2800,6500) cluster.workers_cluster.internal.upstream_rq_time: P0(nan,22) P25(nan,35.75) P50(nan,47.5) P75(nan,64.25) P90(nan,553) P95(nan,556.5) P99(nan,559.3) P99.5(nan,559.65) P99.9(nan,559.93) P100(nan,560) cluster.workers_cluster.upstream_cx_connect_ms: P0(nan,0) P25(nan,0) P50(nan,0) P75(nan,0) P90(nan,0) P95(nan,0) P99(nan,0) P99.5(nan,0) P99.9(nan,1.0706999999999993) P100(nan,1.1) cluster.workers_cluster.upstream_cx_length_ms: P0(380000,33000) P25(385000,143333.33333333334) P50(390000,297500) P75(1050000,490000) P90(1080000,676000) P95(1090000,813999.9999999999) P99(1098000,1054000) P99.5(1099000,1077000.0000000002) P99.9(1099800,1095400) P100(1100000,1100000) cluster.workers_cluster.upstream_rq_time: P0(1,0) P25(17.285714285714285,18.835357390700903) P50(46.333333333333336,46.91855753646677) P75(87.8,92.42887931034483) P90(361.0000000000002,328.36832740213555) P95(626.0000000000002,573.6536144578309) P99(1325.999999999999,1223.7480916030502) P99.5(1587.9999999999995,1480.032994923862) P99.9(2735.1999999999975,2589.1625000000204) P100(2800,6500) cluster_manager.cds.update_duration: No recorded values http.admin.downstream_cx_length_ms: P0(nan,1) P25(nan,1.025) P50(nan,1.05) P75(nan,1.075) P90(nan,1.09) P95(nan,1.095) P99(nan,1.099) P99.5(nan,1.0995) P99.9(nan,1.0999) P100(nan,1.1) http.admin.downstream_rq_time: P0(nan,0) P25(nan,0) P50(nan,0) P75(nan,0) P90(nan,0) P95(nan,0) P99(nan,0) P99.5(nan,0) P99.9(nan,0) P100(nan,0) http.monoceros_proxy_http.downstream_cx_length_ms: P0(1,1) P25(1152.7777777777778,1160.5003602954423) P50(1383.8709677419356,1375.7171336803633) P75(1925,1913.1800518134714) P90(2879.9999999999995,2699.548167092924) P95(3477.499999999999,3328.0866807610973) P99(4481.999999999999,4832.734939759034) P99.5(5091.000000000003,5558.33870967744) P99.9(7958.199999999999,7928.340000000026) P100(8000,200000) http.monoceros_proxy_http.downstream_rq_time: P0(1,1) P25(17.375,19.03603448275862) P50(46.44444444444444,47.12083333333333) P75(88,92.61533149171271) P90(361.0000000000002,328.5808170515099) P95(626.0000000000002,573.8515151515145) P99(1325.999999999999,1224.825757575757) P99.5(1587.9999999999995,1481.1388888888882) P99.9(2735.1999999999975,2622.619999999879) P100(2800,16000) http.monoceros_proxy_http.user_agent.ios.downstream_cx_length_ms: P0(850,11) P25(1155.2631578947369,1214.369893148963) P50(1411.111111111111,1453.0849549121974) P75(1931.25,2011.4338235294117) P90(3060.000000000001,2770.6269592476488) P95(3710,3389.7077922077906) P99(4366,4825.347826086948) P99.5(5033.000000000001,5488.678571428578) P99.9(5086.600000000001,7157.660000000033) P100(5100,34000) listener.0.0.0.0_9090.downstream_cx_length_ms: P0(1,1) P25(1152.7777777777778,1160.4842342342342) P50(1383.8709677419356,1375.6839074094585) P75(1919.2307692307693,1913.0936960276338) P90(2879.9999999999995,2699.548167092924) P95(3477.499999999999,3328.0866807610973) P99(4481.999999999999,4832.734939759034) P99.5(5091.000000000003,5558.33870967744) P99.9(7958.199999999999,7928.340000000026) P100(8000,200000) listener.admin.downstream_cx_length_ms: P0(nan,1) P25(nan,1.025) P50(nan,1.05) P75(nan,1.075) P90(nan,1.09) P95(nan,1.095) P99(nan,1.099) P99.5(nan,1.0995) P99.9(nan,1.0999) P100(nan,1.1) listener_manager.lds.update_duration: No recorded values server.initialization_time_ms: P0(nan,16) P25(nan,16.25) P50(nan,16.5) P75(nan,16.75) P90(nan,16.9) P95(nan,16.95) P99(nan,16.99) P99.5(nan,16.995) P99.9(nan,16.999) P100(nan,17)
The text was updated successfully, but these errors were encountered:
No branches or pull requests
When reducing the default concurrency to
1
we pool connections which should be more efficient since we are running effectively as a sidecar.When we attempted this we saw an increase in 500 responses due to connection pools getting reseted.
Stats before:
Stats after:
The text was updated successfully, but these errors were encountered: