Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

parse_aws_alb_log function error failed to get field client_host #1193

Open
mdesouky opened this issue Dec 19, 2024 · 4 comments
Open

parse_aws_alb_log function error failed to get field client_host #1193

mdesouky opened this issue Dec 19, 2024 · 4 comments
Labels
type: bug A code related bug vrl: stdlib Changes to the standard library

Comments

@mdesouky
Copy link

mdesouky commented Dec 19, 2024

We're trying to ingest AWS alb logs from s3 buckets using the parse_aws_alb_logs function but on some logs we get this error message:
ERROR transform{component_kind="transform" component_id=parse_alb_logs component_type=remap}: vector::internal_events::remap: Mapping failed with event. error="function call error for \"parse_aws_alb_log\" at (13:41): failed to get field `client_host`: Parsing Error: (\"net/nginx-staging-au-1/xxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxx xx.xx.xx.xx:xxxxx xx.xx.xxx.x:xxx 100 6 161 8144 - arn:aws:acm:ap-southeast-2:xxxxxxxxxxxx:certificate/xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx - XXXXX-XXX-XXX000-XXX-XXX000 tlsv12 - xxxxx-xxxxxxx.xxxxxxxx.com - - - 2024-12-19T20:20:28\", TakeWhile1)" error_type="conversion_failed" stage="processing" internal_log_rate_limit=true

I'm suspecting it's the TakeWhile1 at the end but not sure
We've deployed vector as a helm chart
Vector version: 0.38.1

@jszwedko
Copy link
Member

Thanks @mdesouky . Could you provide the full line that was not successfully parsed?

@mdesouky
Copy link
Author

"net/nginx-staging-au-1/xxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxx xx.xx.xx.xx:xxxxx xx.xx.xxx.x:xxx 100 6 161 8144 - arn:aws:acm:ap-southeast-2:xxxxxxxxxxxx:certificate/xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx - XXXXX-XXX-XXX000-XXX-XXX000 tlsv12 - xxxxx-xxxxxxx.xxxxxxxx.com - - - 2024-12-19T20:20:28"

@mdesouky
Copy link
Author

I've just redacted IPs, hostnames and such

@jszwedko
Copy link
Member

Thanks!

@jszwedko jszwedko added vrl: stdlib Changes to the standard library type: bug A code related bug labels Dec 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: bug A code related bug vrl: stdlib Changes to the standard library
Projects
None yet
Development

No branches or pull requests

2 participants