[Bug]

[YaoXina]

Search before asking

• I had searched in the issues and found no similar issues.

Apache SkyWalking Component

Java Agent (apache/skywalking-java)

What happened

I use in docker java-agent

What you expected to happen

ERROR 2024-01-23 15:29:15.188 3a23de32c3114df5aaed5f117047f960-0-C-1 InstMethodsInter : class[class org.apache.kafka.clients.consumer.KafkaConsumer] after method[pollForFetches] intercept failure
java.lang.ClassCastException: org.apache.kafka.clients.consumer.internals.Fetch incompatible with java.util.Map
at org.apache.skywalking.apm.plugin.kafka.KafkaConsumerInterceptor.afterMethod(KafkaConsumerInterceptor.java:64)
at org.apache.skywalking.apm.agent.core.plugin.interceptor.enhance.InstMethodsInter.intercept(InstMethodsInter.java:97)
at org.apache.kafka.clients.consumer.KafkaConsumer.pollForFetches(KafkaConsumer.java)
at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1254)
at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1227)
at org.apache.kafka.clients.consumer.KafkaConsumer$$FastClassBySpringCGLIB$$11173828.invoke()
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386)
at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704)
at org.apache.kafka.clients.consumer.KafkaConsumer$$EnhancerBySpringCGLIB$$262c25f1.poll()
at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.pollConsumer(KafkaMessageListenerContainer.java:1601)
at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.doPoll(KafkaMessageListenerContainer.java:1576)
at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.pollAndInvoke$original$Ndtu6fc3(KafkaMessageListenerContainer.java:1377)
at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.pollAndInvoke$original$Ndtu6fc3$accessor$d6AyCJFE(KafkaMessageListenerContainer.java)
at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer$auxiliary$LUiXHu1Q.call(Unknown Source)
at org.apache.skywalking.apm.agent.core.plugin.interceptor.enhance.InstMethodsInter.intercept(InstMethodsInter.java:86)
at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.pollAndInvoke(KafkaMessageListenerContainer.java)
at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.run(KafkaMessageListenerContainer.java:1291)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.lang.Thread.run(Thread.java:832)

How to reproduce

bi-server:
image: /bi-base-image:2.2.0
deploy:
restart_policy:
condition: on-failure
placement:
constraints: [node.role == manager]
depends_on:
- bi-server-jar
- bi-server-lib
volumes:
- ../file:/file
- ../log:/logs
- ../backup:/backup
- ./config:/config
- ../application/:/app
- /data/skywalking-agent/:/home/skywalking-agent
entrypoint: "sh /wait.sh -d pgsql:5432 -s 3 -c 'java -javaagent:/home/skywalking-agent/skywalking-agent.jar -Dskywalking.agent.service_name= -Dskywalking.collector.backend_service=*** -jar -Ddb.password=${DB_PASSWORD} -Dspring.profiles.active=prd -Dspring.config.additional-location=file:/config/ /app/bi-server.jar'"
networks:
- ${NETWORK_NAME}
environment:
- TZ=Asia/Shanghai

Anything else

No response

Are you willing to submit a pull request to fix on your own?

• Yes I am willing to submit a pull request on my own!

Code of Conduct

• I agree to follow this project's Code of Conduct

[wu-sheng]

Which version of Kafka are you using?

We only verified these, https://github.com/apache/skywalking-java/blob/main/test/plugin/scenarios/kafka-scenario/support-version.list
The test codes could be found, https://github.com/apache/skywalking-java/tree/main/test/plugin/scenarios/kafka-scenario

[tunbb]

hi，we upgrade kafka client to version 3.4.0 because of Apache kafka CVE（ CVE-2023-25194）, then many logs occurrs.
what's the impact of this error ,can I ignore it? If so, How to I control the log size.
Thank you!

[wu-sheng]

Your changes, your responsibility.

[CzyerChen]

Testcase passed with kafka-client 3.4.0, you can check the difference from the testcase(https://github.com/apache/skywalking-java/tree/main/test/plugin/scenarios/kafka-scenario), or provide more details about your versions, like agent, kafka-server...

+ echo 'start container of testcase.name=kafka-scenario-3.4.0'
start container of testcase.name=kafka-scenario-3.4.0
+ bash /Users/chenzy/files/gitFile/skywalking-java-own-7/skywalking-java/test/plugin/workspace/kafka-scenario/3.4.0/scenario.sh
Creating network "kafka-scenario-1.0.0" with the default driver
Pulling zookeeper-server (zookeeper:3.4)...
Pulling kafka-server (bitnami/kafka:2.1.1)...
Creating 100_kafka-server_1     ... done
Creating 100_zookeeper-server_1 ... done
Creating 100_kafka-scenario-3.4.0-1.0.0_1 ... done
/Users/chenzy/files/gitFile/skywalking-java-own-7/skywalking-java/test/plugin/workspace/kafka-scenario/3.4.0/scenario.sh: line 45: /Users/chenzy/files/gitFile/skywalking-java-own-7/skywalking-java/test/plugin/workspace/kafka-scenario/3.4.0/logs/container.log: No such file or directory
Killing 100_kafka-server_1     ... done
Killing 100_zookeeper-server_1 ... done
Removing 100_kafka-scenario-3.4.0-1.0.0_1 ... done
Removing 100_kafka-server_1               ... done
Removing 100_zookeeper-server_1           ... done
+ status=0
+ [[ 0 == 0 ]]
+ [[ -z '' ]]
+ remove_dir /Users/chenzy/files/gitFile/skywalking-java-own-7/skywalking-java/test/plugin/workspace/kafka-scenario/3.4.0
+ dir=/Users/chenzy/files/gitFile/skywalking-java-own-7/skywalking-java/test/plugin/workspace/kafka-scenario/3.4.0
+ [[ Darwin == \D\a\r\w\i\n ]]
++ whoami
+ find /Users/chenzy/files/gitFile/skywalking-java-own-7/skywalking-java/test/plugin/workspace/kafka-scenario/3.4.0 -type d -exec chmod -a 'chenzy deny delete' '{}' ';'
chmod: No ACL present '/Users/chenzy/files/gitFile/skywalking-java-own-7/skywalking-java/test/plugin/workspace/kafka-scenario/3.4.0'
chmod: No ACL present '/Users/chenzy/files/gitFile/skywalking-java-own-7/skywalking-java/test/plugin/workspace/kafka-scenario/3.4.0/agent'
chmod: No ACL present '/Users/chenzy/files/gitFile/skywalking-java-own-7/skywalking-java/test/plugin/workspace/kafka-scenario/3.4.0/data'
+ rm -rf /Users/chenzy/files/gitFile/skywalking-java-own-7/skywalking-java/test/plugin/workspace/kafka-scenario/3.4.0
+ num_of_testcases=1
+ echo -e '\033[33mkafka-scenario has already sumbitted\033[0m'
kafka-scenario has already sumbitted
+ exitAndClean 0
++ date +%s
+ elapsed=499
+ [[ 0 -eq 1 ]]
+ printf 'Scenarios: kafka-scenario, Testcases: 1, Elapsed: %02d:%02d:%02d \n' 0 8 19
Scenarios: kafka-scenario, Testcases: 1, Elapsed: 00:08:19 
+ exit 0

[tunbb]

kafka client 3.4.0
kafka server 2.8.1
agent ：apache/skywalking-java-agent:8.8.0-java8

[wu-sheng]

InstMethodsInter : class[class org.apache.kafka.clients.consumer.KafkaConsumer] after method[pollForFetches] intercept failure
java.lang.ClassCastException: org.apache.kafka.clients.consumer.internals.Fetch incompatible with java.util.Map

This usually means plugin incompatible. And why don't you try the latest version first? 8.8 is years ago version.

[YaoXina]

help