Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PipeMapRed.waitOutputThreads(): subprocess failed with code 1 #2182

Open
sdiniz73 opened this issue Jun 23, 2020 · 0 comments
Open

PipeMapRed.waitOutputThreads(): subprocess failed with code 1 #2182

sdiniz73 opened this issue Jun 23, 2020 · 0 comments

Comments

@sdiniz73
Copy link

sdiniz73 commented Jun 23, 2020

Hello,

When executing the script, the error below is generated:
Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads (): subprocess failed with code 1
My environment is a cluster with 5 servers, 1 with the applications and the other forming a High Availability Hadoop cluster (2 NameNodes and 2 DataNodes).

I'm running the command where the source is in HDFS:

"python mr_word_freq_count.py hdfs:///mapred/u.data -r hadoop"

The script is executed from the application server.

But I've done everything and nothing works.

Locally runs normally.

I attach the Yarn log.

Thank you

Hadoop 3.2.0
Python 3.7.3

yarn_error.txt

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant