Some of my thoughts on Latency hiding

[ezrannetttty]

XM_40017/notebooks/jacobi_method.ipynb

Line 641 in 26afa1d

"Can our implementation above be improved? Note that we only need communications to update the values at the boundary of the portion owned by each process. The other values (the one in green in the figure below) can be updated without communications. This provides the opportunity of overlapping the computation of the interior values (green cells in the figure) with the communication of the ghost values. This technique is called latency hiding, since we are hiding communication latency by overlapping it with communication that we need to do anyway.\n",

May I ask if what you are trying to convey is in fact: "we are hiding communication latency by overlapping it with computation that we need to do anyway"?

[fverdugo]

Dear @ezrannetttty,

yes, this is indeed a typo.

with communication that we need to do anyway -> with computation that we need to do anyway.

Feel free to open a PR.

[ezrannetttty]

Dear @fverdugo,

The new PR has been submitted. It feels great to contribute.

BTW, the teaching materials you've written are of very high quality and have been extremely helpful for me in understanding parallel computing.