Distributed code performance
Hi Brad, Thank you for your kind offer! I've added the code and some explanatory notes to GitHub - razoumov/performance · GitHub Please let me know if anything is unclear. Best, Alex
Posts from every feed QUEST has found across the web — blogs, news, podcasts, channels and more.
Hi Brad, Thank you for your kind offer! I've added the code and some explanatory notes to GitHub - razoumov/performance · GitHub Please let me know if anything is unclear. Best, Alex
Failure encountered generating PR merge email for PR null. Run ID: 40794587631
Branch: fix-bad-extern Revision: 4564c4175096499e37bff7866b8d348dd3b18fba Author: jabraham17 Merged at: 2026-10-29T00:31:11Z Link: Fix bad extern calls in Socket by jabraham17 · Pull Request #29614 · chapel-lang/chapel · GitHub Log Message: Fix bad extern calls in Socket Fixes some bad extern call declarations in Socket, which would fail under --baseline and where due to Internal compiler error for incorrect extern declarations with `--baseline` · Issue #22548 · chapel-lang/chapel · GitHub and…
Branch: add-portability-bsd Revision: 4564c4175096499e37bff7866b8d348dd3b18fba Author: jabraham17 Merged at: 2026-10-29T00:31:10Z Link: Add portability testing for FreeBSD by jabraham17 · Pull Request #29606 · chapel-lang/chapel · GitHub Log Message: Add portability testing for FreeBSD Adds portability testing for FreeBSD to the GA CI. This also removes Vagrant configs from the generated prereqs docs, since they were only there for FreeBSD, which is now out of date. Motivated by a few factors…
Branch: fix-no-local-sporadic Revision: f30520d34a9bf602aedd10e7604dd673a135dfc1 Author: jabraham17 Merged at: 2026-10-28T22:58:20Z Link: Prevent test failing sporadically by jabraham17 · Pull Request #29613 · chapel-lang/chapel · GitHub Log Message: Prevent test failing sporadically Fixes an issue where a test could fail sporadically due to unreliable backlog behavior for sockets. Using for instead of coforall makes the test much more reliable (2/100 failures -> 0/100 failures) [Not reviewed -…
Branch: more-darwin-paratests Revision: 2b47669de3d4ea820569aefcb3e3240ee2a8f1ec Author: jabraham17 Merged at: 2026-10-28T21:30:27Z Link: Add more Darwin paratest configs by jabraham17 · Pull Request #29551 · chapel-lang/chapel · GitHub Log Message: Add more Darwin paratest configs Adds darwin paratest configs for quickstart, gasnet everything, and gasnet fast Builds on work done by @arifthpe in Add additional Darwin paratest configs by arifthpe · Pull Request #29465 · chapel-lang/chapel ·…
Branch: fix-ccache-key-reuse Revision: 82b448870ae568951ed2fc00b233cda8946d5e80 Author: arifthpe Merged at: 2026-10-28T20:05:12Z Link: Include timestamp in ccache keys to prevent reuse attempt by arifthpe · Pull Request #29612 · chapel-lang/chapel · GitHub Log Message: Include timestamp in ccache keys to prevent reuse attempt Remove the append-timestamp: false option from our uses of GitHub - hendrikmuhs/ccache-action: github action to speedup building using ccache · GitHub , so the cache keys…
Branch: failure-mail-ignore-skipped-step Revision: 88a07733d25ba01e272b1aec5c795583048b530b Author: arifthpe Merged at: 2026-10-28T20:05:11Z Link: Don't consider skipped steps as failed in nightly mail by arifthpe · Pull Request #29611 · chapel-lang/chapel · GitHub Log Message: Don't consider skipped steps as failed in nightly mail Restrict our logic for finding the "first bad step" of a failed job to mean a step whose conclusion was neither success nor skipped, instead of just checking that it…
Branch: fix-unwind Revision: f713d580a34110ebfccbeb779bd300b953650463 Author: benharsh Merged at: 2026-10-28T18:53:54Z Link: Fix use of 'bool' in chpl-unwind by benharsh · Pull Request #29610 · chapel-lang/chapel · GitHub Log Message: Fix use of 'bool' in chpl-unwind Use of 'bool' fails when CHPL_LLVM=none, using chpl_bool instead. Trivial, not reviewed. Compare: Fix use of 'bool' in chpl-unwind by benharsh · Pull Request #29610 · chapel-lang/chapel · GitHub Diff: M runtime/src/chpl-unwind.c…
Reporting the skipped step as failed will be fixed in Don't consider skipped steps as failed in nightly mail by arifthpe · Pull Request #29611 · chapel-lang/chapel · GitHub
arkouda-release-smoke-test got cancelled due to an over-zealous concurrency limit added in Trigger basic arkouda testing on modification to test infastructure by jabraham17 · Pull Request #29602 · chapel-lang/chapel · GitHub, fixed in Allow Arkouda main and release tests to run concurrently by arifthpe · Pull Request #29608 · chapel-lang/chapel · GitHub now * the paratest, portability, and packaging failures are all due to https://chapel.discourse.group/t/…
Hi Alex — I'd be happy to look through your codes as time permits if you can provide pointers. Thanks, -Brad
Thank you all for your feedback! The slowdown is indeed caused by indexing into distributed arrays; it is the magnitude of the slowdown that is surprising. To answer the last comment about adding computations per element: as far as you don't add to the distributed array access, e.g. in this code // run a 5-point stencil forall (i, j) in Data.domain.expand(-1) { var tmp = 0.0; for k in 1..50 do tmp += sin(0.01*i+k)/j; OutData[i, j] = (Data[i-1, j] + Data[i, j-1] + Data[i , j] + Data[i, j+1] +…
Branch: fix-concurrent-arkouda-jobs Revision: 64389e421ef39fdfb855243b3574287d03825930 Author: arifthpe Merged at: 2026-10-28T16:49:38Z Link: Allow Arkouda main and release tests to run concurrently by arifthpe · Pull Request #29608 · chapel-lang/chapel · GitHub Log Message: Allow Arkouda main and release tests to run concurrently Adjust the concurrency group of arkouda-smoke-test to include the arkouda-version input, so the nightly runs against latest main and release Arkouda can proceed…
The following GitHub Actions jobs failed: extended-checks / arkouda-release-smoke-test / arkouda-smoke-test, step: "null" full-checks / Chapel paratest with GASNet and AddressSanitizer / Build Chapel (gasnet-asan), step: "build Chapel" full-checks / Chapel paratest with AddressSanitizer / Build Chapel (asan), step: "build Chapel" full-checks / Chapel paratest with UndefinedBehaviorSanitizer (gnu) / Build Chapel (ubsan.gnu), step: "build Chapel" full-checks / Chapel paratest with…
Branch: dl-lookup-filename Revision: d1b70c9288e3ebeb11105df6328f3529dfba9ac3 Author: benharsh Merged at: 2026-10-28T01:14:55Z Link: Improve filenames for halts, throws, and stack traces in dynamically loaded programs by benharsh · Pull Request #29587 · chapel-lang/chapel · GitHub Log Message: Improve filenames for halts, throws, and stack traces in dynamically loaded programs This PR improves the filenames shown in halts, throws, and stack traces when dynamically loaded programs are involved.…
Branch: ga-test-linux32 Revision: b06998b447c66c7869d90362256d19da5eeea09f Author: arifthpe Merged at: 2026-10-27T22:27:47Z Link: Add linux32 examples testing in container using QEMU by arifthpe · Pull Request #29525 · chapel-lang/chapel · GitHub Log Message: Add linux32 examples testing in container using QEMU Add a nightly GA job which builds Chapel and tests test/release/examples in a Debian container with 32-bit userland. IIUC this still uses the host 64 bit kernel, so it isn't as faithful…
Branch: socket-nb Revision: 21d36472fca6fd96e47b48ee0c6f94a3d69b95e1 Author: jabraham17 Merged at: 2026-10-27T22:27:47Z Link: Support non-blocking IO for the Socket module by jabraham17 · Pull Request #29596 · chapel-lang/chapel · GitHub Log Message: Support non-blocking IO for the Socket module Implements the non-blocking IO described in Supporting non-blocking I/O for Spawn · Issue #22691 · chapel-lang/chapel · GitHub for the Socket module. With this PR, the socket module can now be used with…
Branch: trigger-arkouda Revision: 77d9cac71fab5ea1f956a78206326a203ca19ebe Author: jabraham17 Merged at: 2026-10-27T21:32:10Z Link: Trigger basic arkouda testing on modification to test infastructure by jabraham17 · Pull Request #29602 · chapel-lang/chapel · GitHub Log Message: Trigger basic arkouda testing on modification to test infastructure Trigger the arkouda smoke test when the smoke test itself is modified [Reviewed by @arifthpe] Compare: Trigger basic arkouda testing on modification to…
Branch: custom-sub_test-skip-children Revision: 49a6039c2d77e5f2e8cad6cde7ab7d5c7fabcdb3 Author: arifthpe Merged at: 2026-10-27T21:32:09Z Link: Skip descending into child dirs under custom `sub_test` by arifthpe · Pull Request #29543 · chapel-lang/chapel · GitHub Log Message: Skip descending into child dirs under custom sub_test Enforce the assumption that in a dir with a custom sub_test, that sub_test is responsible for running any tests in child dirs. Includes: Treat a dir containing a custom…
Branch: dependabot/github_actions/psf/black-26.10.1 Revision: fa6d069d4838899a96343b14f1394434d87fd676 Author: arifthpe Merged at: 2026-10-27T21:32:09Z Link: Bump psf/black from 26.10.0 to 26.10.1 by dependabot[bot] · Pull Request #29597 · chapel-lang/chapel · GitHub Log Message: Bump psf/black from 26.10.0 to 26.10.1 Bumps psf/black from 26.10.0 to 26.10.1. Release notes (click for more details) Changelog (click for more details) Commits (click for more details) Dependabot will resolve any…
Branch: ci-container-merge-queue Revision: fe150e9bf2859b5b8476cf1cdaed39a25ec342cf Author: arifthpe Merged at: 2026-10-27T20:25:30Z Link: Also run build-CI-container workflow in merge queue by arifthpe · Pull Request #29605 · chapel-lang/chapel · GitHub Log Message: Also run build-CI-container workflow in merge queue Add a merge_group trigger to the build-CI-container workflow. This is needed after we made its job ci-container-alert-failure required after Always use the latest LLVM in the CI…
Branch: fix-sync-from-pthread Revision: 45962893bfb1ac6e9da44b7030aedb6d968014b9 Author: jabraham17 Merged at: 2026-10-27T18:17:47Z Link: Fix using `sync` variables from pthreads by jabraham17 · Pull Request #29600 · chapel-lang/chapel · GitHub Log Message: Fix using sync variables from pthreads Fixes an issue where using a sync variable from a pthread not created by the Chapel runtime would cause the program to crash. This was due to an issue in the cache, where we would try to use the cache…
Branch: pin-pandas Revision: 43ec2d77fdd94b8eeb3e3d24dd7336945a719046 Author: jabraham17 Merged at: 2026-10-27T18:10:50Z Link: Pin pandas in arkouda release testing by jabraham17 · Pull Request #29601 · chapel-lang/chapel · GitHub Log Message: Pin pandas in arkouda release testing Pin pandas in arkouda release testing, since the fix on main won't get propagated here [Reviewed by @arifthpe] Compare: Pin pandas in arkouda release testing by jabraham17 · Pull Request #29601 · chapel-lang/chapel ·…
gcc test shows as failed yet has a spinner as though it's still running, I think the runner got disconnected * release arkouda failure will be fixed by Pin pandas in arkouda release testing by jabraham17 · Pull Request #29601 · chapel-lang/chapel · GitHub, pinning the pandas dep version since previous release arkouda doesn't have the fix * ubsan.gnu failure is the tcpio timeout issue, which Jade has a fix for pending in Fix using `sync` variables from pthreads by jabraham17 · Pull Request…
One other thing I'd be curious about is how much work happens between the distributed array accesses. If the stencil is doing very little arithmetic per element, those locality checks Engin mentioned could end up dominating the runtime, even with everything on one locale. It might be interesting to keep the same array layout but increase the computation per element in a small benchmark. If the relative slowdown shrinks as the arithmetic gets heavier, that would give another clue about where the…
The following GitHub Actions jobs failed: extended-checks / gcc-version-tests (16), step: "save GCC 16 packages to cache" extended-checks / arkouda-release-smoke-test / arkouda-smoke-test, step: "build Chapel and run Arkouda smoke testing" full-checks / Chapel paratest with --fast / Test test/arrays (fast), step: "run tests" full-checks / Chapel paratest on linux64 using Clang as the host/target compiler / Test test/library/packages (linux64-clang), step: "upload test results" full-checks /…
Branch: fix-prediff4 Revision: af58c938e5bd86b057ff7ee395b929f09ee2fee1 Author: jabraham17 Merged at: 2026-10-26T22:19:34Z Link: Fix two prediffs for ubsan by jabraham17 · Pull Request #29595 · chapel-lang/chapel · GitHub Log Message: Fix two prediffs for ubsan Fixes two prediffs for ubsan to check correct sanitize value [Not reviewed - trivial] Compare: Fix two prediffs for ubsan by jabraham17 · Pull Request #29595 · chapel-lang/chapel · GitHub Diff: M test/io/bharshbarg/readTypeEOF.prediff M…
Hello all: It may be of interest to know that the new ttt editor, https://tttedit.dev, supports Chapel syntax highlighting out of the box. Since syntax highlighting support for Chapel is not so widespread, this seems like welcome news. Regards Nelson
Branch: fix-portability-package-concurrent Revision: 0fa096a2c933e137169954da6e3949ad3110b41c Author: arifthpe Merged at: 2026-10-26T21:05:52Z Link: Prevent portability and packaging runs cancelling each other by arifthpe · Pull Request #29594 · chapel-lang/chapel · GitHub Log Message: Prevent portability and packaging runs cancelling each other Ensure the concurrency group keys for portability and package testing are different, so the jobs can't cancel each other. The workflows' groups were…