- update to 2024.11.1:
  * Skip collecting coverage for CLI tests @fjetter
- update to 2024.11.0:
  * Remove redundant methods in P2PBarrierTask @fjetter
  * fix skipif condition for
    test\_tell\_workers\_when\_peers\_have\_left @fjetter
  * Ensure ConnectionPool closes even if network stack swallows
    cancellation @fjetter
  * Fix flaky test\_server\_comms\_mark\_active\_handlers
  * Make assumption in P2P's barrier mechanism explicit
  * Adjust timeouts in jupyter cli test @fjetter
  * Add `stimulus_id` to `SchedulerPlugin.update_graph` hook
  * Reduce P2P transfer task overhead @hendrikmakait
  * Disable profiler on python 3.11 @fjetter
  * Fix test\_restarting\_does\_not\_deadlock @fjetter
  * Adjust popen timeouts for testing @fjetter
  * Add retry to shuffle broadcast @fjetter
  * Fix test\_shuffle\_with\_array\_conversion @fjetter
  * Refactor some tests @fjetter
  * Reflect graduation of `dask-expr` from `dask-contrib` to
    `dask` @hendrikmakait
  * Skip test\_tell\_workers\_when\_peers\_have\_left on py3.10
  * Internal cleanup of P2P code @hendrikmakait
  * Use Task class instead of tuple @fjetter
  * Increase connect timeout for
    test\_tell\_workers\_when\_peers\_have\_left @fjetter
  * Remove dispatching in TaskCollection @fjetter
  * Deduplicate scheduler requests in P2P @hendrikmakait
  * Add configurations for rootish taskgroup threshold @phofl
- update to 2024.10.0:

• Files Changed
• Browse Source

- update to 2024.8.2:
  * Avoid capturing code of xdist @fjetter
  * Reduce memory footprint of culling P2P rechunking
  * Add tests for choosing default rechunking method
  * Increase visibility of GPU CI updates @charlesbluca
  * Bump test\_pause\_while\_idle timeout @fjetter
  * Concatenate small input chunks before P2P rechunking
  * Remove dump cluster from gen\_cluster @fjetter
  * Bump `numpy>=1.24` and `pyarrow>=14.0.1` minimum versions
  * Fix PipInstall plugin on Worker @hendrikmakait
  * Remove more Python 3.10 compatibility code @jrbourbeau
  * Use task-based rechunking to prechunk along partial
    boundaries @hendrikmakait
  * Ensure client\_desires\_keys does not corrupt Scheduler state
    @fjetter
  * Bump minimum ``cloudpickle`` to 3 @jrbourbeau

• Files Changed
• Browse Source

• Files Changed
• Browse Source

- switch to modern python for sle15

- Update to 2024.6.2:

• Files Changed
• Browse Source

- Update to 2024.6.2: 
  * profile._f_lineno: handle next_line being None in Python 3.13
  * Cache global query-planning config
  * Python 3.13 fixes
  * Fix test_map_freq_to_period_start for pandas=3
  * Tokenizing memmap arrays will now avoid materializing the array into
    memory.
  * Fix test_dt_accessor with query planning disabled
  * Remove deprecated dask.compatibility module
  * Ensure compatibility for xarray.NamedArray
  * Avoid rounding error in
    test_prometheus_collect_count_total_by_cost_multipliers
  * Log key collision count in update_graph log event
  * Rename safe to expected in Scheduler.remove_worker
  * Eagerly update aggregate statistics for TaskPrefix instead of
    calculating them on-demand
  * Improve graph submission time for P2P rechunking by avoiding unpack
    recursion into indices
  * Add safe keyword to remove-worker event
  * Improved errors and reduced logging for P2P RPC calls
  * Adjust P2P tests for dask-expr
  * Iterate over copy of Server.digests_total_since_heartbeat to avoid
    RuntimeError
  * Add Prometheus gauge for task groups
  * Fix too strict assertion in shuffle code for pandas subclasses
  * Reduce noise from erring tasks that are not supposed to be running

• Files Changed
• Browse Source

• Files Changed
• Browse Source

• Files Changed
• Browse Source

Forwarded request #1146780 from bnavigator

- Update to 2024.2.0
    * Deprecate Dask DataFrame implementation
    * Improved tokenization
    * https://docs.dask.org/en/stable/changelog.html#v2024-2-0
  - Add distributed-ignore-daskdepr.patch gh#dask/distributed#8504
  - Drop python39 test flavor
  - Fix python312 tests

• Files Changed
• Browse Source

- update to 2024.1.1:
  * see corresponding dask update:
  https://docs.dask.org/en/stable/changelog.html#v2024-1-1
  * compatibility updates for latest pandas and scipy

- update to 2024.1.0:

• Files Changed
• Browse Source

Automatic submission by obs-autosubmit

• Files Changed
• Browse Source

- update to 2023.1.4:
  * see corresponding dask update:
  https://docs.dask.org/en/stable/changelog.html#v2024-1-0

• Files Changed
• Browse Source

Automatic submission by obs-autosubmit

• Files Changed
• Browse Source

Automatic submission by obs-autosubmit

• Files Changed
• Browse Source

- Update to 2023.11.0
- add distributed-ignore-rerun.patch to ignore pytest runners during
  test code introspection
 * Zero-copy P2P Array Rechunking
 * Deprecating PyArrow <14.0.1
 * Improved PyArrow filesystem for Parquet
 * Improve Type Reconciliation in P2P Shuffling
 * official support for Python 3.12
 * Reduced memory pressure for multi array reductions
 * improved P2P shuffling robustness
 * Reduced scheduler CPU load for large graphs (forwarded request 1127182 from mimi_vx)

• Files Changed
• Browse Source

• Files Changed
• Browse Source

- Ratchet up bokeh to >= 3.1, since upstream supports it.
- Also BuildRequire sparse for Python 3.11.

- Update to 2023.5.1
  * This release drops support for Python 3.8
  ## Enhancements
  * Exclude IPython code from computations (GH#7788) Miles
  * Drop Python 3.8 support (GH#7840) Thomas Grainger
  * Add storage_options to performance_report (GH#7636) ypogorelova
  * Don’t warn about mismatched msgpack (GH#7839) Irina Truong
  * Clean up sys.path on Server shutdown (GH#7838) James Bourbeau
  * Dashboard: Fine Performance Metrics (GH#7725) Miles
  ## Bug Fixes
  * Properly handle unknown chunk sizes in P2P rechunking (GH#7856)
    Hendrik Makait
  * Minimal change to work around (GH#7726) / support for UCX
    (GH#7851) Benjamin Zaitlen
  * Don’t end computations until cluster is truly idle (GH#7790)
    crusaderky
- Release 2023.5.0
  ## Enhancements
  * Client.upload_file send to both Workers and Scheduler and
    rename scratch directory (GH#7802) Miles
  * Allow dashboard to be used with bokeh prereleases (GH#7814)
    James Bourbeau
  ## Bug Fixes
  * Ensure log_event of non-msgpack serializable object do not kill
    servers (GH#7472) Florian Jetter
  * Fix test_nanny.py duplicated pytestmark definitions (GH#7819)
    Thomas Grainger

• Files Changed
• Browse Source

• Files Changed
• Browse Source

• Files Changed
• Browse Source

Has to go together with sr#1071019!

- Skip more flaky tests
- Update to 2023.3.1
  ## Enhancements
  * Add Jupyter link to dashboard menu if --jupyter flag is set
    (GH#7638) Jacob Tomlinson
  * Bump minimum click version from 7.0 to 8.0 (GH#7637) Miles
  * Extend dask metapackage dependencies (GH#7630) James Bourbeau
  * Further improvements to Client.restart_workers (GH#7620) Miles
  * P2P offload get_output_partition (GH#7587) Florian Jetter
  * Initial integration of GIL contention metric (GH#7624) Miles
  * Add dashboard documentation links (GH#7610) Miles
  * Rename shuffle/rechunk config option/kwarg to method (GH#7623)
    Hendrik Makait
  * Return results in restart_workers (GH#7606) Miles
  * Ensure client key cancellation uses ordered messages (GH#7583)
    Florian Jetter
  ## Bug Fixes
  * Fix undefined async_wait_for -> async_poll_for (GH#7627) Miles
  * Don’t send client heartbeat without a scheduler_comm (GH#7612)
    James Bourbeau
  * Do not unspill on free-keys (GH#7607) crusaderky
  ## Documentation
  * Add notes to Client.submit, Client.map, and Client.scatter with
    the description of the current task graph resolution algorithm
    limitations (GH#7588) Eugene Druzhynin
  ## Maintenance
  * Use range with pickle protocol versions (GH#7635) jakirkham
  * Share thread pool among P2P shuffle runs (GH#7621) Hendrik
    Makait
  * Replace psutil suspend with BlockedGatherDep in
    test_failing_worker_with_additional_replicas_on_cluster
    (GH#7633) Thomas Grainger
  * Ignore pkg_resources DeprecationWarning for mindeps (GH#7626)
    Miles
  * Implement wait_for using asyncio.timeout() on 3.11 (GH#7571)
    Thomas Grainger
  * Use tmp_path fixture instead of outdated tmpdir fixture
    (GH#7582) ypogorelova
  * Only one crick callback (GH#7614) crusaderky
  * Add mindeps + numpy job to tests CI (GH#7609) Miles
  * Do not xfail whole tests due to (GH#6705) (GH#7611) crusaderky

• Files Changed
• Browse Source

- update to 2023.3.0:
  * Remove pyarrow dependency for rechunking
  * Update rechunk_transfer and rechunk_unpack errors
  * Remove dead code and document arguments to ShardBuffer
    constructors
  * Fix tests for p2p by default
  * Remove obsolete cast

• Files Changed
• Browse Source