Ray master#3

Open

eugenevinitsky wants to merge 215 commits intomasterfrom

Commits on Oct 2, 2018

Test dying_worker_get and dying_worker_wait for xray. (#2997)

robertnishihara
authored and
richardliaw
committed

Commits on Oct 3, 2018

Commits on Oct 4, 2018

Minor improvements and fixes in Python code. (#3022)

suquark
authored and
robertnishihara
committed
Suppress errors when worker or driver intentionally disconnects. (#2935)

richardliaw
authored and
robertnishihara
committed
Introduce concept of resources required for placing a task. (#2837)

robertnishihara
authored and
atumanov
committed

Commits on Oct 5, 2018

[tune/core] Use Global State API for resources (#3004)

richardliaw
authored and
robertnishihara
committed
[core] Improve logging message when plasma store is started. (#3029)

richardliaw
authored and
robertnishihara
committed

Commits on Oct 6, 2018

Bug/log syncer fails with parentheses (#2653)

hartikainen
authored and
ericl
committed

Commits on Oct 8, 2018

[Java] Load driver resources from local path. (#3001)

jovany-wang
authored and
raulchen
committed
Fix the uniqueId toString format. (#3035)

jovany-wang
authored and
robertnishihara
committed

Commits on Oct 10, 2018

[cmake] avoid to re-build pyarrow (#2963)

chuxi
authored and
pcmoritz
committed

Commits on Oct 11, 2018

[Java] Improve some Java code (#3040)

jovany-wang
authored and
robertnishihara
committed
[Java] Fix loading driver resources issue. (#3046)

jovany-wang
authored and
raulchen
committed

Commits on Oct 12, 2018

Commits on Oct 13, 2018

[rllib] Add unit test and some better error messages for custom policy states (#3032)
ericl
authored

Commits on Oct 14, 2018

[rllib] Don't crash printing out error message (#3054)
ericl
authored

Commits on Oct 15, 2018

Commits on Oct 16, 2018

[tune] Fix (some more) misleading comments in tune/results.py (#3068)

praveen-palanisamy
authored and
richardliaw
committed
[Java] Add jvm-parameters in Config. (#3065)

jovany-wang
authored and
raulchen
committed
[rllib] Include config dicts in the sphinx docs (#3064)
ericl
authored

Commits on Oct 17, 2018

Add password authentication to Redis ports (#2952)

pschafhalter
authored and
pcmoritz
committed

Commits on Oct 18, 2018

Commits on Oct 19, 2018

Adding Python3.7 wheels support (#2546)

devin-petersohn
authored and
pcmoritz
committed
Fix bug when connecting to password-secured cluster (#3083)

pschafhalter
authored and
robertnishihara
committed
[xray] All messages on main asio event loop should be written asynchronously (#3023)

ericl
authored and
stephanie-wang
committed
[Java] Support dynamically defining resources when submitting task. (#3070)

jovany-wang
authored and
raulchen
committed
[java] fix check exception type (#3093)

bibabolynn
authored and
raulchen
committed
Add links for latest Python 3.7 wheels to documentation. (#3091)

robertnishihara
authored and
richardliaw
committed

Commits on Oct 20, 2018

[rllib] Native support for Dict and Tuple spaces; fix Tuple action spaces; add prev a, r to LSTM (#3051)
ericl
authored

Commits on Oct 21, 2018

Fill driver id into actor notification when finishing assigned task. (#3080)

jovany-wang
authored and
raulchen
committed
Cluster Utilities for Fault Tolerance Tests (#3008)

richardliaw
authored and
robertnishihara
committed

Commits on Oct 22, 2018

[rllib] switch to python logger (#3098)
ericl
authored
[tune] Fix SearchAlg finishing early (#3081)

richardliaw
authored and
ericl
committed

Commits on Oct 23, 2018

Retry connections to redis for async and subscribe contexts (#3105)

pcmoritz
authored and
robertnishihara
committed
update (#3112)
ericl
authored
Add test for wait reconstruction. (#3110)

robertnishihara
authored and
pcmoritz
committed
Fix Python linting error. (#3113)

robertnishihara
authored and
ericl
committed
Use XRay backend by default. (#3020)

robertnishihara
authored and
pcmoritz
committed

Commits on Oct 24, 2018

[Java] support python worker command in raylet (#3092)

chuxi
authored and
raulchen
committed
[autoscaler] Also grant roles to worker nodes
ericl
authored
Fix linting errors. (#3127)

robertnishihara
authored and
pcmoritz
committed

Commits on Oct 26, 2018

Commits on Oct 27, 2018

Delete empty pubsub keys (#3146)

guoyuhong
authored and
robertnishihara
committed

Commits on Oct 28, 2018

Commits on Oct 29, 2018

Commits on Oct 30, 2018

Commits on Oct 31, 2018

Update task_table and object_table API. (#3161)

robertnishihara
authored and
pcmoritz
committed

Commits on Nov 2, 2018

Commits on Nov 3, 2018

Enable to specify driver id by user. (#3084)

jovany-wang
authored and
robertnishihara
committed
Add `ray stack` tool for debugging (#3213)

ericl
authored and
robertnishihara
committed
Fix build system dependency for local_scheduler_client (#3215)

pcmoritz
authored and
robertnishihara
committed

Commits on Nov 4, 2018

Commits on Nov 5, 2018

Update CMake to support Mac OS X 10.14 (#3218)

pcmoritz
authored and
robertnishihara
committed
[rllib] Fix rllib rollouts script and add test (#3211)

ericl
authored and
richardliaw
committed
Caching task resource requirements. (#3231)

istoica
authored and
pcmoritz
committed

Commits on Nov 7, 2018

[rllib] Fix filter sync for ES and ARS (#2918)

eugenevinitsky
authored and
ericl
committed
Refactor ObjectDirectory to reduce and fix callback usage (#3227)

stephanie-wang
authored and
robertnishihara
committed
Change dict serialization warning to debug (#3230)

ericl
authored and
robertnishihara
committed
Cache resources in SchedulingQueue (#3232)

pcmoritz
authored and
stephanie-wang
committed
Enable timeline visualizations of object transfers. (#3255)

robertnishihara
authored and
pcmoritz
committed
Better errors on process deaths (#3252)
ericl
authored
[tune] Raise Error when overstepping (#3235)
richardliaw
authored
[rllib] Add some debug logs during agent setup (#3247)

ericl
authored and
richardliaw
committed

Commits on Nov 9, 2018

[autoscaler] Add option to allow private ips only (#3270)

ericl
authored and
pcmoritz
committed
[tune] Annotated Example Page and showcase Tutorials (#3267)
richardliaw
authored
[rllib] rollout.py should reduce num workers (#3263)

ericl
authored and
richardliaw
committed

Commits on Nov 10, 2018

[autoscaler] missing example-full.yaml file in the latest wheel for provider type "local"
ericl
authored
[tune] Support "None" for upload_dir

richardliaw
authored and
ericl
committed
Speed up task dispatch. (#3234)

istoica
authored and
pcmoritz
committed

Commits on Nov 11, 2018

Commits on Nov 12, 2018

[tune] Fix default handling for timesteps (#3293)
richardliaw
authored

Commits on Nov 13, 2018

[rllib] Rename ServingEnv => ExternalEnv (#3302)
ericl
authored
enable incremental builds (#3292)

pcmoritz
authored and
robertnishihara
committed
[rllib] Add self-supervised loss to model (#3291)

ericl
authored and
richardliaw
committed
[core] Add Global State Test for multi-node setting (#3239)

richardliaw
authored and
pschafhalter
committed
[rllib] Raise worker TF intra_op threads to 2, lower driver intra_op threads to 8 (#3299)
ericl
authored
[tune] Doc: Autofilled, StatusReporter (#3294)

richardliaw
authored and
ericl
committed
Clean up Ray processes after cluster util exits (#3278)

richardliaw
authored and
ericl
committed
Update profiling instructions for raylet (#3311)

pcmoritz
authored and
robertnishihara
committed

Commits on Nov 14, 2018

Commits on Nov 15, 2018

Update redis version in setup.py (#3333)

lewisbelcher
authored and
robertnishihara
committed
Fix socket retry message (#3325)

pcmoritz
authored and
robertnishihara
committed
Raise exception if the node is nearly out of memory (#3323)

ericl
authored and
pcmoritz
committed
Fix redis crash when duplicate messages are appended to log. (#3316)

pcmoritz
authored and
robertnishihara
committed
Note requirement cython==0.27.3 in installation instructions. (#3322)

robertnishihara
authored and
pcmoritz
committed
Rename _submit -> _remote. (#3321)

robertnishihara
authored and
pcmoritz
committed

Commits on Nov 16, 2018

Add debug string to raylet (#3317)

ericl
authored and
pcmoritz
committed
Don't unsubscribe dependencies for infeasible tasks. (#3338)

robertnishihara
authored and
pcmoritz
committed

Commits on Nov 17, 2018

support home path and relative path for temp-dir (#3329)

Seventeen17
authored and
robertnishihara
committed
Suppress duplicate pre-emptive object pushes. (#3276)

robertnishihara
authored and
pcmoritz
committed
Update stale example links
ericl
authored

Commits on Nov 19, 2018

Fix logging when ray cluster utils is used
ericl
authored

Commits on Nov 20, 2018

Don't retry IPC connect an absurd number of times (#3355)

ericl
authored and
robertnishihara
committed
Add ordered_set container. (#3352)

robertnishihara
authored and
pcmoritz
committed
Don't setpgid() on actors (#3347)

ericl
authored and
robertnishihara
committed
[rllib] Set ape-x local exploration to 0, also load explorations before training steps (#3349)

ericl
authored and
richardliaw
committed
[rllib] Update multi-gpu impala numbers (#3327)
ericl
authored
Batch heartbeats from node manager together in the monitor. (#3011)

ujvl
authored and
robertnishihara
committed
Ready queue refactor to make Dispatching tasks more efficient (#3324)
pcmoritz
authored
[autoscaler] Submit command (#3312)

richardliaw
authored and
ericl
committed
Remove uses of std::list::size (#3358)

ericl
authored and
pcmoritz
committed

Commits on Nov 21, 2018

Commits on Nov 24, 2018

[rllib] Fix use_lstm option when using custom model with dict space (#3368)

ericl
authored and
richardliaw
committed
[rllib] Clip DDPG ou-noise to avoid exceeding action bounds (#3386)

ericl
authored and
richardliaw
committed

Commits on Nov 25, 2018

Commits on Nov 27, 2018

Commits on Nov 29, 2018

Automatically indent tune logger params (#3399)

hartikainen
authored and
ericl
committed
Remove: duplicate feed_dict constructing (#3431)

chunyang-wen
authored and
ericl
committed
Fault tolerance for actor creation (#3422)

stephanie-wang
authored and
ericl
committed
Ship Modin with Ray. (#3109)

devin-petersohn
authored and
pcmoritz
committed
[rllib] Support batch norm layers (#3369)
ericl
authored

Commits on Nov 30, 2018

Use actor ID for the dummy object (#3437)

stephanie-wang
authored and
ericl
committed

Commits on Dec 1, 2018

[docs] Snippet did not have a code-block tag above it (#3442)

GiliR4t1qbit
authored and
robertnishihara
committed
Update readme to contain logo (#3443)

devin-petersohn
authored and
ericl
committed
Bump version from 0.5.3 to 0.6.0. (#3420)

robertnishihara
authored and
ericl
committed

Commits on Dec 2, 2018

Add stress test for Java worker (#3424)

raulchen
authored and
robertnishihara
committed
Upgrade Arrow to include Plasma TensorFlow Op release fix (#3448)

pcmoritz
authored and
robertnishihara
committed
Update README.rst with 0.6.0 version number. (#3453)

ericl
authored and
robertnishihara
committed
Fix bug in ray.wait (#3445)

stephanie-wang
authored and
robertnishihara
committed

Commits on Dec 3, 2018

[rllib] Better error message for unsupported non-atari image observation sizes (#3444)
ericl
authored

Commits on Dec 5, 2018

Commits on Dec 8, 2018

[rllib] Use smoothed version of collect metrics for DQN (#3491)
ericl
authored