This is an automated email from the ASF dual-hosted git repository. xxyu pushed a change to branch kylin5 in repository https://gitbox.apache.org/repos/asf/kylin.git
discard d40fc16385 KYLIN-5217 Upgrade metadata and engine new edab8698b6 KYLIN-5217 Upgrade metadata and engine This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (d40fc16385) \ N -- N -- N refs/heads/kylin5 (edab8698b6) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: build/spark/LICENSE | 566 - build/spark/NOTICE | 1530 -- build/spark/README.md | 109 - build/spark/RELEASE | 2 - build/spark/bin/beeline | 32 - build/spark/bin/beeline.cmd | 22 - build/spark/bin/docker-image-tool.sh | 336 - build/spark/bin/find-spark-home | 41 - build/spark/bin/find-spark-home.cmd | 60 - build/spark/bin/load-spark-env.cmd | 62 - build/spark/bin/load-spark-env.sh | 65 - build/spark/bin/pyspark | 68 - build/spark/bin/pyspark.cmd | 25 - build/spark/bin/pyspark2.cmd | 38 - build/spark/bin/run-example | 25 - build/spark/bin/run-example.cmd | 27 - build/spark/bin/spark-class | 111 - build/spark/bin/spark-class.cmd | 25 - build/spark/bin/spark-class2.cmd | 77 - build/spark/bin/spark-shell | 98 - build/spark/bin/spark-shell.cmd | 25 - build/spark/bin/spark-shell2.cmd | 43 - build/spark/bin/spark-sql | 25 - build/spark/bin/spark-sql.cmd | 25 - build/spark/bin/spark-sql2.cmd | 25 - build/spark/bin/spark-submit | 27 - build/spark/bin/spark-submit.cmd | 25 - build/spark/bin/spark-submit2.cmd | 27 - build/spark/bin/sparkR | 26 - build/spark/bin/sparkR.cmd | 25 - build/spark/bin/sparkR2.cmd | 25 - build/spark/conf/fairscheduler.xml.template | 31 - build/spark/conf/log4j.properties.template | 48 - build/spark/conf/metrics.properties.template | 210 - build/spark/conf/spark-defaults.conf.template | 27 - build/spark/conf/spark-env.sh.template | 73 - build/spark/conf/workers.template | 19 - .../spark/kubernetes/dockerfiles/spark/Dockerfile | 63 - .../dockerfiles/spark/bindings/R/Dockerfile | 42 - .../dockerfiles/spark/bindings/python/Dockerfile | 41 - build/spark/kubernetes/dockerfiles/spark/decom.sh | 35 - .../kubernetes/dockerfiles/spark/entrypoint.sh | 105 - build/spark/kubernetes/tests/autoscale.py | 49 - build/spark/kubernetes/tests/decommissioning.py | 55 - .../kubernetes/tests/decommissioning_cleanup.py | 59 - .../spark/kubernetes/tests/py_container_checks.py | 32 - build/spark/kubernetes/tests/pyfiles.py | 43 - .../kubernetes/tests/python_executable_check.py | 40 - .../spark/kubernetes/tests/worker_memory_check.py | 45 - build/spark/licenses/LICENSE-AnchorJS.txt | 21 - build/spark/licenses/LICENSE-CC0.txt | 121 - build/spark/licenses/LICENSE-JLargeArrays.txt | 23 - build/spark/licenses/LICENSE-JTransforms.txt | 23 - build/spark/licenses/LICENSE-antlr.txt | 8 - build/spark/licenses/LICENSE-arpack.txt | 8 - build/spark/licenses/LICENSE-automaton.txt | 24 - build/spark/licenses/LICENSE-blas.txt | 25 - build/spark/licenses/LICENSE-bootstrap.txt | 22 - build/spark/licenses/LICENSE-cloudpickle.txt | 28 - build/spark/licenses/LICENSE-d3.min.js.txt | 26 - build/spark/licenses/LICENSE-dagre-d3.txt | 19 - build/spark/licenses/LICENSE-datatables.txt | 7 - build/spark/licenses/LICENSE-dnsjava.txt | 24 - build/spark/licenses/LICENSE-f2j.txt | 8 - build/spark/licenses/LICENSE-graphlib-dot.txt | 19 - .../licenses/LICENSE-istack-commons-runtime.txt | 11 - .../spark/licenses/LICENSE-jakarta-annotation-api | 277 - build/spark/licenses/LICENSE-jakarta-ws-rs-api | 277 - .../licenses/LICENSE-jakarta.activation-api.txt | 11 - .../licenses/LICENSE-jakarta.xml.bind-api.txt | 11 - build/spark/licenses/LICENSE-janino.txt | 31 - build/spark/licenses/LICENSE-javassist.html | 373 - .../LICENSE-javax-transaction-transaction-api.txt | 119 - build/spark/licenses/LICENSE-javolution.txt | 27 - build/spark/licenses/LICENSE-jaxb-runtime.txt | 11 - build/spark/licenses/LICENSE-jline.txt | 32 - build/spark/licenses/LICENSE-jodd.txt | 24 - build/spark/licenses/LICENSE-join.txt | 30 - build/spark/licenses/LICENSE-jquery.txt | 20 - build/spark/licenses/LICENSE-json-formatter.txt | 6 - build/spark/licenses/LICENSE-jsp-api.txt | 759 - build/spark/licenses/LICENSE-kryo.txt | 10 - build/spark/licenses/LICENSE-leveldbjni.txt | 27 - build/spark/licenses/LICENSE-machinist.txt | 19 - .../spark/licenses/LICENSE-matchMedia-polyfill.txt | 1 - build/spark/licenses/LICENSE-minlog.txt | 10 - build/spark/licenses/LICENSE-modernizr.txt | 21 - build/spark/licenses/LICENSE-mustache.txt | 11 - build/spark/licenses/LICENSE-netlib.txt | 49 - build/spark/licenses/LICENSE-paranamer.txt | 28 - build/spark/licenses/LICENSE-pmml-model.txt | 10 - build/spark/licenses/LICENSE-protobuf.txt | 42 - build/spark/licenses/LICENSE-py4j.txt | 27 - build/spark/licenses/LICENSE-pyrolite.txt | 28 - build/spark/licenses/LICENSE-re2j.txt | 32 - build/spark/licenses/LICENSE-reflectasm.txt | 10 - build/spark/licenses/LICENSE-respond.txt | 22 - build/spark/licenses/LICENSE-sbt-launch-lib.txt | 26 - build/spark/licenses/LICENSE-scala.txt | 30 - build/spark/licenses/LICENSE-scopt.txt | 9 - build/spark/licenses/LICENSE-slf4j.txt | 21 - build/spark/licenses/LICENSE-sorttable.js.txt | 16 - build/spark/licenses/LICENSE-spire.txt | 19 - build/spark/licenses/LICENSE-vis-timeline.txt | 22 - build/spark/licenses/LICENSE-xmlenc.txt | 27 - build/spark/licenses/LICENSE-zstd-jni.txt | 26 - build/spark/licenses/LICENSE-zstd.txt | 30 - build/spark/python/.coveragerc | 21 - build/spark/python/.gitignore | 5 - build/spark/python/MANIFEST.in | 26 - build/spark/python/README.md | 32 - build/spark/python/docs/Makefile | 35 - build/spark/python/docs/make.bat | 23 - build/spark/python/docs/make2.bat | 51 - .../spark/python/docs/source/_static/copybutton.js | 66 - .../python/docs/source/_static/css/pyspark.css | 94 - .../docs/source/_templates/autosummary/class.rst | 38 - .../_templates/autosummary/class_with_docs.rst | 79 - build/spark/python/docs/source/conf.py | 404 - .../docs/source/development/contributing.rst | 236 - .../python/docs/source/development/debugging.rst | 280 - .../spark/python/docs/source/development/index.rst | 29 - .../python/docs/source/development/setting_ide.rst | 62 - .../python/docs/source/development/testing.rst | 57 - .../python/docs/source/getting_started/index.rst | 40 - .../python/docs/source/getting_started/install.rst | 180 - .../source/getting_started/quickstart_df.ipynb | 1177 -- .../source/getting_started/quickstart_ps.ipynb | 14489 ------------------- build/spark/python/docs/source/index.rst | 76 - .../python/docs/source/migration_guide/index.rst | 50 - .../source/migration_guide/koalas_to_pyspark.rst | 36 - .../migration_guide/pyspark_1.0_1.2_to_1.3.rst | 23 - .../source/migration_guide/pyspark_1.4_to_1.5.rst | 25 - .../source/migration_guide/pyspark_2.2_to_2.3.rst | 30 - .../pyspark_2.3.0_to_2.3.1_above.rst | 23 - .../source/migration_guide/pyspark_2.3_to_2.4.rst | 23 - .../source/migration_guide/pyspark_2.4_to_3.0.rst | 44 - .../source/migration_guide/pyspark_3.1_to_3.2.rst | 31 - build/spark/python/docs/source/reference/index.rst | 35 - .../python/docs/source/reference/pyspark.ml.rst | 363 - .../python/docs/source/reference/pyspark.mllib.rst | 254 - .../source/reference/pyspark.pandas/extensions.rst | 39 - .../docs/source/reference/pyspark.pandas/frame.rst | 338 - .../reference/pyspark.pandas/general_functions.rst | 67 - .../source/reference/pyspark.pandas/groupby.rst | 106 - .../docs/source/reference/pyspark.pandas/index.rst | 36 - .../source/reference/pyspark.pandas/indexing.rst | 386 - .../docs/source/reference/pyspark.pandas/io.rst | 121 - .../docs/source/reference/pyspark.pandas/ml.rst | 42 - .../source/reference/pyspark.pandas/series.rst | 478 - .../source/reference/pyspark.pandas/window.rst | 49 - .../docs/source/reference/pyspark.resource.rst | 38 - .../spark/python/docs/source/reference/pyspark.rst | 284 - .../python/docs/source/reference/pyspark.sql.rst | 634 - .../python/docs/source/reference/pyspark.ss.rst | 90 - .../docs/source/reference/pyspark.streaming.rst | 130 - .../python/docs/source/user_guide/arrow_pandas.rst | 24 - .../spark/python/docs/source/user_guide/index.rst | 40 - .../user_guide/pandas_on_spark/best_practices.rst | 331 - .../docs/source/user_guide/pandas_on_spark/faq.rst | 57 - .../user_guide/pandas_on_spark/from_to_dbms.rst | 125 - .../source/user_guide/pandas_on_spark/index.rst | 33 - .../source/user_guide/pandas_on_spark/options.rst | 294 - .../user_guide/pandas_on_spark/pandas_pyspark.rst | 136 - .../user_guide/pandas_on_spark/transform_apply.rst | 139 - .../user_guide/pandas_on_spark/typehints.rst | 154 - .../source/user_guide/pandas_on_spark/types.rst | 246 - .../docs/source/user_guide/python_packaging.rst | 253 - .../docs/source/user_guide/sql/arrow_pandas.rst | 421 - .../python/docs/source/user_guide/sql/index.rst | 27 - build/spark/python/lib/PY4J_LICENSE.txt | 27 - build/spark/python/lib/py4j-0.10.9.2-src.zip | Bin 41839 -> 0 bytes build/spark/python/lib/pyspark.zip | Bin 1517553 -> 0 bytes build/spark/python/mypy.ini | 158 - build/spark/python/pylintrc | 404 - build/spark/python/pyspark/__init__.py | 129 - build/spark/python/pyspark/__init__.pyi | 77 - build/spark/python/pyspark/_globals.py | 70 - build/spark/python/pyspark/_typing.pyi | 33 - build/spark/python/pyspark/accumulators.py | 303 - build/spark/python/pyspark/accumulators.pyi | 73 - build/spark/python/pyspark/broadcast.py | 209 - build/spark/python/pyspark/broadcast.pyi | 48 - build/spark/python/pyspark/cloudpickle/__init__.py | 11 - .../python/pyspark/cloudpickle/cloudpickle.py | 842 -- .../python/pyspark/cloudpickle/cloudpickle_fast.py | 770 - build/spark/python/pyspark/cloudpickle/compat.py | 13 - build/spark/python/pyspark/conf.py | 231 - build/spark/python/pyspark/conf.pyi | 44 - build/spark/python/pyspark/context.py | 1289 -- build/spark/python/pyspark/context.pyi | 194 - build/spark/python/pyspark/daemon.py | 211 - build/spark/python/pyspark/files.py | 58 - build/spark/python/pyspark/files.pyi | 24 - build/spark/python/pyspark/find_spark_home.py | 86 - build/spark/python/pyspark/install.py | 179 - build/spark/python/pyspark/java_gateway.py | 237 - build/spark/python/pyspark/join.py | 113 - build/spark/python/pyspark/ml/__init__.py | 33 - build/spark/python/pyspark/ml/_typing.pyi | 76 - build/spark/python/pyspark/ml/base.py | 367 - build/spark/python/pyspark/ml/base.pyi | 107 - build/spark/python/pyspark/ml/classification.py | 3575 ----- build/spark/python/pyspark/ml/classification.pyi | 944 -- build/spark/python/pyspark/ml/clustering.py | 1853 --- build/spark/python/pyspark/ml/clustering.pyi | 437 - build/spark/python/pyspark/ml/common.py | 133 - build/spark/python/pyspark/ml/common.pyi | 26 - build/spark/python/pyspark/ml/evaluation.py | 949 -- build/spark/python/pyspark/ml/evaluation.pyi | 283 - build/spark/python/pyspark/ml/feature.py | 6032 -------- build/spark/python/pyspark/ml/feature.pyi | 1623 --- build/spark/python/pyspark/ml/fpm.py | 486 - build/spark/python/pyspark/ml/fpm.pyi | 109 - build/spark/python/pyspark/ml/functions.py | 130 - build/spark/python/pyspark/ml/functions.pyi | 24 - build/spark/python/pyspark/ml/image.py | 261 - build/spark/python/pyspark/ml/image.pyi | 40 - build/spark/python/pyspark/ml/linalg/__init__.py | 1200 -- build/spark/python/pyspark/ml/linalg/__init__.pyi | 251 - build/spark/python/pyspark/ml/param/__init__.py | 560 - build/spark/python/pyspark/ml/param/__init__.pyi | 96 - .../pyspark/ml/param/_shared_params_code_gen.py | 179 - .../pyspark/ml/param/_shared_params_code_gen.pyi | 19 - build/spark/python/pyspark/ml/param/shared.py | 617 - build/spark/python/pyspark/ml/param/shared.pyi | 192 - build/spark/python/pyspark/ml/pipeline.py | 408 - build/spark/python/pyspark/ml/pipeline.pyi | 97 - build/spark/python/pyspark/ml/recommendation.py | 649 - build/spark/python/pyspark/ml/recommendation.pyi | 152 - build/spark/python/pyspark/ml/regression.py | 2773 ---- build/spark/python/pyspark/ml/regression.pyi | 825 -- build/spark/python/pyspark/ml/stat.py | 495 - build/spark/python/pyspark/ml/stat.pyi | 77 - build/spark/python/pyspark/ml/tests/__init__.py | 16 - .../python/pyspark/ml/tests/test_algorithms.py | 352 - build/spark/python/pyspark/ml/tests/test_base.py | 90 - .../python/pyspark/ml/tests/test_evaluation.py | 69 - .../spark/python/pyspark/ml/tests/test_feature.py | 311 - build/spark/python/pyspark/ml/tests/test_image.py | 76 - build/spark/python/pyspark/ml/tests/test_linalg.py | 388 - build/spark/python/pyspark/ml/tests/test_param.py | 394 - .../python/pyspark/ml/tests/test_persistence.py | 473 - .../spark/python/pyspark/ml/tests/test_pipeline.py | 69 - build/spark/python/pyspark/ml/tests/test_stat.py | 50 - .../pyspark/ml/tests/test_training_summary.py | 452 - build/spark/python/pyspark/ml/tests/test_tuning.py | 949 -- build/spark/python/pyspark/ml/tests/test_util.py | 84 - .../spark/python/pyspark/ml/tests/test_wrapper.py | 129 - build/spark/python/pyspark/ml/tree.py | 356 - build/spark/python/pyspark/ml/tree.pyi | 112 - build/spark/python/pyspark/ml/tuning.py | 1475 -- build/spark/python/pyspark/ml/tuning.pyi | 225 - build/spark/python/pyspark/ml/util.py | 667 - build/spark/python/pyspark/ml/util.pyi | 136 - build/spark/python/pyspark/ml/wrapper.py | 416 - build/spark/python/pyspark/ml/wrapper.pyi | 48 - build/spark/python/pyspark/mllib/__init__.py | 33 - build/spark/python/pyspark/mllib/_typing.pyi | 23 - build/spark/python/pyspark/mllib/classification.py | 813 -- .../spark/python/pyspark/mllib/classification.pyi | 151 - build/spark/python/pyspark/mllib/clustering.py | 1152 -- build/spark/python/pyspark/mllib/clustering.pyi | 198 - build/spark/python/pyspark/mllib/common.py | 158 - build/spark/python/pyspark/mllib/common.pyi | 35 - build/spark/python/pyspark/mllib/evaluation.py | 660 - build/spark/python/pyspark/mllib/evaluation.pyi | 94 - build/spark/python/pyspark/mllib/feature.py | 954 -- build/spark/python/pyspark/mllib/feature.pyi | 167 - build/spark/python/pyspark/mllib/fpm.py | 215 - build/spark/python/pyspark/mllib/fpm.pyi | 57 - .../spark/python/pyspark/mllib/linalg/__init__.py | 1444 -- .../spark/python/pyspark/mllib/linalg/__init__.pyi | 286 - .../python/pyspark/mllib/linalg/distributed.py | 1596 -- .../python/pyspark/mllib/linalg/distributed.pyi | 151 - build/spark/python/pyspark/mllib/random.py | 599 - build/spark/python/pyspark/mllib/random.pyi | 126 - build/spark/python/pyspark/mllib/recommendation.py | 344 - .../spark/python/pyspark/mllib/recommendation.pyi | 75 - build/spark/python/pyspark/mllib/regression.py | 906 -- build/spark/python/pyspark/mllib/regression.pyi | 155 - .../python/pyspark/mllib/stat/KernelDensity.py | 56 - .../python/pyspark/mllib/stat/KernelDensity.pyi | 27 - build/spark/python/pyspark/mllib/stat/__init__.py | 29 - build/spark/python/pyspark/mllib/stat/__init__.pyi | 29 - .../spark/python/pyspark/mllib/stat/_statistics.py | 365 - .../python/pyspark/mllib/stat/_statistics.pyi | 69 - .../python/pyspark/mllib/stat/distribution.py | 34 - .../python/pyspark/mllib/stat/distribution.pyi | 25 - build/spark/python/pyspark/mllib/stat/test.py | 82 - build/spark/python/pyspark/mllib/stat/test.pyi | 39 - build/spark/python/pyspark/mllib/tests/__init__.py | 16 - .../python/pyspark/mllib/tests/test_algorithms.py | 302 - .../python/pyspark/mllib/tests/test_feature.py | 192 - .../python/pyspark/mllib/tests/test_linalg.py | 661 - .../spark/python/pyspark/mllib/tests/test_stat.py | 187 - .../mllib/tests/test_streaming_algorithms.py | 485 - .../spark/python/pyspark/mllib/tests/test_util.py | 104 - build/spark/python/pyspark/mllib/tree.py | 702 - build/spark/python/pyspark/mllib/tree.pyi | 126 - build/spark/python/pyspark/mllib/util.py | 609 - build/spark/python/pyspark/mllib/util.pyi | 90 - build/spark/python/pyspark/pandas/__init__.py | 147 - build/spark/python/pyspark/pandas/_typing.py | 51 - build/spark/python/pyspark/pandas/accessors.py | 922 -- build/spark/python/pyspark/pandas/base.py | 1667 --- build/spark/python/pyspark/pandas/categorical.py | 933 -- build/spark/python/pyspark/pandas/config.py | 471 - .../pyspark/pandas/data_type_ops/__init__.py | 16 - .../python/pyspark/pandas/data_type_ops/base.py | 385 - .../pyspark/pandas/data_type_ops/binary_ops.py | 108 - .../pyspark/pandas/data_type_ops/boolean_ops.py | 367 - .../pandas/data_type_ops/categorical_ops.py | 143 - .../pyspark/pandas/data_type_ops/complex_ops.py | 145 - .../pyspark/pandas/data_type_ops/date_ops.py | 123 - .../pyspark/pandas/data_type_ops/datetime_ops.py | 138 - .../pyspark/pandas/data_type_ops/null_ops.py | 80 - .../python/pyspark/pandas/data_type_ops/num_ops.py | 498 - .../pyspark/pandas/data_type_ops/string_ops.py | 162 - .../python/pyspark/pandas/data_type_ops/udt_ops.py | 29 - build/spark/python/pyspark/pandas/datetimes.py | 902 -- build/spark/python/pyspark/pandas/exceptions.py | 142 - build/spark/python/pyspark/pandas/extensions.py | 388 - build/spark/python/pyspark/pandas/frame.py | 12065 --------------- build/spark/python/pyspark/pandas/generic.py | 3242 ----- build/spark/python/pyspark/pandas/groupby.py | 3357 ----- .../python/pyspark/pandas/indexes/__init__.py | 20 - build/spark/python/pyspark/pandas/indexes/base.py | 2640 ---- .../python/pyspark/pandas/indexes/category.py | 736 - .../python/pyspark/pandas/indexes/datetimes.py | 777 - build/spark/python/pyspark/pandas/indexes/multi.py | 1205 -- .../spark/python/pyspark/pandas/indexes/numeric.py | 197 - build/spark/python/pyspark/pandas/indexing.py | 1843 --- build/spark/python/pyspark/pandas/internal.py | 1584 -- .../python/pyspark/pandas/missing/__init__.py | 48 - .../spark/python/pyspark/pandas/missing/common.py | 59 - build/spark/python/pyspark/pandas/missing/frame.py | 98 - .../spark/python/pyspark/pandas/missing/groupby.py | 103 - .../spark/python/pyspark/pandas/missing/indexes.py | 201 - .../spark/python/pyspark/pandas/missing/series.py | 125 - .../spark/python/pyspark/pandas/missing/window.py | 126 - build/spark/python/pyspark/pandas/ml.py | 116 - build/spark/python/pyspark/pandas/mlflow.py | 238 - build/spark/python/pyspark/pandas/namespace.py | 3004 ---- build/spark/python/pyspark/pandas/numpy_compat.py | 254 - build/spark/python/pyspark/pandas/plot/__init__.py | 17 - build/spark/python/pyspark/pandas/plot/core.py | 1144 -- .../spark/python/pyspark/pandas/plot/matplotlib.py | 897 -- build/spark/python/pyspark/pandas/plot/plotly.py | 218 - build/spark/python/pyspark/pandas/series.py | 6400 -------- .../spark/python/pyspark/pandas/spark/__init__.py | 16 - .../spark/python/pyspark/pandas/spark/accessors.py | 1275 -- .../spark/python/pyspark/pandas/spark/functions.py | 74 - build/spark/python/pyspark/pandas/spark/utils.py | 195 - build/spark/python/pyspark/pandas/sql_processor.py | 386 - build/spark/python/pyspark/pandas/strings.py | 2404 --- .../spark/python/pyspark/pandas/tests/__init__.py | 16 - .../pyspark/pandas/tests/data_type_ops/__init__.py | 16 - .../pandas/tests/data_type_ops/test_base.py | 98 - .../pandas/tests/data_type_ops/test_binary_ops.py | 221 - .../pandas/tests/data_type_ops/test_boolean_ops.py | 779 - .../tests/data_type_ops/test_categorical_ops.py | 563 - .../pandas/tests/data_type_ops/test_complex_ops.py | 365 - .../pandas/tests/data_type_ops/test_date_ops.py | 244 - .../tests/data_type_ops/test_datetime_ops.py | 250 - .../pandas/tests/data_type_ops/test_null_ops.py | 174 - .../pandas/tests/data_type_ops/test_num_ops.py | 638 - .../pandas/tests/data_type_ops/test_string_ops.py | 351 - .../pandas/tests/data_type_ops/test_udt_ops.py | 189 - .../pandas/tests/data_type_ops/testing_utils.py | 248 - .../pyspark/pandas/tests/indexes/__init__.py | 16 - .../pyspark/pandas/tests/indexes/test_base.py | 2382 --- .../pyspark/pandas/tests/indexes/test_category.py | 443 - .../pyspark/pandas/tests/indexes/test_datetime.py | 254 - .../python/pyspark/pandas/tests/plot/__init__.py | 16 - .../pyspark/pandas/tests/plot/test_frame_plot.py | 124 - .../tests/plot/test_frame_plot_matplotlib.py | 488 - .../pandas/tests/plot/test_frame_plot_plotly.py | 279 - .../pyspark/pandas/tests/plot/test_series_plot.py | 102 - .../tests/plot/test_series_plot_matplotlib.py | 408 - .../pandas/tests/plot/test_series_plot_plotly.py | 248 - .../pyspark/pandas/tests/test_categorical.py | 805 -- .../python/pyspark/pandas/tests/test_config.py | 156 - .../spark/python/pyspark/pandas/tests/test_csv.py | 435 - .../python/pyspark/pandas/tests/test_dataframe.py | 5787 -------- .../pandas/tests/test_dataframe_conversion.py | 276 - .../pandas/tests/test_dataframe_spark_io.py | 458 - .../pyspark/pandas/tests/test_default_index.py | 52 - .../python/pyspark/pandas/tests/test_expanding.py | 345 - .../python/pyspark/pandas/tests/test_extension.py | 152 - .../pyspark/pandas/tests/test_frame_spark.py | 156 - .../python/pyspark/pandas/tests/test_groupby.py | 2943 ---- .../python/pyspark/pandas/tests/test_indexing.py | 1345 -- .../pyspark/pandas/tests/test_indexops_spark.py | 76 - .../python/pyspark/pandas/tests/test_internal.py | 120 - .../python/pyspark/pandas/tests/test_namespace.py | 350 - .../pyspark/pandas/tests/test_numpy_compat.py | 212 - .../pandas/tests/test_ops_on_diff_frames.py | 1983 --- .../tests/test_ops_on_diff_frames_groupby.py | 623 - .../test_ops_on_diff_frames_groupby_expanding.py | 144 - .../test_ops_on_diff_frames_groupby_rolling.py | 107 - .../spark/python/pyspark/pandas/tests/test_repr.py | 186 - .../python/pyspark/pandas/tests/test_reshape.py | 297 - .../python/pyspark/pandas/tests/test_rolling.py | 220 - .../python/pyspark/pandas/tests/test_series.py | 2974 ---- .../pyspark/pandas/tests/test_series_conversion.py | 77 - .../pyspark/pandas/tests/test_series_datetime.py | 293 - .../pyspark/pandas/tests/test_series_string.py | 341 - .../pyspark/pandas/tests/test_spark_functions.py | 54 - .../spark/python/pyspark/pandas/tests/test_sql.py | 77 - .../python/pyspark/pandas/tests/test_stats.py | 427 - .../python/pyspark/pandas/tests/test_typedef.py | 438 - .../python/pyspark/pandas/tests/test_utils.py | 116 - .../python/pyspark/pandas/tests/test_window.py | 317 - .../python/pyspark/pandas/typedef/__init__.py | 18 - .../pyspark/pandas/typedef/string_typehints.py | 40 - .../python/pyspark/pandas/typedef/typehints.py | 551 - .../pyspark/pandas/usage_logging/__init__.py | 267 - .../pyspark/pandas/usage_logging/usage_logger.py | 132 - build/spark/python/pyspark/pandas/utils.py | 985 -- build/spark/python/pyspark/pandas/window.py | 1782 --- build/spark/python/pyspark/profiler.py | 181 - build/spark/python/pyspark/profiler.pyi | 56 - build/spark/python/pyspark/py.typed | 1 - build/spark/python/pyspark/python/pyspark/shell.py | 75 - build/spark/python/pyspark/rdd.py | 2989 ---- build/spark/python/pyspark/rdd.pyi | 483 - build/spark/python/pyspark/rddsampler.py | 119 - build/spark/python/pyspark/resource/__init__.py | 30 - build/spark/python/pyspark/resource/information.py | 51 - .../spark/python/pyspark/resource/information.pyi | 26 - build/spark/python/pyspark/resource/profile.py | 172 - build/spark/python/pyspark/resource/profile.pyi | 60 - build/spark/python/pyspark/resource/requests.py | 281 - build/spark/python/pyspark/resource/requests.pyi | 83 - .../python/pyspark/resource/tests/__init__.py | 16 - .../pyspark/resource/tests/test_resources.py | 82 - build/spark/python/pyspark/resultiterable.py | 40 - build/spark/python/pyspark/resultiterable.pyi | 30 - build/spark/python/pyspark/serializers.py | 648 - build/spark/python/pyspark/shell.py | 75 - build/spark/python/pyspark/shuffle.py | 824 -- build/spark/python/pyspark/sql/__init__.py | 59 - build/spark/python/pyspark/sql/__init__.pyi | 41 - build/spark/python/pyspark/sql/_typing.pyi | 63 - build/spark/python/pyspark/sql/avro/__init__.py | 18 - build/spark/python/pyspark/sql/avro/functions.py | 163 - build/spark/python/pyspark/sql/avro/functions.pyi | 27 - build/spark/python/pyspark/sql/catalog.py | 332 - build/spark/python/pyspark/sql/catalog.pyi | 64 - build/spark/python/pyspark/sql/column.py | 939 -- build/spark/python/pyspark/sql/column.pyi | 118 - build/spark/python/pyspark/sql/conf.py | 91 - build/spark/python/pyspark/sql/conf.pyi | 27 - build/spark/python/pyspark/sql/context.py | 673 - build/spark/python/pyspark/sql/context.pyi | 140 - build/spark/python/pyspark/sql/dataframe.py | 2874 ---- build/spark/python/pyspark/sql/dataframe.pyi | 349 - build/spark/python/pyspark/sql/functions.py | 5135 ------- build/spark/python/pyspark/sql/functions.pyi | 372 - build/spark/python/pyspark/sql/group.py | 303 - build/spark/python/pyspark/sql/group.pyi | 44 - build/spark/python/pyspark/sql/pandas/__init__.py | 21 - .../python/pyspark/sql/pandas/_typing/__init__.pyi | 338 - .../sql/pandas/_typing/protocols/__init__.pyi | 17 - .../pyspark/sql/pandas/_typing/protocols/frame.pyi | 428 - .../sql/pandas/_typing/protocols/series.pyi | 253 - .../spark/python/pyspark/sql/pandas/conversion.py | 513 - .../spark/python/pyspark/sql/pandas/conversion.pyi | 58 - build/spark/python/pyspark/sql/pandas/functions.py | 432 - .../spark/python/pyspark/sql/pandas/functions.pyi | 176 - build/spark/python/pyspark/sql/pandas/group_ops.py | 360 - .../spark/python/pyspark/sql/pandas/group_ops.pyi | 49 - build/spark/python/pyspark/sql/pandas/map_ops.py | 105 - build/spark/python/pyspark/sql/pandas/map_ops.pyi | 30 - .../spark/python/pyspark/sql/pandas/serializers.py | 302 - build/spark/python/pyspark/sql/pandas/typehints.py | 141 - build/spark/python/pyspark/sql/pandas/types.py | 348 - build/spark/python/pyspark/sql/pandas/utils.py | 62 - build/spark/python/pyspark/sql/readwriter.py | 1211 -- build/spark/python/pyspark/sql/readwriter.pyi | 257 - build/spark/python/pyspark/sql/session.py | 849 -- build/spark/python/pyspark/sql/session.pyi | 131 - build/spark/python/pyspark/sql/streaming.py | 1312 -- build/spark/python/pyspark/sql/streaming.pyi | 197 - build/spark/python/pyspark/sql/tests/__init__.py | 16 - build/spark/python/pyspark/sql/tests/test_arrow.py | 603 - .../spark/python/pyspark/sql/tests/test_catalog.py | 213 - .../spark/python/pyspark/sql/tests/test_column.py | 193 - build/spark/python/pyspark/sql/tests/test_conf.py | 56 - .../spark/python/pyspark/sql/tests/test_context.py | 182 - .../python/pyspark/sql/tests/test_dataframe.py | 966 -- .../python/pyspark/sql/tests/test_datasources.py | 171 - .../python/pyspark/sql/tests/test_functions.py | 694 - build/spark/python/pyspark/sql/tests/test_group.py | 47 - .../pyspark/sql/tests/test_pandas_cogrouped_map.py | 266 - .../pyspark/sql/tests/test_pandas_grouped_map.py | 621 - .../python/pyspark/sql/tests/test_pandas_map.py | 132 - .../python/pyspark/sql/tests/test_pandas_udf.py | 251 - .../sql/tests/test_pandas_udf_grouped_agg.py | 523 - .../pyspark/sql/tests/test_pandas_udf_scalar.py | 1164 -- .../pyspark/sql/tests/test_pandas_udf_typehints.py | 253 - .../pyspark/sql/tests/test_pandas_udf_window.py | 366 - .../python/pyspark/sql/tests/test_readwriter.py | 211 - build/spark/python/pyspark/sql/tests/test_serde.py | 149 - .../spark/python/pyspark/sql/tests/test_session.py | 368 - .../python/pyspark/sql/tests/test_streaming.py | 606 - build/spark/python/pyspark/sql/tests/test_types.py | 992 -- build/spark/python/pyspark/sql/tests/test_udf.py | 718 - build/spark/python/pyspark/sql/tests/test_utils.py | 61 - build/spark/python/pyspark/sql/types.py | 1642 --- build/spark/python/pyspark/sql/types.pyi | 205 - build/spark/python/pyspark/sql/udf.py | 455 - build/spark/python/pyspark/sql/udf.pyi | 58 - build/spark/python/pyspark/sql/utils.py | 212 - build/spark/python/pyspark/sql/window.py | 332 - build/spark/python/pyspark/sql/window.pyi | 41 - build/spark/python/pyspark/statcounter.py | 160 - build/spark/python/pyspark/statcounter.pyi | 44 - build/spark/python/pyspark/status.py | 96 - build/spark/python/pyspark/status.pyi | 42 - build/spark/python/pyspark/storagelevel.py | 60 - build/spark/python/pyspark/storagelevel.pyi | 43 - build/spark/python/pyspark/streaming/__init__.py | 22 - build/spark/python/pyspark/streaming/context.py | 403 - build/spark/python/pyspark/streaming/context.pyi | 75 - build/spark/python/pyspark/streaming/dstream.py | 682 - build/spark/python/pyspark/streaming/dstream.pyi | 216 - build/spark/python/pyspark/streaming/kinesis.py | 122 - build/spark/python/pyspark/streaming/kinesis.pyi | 49 - build/spark/python/pyspark/streaming/listener.py | 81 - build/spark/python/pyspark/streaming/listener.pyi | 35 - .../python/pyspark/streaming/tests/__init__.py | 16 - .../python/pyspark/streaming/tests/test_context.py | 185 - .../python/pyspark/streaming/tests/test_dstream.py | 651 - .../python/pyspark/streaming/tests/test_kinesis.py | 90 - .../pyspark/streaming/tests/test_listener.py | 159 - build/spark/python/pyspark/streaming/util.py | 162 - build/spark/python/pyspark/taskcontext.py | 282 - build/spark/python/pyspark/taskcontext.pyi | 45 - build/spark/python/pyspark/testing/__init__.py | 16 - build/spark/python/pyspark/testing/mllibutils.py | 30 - build/spark/python/pyspark/testing/mlutils.py | 250 - build/spark/python/pyspark/testing/pandasutils.py | 389 - build/spark/python/pyspark/testing/sqlutils.py | 261 - .../spark/python/pyspark/testing/streamingutils.py | 174 - build/spark/python/pyspark/testing/utils.py | 174 - build/spark/python/pyspark/tests/__init__.py | 16 - build/spark/python/pyspark/tests/test_appsubmit.py | 248 - build/spark/python/pyspark/tests/test_broadcast.py | 155 - build/spark/python/pyspark/tests/test_conf.py | 43 - build/spark/python/pyspark/tests/test_context.py | 332 - build/spark/python/pyspark/tests/test_daemon.py | 83 - .../python/pyspark/tests/test_install_spark.py | 109 - build/spark/python/pyspark/tests/test_join.py | 69 - .../spark/python/pyspark/tests/test_pin_thread.py | 176 - build/spark/python/pyspark/tests/test_profiler.py | 108 - build/spark/python/pyspark/tests/test_rdd.py | 891 -- .../spark/python/pyspark/tests/test_rddbarrier.py | 50 - build/spark/python/pyspark/tests/test_readwrite.py | 314 - .../spark/python/pyspark/tests/test_serializers.py | 234 - build/spark/python/pyspark/tests/test_shuffle.py | 177 - .../spark/python/pyspark/tests/test_taskcontext.py | 338 - build/spark/python/pyspark/tests/test_util.py | 84 - build/spark/python/pyspark/tests/test_worker.py | 260 - build/spark/python/pyspark/traceback_utils.py | 78 - build/spark/python/pyspark/util.py | 414 - build/spark/python/pyspark/util.pyi | 29 - build/spark/python/pyspark/version.py | 19 - build/spark/python/pyspark/version.pyi | 19 - build/spark/python/pyspark/worker.py | 679 - build/spark/python/run-tests | 30 - build/spark/python/run-tests-with-coverage | 69 - build/spark/python/run-tests.py | 331 - build/spark/python/setup.cfg | 22 - build/spark/python/setup.py | 309 - .../python/test_coverage/conf/spark-defaults.conf | 21 - .../spark/python/test_coverage/coverage_daemon.py | 48 - build/spark/python/test_coverage/sitecustomize.py | 26 - .../spark/python/test_support/SimpleHTTPServer.py | 22 - build/spark/python/test_support/hello/hello.txt | 1 - .../test_support/hello/sub_hello/sub_hello.txt | 1 - build/spark/python/test_support/sql/ages.csv | 4 - .../python/test_support/sql/ages_newlines.csv | 6 - ...-00000-829af031-b970-49d6-ad39-30460a0be2c8.orc | Bin 168 -> 0 bytes ...-00000-829af031-b970-49d6-ad39-30460a0be2c8.orc | Bin 168 -> 0 bytes .../sql/parquet_partitioned/_common_metadata | Bin 210 -> 0 bytes .../test_support/sql/parquet_partitioned/_metadata | Bin 743 -> 0 bytes .../month=9/day=1/part-r-00008.gz.parquet | Bin 322 -> 0 bytes .../month=10/day=25/part-r-00002.gz.parquet | Bin 343 -> 0 bytes .../month=10/day=25/part-r-00004.gz.parquet | Bin 343 -> 0 bytes .../month=10/day=26/part-r-00005.gz.parquet | Bin 333 -> 0 bytes .../month=9/day=1/part-r-00007.gz.parquet | Bin 343 -> 0 bytes build/spark/python/test_support/sql/people.json | 3 - build/spark/python/test_support/sql/people1.json | 2 - .../python/test_support/sql/people_array.json | 13 - .../test_support/sql/people_array_utf16le.json | Bin 182 -> 0 bytes .../test_support/sql/streaming/text-test.txt | 2 - build/spark/python/test_support/sql/text-test.txt | 2 - build/spark/python/test_support/userlib-0.1.zip | Bin 668 -> 0 bytes build/spark/python/test_support/userlibrary.py | 26 - build/spark/sbin/decommission-slave.sh | 23 - build/spark/sbin/decommission-worker.sh | 57 - build/spark/sbin/slaves.sh | 23 - build/spark/sbin/spark-config.sh | 33 - build/spark/sbin/spark-daemon.sh | 264 - build/spark/sbin/spark-daemons.sh | 36 - build/spark/sbin/start-all.sh | 35 - build/spark/sbin/start-history-server.sh | 49 - build/spark/sbin/start-master.sh | 68 - build/spark/sbin/start-mesos-dispatcher.sh | 51 - build/spark/sbin/start-mesos-shuffle-service.sh | 36 - build/spark/sbin/start-slave.sh | 23 - build/spark/sbin/start-slaves.sh | 23 - build/spark/sbin/start-thriftserver.sh | 60 - build/spark/sbin/start-worker.sh | 92 - build/spark/sbin/start-workers.sh | 46 - build/spark/sbin/stop-all.sh | 49 - build/spark/sbin/stop-history-server.sh | 26 - build/spark/sbin/stop-master.sh | 28 - build/spark/sbin/stop-mesos-dispatcher.sh | 33 - build/spark/sbin/stop-mesos-shuffle-service.sh | 26 - build/spark/sbin/stop-slave.sh | 23 - build/spark/sbin/stop-slaves.sh | 23 - build/spark/sbin/stop-thriftserver.sh | 26 - build/spark/sbin/stop-worker.sh | 44 - build/spark/sbin/stop-workers.sh | 28 - build/spark/sbin/workers.sh | 120 - 628 files changed, 223699 deletions(-) delete mode 100644 build/spark/LICENSE delete mode 100644 build/spark/NOTICE delete mode 100644 build/spark/README.md delete mode 100644 build/spark/RELEASE delete mode 100755 build/spark/bin/beeline delete mode 100644 build/spark/bin/beeline.cmd delete mode 100755 build/spark/bin/docker-image-tool.sh delete mode 100755 build/spark/bin/find-spark-home delete mode 100644 build/spark/bin/find-spark-home.cmd delete mode 100644 build/spark/bin/load-spark-env.cmd delete mode 100644 build/spark/bin/load-spark-env.sh delete mode 100755 build/spark/bin/pyspark delete mode 100644 build/spark/bin/pyspark.cmd delete mode 100644 build/spark/bin/pyspark2.cmd delete mode 100755 build/spark/bin/run-example delete mode 100644 build/spark/bin/run-example.cmd delete mode 100755 build/spark/bin/spark-class delete mode 100644 build/spark/bin/spark-class.cmd delete mode 100755 build/spark/bin/spark-class2.cmd delete mode 100755 build/spark/bin/spark-shell delete mode 100644 build/spark/bin/spark-shell.cmd delete mode 100644 build/spark/bin/spark-shell2.cmd delete mode 100755 build/spark/bin/spark-sql delete mode 100644 build/spark/bin/spark-sql.cmd delete mode 100644 build/spark/bin/spark-sql2.cmd delete mode 100755 build/spark/bin/spark-submit delete mode 100644 build/spark/bin/spark-submit.cmd delete mode 100644 build/spark/bin/spark-submit2.cmd delete mode 100755 build/spark/bin/sparkR delete mode 100644 build/spark/bin/sparkR.cmd delete mode 100644 build/spark/bin/sparkR2.cmd delete mode 100644 build/spark/conf/fairscheduler.xml.template delete mode 100644 build/spark/conf/log4j.properties.template delete mode 100644 build/spark/conf/metrics.properties.template delete mode 100644 build/spark/conf/spark-defaults.conf.template delete mode 100755 build/spark/conf/spark-env.sh.template delete mode 100644 build/spark/conf/workers.template delete mode 100644 build/spark/kubernetes/dockerfiles/spark/Dockerfile delete mode 100644 build/spark/kubernetes/dockerfiles/spark/bindings/R/Dockerfile delete mode 100644 build/spark/kubernetes/dockerfiles/spark/bindings/python/Dockerfile delete mode 100755 build/spark/kubernetes/dockerfiles/spark/decom.sh delete mode 100755 build/spark/kubernetes/dockerfiles/spark/entrypoint.sh delete mode 100644 build/spark/kubernetes/tests/autoscale.py delete mode 100644 build/spark/kubernetes/tests/decommissioning.py delete mode 100644 build/spark/kubernetes/tests/decommissioning_cleanup.py delete mode 100644 build/spark/kubernetes/tests/py_container_checks.py delete mode 100644 build/spark/kubernetes/tests/pyfiles.py delete mode 100644 build/spark/kubernetes/tests/python_executable_check.py delete mode 100644 build/spark/kubernetes/tests/worker_memory_check.py delete mode 100644 build/spark/licenses/LICENSE-AnchorJS.txt delete mode 100644 build/spark/licenses/LICENSE-CC0.txt delete mode 100644 build/spark/licenses/LICENSE-JLargeArrays.txt delete mode 100644 build/spark/licenses/LICENSE-JTransforms.txt delete mode 100644 build/spark/licenses/LICENSE-antlr.txt delete mode 100644 build/spark/licenses/LICENSE-arpack.txt delete mode 100644 build/spark/licenses/LICENSE-automaton.txt delete mode 100644 build/spark/licenses/LICENSE-blas.txt delete mode 100644 build/spark/licenses/LICENSE-bootstrap.txt delete mode 100644 build/spark/licenses/LICENSE-cloudpickle.txt delete mode 100644 build/spark/licenses/LICENSE-d3.min.js.txt delete mode 100644 build/spark/licenses/LICENSE-dagre-d3.txt delete mode 100644 build/spark/licenses/LICENSE-datatables.txt delete mode 100644 build/spark/licenses/LICENSE-dnsjava.txt delete mode 100644 build/spark/licenses/LICENSE-f2j.txt delete mode 100644 build/spark/licenses/LICENSE-graphlib-dot.txt delete mode 100644 build/spark/licenses/LICENSE-istack-commons-runtime.txt delete mode 100644 build/spark/licenses/LICENSE-jakarta-annotation-api delete mode 100644 build/spark/licenses/LICENSE-jakarta-ws-rs-api delete mode 100644 build/spark/licenses/LICENSE-jakarta.activation-api.txt delete mode 100644 build/spark/licenses/LICENSE-jakarta.xml.bind-api.txt delete mode 100644 build/spark/licenses/LICENSE-janino.txt delete mode 100644 build/spark/licenses/LICENSE-javassist.html delete mode 100644 build/spark/licenses/LICENSE-javax-transaction-transaction-api.txt delete mode 100644 build/spark/licenses/LICENSE-javolution.txt delete mode 100644 build/spark/licenses/LICENSE-jaxb-runtime.txt delete mode 100644 build/spark/licenses/LICENSE-jline.txt delete mode 100644 build/spark/licenses/LICENSE-jodd.txt delete mode 100644 build/spark/licenses/LICENSE-join.txt delete mode 100644 build/spark/licenses/LICENSE-jquery.txt delete mode 100644 build/spark/licenses/LICENSE-json-formatter.txt delete mode 100644 build/spark/licenses/LICENSE-jsp-api.txt delete mode 100644 build/spark/licenses/LICENSE-kryo.txt delete mode 100644 build/spark/licenses/LICENSE-leveldbjni.txt delete mode 100644 build/spark/licenses/LICENSE-machinist.txt delete mode 100644 build/spark/licenses/LICENSE-matchMedia-polyfill.txt delete mode 100644 build/spark/licenses/LICENSE-minlog.txt delete mode 100644 build/spark/licenses/LICENSE-modernizr.txt delete mode 100644 build/spark/licenses/LICENSE-mustache.txt delete mode 100644 build/spark/licenses/LICENSE-netlib.txt delete mode 100644 build/spark/licenses/LICENSE-paranamer.txt delete mode 100644 build/spark/licenses/LICENSE-pmml-model.txt delete mode 100644 build/spark/licenses/LICENSE-protobuf.txt delete mode 100644 build/spark/licenses/LICENSE-py4j.txt delete mode 100644 build/spark/licenses/LICENSE-pyrolite.txt delete mode 100644 build/spark/licenses/LICENSE-re2j.txt delete mode 100644 build/spark/licenses/LICENSE-reflectasm.txt delete mode 100644 build/spark/licenses/LICENSE-respond.txt delete mode 100644 build/spark/licenses/LICENSE-sbt-launch-lib.txt delete mode 100644 build/spark/licenses/LICENSE-scala.txt delete mode 100644 build/spark/licenses/LICENSE-scopt.txt delete mode 100644 build/spark/licenses/LICENSE-slf4j.txt delete mode 100644 build/spark/licenses/LICENSE-sorttable.js.txt delete mode 100644 build/spark/licenses/LICENSE-spire.txt delete mode 100644 build/spark/licenses/LICENSE-vis-timeline.txt delete mode 100644 build/spark/licenses/LICENSE-xmlenc.txt delete mode 100644 build/spark/licenses/LICENSE-zstd-jni.txt delete mode 100644 build/spark/licenses/LICENSE-zstd.txt delete mode 100644 build/spark/python/.coveragerc delete mode 100644 build/spark/python/.gitignore delete mode 100644 build/spark/python/MANIFEST.in delete mode 100644 build/spark/python/README.md delete mode 100644 build/spark/python/docs/Makefile delete mode 100644 build/spark/python/docs/make.bat delete mode 100644 build/spark/python/docs/make2.bat delete mode 100644 build/spark/python/docs/source/_static/copybutton.js delete mode 100644 build/spark/python/docs/source/_static/css/pyspark.css delete mode 100644 build/spark/python/docs/source/_templates/autosummary/class.rst delete mode 100644 build/spark/python/docs/source/_templates/autosummary/class_with_docs.rst delete mode 100644 build/spark/python/docs/source/conf.py delete mode 100644 build/spark/python/docs/source/development/contributing.rst delete mode 100644 build/spark/python/docs/source/development/debugging.rst delete mode 100644 build/spark/python/docs/source/development/index.rst delete mode 100644 build/spark/python/docs/source/development/setting_ide.rst delete mode 100644 build/spark/python/docs/source/development/testing.rst delete mode 100644 build/spark/python/docs/source/getting_started/index.rst delete mode 100644 build/spark/python/docs/source/getting_started/install.rst delete mode 100644 build/spark/python/docs/source/getting_started/quickstart_df.ipynb delete mode 100644 build/spark/python/docs/source/getting_started/quickstart_ps.ipynb delete mode 100644 build/spark/python/docs/source/index.rst delete mode 100644 build/spark/python/docs/source/migration_guide/index.rst delete mode 100644 build/spark/python/docs/source/migration_guide/koalas_to_pyspark.rst delete mode 100644 build/spark/python/docs/source/migration_guide/pyspark_1.0_1.2_to_1.3.rst delete mode 100644 build/spark/python/docs/source/migration_guide/pyspark_1.4_to_1.5.rst delete mode 100644 build/spark/python/docs/source/migration_guide/pyspark_2.2_to_2.3.rst delete mode 100644 build/spark/python/docs/source/migration_guide/pyspark_2.3.0_to_2.3.1_above.rst delete mode 100644 build/spark/python/docs/source/migration_guide/pyspark_2.3_to_2.4.rst delete mode 100644 build/spark/python/docs/source/migration_guide/pyspark_2.4_to_3.0.rst delete mode 100644 build/spark/python/docs/source/migration_guide/pyspark_3.1_to_3.2.rst delete mode 100644 build/spark/python/docs/source/reference/index.rst delete mode 100644 build/spark/python/docs/source/reference/pyspark.ml.rst delete mode 100644 build/spark/python/docs/source/reference/pyspark.mllib.rst delete mode 100644 build/spark/python/docs/source/reference/pyspark.pandas/extensions.rst delete mode 100644 build/spark/python/docs/source/reference/pyspark.pandas/frame.rst delete mode 100644 build/spark/python/docs/source/reference/pyspark.pandas/general_functions.rst delete mode 100644 build/spark/python/docs/source/reference/pyspark.pandas/groupby.rst delete mode 100644 build/spark/python/docs/source/reference/pyspark.pandas/index.rst delete mode 100644 build/spark/python/docs/source/reference/pyspark.pandas/indexing.rst delete mode 100644 build/spark/python/docs/source/reference/pyspark.pandas/io.rst delete mode 100644 build/spark/python/docs/source/reference/pyspark.pandas/ml.rst delete mode 100644 build/spark/python/docs/source/reference/pyspark.pandas/series.rst delete mode 100644 build/spark/python/docs/source/reference/pyspark.pandas/window.rst delete mode 100644 build/spark/python/docs/source/reference/pyspark.resource.rst delete mode 100644 build/spark/python/docs/source/reference/pyspark.rst delete mode 100644 build/spark/python/docs/source/reference/pyspark.sql.rst delete mode 100644 build/spark/python/docs/source/reference/pyspark.ss.rst delete mode 100644 build/spark/python/docs/source/reference/pyspark.streaming.rst delete mode 100644 build/spark/python/docs/source/user_guide/arrow_pandas.rst delete mode 100644 build/spark/python/docs/source/user_guide/index.rst delete mode 100644 build/spark/python/docs/source/user_guide/pandas_on_spark/best_practices.rst delete mode 100644 build/spark/python/docs/source/user_guide/pandas_on_spark/faq.rst delete mode 100644 build/spark/python/docs/source/user_guide/pandas_on_spark/from_to_dbms.rst delete mode 100644 build/spark/python/docs/source/user_guide/pandas_on_spark/index.rst delete mode 100644 build/spark/python/docs/source/user_guide/pandas_on_spark/options.rst delete mode 100644 build/spark/python/docs/source/user_guide/pandas_on_spark/pandas_pyspark.rst delete mode 100644 build/spark/python/docs/source/user_guide/pandas_on_spark/transform_apply.rst delete mode 100644 build/spark/python/docs/source/user_guide/pandas_on_spark/typehints.rst delete mode 100644 build/spark/python/docs/source/user_guide/pandas_on_spark/types.rst delete mode 100644 build/spark/python/docs/source/user_guide/python_packaging.rst delete mode 100644 build/spark/python/docs/source/user_guide/sql/arrow_pandas.rst delete mode 100644 build/spark/python/docs/source/user_guide/sql/index.rst delete mode 100644 build/spark/python/lib/PY4J_LICENSE.txt delete mode 100644 build/spark/python/lib/py4j-0.10.9.2-src.zip delete mode 100644 build/spark/python/lib/pyspark.zip delete mode 100644 build/spark/python/mypy.ini delete mode 100644 build/spark/python/pylintrc delete mode 100644 build/spark/python/pyspark/__init__.py delete mode 100644 build/spark/python/pyspark/__init__.pyi delete mode 100644 build/spark/python/pyspark/_globals.py delete mode 100644 build/spark/python/pyspark/_typing.pyi delete mode 100644 build/spark/python/pyspark/accumulators.py delete mode 100644 build/spark/python/pyspark/accumulators.pyi delete mode 100644 build/spark/python/pyspark/broadcast.py delete mode 100644 build/spark/python/pyspark/broadcast.pyi delete mode 100644 build/spark/python/pyspark/cloudpickle/__init__.py delete mode 100644 build/spark/python/pyspark/cloudpickle/cloudpickle.py delete mode 100644 build/spark/python/pyspark/cloudpickle/cloudpickle_fast.py delete mode 100644 build/spark/python/pyspark/cloudpickle/compat.py delete mode 100644 build/spark/python/pyspark/conf.py delete mode 100644 build/spark/python/pyspark/conf.pyi delete mode 100644 build/spark/python/pyspark/context.py delete mode 100644 build/spark/python/pyspark/context.pyi delete mode 100644 build/spark/python/pyspark/daemon.py delete mode 100644 build/spark/python/pyspark/files.py delete mode 100644 build/spark/python/pyspark/files.pyi delete mode 100755 build/spark/python/pyspark/find_spark_home.py delete mode 100644 build/spark/python/pyspark/install.py delete mode 100644 build/spark/python/pyspark/java_gateway.py delete mode 100644 build/spark/python/pyspark/join.py delete mode 100644 build/spark/python/pyspark/ml/__init__.py delete mode 100644 build/spark/python/pyspark/ml/_typing.pyi delete mode 100644 build/spark/python/pyspark/ml/base.py delete mode 100644 build/spark/python/pyspark/ml/base.pyi delete mode 100644 build/spark/python/pyspark/ml/classification.py delete mode 100644 build/spark/python/pyspark/ml/classification.pyi delete mode 100644 build/spark/python/pyspark/ml/clustering.py delete mode 100644 build/spark/python/pyspark/ml/clustering.pyi delete mode 100644 build/spark/python/pyspark/ml/common.py delete mode 100644 build/spark/python/pyspark/ml/common.pyi delete mode 100644 build/spark/python/pyspark/ml/evaluation.py delete mode 100644 build/spark/python/pyspark/ml/evaluation.pyi delete mode 100755 build/spark/python/pyspark/ml/feature.py delete mode 100644 build/spark/python/pyspark/ml/feature.pyi delete mode 100644 build/spark/python/pyspark/ml/fpm.py delete mode 100644 build/spark/python/pyspark/ml/fpm.pyi delete mode 100644 build/spark/python/pyspark/ml/functions.py delete mode 100644 build/spark/python/pyspark/ml/functions.pyi delete mode 100644 build/spark/python/pyspark/ml/image.py delete mode 100644 build/spark/python/pyspark/ml/image.pyi delete mode 100644 build/spark/python/pyspark/ml/linalg/__init__.py delete mode 100644 build/spark/python/pyspark/ml/linalg/__init__.pyi delete mode 100644 build/spark/python/pyspark/ml/param/__init__.py delete mode 100644 build/spark/python/pyspark/ml/param/__init__.pyi delete mode 100644 build/spark/python/pyspark/ml/param/_shared_params_code_gen.py delete mode 100644 build/spark/python/pyspark/ml/param/_shared_params_code_gen.pyi delete mode 100644 build/spark/python/pyspark/ml/param/shared.py delete mode 100644 build/spark/python/pyspark/ml/param/shared.pyi delete mode 100644 build/spark/python/pyspark/ml/pipeline.py delete mode 100644 build/spark/python/pyspark/ml/pipeline.pyi delete mode 100644 build/spark/python/pyspark/ml/recommendation.py delete mode 100644 build/spark/python/pyspark/ml/recommendation.pyi delete mode 100644 build/spark/python/pyspark/ml/regression.py delete mode 100644 build/spark/python/pyspark/ml/regression.pyi delete mode 100644 build/spark/python/pyspark/ml/stat.py delete mode 100644 build/spark/python/pyspark/ml/stat.pyi delete mode 100644 build/spark/python/pyspark/ml/tests/__init__.py delete mode 100644 build/spark/python/pyspark/ml/tests/test_algorithms.py delete mode 100644 build/spark/python/pyspark/ml/tests/test_base.py delete mode 100644 build/spark/python/pyspark/ml/tests/test_evaluation.py delete mode 100644 build/spark/python/pyspark/ml/tests/test_feature.py delete mode 100644 build/spark/python/pyspark/ml/tests/test_image.py delete mode 100644 build/spark/python/pyspark/ml/tests/test_linalg.py delete mode 100644 build/spark/python/pyspark/ml/tests/test_param.py delete mode 100644 build/spark/python/pyspark/ml/tests/test_persistence.py delete mode 100644 build/spark/python/pyspark/ml/tests/test_pipeline.py delete mode 100644 build/spark/python/pyspark/ml/tests/test_stat.py delete mode 100644 build/spark/python/pyspark/ml/tests/test_training_summary.py delete mode 100644 build/spark/python/pyspark/ml/tests/test_tuning.py delete mode 100644 build/spark/python/pyspark/ml/tests/test_util.py delete mode 100644 build/spark/python/pyspark/ml/tests/test_wrapper.py delete mode 100644 build/spark/python/pyspark/ml/tree.py delete mode 100644 build/spark/python/pyspark/ml/tree.pyi delete mode 100644 build/spark/python/pyspark/ml/tuning.py delete mode 100644 build/spark/python/pyspark/ml/tuning.pyi delete mode 100644 build/spark/python/pyspark/ml/util.py delete mode 100644 build/spark/python/pyspark/ml/util.pyi delete mode 100644 build/spark/python/pyspark/ml/wrapper.py delete mode 100644 build/spark/python/pyspark/ml/wrapper.pyi delete mode 100644 build/spark/python/pyspark/mllib/__init__.py delete mode 100644 build/spark/python/pyspark/mllib/_typing.pyi delete mode 100644 build/spark/python/pyspark/mllib/classification.py delete mode 100644 build/spark/python/pyspark/mllib/classification.pyi delete mode 100644 build/spark/python/pyspark/mllib/clustering.py delete mode 100644 build/spark/python/pyspark/mllib/clustering.pyi delete mode 100644 build/spark/python/pyspark/mllib/common.py delete mode 100644 build/spark/python/pyspark/mllib/common.pyi delete mode 100644 build/spark/python/pyspark/mllib/evaluation.py delete mode 100644 build/spark/python/pyspark/mllib/evaluation.pyi delete mode 100644 build/spark/python/pyspark/mllib/feature.py delete mode 100644 build/spark/python/pyspark/mllib/feature.pyi delete mode 100644 build/spark/python/pyspark/mllib/fpm.py delete mode 100644 build/spark/python/pyspark/mllib/fpm.pyi delete mode 100644 build/spark/python/pyspark/mllib/linalg/__init__.py delete mode 100644 build/spark/python/pyspark/mllib/linalg/__init__.pyi delete mode 100644 build/spark/python/pyspark/mllib/linalg/distributed.py delete mode 100644 build/spark/python/pyspark/mllib/linalg/distributed.pyi delete mode 100644 build/spark/python/pyspark/mllib/random.py delete mode 100644 build/spark/python/pyspark/mllib/random.pyi delete mode 100644 build/spark/python/pyspark/mllib/recommendation.py delete mode 100644 build/spark/python/pyspark/mllib/recommendation.pyi delete mode 100644 build/spark/python/pyspark/mllib/regression.py delete mode 100644 build/spark/python/pyspark/mllib/regression.pyi delete mode 100644 build/spark/python/pyspark/mllib/stat/KernelDensity.py delete mode 100644 build/spark/python/pyspark/mllib/stat/KernelDensity.pyi delete mode 100644 build/spark/python/pyspark/mllib/stat/__init__.py delete mode 100644 build/spark/python/pyspark/mllib/stat/__init__.pyi delete mode 100644 build/spark/python/pyspark/mllib/stat/_statistics.py delete mode 100644 build/spark/python/pyspark/mllib/stat/_statistics.pyi delete mode 100644 build/spark/python/pyspark/mllib/stat/distribution.py delete mode 100644 build/spark/python/pyspark/mllib/stat/distribution.pyi delete mode 100644 build/spark/python/pyspark/mllib/stat/test.py delete mode 100644 build/spark/python/pyspark/mllib/stat/test.pyi delete mode 100644 build/spark/python/pyspark/mllib/tests/__init__.py delete mode 100644 build/spark/python/pyspark/mllib/tests/test_algorithms.py delete mode 100644 build/spark/python/pyspark/mllib/tests/test_feature.py delete mode 100644 build/spark/python/pyspark/mllib/tests/test_linalg.py delete mode 100644 build/spark/python/pyspark/mllib/tests/test_stat.py delete mode 100644 build/spark/python/pyspark/mllib/tests/test_streaming_algorithms.py delete mode 100644 build/spark/python/pyspark/mllib/tests/test_util.py delete mode 100644 build/spark/python/pyspark/mllib/tree.py delete mode 100644 build/spark/python/pyspark/mllib/tree.pyi delete mode 100644 build/spark/python/pyspark/mllib/util.py delete mode 100644 build/spark/python/pyspark/mllib/util.pyi delete mode 100644 build/spark/python/pyspark/pandas/__init__.py delete mode 100644 build/spark/python/pyspark/pandas/_typing.py delete mode 100644 build/spark/python/pyspark/pandas/accessors.py delete mode 100644 build/spark/python/pyspark/pandas/base.py delete mode 100644 build/spark/python/pyspark/pandas/categorical.py delete mode 100644 build/spark/python/pyspark/pandas/config.py delete mode 100644 build/spark/python/pyspark/pandas/data_type_ops/__init__.py delete mode 100644 build/spark/python/pyspark/pandas/data_type_ops/base.py delete mode 100644 build/spark/python/pyspark/pandas/data_type_ops/binary_ops.py delete mode 100644 build/spark/python/pyspark/pandas/data_type_ops/boolean_ops.py delete mode 100644 build/spark/python/pyspark/pandas/data_type_ops/categorical_ops.py delete mode 100644 build/spark/python/pyspark/pandas/data_type_ops/complex_ops.py delete mode 100644 build/spark/python/pyspark/pandas/data_type_ops/date_ops.py delete mode 100644 build/spark/python/pyspark/pandas/data_type_ops/datetime_ops.py delete mode 100644 build/spark/python/pyspark/pandas/data_type_ops/null_ops.py delete mode 100644 build/spark/python/pyspark/pandas/data_type_ops/num_ops.py delete mode 100644 build/spark/python/pyspark/pandas/data_type_ops/string_ops.py delete mode 100644 build/spark/python/pyspark/pandas/data_type_ops/udt_ops.py delete mode 100644 build/spark/python/pyspark/pandas/datetimes.py delete mode 100644 build/spark/python/pyspark/pandas/exceptions.py delete mode 100644 build/spark/python/pyspark/pandas/extensions.py delete mode 100644 build/spark/python/pyspark/pandas/frame.py delete mode 100644 build/spark/python/pyspark/pandas/generic.py delete mode 100644 build/spark/python/pyspark/pandas/groupby.py delete mode 100644 build/spark/python/pyspark/pandas/indexes/__init__.py delete mode 100644 build/spark/python/pyspark/pandas/indexes/base.py delete mode 100644 build/spark/python/pyspark/pandas/indexes/category.py delete mode 100644 build/spark/python/pyspark/pandas/indexes/datetimes.py delete mode 100644 build/spark/python/pyspark/pandas/indexes/multi.py delete mode 100644 build/spark/python/pyspark/pandas/indexes/numeric.py delete mode 100644 build/spark/python/pyspark/pandas/indexing.py delete mode 100644 build/spark/python/pyspark/pandas/internal.py delete mode 100644 build/spark/python/pyspark/pandas/missing/__init__.py delete mode 100644 build/spark/python/pyspark/pandas/missing/common.py delete mode 100644 build/spark/python/pyspark/pandas/missing/frame.py delete mode 100644 build/spark/python/pyspark/pandas/missing/groupby.py delete mode 100644 build/spark/python/pyspark/pandas/missing/indexes.py delete mode 100644 build/spark/python/pyspark/pandas/missing/series.py delete mode 100644 build/spark/python/pyspark/pandas/missing/window.py delete mode 100644 build/spark/python/pyspark/pandas/ml.py delete mode 100644 build/spark/python/pyspark/pandas/mlflow.py delete mode 100644 build/spark/python/pyspark/pandas/namespace.py delete mode 100644 build/spark/python/pyspark/pandas/numpy_compat.py delete mode 100644 build/spark/python/pyspark/pandas/plot/__init__.py delete mode 100644 build/spark/python/pyspark/pandas/plot/core.py delete mode 100644 build/spark/python/pyspark/pandas/plot/matplotlib.py delete mode 100644 build/spark/python/pyspark/pandas/plot/plotly.py delete mode 100644 build/spark/python/pyspark/pandas/series.py delete mode 100644 build/spark/python/pyspark/pandas/spark/__init__.py delete mode 100644 build/spark/python/pyspark/pandas/spark/accessors.py delete mode 100644 build/spark/python/pyspark/pandas/spark/functions.py delete mode 100644 build/spark/python/pyspark/pandas/spark/utils.py delete mode 100644 build/spark/python/pyspark/pandas/sql_processor.py delete mode 100644 build/spark/python/pyspark/pandas/strings.py delete mode 100644 build/spark/python/pyspark/pandas/tests/__init__.py delete mode 100644 build/spark/python/pyspark/pandas/tests/data_type_ops/__init__.py delete mode 100644 build/spark/python/pyspark/pandas/tests/data_type_ops/test_base.py delete mode 100644 build/spark/python/pyspark/pandas/tests/data_type_ops/test_binary_ops.py delete mode 100644 build/spark/python/pyspark/pandas/tests/data_type_ops/test_boolean_ops.py delete mode 100644 build/spark/python/pyspark/pandas/tests/data_type_ops/test_categorical_ops.py delete mode 100644 build/spark/python/pyspark/pandas/tests/data_type_ops/test_complex_ops.py delete mode 100644 build/spark/python/pyspark/pandas/tests/data_type_ops/test_date_ops.py delete mode 100644 build/spark/python/pyspark/pandas/tests/data_type_ops/test_datetime_ops.py delete mode 100644 build/spark/python/pyspark/pandas/tests/data_type_ops/test_null_ops.py delete mode 100644 build/spark/python/pyspark/pandas/tests/data_type_ops/test_num_ops.py delete mode 100644 build/spark/python/pyspark/pandas/tests/data_type_ops/test_string_ops.py delete mode 100644 build/spark/python/pyspark/pandas/tests/data_type_ops/test_udt_ops.py delete mode 100644 build/spark/python/pyspark/pandas/tests/data_type_ops/testing_utils.py delete mode 100644 build/spark/python/pyspark/pandas/tests/indexes/__init__.py delete mode 100644 build/spark/python/pyspark/pandas/tests/indexes/test_base.py delete mode 100644 build/spark/python/pyspark/pandas/tests/indexes/test_category.py delete mode 100644 build/spark/python/pyspark/pandas/tests/indexes/test_datetime.py delete mode 100644 build/spark/python/pyspark/pandas/tests/plot/__init__.py delete mode 100644 build/spark/python/pyspark/pandas/tests/plot/test_frame_plot.py delete mode 100644 build/spark/python/pyspark/pandas/tests/plot/test_frame_plot_matplotlib.py delete mode 100644 build/spark/python/pyspark/pandas/tests/plot/test_frame_plot_plotly.py delete mode 100644 build/spark/python/pyspark/pandas/tests/plot/test_series_plot.py delete mode 100644 build/spark/python/pyspark/pandas/tests/plot/test_series_plot_matplotlib.py delete mode 100644 build/spark/python/pyspark/pandas/tests/plot/test_series_plot_plotly.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_categorical.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_config.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_csv.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_dataframe.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_dataframe_conversion.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_dataframe_spark_io.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_default_index.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_expanding.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_extension.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_frame_spark.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_groupby.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_indexing.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_indexops_spark.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_internal.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_namespace.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_numpy_compat.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_ops_on_diff_frames.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_ops_on_diff_frames_groupby.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_ops_on_diff_frames_groupby_expanding.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_ops_on_diff_frames_groupby_rolling.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_repr.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_reshape.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_rolling.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_series.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_series_conversion.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_series_datetime.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_series_string.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_spark_functions.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_sql.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_stats.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_typedef.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_utils.py delete mode 100644 build/spark/python/pyspark/pandas/tests/test_window.py delete mode 100644 build/spark/python/pyspark/pandas/typedef/__init__.py delete mode 100644 build/spark/python/pyspark/pandas/typedef/string_typehints.py delete mode 100644 build/spark/python/pyspark/pandas/typedef/typehints.py delete mode 100644 build/spark/python/pyspark/pandas/usage_logging/__init__.py delete mode 100644 build/spark/python/pyspark/pandas/usage_logging/usage_logger.py delete mode 100644 build/spark/python/pyspark/pandas/utils.py delete mode 100644 build/spark/python/pyspark/pandas/window.py delete mode 100644 build/spark/python/pyspark/profiler.py delete mode 100644 build/spark/python/pyspark/profiler.pyi delete mode 100644 build/spark/python/pyspark/py.typed delete mode 100644 build/spark/python/pyspark/python/pyspark/shell.py delete mode 100644 build/spark/python/pyspark/rdd.py delete mode 100644 build/spark/python/pyspark/rdd.pyi delete mode 100644 build/spark/python/pyspark/rddsampler.py delete mode 100644 build/spark/python/pyspark/resource/__init__.py delete mode 100644 build/spark/python/pyspark/resource/information.py delete mode 100644 build/spark/python/pyspark/resource/information.pyi delete mode 100644 build/spark/python/pyspark/resource/profile.py delete mode 100644 build/spark/python/pyspark/resource/profile.pyi delete mode 100644 build/spark/python/pyspark/resource/requests.py delete mode 100644 build/spark/python/pyspark/resource/requests.pyi delete mode 100644 build/spark/python/pyspark/resource/tests/__init__.py delete mode 100644 build/spark/python/pyspark/resource/tests/test_resources.py delete mode 100644 build/spark/python/pyspark/resultiterable.py delete mode 100644 build/spark/python/pyspark/resultiterable.pyi delete mode 100644 build/spark/python/pyspark/serializers.py delete mode 100644 build/spark/python/pyspark/shell.py delete mode 100644 build/spark/python/pyspark/shuffle.py delete mode 100644 build/spark/python/pyspark/sql/__init__.py delete mode 100644 build/spark/python/pyspark/sql/__init__.pyi delete mode 100644 build/spark/python/pyspark/sql/_typing.pyi delete mode 100644 build/spark/python/pyspark/sql/avro/__init__.py delete mode 100644 build/spark/python/pyspark/sql/avro/functions.py delete mode 100644 build/spark/python/pyspark/sql/avro/functions.pyi delete mode 100644 build/spark/python/pyspark/sql/catalog.py delete mode 100644 build/spark/python/pyspark/sql/catalog.pyi delete mode 100644 build/spark/python/pyspark/sql/column.py delete mode 100644 build/spark/python/pyspark/sql/column.pyi delete mode 100644 build/spark/python/pyspark/sql/conf.py delete mode 100644 build/spark/python/pyspark/sql/conf.pyi delete mode 100644 build/spark/python/pyspark/sql/context.py delete mode 100644 build/spark/python/pyspark/sql/context.pyi delete mode 100644 build/spark/python/pyspark/sql/dataframe.py delete mode 100644 build/spark/python/pyspark/sql/dataframe.pyi delete mode 100644 build/spark/python/pyspark/sql/functions.py delete mode 100644 build/spark/python/pyspark/sql/functions.pyi delete mode 100644 build/spark/python/pyspark/sql/group.py delete mode 100644 build/spark/python/pyspark/sql/group.pyi delete mode 100644 build/spark/python/pyspark/sql/pandas/__init__.py delete mode 100644 build/spark/python/pyspark/sql/pandas/_typing/__init__.pyi delete mode 100644 build/spark/python/pyspark/sql/pandas/_typing/protocols/__init__.pyi delete mode 100644 build/spark/python/pyspark/sql/pandas/_typing/protocols/frame.pyi delete mode 100644 build/spark/python/pyspark/sql/pandas/_typing/protocols/series.pyi delete mode 100644 build/spark/python/pyspark/sql/pandas/conversion.py delete mode 100644 build/spark/python/pyspark/sql/pandas/conversion.pyi delete mode 100644 build/spark/python/pyspark/sql/pandas/functions.py delete mode 100644 build/spark/python/pyspark/sql/pandas/functions.pyi delete mode 100644 build/spark/python/pyspark/sql/pandas/group_ops.py delete mode 100644 build/spark/python/pyspark/sql/pandas/group_ops.pyi delete mode 100644 build/spark/python/pyspark/sql/pandas/map_ops.py delete mode 100644 build/spark/python/pyspark/sql/pandas/map_ops.pyi delete mode 100644 build/spark/python/pyspark/sql/pandas/serializers.py delete mode 100644 build/spark/python/pyspark/sql/pandas/typehints.py delete mode 100644 build/spark/python/pyspark/sql/pandas/types.py delete mode 100644 build/spark/python/pyspark/sql/pandas/utils.py delete mode 100644 build/spark/python/pyspark/sql/readwriter.py delete mode 100644 build/spark/python/pyspark/sql/readwriter.pyi delete mode 100644 build/spark/python/pyspark/sql/session.py delete mode 100644 build/spark/python/pyspark/sql/session.pyi delete mode 100644 build/spark/python/pyspark/sql/streaming.py delete mode 100644 build/spark/python/pyspark/sql/streaming.pyi delete mode 100644 build/spark/python/pyspark/sql/tests/__init__.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_arrow.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_catalog.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_column.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_conf.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_context.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_dataframe.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_datasources.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_functions.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_group.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_pandas_cogrouped_map.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_pandas_grouped_map.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_pandas_map.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_pandas_udf.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_pandas_udf_grouped_agg.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_pandas_udf_scalar.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_pandas_udf_typehints.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_pandas_udf_window.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_readwriter.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_serde.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_session.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_streaming.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_types.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_udf.py delete mode 100644 build/spark/python/pyspark/sql/tests/test_utils.py delete mode 100644 build/spark/python/pyspark/sql/types.py delete mode 100644 build/spark/python/pyspark/sql/types.pyi delete mode 100644 build/spark/python/pyspark/sql/udf.py delete mode 100644 build/spark/python/pyspark/sql/udf.pyi delete mode 100644 build/spark/python/pyspark/sql/utils.py delete mode 100644 build/spark/python/pyspark/sql/window.py delete mode 100644 build/spark/python/pyspark/sql/window.pyi delete mode 100644 build/spark/python/pyspark/statcounter.py delete mode 100644 build/spark/python/pyspark/statcounter.pyi delete mode 100644 build/spark/python/pyspark/status.py delete mode 100644 build/spark/python/pyspark/status.pyi delete mode 100644 build/spark/python/pyspark/storagelevel.py delete mode 100644 build/spark/python/pyspark/storagelevel.pyi delete mode 100644 build/spark/python/pyspark/streaming/__init__.py delete mode 100644 build/spark/python/pyspark/streaming/context.py delete mode 100644 build/spark/python/pyspark/streaming/context.pyi delete mode 100644 build/spark/python/pyspark/streaming/dstream.py delete mode 100644 build/spark/python/pyspark/streaming/dstream.pyi delete mode 100644 build/spark/python/pyspark/streaming/kinesis.py delete mode 100644 build/spark/python/pyspark/streaming/kinesis.pyi delete mode 100644 build/spark/python/pyspark/streaming/listener.py delete mode 100644 build/spark/python/pyspark/streaming/listener.pyi delete mode 100644 build/spark/python/pyspark/streaming/tests/__init__.py delete mode 100644 build/spark/python/pyspark/streaming/tests/test_context.py delete mode 100644 build/spark/python/pyspark/streaming/tests/test_dstream.py delete mode 100644 build/spark/python/pyspark/streaming/tests/test_kinesis.py delete mode 100644 build/spark/python/pyspark/streaming/tests/test_listener.py delete mode 100644 build/spark/python/pyspark/streaming/util.py delete mode 100644 build/spark/python/pyspark/taskcontext.py delete mode 100644 build/spark/python/pyspark/taskcontext.pyi delete mode 100644 build/spark/python/pyspark/testing/__init__.py delete mode 100644 build/spark/python/pyspark/testing/mllibutils.py delete mode 100644 build/spark/python/pyspark/testing/mlutils.py delete mode 100644 build/spark/python/pyspark/testing/pandasutils.py delete mode 100644 build/spark/python/pyspark/testing/sqlutils.py delete mode 100644 build/spark/python/pyspark/testing/streamingutils.py delete mode 100644 build/spark/python/pyspark/testing/utils.py delete mode 100644 build/spark/python/pyspark/tests/__init__.py delete mode 100644 build/spark/python/pyspark/tests/test_appsubmit.py delete mode 100644 build/spark/python/pyspark/tests/test_broadcast.py delete mode 100644 build/spark/python/pyspark/tests/test_conf.py delete mode 100644 build/spark/python/pyspark/tests/test_context.py delete mode 100644 build/spark/python/pyspark/tests/test_daemon.py delete mode 100644 build/spark/python/pyspark/tests/test_install_spark.py delete mode 100644 build/spark/python/pyspark/tests/test_join.py delete mode 100644 build/spark/python/pyspark/tests/test_pin_thread.py delete mode 100644 build/spark/python/pyspark/tests/test_profiler.py delete mode 100644 build/spark/python/pyspark/tests/test_rdd.py delete mode 100644 build/spark/python/pyspark/tests/test_rddbarrier.py delete mode 100644 build/spark/python/pyspark/tests/test_readwrite.py delete mode 100644 build/spark/python/pyspark/tests/test_serializers.py delete mode 100644 build/spark/python/pyspark/tests/test_shuffle.py delete mode 100644 build/spark/python/pyspark/tests/test_taskcontext.py delete mode 100644 build/spark/python/pyspark/tests/test_util.py delete mode 100644 build/spark/python/pyspark/tests/test_worker.py delete mode 100644 build/spark/python/pyspark/traceback_utils.py delete mode 100644 build/spark/python/pyspark/util.py delete mode 100644 build/spark/python/pyspark/util.pyi delete mode 100644 build/spark/python/pyspark/version.py delete mode 100644 build/spark/python/pyspark/version.pyi delete mode 100644 build/spark/python/pyspark/worker.py delete mode 100755 build/spark/python/run-tests delete mode 100755 build/spark/python/run-tests-with-coverage delete mode 100755 build/spark/python/run-tests.py delete mode 100644 build/spark/python/setup.cfg delete mode 100755 build/spark/python/setup.py delete mode 100644 build/spark/python/test_coverage/conf/spark-defaults.conf delete mode 100644 build/spark/python/test_coverage/coverage_daemon.py delete mode 100644 build/spark/python/test_coverage/sitecustomize.py delete mode 100644 build/spark/python/test_support/SimpleHTTPServer.py delete mode 100755 build/spark/python/test_support/hello/hello.txt delete mode 100644 build/spark/python/test_support/hello/sub_hello/sub_hello.txt delete mode 100644 build/spark/python/test_support/sql/ages.csv delete mode 100644 build/spark/python/test_support/sql/ages_newlines.csv delete mode 100755 build/spark/python/test_support/sql/orc_partitioned/b=0/c=0/part-r-00000-829af031-b970-49d6-ad39-30460a0be2c8.orc delete mode 100755 build/spark/python/test_support/sql/orc_partitioned/b=1/c=1/part-r-00000-829af031-b970-49d6-ad39-30460a0be2c8.orc delete mode 100644 build/spark/python/test_support/sql/parquet_partitioned/_common_metadata delete mode 100644 build/spark/python/test_support/sql/parquet_partitioned/_metadata delete mode 100644 build/spark/python/test_support/sql/parquet_partitioned/year=2014/month=9/day=1/part-r-00008.gz.parquet delete mode 100644 build/spark/python/test_support/sql/parquet_partitioned/year=2015/month=10/day=25/part-r-00002.gz.parquet delete mode 100644 build/spark/python/test_support/sql/parquet_partitioned/year=2015/month=10/day=25/part-r-00004.gz.parquet delete mode 100644 build/spark/python/test_support/sql/parquet_partitioned/year=2015/month=10/day=26/part-r-00005.gz.parquet delete mode 100644 build/spark/python/test_support/sql/parquet_partitioned/year=2015/month=9/day=1/part-r-00007.gz.parquet delete mode 100644 build/spark/python/test_support/sql/people.json delete mode 100644 build/spark/python/test_support/sql/people1.json delete mode 100644 build/spark/python/test_support/sql/people_array.json delete mode 100644 build/spark/python/test_support/sql/people_array_utf16le.json delete mode 100644 build/spark/python/test_support/sql/streaming/text-test.txt delete mode 100644 build/spark/python/test_support/sql/text-test.txt delete mode 100644 build/spark/python/test_support/userlib-0.1.zip delete mode 100755 build/spark/python/test_support/userlibrary.py delete mode 100755 build/spark/sbin/decommission-slave.sh delete mode 100755 build/spark/sbin/decommission-worker.sh delete mode 100755 build/spark/sbin/slaves.sh delete mode 100755 build/spark/sbin/spark-config.sh delete mode 100755 build/spark/sbin/spark-daemon.sh delete mode 100755 build/spark/sbin/spark-daemons.sh delete mode 100755 build/spark/sbin/start-all.sh delete mode 100755 build/spark/sbin/start-history-server.sh delete mode 100755 build/spark/sbin/start-master.sh delete mode 100755 build/spark/sbin/start-mesos-dispatcher.sh delete mode 100755 build/spark/sbin/start-mesos-shuffle-service.sh delete mode 100755 build/spark/sbin/start-slave.sh delete mode 100755 build/spark/sbin/start-slaves.sh delete mode 100755 build/spark/sbin/start-thriftserver.sh delete mode 100755 build/spark/sbin/start-worker.sh delete mode 100755 build/spark/sbin/start-workers.sh delete mode 100755 build/spark/sbin/stop-all.sh delete mode 100755 build/spark/sbin/stop-history-server.sh delete mode 100755 build/spark/sbin/stop-master.sh delete mode 100755 build/spark/sbin/stop-mesos-dispatcher.sh delete mode 100755 build/spark/sbin/stop-mesos-shuffle-service.sh delete mode 100755 build/spark/sbin/stop-slave.sh delete mode 100755 build/spark/sbin/stop-slaves.sh delete mode 100755 build/spark/sbin/stop-thriftserver.sh delete mode 100755 build/spark/sbin/stop-worker.sh delete mode 100755 build/spark/sbin/stop-workers.sh delete mode 100755 build/spark/sbin/workers.sh