![]() ![]() ![]() Sudo python3 /usr/local/lib/python3.7/dist-packages/pyspark-patch/unzip.py -file /usr/local/lib/python3.7/dist-packages/pyspark-patch/pyspark_sql_session.zip -dest /usr/local/lib/python3.7/dist-packages/pyspark-patch -password cp -v /usr/local/lib/python3.7/dist-packages/pyspark-patch/pyspark_sql_types.py /usr/hdp/current/spark3-client/python/pyspark/sql/types.py || true #mv /usr/hdp/current/spark3-client/python/pyspark /usr/hdp/current/spark3-client/python/pyspark-oldĬp -r /usr/local/lib/python3.7/dist-packages/pyspark /usr/hdp/current/spark3-client/python Python3 -m nltk.downloader stopwords || true Python3 -m nltk.downloader averaged_perceptron_tagger || true Mv -v /root/nltk_data/ /usr/share || true Python3 -m spacy download en_core_web_md || true Python3 -m spacy download en_core_web_sm || true Python3 -m pip install pyJWT=1.7.1 -upgrade Python3 -m pip install six=1.15.0 pyasn1-modules=0.2.8 || true ![]() Python3 -m pip install -force-reinstall -upgrade adal=1.2.5 requests=2.25.0 requests_toolbelt=0.9.1 pyOpenSSL=20.0.0 cryptography=3.2.1 || true Python3 -m pip install pypandoc=1.5 PyYAML=5.3.1 || true Python3 -m pip install -upgrade pip setuptools || true Ln -s /usr/bin/python3.7-config /usr/bin/python3-config Ln -s /usr/bin/python3.7 /usr/bin/python3 Rm -rf /usr/lib/python3/dist-packages/yaml Rm /usr/lib/python3/dist-packages/PyYAML* # !!! It _POSSIBE_ code for fix AZ hdinsight nodes for new spark 3 and upd to python3.7Īdd-apt-repository -y ppa:deadsnakes/ppa || true It can fails on first/second run, just examle Custom script on for script acrions with code like it.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |