Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

release: v1.11.0 #476

Merged
merged 2 commits into from
Sep 19, 2024
Merged

release: v1.11.0 #476

merged 2 commits into from
Sep 19, 2024

Conversation

github-actions[bot]
Copy link
Contributor

This pull request was created by GitHub Actions/AWS CodeBuild! Before merging, please do the following:

  • Review changelog/staleness report.
  • (Only for Minor/Major version releases) Review python package dependency and size report.
  • Review build/test results by clicking Build Logs in CI Report (be patient, tests take ~4hr).
  • Review ECR Scan results.

@sagemaker-distribution-bot
Copy link
Collaborator

Staleness Report: 1.11.0(gpu)

Package Current Version in the Distribution image Latest Relevant Version in Upstream
numpy 1.26.4 1.26.4
jinja2 3.1.4 3.1.4
altair 5.4.1 5.4.1
${\color{red}boto3}$ 1.34.162 1.35.20
ipython 8.27.0 8.27.0
jupyter-lsp 2.2.5 2.2.5
${\color{red}jupyterlab}$ 4.1.6 4.2.5
amazon-q-developer-jupyterlab-ext 3.2.0 3.2.0
${\color{red}langchain}$ 0.2.5 0.3.0
jupyter-ai 2.23.0 2.23.0
amazon-sagemaker-jupyter-ai-q-developer 1.0.9 1.0.9
${\color{red}jupyter-scheduler}$ 2.7.1 2.8.0
amazon-sagemaker-jupyter-scheduler 3.1.5 3.1.5
${\color{red}pandas}$ 2.1.4 2.2.2
amazon-sagemaker-sql-magic 0.1.3 0.1.3
${\color{red}jupyterlab-lsp}$ 5.0.3 5.1.0
amazon_sagemaker_sql_editor 0.1.11 0.1.11
${\color{red}scipy}$ 1.11.4 1.14.1
${\color{red}scikit-learn}$ 1.4.2 1.5.2
pip 23.3.2 23.3.2
${\color{red}torchvision}$ 0.15.2 0.19.0
autogluon 0.8.3 0.8.3
ipywidgets 8.1.5 8.1.5
${\color{red}notebook}$ 7.1.3 7.2.2
aws-glue-sessions 1.0.7 1.0.7
conda 23.11.0 23.11.0
${\color{red}fastapi}$ 0.110.3 0.114.2
${\color{red}jupyter-collaboration}$ 1.1.0 1.2.0
jupyter-dash 0.4.2 0.4.2
jupyter-server-proxy 4.4.0 4.4.0
jupyterlab-git 0.50.1 0.50.1
${\color{red}keras}$ 2.14.0 2.15.0
langchain-aws 0.1.18 0.1.18
matplotlib 3.9.2 3.9.2
nodejs 18.20.3 18.20.3
py-xgboost-gpu 1.7.6 1.7.6
thrift_sasl 0.4.3 0.4.3
pyhive 0.7.0 0.7.0
python-gssapi 1.8.3 1.8.3
python-lsp-server 1.12.0 1.12.0
${\color{red}pytorch-gpu}$ 2.0.0 2.4.0
${\color{red}sagemaker-code-editor}$ 1.1.0 1.3.2
sagemaker-headless-execution-driver 0.0.13 0.0.13
sagemaker-jupyterlab-emr-extension 0.3.3 0.3.3
sagemaker-jupyterlab-extension 0.3.2 0.3.2
sagemaker-kernel-wrapper 0.0.4 0.0.4
sagemaker-python-sdk 2.227.0 2.227.0
sagemaker-studio-analytics-extension 0.1.2 0.1.2
sasl 0.3.1 0.3.1
supervisor 4.2.5 4.2.5
${\color{red}tensorflow-gpu}$ 2.14.0 2.17.0
uvicorn 0.30.6 0.30.6

Staleness Report: 1.11.0(cpu)

Package Current Version in the Distribution image Latest Relevant Version in Upstream
numpy 1.26.4 1.26.4
jinja2 3.1.4 3.1.4
${\color{red}pytorch}$ 2.0.0 2.4.0
altair 5.4.1 5.4.1
${\color{red}boto3}$ 1.34.162 1.35.20
ipython 8.27.0 8.27.0
jupyter-lsp 2.2.5 2.2.5
${\color{red}jupyterlab}$ 4.1.6 4.2.5
amazon-q-developer-jupyterlab-ext 3.2.0 3.2.0
${\color{red}langchain}$ 0.2.5 0.3.0
jupyter-ai 2.23.0 2.23.0
amazon-sagemaker-jupyter-ai-q-developer 1.0.9 1.0.9
${\color{red}jupyter-scheduler}$ 2.7.1 2.8.0
amazon-sagemaker-jupyter-scheduler 3.1.5 3.1.5
${\color{red}pandas}$ 2.1.4 2.2.2
amazon-sagemaker-sql-magic 0.1.3 0.1.3
${\color{red}jupyterlab-lsp}$ 5.0.3 5.1.0
amazon_sagemaker_sql_editor 0.1.11 0.1.11
${\color{red}scipy}$ 1.11.4 1.14.1
${\color{red}scikit-learn}$ 1.4.2 1.5.2
pip 23.3.2 23.3.2
${\color{red}torchvision}$ 0.15.2 0.19.0
autogluon 0.8.3 0.8.3
ipywidgets 8.1.5 8.1.5
${\color{red}notebook}$ 7.1.3 7.2.2
aws-glue-sessions 1.0.7 1.0.7
conda 23.11.0 23.11.0
${\color{red}fastapi}$ 0.110.3 0.114.2
${\color{red}jupyter-collaboration}$ 1.1.0 1.2.0
jupyter-dash 0.4.2 0.4.2
jupyter-server-proxy 4.4.0 4.4.0
jupyterlab-git 0.50.1 0.50.1
keras 2.15.0 2.15.0
langchain-aws 0.1.18 0.1.18
matplotlib 3.9.2 3.9.2
nodejs 18.20.3 18.20.3
py-xgboost-cpu 1.7.6 1.7.6
thrift_sasl 0.4.3 0.4.3
pyhive 0.7.0 0.7.0
python-gssapi 1.8.3 1.8.3
python-lsp-server 1.12.0 1.12.0
${\color{red}sagemaker-code-editor}$ 1.1.0 1.3.2
sagemaker-headless-execution-driver 0.0.13 0.0.13
sagemaker-jupyterlab-emr-extension 0.3.3 0.3.3
sagemaker-jupyterlab-extension 0.3.2 0.3.2
sagemaker-kernel-wrapper 0.0.4 0.0.4
sagemaker-python-sdk 2.227.0 2.227.0
sagemaker-studio-analytics-extension 0.1.2 0.1.2
sasl 0.3.1 0.3.1
supervisor 4.2.5 4.2.5
${\color{red}tensorflow}$ 2.15.0 2.17.0
uvicorn 0.30.6 0.30.6

@sagemaker-distribution-bot
Copy link
Collaborator

Python Package Size Report (GPU)

Target Image Version: 1.11.0 | Base Image Version: 1.10.1

Python Packages Total Size Summary

Target Version Total Size Base Version Total Size Size Change (abs) Size Change (%)
3.47GB 3.47GB -20.83KB -0.0

Top-20 Largest Python Packages

Package Version in the Target Image Size
cudatoolkit 11.8.0 682.45MB
tensorflow-base 2.14.0 513.71MB
cudnn 8.9.7.29 443.90MB
pytorch 2.0.0 403.50MB
mkl 2022.2.1 201.46MB
libmagma 2.7.1 201.22MB
nccl 2.22.3.1 124.94MB
libxgboost 1.7.6 99.28MB
llvm-openmp 18.1.8 55.77MB
catboost 1.2.7 45.27MB
qt6-main 6.7.2 44.84MB
libgoogle-cloud 2.12.0 43.43MB
pillow 10.4.0 40.77MB
sagemaker-code-editor 1.1.0 39.16MB
libllvm18 18.1.8 36.46MB
libllvm14 14.0.6 30.03MB
libarrow 12.0.1 26.43MB
python 3.10.14 24.34MB
pandoc 3.4 20.03MB
libclang-cpp18.1 18.1.8 18.29MB

Python Package Size Delta

The total size of newly introduced Python packages is 96.40KB, accounts for 0.0% of the total package size.

Package Version in the Target Image Version in the Base Image Size Change (abs) Size Change (%)
narwhals 1.8.1 - 96.40KB -
statsmodels 0.14.3 0.14.2 30.96KB 0.29
altair 5.4.1 5.3.0 25.42KB 5.95
jupyter-ai 2.23.0 2.20.0 2.26KB 0.31
langsmith 0.1.121 0.1.120 875.00B 0.35
jupyter-server-proxy 4.4.0 4.3.0 833.00B 2.31
jupyter-ai-magics 2.23.0 2.20.0 818.00B 2.46
langchain-core 0.2.40 0.2.39 647.00B 0.25
idna 3.10 3.8 562.00B 1.14
langchain-text-splitters 0.2.4 0.2.2 183.00B 0.69
flake8 7.1.1 7.0.0 171.00B 0.15
python-lsp-server-base 1.12.0 1.11.0 92.00B 0.15
platformdirs 4.3.3 4.3.2 -45.00B -0.22
pycodestyle 2.12.1 2.11.1 -103.00B -0.3
python-lsp-server 1.12.0 1.11.0 -120.00B -1.67
fastcore 1.7.8 1.7.5 -121.00B -0.17
ipython 8.27.0 8.26.0 -401.00B -0.07
dash 2.18.1 2.18.0 -179.15KB -3.36

Python Package Size Report (CPU)

Target Image Version: 1.11.0 | Base Image Version: 1.10.1

Python Packages Total Size Summary

Target Version Total Size Base Version Total Size Size Change (abs) Size Change (%)
1.27GB 1.27GB -20.83KB -0.0

Top-20 Largest Python Packages

Package Version in the Target Image Size
mkl 2022.2.1 201.46MB
tensorflow-base 2.15.0 136.50MB
pytorch 2.0.0 66.99MB
llvm-openmp 18.1.8 55.77MB
catboost 1.2.7 45.27MB
qt6-main 6.7.2 44.84MB
libgoogle-cloud 2.12.0 41.48MB
pillow 10.4.0 40.77MB
sagemaker-code-editor 1.1.0 39.16MB
libllvm18 18.1.8 36.46MB
libllvm15 15.0.7 31.78MB
libllvm14 14.0.6 30.03MB
python 3.10.14 24.34MB
libarrow 15.0.0 21.99MB
pandoc 3.4 20.03MB
libclang-cpp18.1 18.1.8 18.29MB
amazon_sagemaker_sql_editor 0.1.11 17.26MB
nodejs 18.20.3 14.82MB
scipy 1.11.4 14.55MB
pandas 2.1.4 11.84MB

Python Package Size Delta

The total size of newly introduced Python packages is 96.40KB, accounts for 0.01% of the total package size.

Package Version in the Target Image Version in the Base Image Size Change (abs) Size Change (%)
narwhals 1.8.1 - 96.40KB -
statsmodels 0.14.3 0.14.2 30.96KB 0.29
altair 5.4.1 5.3.0 25.42KB 5.95
jupyter-ai 2.23.0 2.20.0 2.26KB 0.31
langsmith 0.1.121 0.1.120 875.00B 0.35
jupyter-server-proxy 4.4.0 4.3.0 833.00B 2.31
jupyter-ai-magics 2.23.0 2.20.0 818.00B 2.46
langchain-core 0.2.40 0.2.39 647.00B 0.25
idna 3.10 3.8 562.00B 1.14
langchain-text-splitters 0.2.4 0.2.2 183.00B 0.69
flake8 7.1.1 7.0.0 171.00B 0.15
python-lsp-server-base 1.12.0 1.11.0 92.00B 0.15
platformdirs 4.3.3 4.3.2 -45.00B -0.22
pycodestyle 2.12.1 2.11.1 -103.00B -0.3
python-lsp-server 1.12.0 1.11.0 -120.00B -1.67
fastcore 1.7.8 1.7.5 -121.00B -0.17
ipython 8.27.0 8.26.0 -401.00B -0.07
dash 2.18.1 2.18.0 -179.15KB -3.36

@sagemaker-distribution-bot
Copy link
Collaborator

AWS CodeBuild CI Report

  • CodeBuild project: CosmosImageBuildersagemaker-U5omrjiHQCoa
  • Commit ID: a4b5fef
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@TRNWWZ
Copy link
Contributor

TRNWWZ commented Sep 18, 2024

FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[keras.test.Dockerfile-required_packages0]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[scipy.test.Dockerfile-required_packages5]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[autogluon.test.Dockerfile-required_packages1]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[sagemaker-studio-analytics-extension.test.Dockerfile-required_packages21]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[gpu-dependencies.test.Dockerfile-required_packages31]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[pandas.test.Dockerfile-required_packages8]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[sm-python-sdk.test.Dockerfile-required_packages9]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[pytorch.examples.Dockerfile-required_packages10]

(Rerun locally)

  • keras - Single test fails with AttributeError: 'CustomLayer' object has no attribute '_build_input_shape'. Issue with test, not installation
  • scipy - Fix Scipy tests for GPU based docker images #30
  • pandas - single test faied with E matplotlib._api.deprecation.MatplotlibDeprecationWarning: The plot_date function was deprecated in Matplotlib 3.9 and will be removed in 3.11. Use plot instead. - should be warning, test is using deprecated function
  • sagemaker-studio-analytics-extension - test passed locally, see NoCredentialsError: Unable to locate credentials in CodeBuild execution.
  • gpu-dependencies - Unit tests were executed in CPU environment so it failed, test pass when execute test script in container running on GPU instance
  • sm-python-sdk - sm-python-sdk test failures #316
  • pytorch - passed when running tests in local container directly, failure was caused by dependencies conflict when installing some , but not impacting functionality.
  • autogluon - Memory leak issue in Multi-model unite test.

@TRNWWZ TRNWWZ merged commit 1c47651 into main Sep 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants