Profiling ttnn operations
See the documentation on profiling !
[8]:
%%bash
cd $TT_METAL_HOME
unset SILENT
make nuke
build_metal.sh --enable-profiler
make[1]: warning: jobserver unavailable: using -j1. Add '+' to parent make rule.
Removed all profiler artifacts
make[1]: warning: jobserver unavailable: using -j1. Add '+' to parent make rule.
make[1]: warning: jobserver unavailable: using -j1. Add '+' to parent make rule.
Writing to /home/ubuntu/.config/pip/pip.conf
Installing python env build backend requirements...
Looking in indexes: https://pypi.org/simple, https://download.pytorch.org/whl/cpu
Requirement already satisfied: setuptools in ./build/python_env/lib/python3.8/site-packages (44.0.0)
Collecting wheel
Using cached wheel-0.42.0-py3-none-any.whl (65 kB)
Installing collected packages: wheel
Successfully installed wheel-0.42.0
Installing editable dev version of tt_eager packages...
Looking in indexes: https://pypi.org/simple, https://download.pytorch.org/whl/cpu
Obtaining file:///home/ubuntu/git/tt-metal
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Collecting click==8.1.3
Using cached click-8.1.3-py3-none-any.whl (96 kB)
Collecting loguru==0.6.0
Using cached loguru-0.6.0-py3-none-any.whl (58 kB)
Collecting ipywidgets==8.1.1
Using cached ipywidgets-8.1.1-py3-none-any.whl (139 kB)
Processing /home/ubuntu/.cache/pip/wheels/13/90/db/290ab3a34f2ef0b5a0f89235dc2d40fea83e77de84ed2dc05c/PyYAML-5.3.1-cp38-cp38-linux_x86_64.whl
Collecting jupyterlab==4.0.7
Using cached jupyterlab-4.0.7-py3-none-any.whl (9.2 MB)
Collecting pyelftools==0.29
Using cached pyelftools-0.29-py2.py3-none-any.whl (174 kB)
Processing /home/ubuntu/.cache/pip/wheels/45/4f/ed/863cf4386fe6db3c09333712009ec1c5146a36f3904b469d13/curtsies-0.4.1-py3-none-any.whl
Processing /home/ubuntu/.cache/pip/wheels/91/b7/13/0c117d73912c6c2beb1eb0d7d6884f4e79e6e5b5e91eeb34f5/torchtrail-0.0.8-py3-none-any.whl
Collecting numpy==1.20.3
Using cached numpy-1.20.3-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (15.4 MB)
Collecting matplotlib==3.7.1
Using cached matplotlib-3.7.1-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (9.2 MB)
Collecting toolz==0.12.0
Using cached toolz-0.12.0-py3-none-any.whl (55 kB)
Collecting Pillow==9.5.0
Using cached Pillow-9.5.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.3 MB)
Collecting pandas==1.5.3
Using cached pandas-1.5.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (12.2 MB)
Collecting torch==1.13.1+cpu
Using cached https://download.pytorch.org/whl/cpu/torch-1.13.1%2Bcpu-cp38-cp38-linux_x86_64.whl (199.1 MB)
Collecting dash==2.8.1
Using cached dash-2.8.1-py3-none-any.whl (9.9 MB)
Collecting rich==13.3.3
Using cached rich-13.3.3-py3-none-any.whl (238 kB)
Collecting seaborn==0.12.2
Using cached seaborn-0.12.2-py3-none-any.whl (293 kB)
Collecting plotly==5.13.0
Using cached plotly-5.13.0-py2.py3-none-any.whl (15.2 MB)
Collecting traitlets>=4.3.1
Using cached traitlets-5.14.1-py3-none-any.whl (85 kB)
Collecting widgetsnbextension~=4.0.9
Using cached widgetsnbextension-4.0.10-py3-none-any.whl (2.3 MB)
Collecting ipython>=6.1.0
Using cached ipython-8.12.3-py3-none-any.whl (798 kB)
Collecting jupyterlab-widgets~=3.0.9
Using cached jupyterlab_widgets-3.0.10-py3-none-any.whl (215 kB)
Collecting comm>=0.1.3
Using cached comm-0.2.1-py3-none-any.whl (7.2 kB)
Collecting async-lru>=1.0.0
Using cached async_lru-2.0.4-py3-none-any.whl (6.1 kB)
Collecting tomli; python_version < "3.11"
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting jupyter-server<3,>=2.4.0
Using cached jupyter_server-2.12.5-py3-none-any.whl (380 kB)
Collecting jinja2>=3.0.3
Using cached Jinja2-3.1.3-py3-none-any.whl (133 kB)
Collecting ipykernel
Using cached ipykernel-6.29.2-py3-none-any.whl (116 kB)
Collecting notebook-shim>=0.2
Using cached notebook_shim-0.2.3-py3-none-any.whl (13 kB)
Collecting jupyterlab-server<3,>=2.19.0
Using cached jupyterlab_server-2.25.2-py3-none-any.whl (58 kB)
Collecting jupyter-lsp>=2.0.0
Using cached jupyter_lsp-2.2.2-py3-none-any.whl (68 kB)
Collecting packaging
Using cached packaging-23.2-py3-none-any.whl (53 kB)
Collecting importlib-resources>=1.4; python_version < "3.9"
Using cached importlib_resources-6.1.1-py3-none-any.whl (33 kB)
Collecting importlib-metadata>=4.8.3; python_version < "3.10"
Using cached importlib_metadata-7.0.1-py3-none-any.whl (23 kB)
Collecting jupyter-core
Using cached jupyter_core-5.7.1-py3-none-any.whl (28 kB)
Collecting tornado>=6.2.0
Using cached tornado-6.4-cp38-abi3-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (435 kB)
Collecting blessed>=1.5
Using cached blessed-1.20.0-py2.py3-none-any.whl (58 kB)
Collecting cwcwidth
Using cached cwcwidth-0.1.9-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (92 kB)
Collecting pyrsistent==0.20.0
Using cached pyrsistent-0.20.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (121 kB)
Collecting graphviz==0.20.1
Using cached graphviz-0.20.1-py3-none-any.whl (47 kB)
Collecting networkx==3.1
Using cached networkx-3.1-py3-none-any.whl (2.1 MB)
Collecting pyparsing>=2.3.1
Using cached pyparsing-3.1.1-py3-none-any.whl (103 kB)
Collecting kiwisolver>=1.0.1
Using cached kiwisolver-1.4.5-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.2 MB)
Collecting contourpy>=1.0.1
Using cached contourpy-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (301 kB)
Collecting fonttools>=4.22.0
Using cached fonttools-4.48.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)
Collecting python-dateutil>=2.7
Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
Collecting cycler>=0.10
Using cached cycler-0.12.1-py3-none-any.whl (8.3 kB)
Collecting pytz>=2020.1
Using cached pytz-2024.1-py2.py3-none-any.whl (505 kB)
Collecting typing-extensions
Using cached typing_extensions-4.9.0-py3-none-any.whl (32 kB)
Collecting dash-html-components==2.0.0
Using cached dash_html_components-2.0.0-py3-none-any.whl (4.1 kB)
Collecting dash-table==5.0.0
Using cached dash_table-5.0.0-py3-none-any.whl (3.9 kB)
Collecting Flask>=1.0.4
Using cached flask-3.0.2-py3-none-any.whl (101 kB)
Collecting dash-core-components==2.0.0
Using cached dash_core_components-2.0.0-py3-none-any.whl (3.8 kB)
Collecting pygments<3.0.0,>=2.13.0
Using cached pygments-2.17.2-py3-none-any.whl (1.2 MB)
Collecting markdown-it-py<3.0.0,>=2.2.0
Using cached markdown_it_py-2.2.0-py3-none-any.whl (84 kB)
Collecting tenacity>=6.2.0
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Collecting pickleshare
Using cached pickleshare-0.7.5-py2.py3-none-any.whl (6.9 kB)
Collecting prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30
Using cached prompt_toolkit-3.0.43-py3-none-any.whl (386 kB)
Collecting stack-data
Using cached stack_data-0.6.3-py3-none-any.whl (24 kB)
Collecting decorator
Using cached decorator-5.1.1-py3-none-any.whl (9.1 kB)
Collecting backcall
Using cached backcall-0.2.0-py2.py3-none-any.whl (11 kB)
Collecting jedi>=0.16
Using cached jedi-0.19.1-py2.py3-none-any.whl (1.6 MB)
Collecting pexpect>4.3; sys_platform != "win32"
Using cached pexpect-4.9.0-py2.py3-none-any.whl (63 kB)
Collecting matplotlib-inline
Using cached matplotlib_inline-0.1.6-py3-none-any.whl (9.4 kB)
Collecting send2trash>=1.8.2
Using cached Send2Trash-1.8.2-py3-none-any.whl (18 kB)
Collecting anyio>=3.1.0
Using cached anyio-4.2.0-py3-none-any.whl (85 kB)
Collecting jupyter-server-terminals
Using cached jupyter_server_terminals-0.5.2-py3-none-any.whl (13 kB)
Collecting jupyter-client>=7.4.4
Using cached jupyter_client-8.6.0-py3-none-any.whl (105 kB)
Collecting nbformat>=5.3.0
Using cached nbformat-5.9.2-py3-none-any.whl (77 kB)
Collecting overrides
Using cached overrides-7.7.0-py3-none-any.whl (17 kB)
Collecting nbconvert>=6.4.4
Using cached nbconvert-7.16.0-py3-none-any.whl (257 kB)
Collecting jupyter-events>=0.9.0
Using cached jupyter_events-0.9.0-py3-none-any.whl (18 kB)
Collecting websocket-client
Using cached websocket_client-1.7.0-py3-none-any.whl (58 kB)
Collecting pyzmq>=24
Using cached pyzmq-25.1.2-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.1 MB)
Collecting prometheus-client
Using cached prometheus_client-0.19.0-py3-none-any.whl (54 kB)
Collecting argon2-cffi
Using cached argon2_cffi-23.1.0-py3-none-any.whl (15 kB)
Collecting terminado>=0.8.3
Using cached terminado-0.18.0-py3-none-any.whl (14 kB)
Collecting MarkupSafe>=2.0
Using cached MarkupSafe-2.1.5-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (26 kB)
Collecting nest-asyncio
Using cached nest_asyncio-1.6.0-py3-none-any.whl (5.2 kB)
Collecting psutil
Using cached psutil-5.9.8-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (288 kB)
Collecting debugpy>=1.6.5
Using cached debugpy-1.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.1 MB)
Collecting babel>=2.10
Using cached Babel-2.14.0-py3-none-any.whl (11.0 MB)
Collecting requests>=2.31
Using cached requests-2.31.0-py3-none-any.whl (62 kB)
Collecting jsonschema>=4.18.0
Using cached jsonschema-4.21.1-py3-none-any.whl (85 kB)
Collecting json5>=0.9.0
Using cached json5-0.9.14-py2.py3-none-any.whl (19 kB)
Collecting zipp>=3.1.0; python_version < "3.10"
Using cached zipp-3.17.0-py3-none-any.whl (7.4 kB)
Collecting platformdirs>=2.5
Using cached platformdirs-4.2.0-py3-none-any.whl (17 kB)
Collecting six>=1.9.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting wcwidth>=0.1.4
Using cached wcwidth-0.2.13-py2.py3-none-any.whl (34 kB)
Collecting itsdangerous>=2.1.2
Using cached itsdangerous-2.1.2-py3-none-any.whl (15 kB)
Collecting blinker>=1.6.2
Using cached blinker-1.7.0-py3-none-any.whl (13 kB)
Collecting Werkzeug>=3.0.0
Using cached werkzeug-3.0.1-py3-none-any.whl (226 kB)
Collecting mdurl~=0.1
Using cached mdurl-0.1.2-py3-none-any.whl (10.0 kB)
Collecting pure-eval
Using cached pure_eval-0.2.2-py3-none-any.whl (11 kB)
Collecting asttokens>=2.1.0
Using cached asttokens-2.4.1-py2.py3-none-any.whl (27 kB)
Collecting executing>=1.2.0
Using cached executing-2.0.1-py2.py3-none-any.whl (24 kB)
Collecting parso<0.9.0,>=0.8.3
Using cached parso-0.8.3-py2.py3-none-any.whl (100 kB)
Collecting ptyprocess>=0.5
Using cached ptyprocess-0.7.0-py2.py3-none-any.whl (13 kB)
Collecting exceptiongroup>=1.0.2; python_version < "3.11"
Using cached exceptiongroup-1.2.0-py3-none-any.whl (16 kB)
Collecting idna>=2.8
Using cached idna-3.6-py3-none-any.whl (61 kB)
Collecting sniffio>=1.1
Using cached sniffio-1.3.0-py3-none-any.whl (10 kB)
Collecting fastjsonschema
Using cached fastjsonschema-2.19.1-py3-none-any.whl (23 kB)
Collecting defusedxml
Using cached defusedxml-0.7.1-py2.py3-none-any.whl (25 kB)
Collecting beautifulsoup4
Using cached beautifulsoup4-4.12.3-py3-none-any.whl (147 kB)
Collecting jupyterlab-pygments
Using cached jupyterlab_pygments-0.3.0-py3-none-any.whl (15 kB)
Collecting pandocfilters>=1.4.1
Using cached pandocfilters-1.5.1-py2.py3-none-any.whl (8.7 kB)
Collecting mistune<4,>=2.0.3
Using cached mistune-3.0.2-py3-none-any.whl (47 kB)
Collecting tinycss2
Using cached tinycss2-1.2.1-py3-none-any.whl (21 kB)
Collecting bleach!=5.0.0
Using cached bleach-6.1.0-py3-none-any.whl (162 kB)
Collecting nbclient>=0.5.0
Using cached nbclient-0.9.0-py3-none-any.whl (24 kB)
Collecting rfc3986-validator>=0.1.1
Using cached rfc3986_validator-0.1.1-py2.py3-none-any.whl (4.2 kB)
Collecting python-json-logger>=2.0.4
Using cached python_json_logger-2.0.7-py3-none-any.whl (8.1 kB)
Collecting referencing
Using cached referencing-0.33.0-py3-none-any.whl (26 kB)
Collecting rfc3339-validator
Using cached rfc3339_validator-0.1.4-py2.py3-none-any.whl (3.5 kB)
Collecting argon2-cffi-bindings
Using cached argon2_cffi_bindings-21.2.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (86 kB)
Collecting urllib3<3,>=1.21.1
Using cached urllib3-2.2.0-py3-none-any.whl (120 kB)
Collecting charset-normalizer<4,>=2
Using cached charset_normalizer-3.3.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (141 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2024.2.2-py3-none-any.whl (163 kB)
Collecting jsonschema-specifications>=2023.03.6
Using cached jsonschema_specifications-2023.12.1-py3-none-any.whl (18 kB)
Collecting pkgutil-resolve-name>=1.3.10; python_version < "3.9"
Using cached pkgutil_resolve_name-1.3.10-py3-none-any.whl (4.7 kB)
Collecting attrs>=22.2.0
Using cached attrs-23.2.0-py3-none-any.whl (60 kB)
Collecting rpds-py>=0.7.1
Using cached rpds_py-0.17.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB)
Collecting soupsieve>1.2
Using cached soupsieve-2.5-py3-none-any.whl (36 kB)
Collecting webencodings>=0.4
Using cached webencodings-0.5.1-py2.py3-none-any.whl (11 kB)
Collecting cffi>=1.0.1
Using cached cffi-1.16.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (444 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Installing collected packages: click, loguru, traitlets, widgetsnbextension, pygments, pickleshare, wcwidth, prompt-toolkit, pure-eval, six, asttokens, executing, stack-data, typing-extensions, decorator, backcall, parso, jedi, ptyprocess, pexpect, matplotlib-inline, ipython, jupyterlab-widgets, comm, ipywidgets, pyyaml, async-lru, tomli, send2trash, exceptiongroup, idna, sniffio, anyio, tornado, terminado, jupyter-server-terminals, pyzmq, platformdirs, jupyter-core, zipp, importlib-metadata, python-dateutil, jupyter-client, fastjsonschema, importlib-resources, rpds-py, attrs, referencing, jsonschema-specifications, pkgutil-resolve-name, jsonschema, nbformat, overrides, packaging, defusedxml, soupsieve, beautifulsoup4, jupyterlab-pygments, pandocfilters, mistune, webencodings, tinycss2, MarkupSafe, bleach, jinja2, nbclient, nbconvert, rfc3986-validator, python-json-logger, rfc3339-validator, jupyter-events, websocket-client, prometheus-client, pycparser, cffi, argon2-cffi-bindings, argon2-cffi, jupyter-server, nest-asyncio, psutil, debugpy, ipykernel, notebook-shim, pytz, babel, urllib3, charset-normalizer, certifi, requests, json5, jupyterlab-server, jupyter-lsp, jupyterlab, pyelftools, blessed, cwcwidth, curtsies, pyrsistent, graphviz, networkx, torch, torchtrail, numpy, pyparsing, kiwisolver, contourpy, fonttools, cycler, Pillow, matplotlib, toolz, pandas, dash-html-components, tenacity, plotly, dash-table, itsdangerous, blinker, Werkzeug, Flask, dash-core-components, dash, mdurl, markdown-it-py, rich, seaborn, metal-libs
Running setup.py develop for metal-libs
Successfully installed Flask-3.0.2 MarkupSafe-2.1.5 Pillow-9.5.0 Werkzeug-3.0.1 anyio-4.2.0 argon2-cffi-23.1.0 argon2-cffi-bindings-21.2.0 asttokens-2.4.1 async-lru-2.0.4 attrs-23.2.0 babel-2.14.0 backcall-0.2.0 beautifulsoup4-4.12.3 bleach-6.1.0 blessed-1.20.0 blinker-1.7.0 certifi-2024.2.2 cffi-1.16.0 charset-normalizer-3.3.2 click-8.1.3 comm-0.2.1 contourpy-1.1.1 curtsies-0.4.1 cwcwidth-0.1.9 cycler-0.12.1 dash-2.8.1 dash-core-components-2.0.0 dash-html-components-2.0.0 dash-table-5.0.0 debugpy-1.8.1 decorator-5.1.1 defusedxml-0.7.1 exceptiongroup-1.2.0 executing-2.0.1 fastjsonschema-2.19.1 fonttools-4.48.1 graphviz-0.20.1 idna-3.6 importlib-metadata-7.0.1 importlib-resources-6.1.1 ipykernel-6.29.2 ipython-8.12.3 ipywidgets-8.1.1 itsdangerous-2.1.2 jedi-0.19.1 jinja2-3.1.3 json5-0.9.14 jsonschema-4.21.1 jsonschema-specifications-2023.12.1 jupyter-client-8.6.0 jupyter-core-5.7.1 jupyter-events-0.9.0 jupyter-lsp-2.2.2 jupyter-server-2.12.5 jupyter-server-terminals-0.5.2 jupyterlab-4.0.7 jupyterlab-pygments-0.3.0 jupyterlab-server-2.25.2 jupyterlab-widgets-3.0.10 kiwisolver-1.4.5 loguru-0.6.0 markdown-it-py-2.2.0 matplotlib-3.7.1 matplotlib-inline-0.1.6 mdurl-0.1.2 metal-libs mistune-3.0.2 nbclient-0.9.0 nbconvert-7.16.0 nbformat-5.9.2 nest-asyncio-1.6.0 networkx-3.1 notebook-shim-0.2.3 numpy-1.20.3 overrides-7.7.0 packaging-23.2 pandas-1.5.3 pandocfilters-1.5.1 parso-0.8.3 pexpect-4.9.0 pickleshare-0.7.5 pkgutil-resolve-name-1.3.10 platformdirs-4.2.0 plotly-5.13.0 prometheus-client-0.19.0 prompt-toolkit-3.0.43 psutil-5.9.8 ptyprocess-0.7.0 pure-eval-0.2.2 pycparser-2.21 pyelftools-0.29 pygments-2.17.2 pyparsing-3.1.1 pyrsistent-0.20.0 python-dateutil-2.8.2 python-json-logger-2.0.7 pytz-2024.1 pyyaml-5.3.1 pyzmq-25.1.2 referencing-0.33.0 requests-2.31.0 rfc3339-validator-0.1.4 rfc3986-validator-0.1.1 rich-13.3.3 rpds-py-0.17.1 seaborn-0.12.2 send2trash-1.8.2 six-1.16.0 sniffio-1.3.0 soupsieve-2.5 stack-data-0.6.3 tenacity-8.2.3 terminado-0.18.0 tinycss2-1.2.1 tomli-2.0.1 toolz-0.12.0 torch-1.13.1+cpu torchtrail-0.0.8 tornado-6.4 traitlets-5.14.1 typing-extensions-4.9.0 urllib3-2.2.0 wcwidth-0.2.13 webencodings-0.5.1 websocket-client-1.7.0 widgetsnbextension-4.0.10 zipp-3.17.0
Installing dev environment packages...
Looking in indexes: https://pypi.org/simple, https://download.pytorch.org/whl/cpu
Collecting platformdirs<4.0.0
Using cached platformdirs-3.11.0-py3-none-any.whl (17 kB)
Collecting pre-commit==3.0.4
Using cached pre_commit-3.0.4-py2.py3-none-any.whl (202 kB)
Collecting black==23.10.1
Using cached black-23.10.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Collecting build==0.10.0
Using cached build-0.10.0-py3-none-any.whl (17 kB)
Collecting twine==4.0.2
Using cached twine-4.0.2-py3-none-any.whl (36 kB)
Collecting yamllint==1.32.0
Using cached yamllint-1.32.0-py3-none-any.whl (65 kB)
Collecting docutils==0.18.1
Using cached docutils-0.18.1-py2.py3-none-any.whl (570 kB)
Collecting sphinx==7.1.2
Using cached sphinx-7.1.2-py3-none-any.whl (3.2 MB)
Collecting sphinx-rtd-theme==1.3.0
Using cached sphinx_rtd_theme-1.3.0-py2.py3-none-any.whl (2.8 MB)
Collecting sphinxcontrib-email==0.3.5
Using cached sphinxcontrib_email-0.3.5-py3-none-any.whl (6.3 kB)
Collecting lxml==4.9.4
Using cached lxml-4.9.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (7.1 MB)
Collecting breathe==4.35.0
Using cached breathe-4.35.0-py3-none-any.whl (92 kB)
Collecting nbsphinx==0.9.3
Using cached nbsphinx-0.9.3-py3-none-any.whl (31 kB)
Collecting sphinxcontrib-jquery==4.1
Using cached sphinxcontrib_jquery-4.1-py2.py3-none-any.whl (121 kB)
Requirement already satisfied: ipython==8.12.3 in ./build/python_env/lib/python3.8/site-packages (from -r tt_metal/python_env/../../docs/requirements-docs.txt (line 9)) (8.12.3)
Processing /home/ubuntu/.cache/pip/wheels/90/3a/a8/3237a93e3a6261bd24edabf3277ca59f64c1710b3d8c7c72a0/pandoc-2.3-py3-none-any.whl
Collecting pytest==7.2.2
Using cached pytest-7.2.2-py3-none-any.whl (317 kB)
Collecting pytest-timeout==2.2.0
Using cached pytest_timeout-2.2.0-py3-none-any.whl (13 kB)
Processing /home/ubuntu/.cache/pip/wheels/6c/40/1d/5706d21e6b4dff52e7af12bff9ca126a3f15beb4dff386aa29/jsbeautifier-1.14.7-py3-none-any.whl
Collecting datasets==2.9.0
Using cached datasets-2.9.0-py3-none-any.whl (462 kB)
Collecting torchvision==0.14.1+cpu
Using cached https://download.pytorch.org/whl/cpu/torchvision-0.14.1%2Bcpu-cp38-cp38-linux_x86_64.whl (16.8 MB)
Collecting transformers==4.28.1
Using cached transformers-4.28.1-py3-none-any.whl (7.0 MB)
Collecting xlsxwriter==3.0.8
Using cached XlsxWriter-3.0.8-py3-none-any.whl (152 kB)
Collecting tiktoken==0.3.3
Using cached tiktoken-0.3.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.7 MB)
Collecting tqdm==4.65.0
Using cached tqdm-4.65.0-py3-none-any.whl (77 kB)
Collecting sentencepiece==0.1.97
Using cached sentencepiece-0.1.97-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB)
Collecting numba==0.56.4
Using cached numba-0.56.4-cp38-cp38-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (3.5 MB)
Collecting librosa==0.10.0
Using cached librosa-0.10.0-py3-none-any.whl (252 kB)
Collecting timm==0.6.13
Using cached timm-0.6.13-py3-none-any.whl (549 kB)
Collecting opencv-python-headless==4.8.0.74
Using cached opencv_python_headless-4.8.0.74-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (49.1 MB)
Collecting diffusers==0.12.1
Using cached diffusers-0.12.1-py3-none-any.whl (604 kB)
Collecting accelerate==0.19.0
Using cached accelerate-0.19.0-py3-none-any.whl (219 kB)
Collecting ftfy==6.1.1
Using cached ftfy-6.1.1-py3-none-any.whl (53 kB)
Collecting gitpython==3.1.32
Using cached GitPython-3.1.32-py3-none-any.whl (188 kB)
Collecting einops==0.6.1
Using cached einops-0.6.1-py3-none-any.whl (42 kB)
Collecting multiprocess==0.70.14
Using cached multiprocess-0.70.14-py38-none-any.whl (132 kB)
Collecting evaluate==0.4.0
Using cached evaluate-0.4.0-py3-none-any.whl (81 kB)
Collecting bert-score==0.3.12
Using cached bert_score-0.3.12-py3-none-any.whl (60 kB)
Collecting fsspec==2023.9.2
Using cached fsspec-2023.9.2-py3-none-any.whl (173 kB)
Collecting nodeenv>=0.11.1
Using cached nodeenv-1.8.0-py2.py3-none-any.whl (22 kB)
Collecting cfgv>=2.0.0
Using cached cfgv-3.4.0-py2.py3-none-any.whl (7.2 kB)
Collecting identify>=1.0.0
Using cached identify-2.5.33-py2.py3-none-any.whl (98 kB)
Collecting virtualenv>=20.10.0
Using cached virtualenv-20.25.0-py3-none-any.whl (3.8 MB)
Requirement already satisfied: pyyaml>=5.1 in ./build/python_env/lib/python3.8/site-packages (from pre-commit==3.0.4->-r tt_metal/python_env/requirements-dev.txt (line 9)) (5.3.1)
Requirement already satisfied: packaging>=22.0 in ./build/python_env/lib/python3.8/site-packages (from black==23.10.1->-r tt_metal/python_env/requirements-dev.txt (line 10)) (23.2)
Collecting pathspec>=0.9.0
Using cached pathspec-0.12.1-py3-none-any.whl (31 kB)
Requirement already satisfied: click>=8.0.0 in ./build/python_env/lib/python3.8/site-packages (from black==23.10.1->-r tt_metal/python_env/requirements-dev.txt (line 10)) (8.1.3)
Requirement already satisfied: typing-extensions>=4.0.1; python_version < "3.11" in ./build/python_env/lib/python3.8/site-packages (from black==23.10.1->-r tt_metal/python_env/requirements-dev.txt (line 10)) (4.9.0)
Requirement already satisfied: tomli>=1.1.0; python_version < "3.11" in ./build/python_env/lib/python3.8/site-packages (from black==23.10.1->-r tt_metal/python_env/requirements-dev.txt (line 10)) (2.0.1)
Collecting mypy-extensions>=0.4.3
Using cached mypy_extensions-1.0.0-py3-none-any.whl (4.7 kB)
Collecting pyproject_hooks
Using cached pyproject_hooks-1.0.0-py3-none-any.whl (9.3 kB)
Collecting readme-renderer>=35.0
Using cached readme_renderer-42.0-py3-none-any.whl (13 kB)
Requirement already satisfied: rich>=12.0.0 in ./build/python_env/lib/python3.8/site-packages (from twine==4.0.2->-r tt_metal/python_env/requirements-dev.txt (line 12)) (13.3.3)
Requirement already satisfied: requests>=2.20 in ./build/python_env/lib/python3.8/site-packages (from twine==4.0.2->-r tt_metal/python_env/requirements-dev.txt (line 12)) (2.31.0)
Requirement already satisfied: importlib-metadata>=3.6 in ./build/python_env/lib/python3.8/site-packages (from twine==4.0.2->-r tt_metal/python_env/requirements-dev.txt (line 12)) (7.0.1)
Collecting pkginfo>=1.8.1
Using cached pkginfo-1.9.6-py3-none-any.whl (30 kB)
Collecting requests-toolbelt!=0.9.0,>=0.8.0
Using cached requests_toolbelt-1.0.0-py2.py3-none-any.whl (54 kB)
Requirement already satisfied: urllib3>=1.26.0 in ./build/python_env/lib/python3.8/site-packages (from twine==4.0.2->-r tt_metal/python_env/requirements-dev.txt (line 12)) (2.2.0)
Collecting keyring>=15.1
Using cached keyring-24.3.0-py3-none-any.whl (38 kB)
Collecting rfc3986>=1.4.0
Using cached rfc3986-2.0.0-py2.py3-none-any.whl (31 kB)
Collecting imagesize>=1.3
Using cached imagesize-1.4.1-py2.py3-none-any.whl (8.8 kB)
Collecting sphinxcontrib-serializinghtml>=1.1.5
Using cached sphinxcontrib_serializinghtml-1.1.5-py2.py3-none-any.whl (94 kB)
Collecting sphinxcontrib-jsmath
Using cached sphinxcontrib_jsmath-1.0.1-py2.py3-none-any.whl (5.1 kB)
Collecting snowballstemmer>=2.0
Using cached snowballstemmer-2.2.0-py2.py3-none-any.whl (93 kB)
Requirement already satisfied: babel>=2.9 in ./build/python_env/lib/python3.8/site-packages (from sphinx==7.1.2->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 2)) (2.14.0)
Collecting sphinxcontrib-htmlhelp>=2.0.0
Using cached sphinxcontrib_htmlhelp-2.0.1-py3-none-any.whl (99 kB)
Requirement already satisfied: Pygments>=2.13 in ./build/python_env/lib/python3.8/site-packages (from sphinx==7.1.2->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 2)) (2.17.2)
Collecting alabaster<0.8,>=0.7
Using cached alabaster-0.7.13-py3-none-any.whl (13 kB)
Collecting sphinxcontrib-applehelp
Using cached sphinxcontrib_applehelp-1.0.4-py3-none-any.whl (120 kB)
Requirement already satisfied: Jinja2>=3.0 in ./build/python_env/lib/python3.8/site-packages (from sphinx==7.1.2->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 2)) (3.1.3)
Collecting sphinxcontrib-devhelp
Using cached sphinxcontrib_devhelp-1.0.2-py2.py3-none-any.whl (84 kB)
Collecting sphinxcontrib-qthelp
Using cached sphinxcontrib_qthelp-1.0.3-py2.py3-none-any.whl (90 kB)
Requirement already satisfied: traitlets>=5 in ./build/python_env/lib/python3.8/site-packages (from nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (5.14.1)
Requirement already satisfied: nbconvert!=5.4 in ./build/python_env/lib/python3.8/site-packages (from nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (7.16.0)
Requirement already satisfied: nbformat in ./build/python_env/lib/python3.8/site-packages (from nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (5.9.2)
Requirement already satisfied: backcall in ./build/python_env/lib/python3.8/site-packages (from ipython==8.12.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 9)) (0.2.0)
Requirement already satisfied: prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30 in ./build/python_env/lib/python3.8/site-packages (from ipython==8.12.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 9)) (3.0.43)
Requirement already satisfied: pickleshare in ./build/python_env/lib/python3.8/site-packages (from ipython==8.12.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 9)) (0.7.5)
Requirement already satisfied: jedi>=0.16 in ./build/python_env/lib/python3.8/site-packages (from ipython==8.12.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 9)) (0.19.1)
Requirement already satisfied: decorator in ./build/python_env/lib/python3.8/site-packages (from ipython==8.12.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 9)) (5.1.1)
Requirement already satisfied: stack-data in ./build/python_env/lib/python3.8/site-packages (from ipython==8.12.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 9)) (0.6.3)
Requirement already satisfied: pexpect>4.3; sys_platform != "win32" in ./build/python_env/lib/python3.8/site-packages (from ipython==8.12.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 9)) (4.9.0)
Requirement already satisfied: matplotlib-inline in ./build/python_env/lib/python3.8/site-packages (from ipython==8.12.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 9)) (0.1.6)
Collecting ply
Using cached ply-3.11-py2.py3-none-any.whl (49 kB)
Collecting plumbum
Using cached plumbum-1.8.2-py3-none-any.whl (127 kB)
Collecting iniconfig
Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Requirement already satisfied: attrs>=19.2.0 in ./build/python_env/lib/python3.8/site-packages (from pytest==7.2.2->-r tt_metal/python_env/requirements-dev.txt (line 19)) (23.2.0)
Collecting pluggy<2.0,>=0.12
Using cached pluggy-1.4.0-py3-none-any.whl (20 kB)
Requirement already satisfied: exceptiongroup>=1.0.0rc8; python_version < "3.11" in ./build/python_env/lib/python3.8/site-packages (from pytest==7.2.2->-r tt_metal/python_env/requirements-dev.txt (line 19)) (1.2.0)
Collecting editorconfig>=0.12.2
Using cached EditorConfig-0.12.3-py3-none-any.whl (16 kB)
Requirement already satisfied: six>=1.13.0 in ./build/python_env/lib/python3.8/site-packages (from jsbeautifier==1.14.7->-r tt_metal/python_env/requirements-dev.txt (line 21)) (1.16.0)
Collecting responses<0.19
Using cached responses-0.18.0-py3-none-any.whl (38 kB)
Collecting pyarrow>=6.0.0
Using cached pyarrow-15.0.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (38.5 MB)
Collecting xxhash
Using cached xxhash-3.4.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (194 kB)
Collecting huggingface-hub<1.0.0,>=0.2.0
Using cached huggingface_hub-0.20.3-py3-none-any.whl (330 kB)
Requirement already satisfied: pandas in ./build/python_env/lib/python3.8/site-packages (from datasets==2.9.0->-r tt_metal/python_env/requirements-dev.txt (line 22)) (1.5.3)
Requirement already satisfied: numpy>=1.17 in ./build/python_env/lib/python3.8/site-packages (from datasets==2.9.0->-r tt_metal/python_env/requirements-dev.txt (line 22)) (1.20.3)
Collecting aiohttp
Using cached aiohttp-3.9.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB)
Collecting dill<0.3.7
Using cached dill-0.3.6-py3-none-any.whl (110 kB)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in ./build/python_env/lib/python3.8/site-packages (from torchvision==0.14.1+cpu->-r tt_metal/python_env/requirements-dev.txt (line 23)) (9.5.0)
Requirement already satisfied: torch==1.13.1 in ./build/python_env/lib/python3.8/site-packages (from torchvision==0.14.1+cpu->-r tt_metal/python_env/requirements-dev.txt (line 23)) (1.13.1+cpu)
Collecting tokenizers!=0.11.3,<0.14,>=0.11.1
Using cached tokenizers-0.13.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (7.8 MB)
Collecting regex!=2019.12.17
Using cached regex-2023.12.25-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (777 kB)
Collecting filelock
Using cached filelock-3.13.1-py3-none-any.whl (11 kB)
Collecting llvmlite<0.40,>=0.39.0dev0
Using cached llvmlite-0.39.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.6 MB)
Requirement already satisfied: setuptools in ./build/python_env/lib/python3.8/site-packages (from numba==0.56.4->-r tt_metal/python_env/requirements-dev.txt (line 29)) (44.0.0)
Collecting soxr>=0.3.2
Using cached soxr-0.3.7-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB)
Collecting soundfile>=0.12.1
Using cached soundfile-0.12.1-py2.py3-none-any.whl (24 kB)
Collecting pooch>=1.0
Using cached pooch-1.8.0-py3-none-any.whl (62 kB)
Collecting lazy-loader>=0.1
Using cached lazy_loader-0.3-py3-none-any.whl (9.1 kB)
Collecting scipy>=1.2.0
Using cached scipy-1.10.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.5 MB)
Collecting joblib>=0.14
Using cached joblib-1.3.2-py3-none-any.whl (302 kB)
Collecting audioread>=2.1.9
Using cached audioread-3.0.1-py3-none-any.whl (23 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.3.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.1 MB)
Collecting msgpack>=1.0
Using cached msgpack-1.0.7-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (534 kB)
Requirement already satisfied: psutil in ./build/python_env/lib/python3.8/site-packages (from accelerate==0.19.0->-r tt_metal/python_env/requirements-dev.txt (line 34)) (5.9.8)
Requirement already satisfied: wcwidth>=0.2.5 in ./build/python_env/lib/python3.8/site-packages (from ftfy==6.1.1->-r tt_metal/python_env/requirements-dev.txt (line 35)) (0.2.13)
Collecting gitdb<5,>=4.0.1
Using cached gitdb-4.0.11-py3-none-any.whl (62 kB)
Requirement already satisfied: matplotlib in ./build/python_env/lib/python3.8/site-packages (from bert-score==0.3.12->-r tt_metal/python_env/requirements-dev.txt (line 43)) (3.7.1)
Collecting distlib<1,>=0.3.7
Using cached distlib-0.3.8-py2.py3-none-any.whl (468 kB)
Collecting nh3>=0.2.14
Using cached nh3-0.2.15-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.7 MB)
Requirement already satisfied: markdown-it-py<3.0.0,>=2.2.0 in ./build/python_env/lib/python3.8/site-packages (from rich>=12.0.0->twine==4.0.2->-r tt_metal/python_env/requirements-dev.txt (line 12)) (2.2.0)
Requirement already satisfied: idna<4,>=2.5 in ./build/python_env/lib/python3.8/site-packages (from requests>=2.20->twine==4.0.2->-r tt_metal/python_env/requirements-dev.txt (line 12)) (3.6)
Requirement already satisfied: charset-normalizer<4,>=2 in ./build/python_env/lib/python3.8/site-packages (from requests>=2.20->twine==4.0.2->-r tt_metal/python_env/requirements-dev.txt (line 12)) (3.3.2)
Requirement already satisfied: certifi>=2017.4.17 in ./build/python_env/lib/python3.8/site-packages (from requests>=2.20->twine==4.0.2->-r tt_metal/python_env/requirements-dev.txt (line 12)) (2024.2.2)
Requirement already satisfied: zipp>=0.5 in ./build/python_env/lib/python3.8/site-packages (from importlib-metadata>=3.6->twine==4.0.2->-r tt_metal/python_env/requirements-dev.txt (line 12)) (3.17.0)
Requirement already satisfied: importlib-resources; python_version < "3.9" in ./build/python_env/lib/python3.8/site-packages (from keyring>=15.1->twine==4.0.2->-r tt_metal/python_env/requirements-dev.txt (line 12)) (6.1.1)
Collecting SecretStorage>=3.2; sys_platform == "linux"
Using cached SecretStorage-3.3.3-py3-none-any.whl (15 kB)
Collecting jeepney>=0.4.2; sys_platform == "linux"
Using cached jeepney-0.8.0-py3-none-any.whl (48 kB)
Collecting jaraco.classes
Using cached jaraco.classes-3.3.1-py3-none-any.whl (6.8 kB)
Requirement already satisfied: pytz>=2015.7; python_version < "3.9" in ./build/python_env/lib/python3.8/site-packages (from babel>=2.9->sphinx==7.1.2->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 2)) (2024.1)
Requirement already satisfied: MarkupSafe>=2.0 in ./build/python_env/lib/python3.8/site-packages (from Jinja2>=3.0->sphinx==7.1.2->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 2)) (2.1.5)
Requirement already satisfied: mistune<4,>=2.0.3 in ./build/python_env/lib/python3.8/site-packages (from nbconvert!=5.4->nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (3.0.2)
Requirement already satisfied: jupyterlab-pygments in ./build/python_env/lib/python3.8/site-packages (from nbconvert!=5.4->nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (0.3.0)
Requirement already satisfied: tinycss2 in ./build/python_env/lib/python3.8/site-packages (from nbconvert!=5.4->nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (1.2.1)
Requirement already satisfied: nbclient>=0.5.0 in ./build/python_env/lib/python3.8/site-packages (from nbconvert!=5.4->nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (0.9.0)
Requirement already satisfied: beautifulsoup4 in ./build/python_env/lib/python3.8/site-packages (from nbconvert!=5.4->nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (4.12.3)
Requirement already satisfied: jupyter-core>=4.7 in ./build/python_env/lib/python3.8/site-packages (from nbconvert!=5.4->nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (5.7.1)
Requirement already satisfied: pandocfilters>=1.4.1 in ./build/python_env/lib/python3.8/site-packages (from nbconvert!=5.4->nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (1.5.1)
Requirement already satisfied: bleach!=5.0.0 in ./build/python_env/lib/python3.8/site-packages (from nbconvert!=5.4->nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (6.1.0)
Requirement already satisfied: defusedxml in ./build/python_env/lib/python3.8/site-packages (from nbconvert!=5.4->nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (0.7.1)
Requirement already satisfied: fastjsonschema in ./build/python_env/lib/python3.8/site-packages (from nbformat->nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (2.19.1)
Requirement already satisfied: jsonschema>=2.6 in ./build/python_env/lib/python3.8/site-packages (from nbformat->nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (4.21.1)
Requirement already satisfied: parso<0.9.0,>=0.8.3 in ./build/python_env/lib/python3.8/site-packages (from jedi>=0.16->ipython==8.12.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 9)) (0.8.3)
Requirement already satisfied: pure-eval in ./build/python_env/lib/python3.8/site-packages (from stack-data->ipython==8.12.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 9)) (0.2.2)
Requirement already satisfied: asttokens>=2.1.0 in ./build/python_env/lib/python3.8/site-packages (from stack-data->ipython==8.12.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 9)) (2.4.1)
Requirement already satisfied: executing>=1.2.0 in ./build/python_env/lib/python3.8/site-packages (from stack-data->ipython==8.12.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 9)) (2.0.1)
Requirement already satisfied: ptyprocess>=0.5 in ./build/python_env/lib/python3.8/site-packages (from pexpect>4.3; sys_platform != "win32"->ipython==8.12.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 9)) (0.7.0)
Requirement already satisfied: python-dateutil>=2.8.1 in ./build/python_env/lib/python3.8/site-packages (from pandas->datasets==2.9.0->-r tt_metal/python_env/requirements-dev.txt (line 22)) (2.8.2)
Collecting frozenlist>=1.1.1
Using cached frozenlist-1.4.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (240 kB)
Collecting async-timeout<5.0,>=4.0; python_version < "3.11"
Using cached async_timeout-4.0.3-py3-none-any.whl (5.7 kB)
Collecting aiosignal>=1.1.2
Using cached aiosignal-1.3.1-py3-none-any.whl (7.6 kB)
Collecting yarl<2.0,>=1.0
Using cached yarl-1.9.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (308 kB)
Collecting multidict<7.0,>=4.5
Using cached multidict-6.0.5-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (129 kB)
Requirement already satisfied: cffi>=1.0 in ./build/python_env/lib/python3.8/site-packages (from soundfile>=0.12.1->librosa==0.10.0->-r tt_metal/python_env/requirements-dev.txt (line 30)) (1.16.0)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.2.0-py3-none-any.whl (15 kB)
Collecting smmap<6,>=3.0.1
Using cached smmap-5.0.1-py3-none-any.whl (24 kB)
Requirement already satisfied: contourpy>=1.0.1 in ./build/python_env/lib/python3.8/site-packages (from matplotlib->bert-score==0.3.12->-r tt_metal/python_env/requirements-dev.txt (line 43)) (1.1.1)
Requirement already satisfied: kiwisolver>=1.0.1 in ./build/python_env/lib/python3.8/site-packages (from matplotlib->bert-score==0.3.12->-r tt_metal/python_env/requirements-dev.txt (line 43)) (1.4.5)
Requirement already satisfied: pyparsing>=2.3.1 in ./build/python_env/lib/python3.8/site-packages (from matplotlib->bert-score==0.3.12->-r tt_metal/python_env/requirements-dev.txt (line 43)) (3.1.1)
Requirement already satisfied: fonttools>=4.22.0 in ./build/python_env/lib/python3.8/site-packages (from matplotlib->bert-score==0.3.12->-r tt_metal/python_env/requirements-dev.txt (line 43)) (4.48.1)
Requirement already satisfied: cycler>=0.10 in ./build/python_env/lib/python3.8/site-packages (from matplotlib->bert-score==0.3.12->-r tt_metal/python_env/requirements-dev.txt (line 43)) (0.12.1)
Requirement already satisfied: mdurl~=0.1 in ./build/python_env/lib/python3.8/site-packages (from markdown-it-py<3.0.0,>=2.2.0->rich>=12.0.0->twine==4.0.2->-r tt_metal/python_env/requirements-dev.txt (line 12)) (0.1.2)
Collecting cryptography>=2.0
Using cached cryptography-42.0.2-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.6 MB)
Collecting more-itertools
Using cached more_itertools-10.2.0-py3-none-any.whl (57 kB)
Requirement already satisfied: webencodings>=0.4 in ./build/python_env/lib/python3.8/site-packages (from tinycss2->nbconvert!=5.4->nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (0.5.1)
Requirement already satisfied: jupyter-client>=6.1.12 in ./build/python_env/lib/python3.8/site-packages (from nbclient>=0.5.0->nbconvert!=5.4->nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (8.6.0)
Requirement already satisfied: soupsieve>1.2 in ./build/python_env/lib/python3.8/site-packages (from beautifulsoup4->nbconvert!=5.4->nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (2.5)
Requirement already satisfied: pkgutil-resolve-name>=1.3.10; python_version < "3.9" in ./build/python_env/lib/python3.8/site-packages (from jsonschema>=2.6->nbformat->nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (1.3.10)
Requirement already satisfied: referencing>=0.28.4 in ./build/python_env/lib/python3.8/site-packages (from jsonschema>=2.6->nbformat->nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (0.33.0)
Requirement already satisfied: jsonschema-specifications>=2023.03.6 in ./build/python_env/lib/python3.8/site-packages (from jsonschema>=2.6->nbformat->nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (2023.12.1)
Requirement already satisfied: rpds-py>=0.7.1 in ./build/python_env/lib/python3.8/site-packages (from jsonschema>=2.6->nbformat->nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (0.17.1)
Requirement already satisfied: pycparser in ./build/python_env/lib/python3.8/site-packages (from cffi>=1.0->soundfile>=0.12.1->librosa==0.10.0->-r tt_metal/python_env/requirements-dev.txt (line 30)) (2.21)
Requirement already satisfied: pyzmq>=23.0 in ./build/python_env/lib/python3.8/site-packages (from jupyter-client>=6.1.12->nbclient>=0.5.0->nbconvert!=5.4->nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (25.1.2)
Requirement already satisfied: tornado>=6.2 in ./build/python_env/lib/python3.8/site-packages (from jupyter-client>=6.1.12->nbclient>=0.5.0->nbconvert!=5.4->nbsphinx==0.9.3->-r tt_metal/python_env/../../docs/requirements-docs.txt (line 7)) (6.4)
Installing collected packages: platformdirs, nodeenv, cfgv, identify, distlib, filelock, virtualenv, pre-commit, pathspec, mypy-extensions, black, pyproject-hooks, build, nh3, docutils, readme-renderer, pkginfo, requests-toolbelt, jeepney, cryptography, SecretStorage, more-itertools, jaraco.classes, keyring, rfc3986, twine, yamllint, imagesize, sphinxcontrib-serializinghtml, sphinxcontrib-jsmath, snowballstemmer, sphinxcontrib-htmlhelp, alabaster, sphinxcontrib-applehelp, sphinxcontrib-devhelp, sphinxcontrib-qthelp, sphinx, sphinxcontrib-jquery, sphinx-rtd-theme, lxml, sphinxcontrib-email, breathe, nbsphinx, ply, plumbum, pandoc, iniconfig, pluggy, pytest, pytest-timeout, editorconfig, jsbeautifier, responses, dill, multiprocess, pyarrow, xxhash, tqdm, fsspec, huggingface-hub, frozenlist, async-timeout, aiosignal, multidict, yarl, aiohttp, datasets, torchvision, tokenizers, regex, transformers, xlsxwriter, tiktoken, sentencepiece, llvmlite, numba, soxr, soundfile, pooch, lazy-loader, scipy, joblib, audioread, threadpoolctl, scikit-learn, msgpack, librosa, timm, opencv-python-headless, diffusers, accelerate, ftfy, smmap, gitdb, gitpython, einops, evaluate, bert-score
Attempting uninstall: platformdirs
Found existing installation: platformdirs 4.2.0
Uninstalling platformdirs-4.2.0:
Successfully uninstalled platformdirs-4.2.0
Successfully installed SecretStorage-3.3.3 accelerate-0.19.0 aiohttp-3.9.3 aiosignal-1.3.1 alabaster-0.7.13 async-timeout-4.0.3 audioread-3.0.1 bert-score-0.3.12 black-23.10.1 breathe-4.35.0 build-0.10.0 cfgv-3.4.0 cryptography-42.0.2 datasets-2.9.0 diffusers-0.12.1 dill-0.3.6 distlib-0.3.8 docutils-0.18.1 editorconfig-0.12.3 einops-0.6.1 evaluate-0.4.0 filelock-3.13.1 frozenlist-1.4.1 fsspec-2023.9.2 ftfy-6.1.1 gitdb-4.0.11 gitpython-3.1.32 huggingface-hub-0.20.3 identify-2.5.33 imagesize-1.4.1 iniconfig-2.0.0 jaraco.classes-3.3.1 jeepney-0.8.0 joblib-1.3.2 jsbeautifier-1.14.7 keyring-24.3.0 lazy-loader-0.3 librosa-0.10.0 llvmlite-0.39.1 lxml-4.9.4 more-itertools-10.2.0 msgpack-1.0.7 multidict-6.0.5 multiprocess-0.70.14 mypy-extensions-1.0.0 nbsphinx-0.9.3 nh3-0.2.15 nodeenv-1.8.0 numba-0.56.4 opencv-python-headless-4.8.0.74 pandoc-2.3 pathspec-0.12.1 pkginfo-1.9.6 platformdirs-3.11.0 pluggy-1.4.0 plumbum-1.8.2 ply-3.11 pooch-1.8.0 pre-commit-3.0.4 pyarrow-15.0.0 pyproject-hooks-1.0.0 pytest-7.2.2 pytest-timeout-2.2.0 readme-renderer-42.0 regex-2023.12.25 requests-toolbelt-1.0.0 responses-0.18.0 rfc3986-2.0.0 scikit-learn-1.3.2 scipy-1.10.1 sentencepiece-0.1.97 smmap-5.0.1 snowballstemmer-2.2.0 soundfile-0.12.1 soxr-0.3.7 sphinx-7.1.2 sphinx-rtd-theme-1.3.0 sphinxcontrib-applehelp-1.0.4 sphinxcontrib-devhelp-1.0.2 sphinxcontrib-email-0.3.5 sphinxcontrib-htmlhelp-2.0.1 sphinxcontrib-jquery-4.1 sphinxcontrib-jsmath-1.0.1 sphinxcontrib-qthelp-1.0.3 sphinxcontrib-serializinghtml-1.1.5 threadpoolctl-3.2.0 tiktoken-0.3.3 timm-0.6.13 tokenizers-0.13.3 torchvision-0.14.1+cpu tqdm-4.65.0 transformers-4.28.1 twine-4.0.2 virtualenv-20.25.0 xlsxwriter-3.0.8 xxhash-3.4.1 yamllint-1.32.0 yarl-1.9.4
Installing editable dev version of ttnn package...
pre-commit installed at .git/hooks/pre-commit
pre-commit installed at .git/hooks/commit-msg
Looking in indexes: https://pypi.org/simple, https://download.pytorch.org/whl/cpu
Obtaining file:///home/ubuntu/git/tt-metal/ttnn
Installing collected packages: ttnn
Running setup.py develop for ttnn
Successfully installed ttnn
[ ]:
%%bash
cd $TT_METAL_HOME
./tt_metal/tools/profiler/profile_this.py -n t5 -c "pytest tests/ttnn/integration_tests/t5/test_performance.py::test_t5_for_conditional_generation[functional_t5=models.experimental.functional_t5.tt.ttnn_functional_t5-sequence_size=64-batch_size=8-model_name=t5-small]"
2024-02-09 02:39:39.373 | INFO | __main__:main:68 - Profiler build flag is set
Always | INFO | Device profiling detected, logs folder location changed to generated/profiler/.logs//ops_device
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.2.2, pluggy-1.4.0 -- /home/ubuntu/git/tt-metal/build/python_env/bin/python
cachedir: .pytest_cache
rootdir: /home/ubuntu/git/tt-metal, configfile: pytest.ini
plugins: anyio-4.2.0, dash-2.8.1, timeout-2.2.0
timeout: 600.0s
timeout method: signal
timeout func_only: False
collecting ... collected 1 item
tests/ttnn/integration_tests/t5/test_performance.py::test_t5_for_conditional_generation[functional_t5=models.experimental.functional_t5.tt.ttnn_functional_t5-sequence_size=64-batch_size=8-model_name=t5-small] Metal | INFO | Initializing device 0
Device | INFO | Opening user mode device driver
2024-02-09 02:39:43.670 | INFO | SiliconDriver - Detected 1 PCI device : {0}
2024-02-09 02:39:43.681 | WARNING | SiliconDriver - init_detect_tt_device_numanodes(): Could not determine NumaNodeSet for TT device (physical_device_id: 0 pci_bus_id: 0000:00:08.0)
2024-02-09 02:39:43.681 | WARNING | SiliconDriver - Could not find NumaNodeSet for TT Device (physical_device_id: 0 pci_bus_id: 0000:00:08.0)
2024-02-09 02:39:43.684 | WARNING | SiliconDriver - bind_area_memory_nodeset(): Unable to determine TT Device to NumaNode mapping for physical_device_id: 0. Skipping membind.
---- ttSiliconDevice::init_hugepage: bind_area_to_memory_nodeset() failed (physical_device_id: 0 ch: 0). Hugepage allocation is not on NumaNode matching TT Device. Side-Effect is decreased Device->Host perf (Issue #893).
Metal | INFO | AI CLK for device 0 is: 1202 MHz
LLRuntime | INFO | Watcher log file: /home/ubuntu/git/tt-metal/built/watcher.log
LLRuntime | INFO | Watcher attached device 0
LLRuntime | INFO | Watcher thread watching...
Op | INFO | Program Cache: enabled.
2024-02-09 02:39:45.109 | INFO | ttnn.model_preprocessing:preprocess_model:465 - Saving model weights to cache: /home/ubuntu/.cache/ttnn/models/ttnn_t5-small (version "6ba823894")
2024-02-09 02:39:48.149 | INFO | ttnn.model_preprocessing:preprocess_model:484 - Saved model weights to cache: /home/ubuntu/.cache/ttnn/models/ttnn_t5-small (version "6ba823894")
2024-02-09 02:39:48.149 | INFO | ttnn.model_preprocessing:preprocess_model:487 - Moving model weights to device
2024-02-09 02:39:48.216 | INFO | ttnn.model_preprocessing:preprocess_model:489 - Moved model weights to device
LLRuntime | INFO | Watcher checking device 0
LLRuntime | INFO | Watcher checking device 0
2024-02-09 02:40:39.721 | INFO | tests.ttnn.integration_tests.t5.test_performance:test_t5_for_conditional_generation:100 - Compile time: 15.359902381896973
2024-02-09 02:40:39.721 | INFO | tests.ttnn.integration_tests.t5.test_performance:test_t5_for_conditional_generation:101 - Inference time: 18.07123565673828
2024-02-09 02:40:39.722 | INFO | tests.ttnn.integration_tests.t5.test_performance:test_t5_for_conditional_generation:102 - Tokens per second: 0.44269247283137575
PASSED Metal | INFO | Closing device 0
LLRuntime | INFO | Watcher detached device 0
Op | INFO | Program Cache: disabled and cleared.
==================================== PASSES ====================================
=========================== short test summary info ============================
PASSED tests/ttnn/integration_tests/t5/test_performance.py::test_t5_for_conditional_generation[functional_t5=models.experimental.functional_t5.tt.ttnn_functional_t5-sequence_size=64-batch_size=8-model_name=t5-small]
============================== 1 passed in 56.44s ==============================
Device | INFO | Closing user mode device drivers
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.2.2, pluggy-1.4.0 -- /home/ubuntu/git/tt-metal/build/python_env/bin/python
cachedir: .pytest_cache
rootdir: /home/ubuntu/git/tt-metal, configfile: pytest.ini
plugins: anyio-4.2.0, dash-2.8.1, timeout-2.2.0
timeout: 600.0s
timeout method: signal
timeout func_only: False
collecting ... collected 1 item
tests/ttnn/integration_tests/t5/test_performance.py::test_t5_for_conditional_generation[functional_t5=models.experimental.functional_t5.tt.ttnn_functional_t5-sequence_size=64-batch_size=8-model_name=t5-small] Metal | INFO | Initializing device 0
Device | INFO | Opening user mode device driver
2024-02-09 02:40:44.627 | INFO | SiliconDriver - Detected 1 PCI device : {0}
2024-02-09 02:40:44.638 | WARNING | SiliconDriver - init_detect_tt_device_numanodes(): Could not determine NumaNodeSet for TT device (physical_device_id: 0 pci_bus_id: 0000:00:08.0)
2024-02-09 02:40:44.638 | WARNING | SiliconDriver - Could not find NumaNodeSet for TT Device (physical_device_id: 0 pci_bus_id: 0000:00:08.0)
2024-02-09 02:40:44.639 | WARNING | SiliconDriver - bind_area_memory_nodeset(): Unable to determine TT Device to NumaNode mapping for physical_device_id: 0. Skipping membind.
---- ttSiliconDevice::init_hugepage: bind_area_to_memory_nodeset() failed (physical_device_id: 0 ch: 0). Hugepage allocation is not on NumaNode matching TT Device. Side-Effect is decreased Device->Host perf (Issue #893).
Metal | INFO | AI CLK for device 0 is: 1202 MHz
LLRuntime | INFO | Watcher log file: /home/ubuntu/git/tt-metal/built/watcher.log
LLRuntime | INFO | Watcher attached device 0
LLRuntime | INFO | Watcher thread watching...
Op | INFO | Program Cache: enabled.
2024-02-09 02:40:46.109 | INFO | ttnn.model_preprocessing:preprocess_model:458 - Loading model weights from cache: /home/ubuntu/.cache/ttnn/models/ttnn_t5-small (version "6ba823894")
2024-02-09 02:40:46.224 | INFO | ttnn.model_preprocessing:preprocess_model:460 - Loaded model weights from cache: /home/ubuntu/.cache/ttnn/models/ttnn_t5-small (version "6ba823894")
2024-02-09 02:40:46.224 | INFO | ttnn.model_preprocessing:preprocess_model:487 - Moving model weights to device
2024-02-09 02:40:46.292 | INFO | ttnn.model_preprocessing:preprocess_model:489 - Moved model weights to device
LLRuntime | INFO | Watcher checking device 0
2024-02-09 02:41:08.164 | INFO | tests.ttnn.integration_tests.t5.test_performance:test_t5_for_conditional_generation:100 - Compile time: 15.22393798828125
2024-02-09 02:41:08.165 | INFO | tests.ttnn.integration_tests.t5.test_performance:test_t5_for_conditional_generation:101 - Inference time: 3.322504758834839
2024-02-09 02:41:08.165 | INFO | tests.ttnn.integration_tests.t5.test_performance:test_t5_for_conditional_generation:102 - Tokens per second: 2.407821983919596
PASSED Metal | INFO | Closing device 0
LLRuntime | INFO | Watcher detached device 0
Op | INFO | Program Cache: disabled and cleared.
==================================== PASSES ====================================
=========================== short test summary info ============================
PASSED tests/ttnn/integration_tests/t5/test_performance.py::test_t5_for_conditional_generation[functional_t5=models.experimental.functional_t5.tt.ttnn_functional_t5-sequence_size=64-batch_size=8-model_name=t5-small]
============================== 1 passed in 23.91s ==============================
Device | INFO | Closing user mode device drivers
[15]:
import pandas as pd
import os
import glob
TT_METAL_HOME = os.getenv('TT_METAL_HOME')
def get_latest_report(base_path):
try:
latest_dir = max([os.path.join(base_path, d) for d in os.listdir(base_path) if os.path.isdir(os.path.join(base_path, d))], key=os.path.getmtime)
return max(glob.glob(os.path.join(latest_dir, '*')), key=os.path.getmtime)
except ValueError:
return None
latest_profile_report = get_latest_report(f'{TT_METAL_HOME}/generated/profiler/reports/t5/ops/')
print(f'Found {latest_profile_report}')
df = pd.read_csv(latest_profile_report)
df
Found /home/ubuntu/git/tt-metal/generated/profiler/reports/resnet/ops/2024_02_09_01_38_37/ops_perf_results_resnet_2024_02_09_01_38_37.csv
[15]:
| OP CODE | OP TYPE | GLOBAL CALL COUNT | ATTRIBUTES | MATH FIDELITY | CORE COUNT | PARALLELIZATION STRATEGY | HOST START TS | HOST END TS | HOST DURATION [ns] | ... | OUTPUT_0_W | OUTPUT_0_Z | OUTPUT_0_Y | OUTPUT_0_X | OUTPUT_0_LAYOUT | OUTPUT_0_DATA TYPE | OUTPUT_0_MEMORY | CALL DEPTH | CompileProgram 0 Count | CompileProgram 0 Average [ns] | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | ttnn.load_tensor_ttnn.load_tensor | python_fallback | 1 | NaN | NaN | - | NaN | 137428381893955 | 137428382188762 | 294807 | ... | - | - | - | - | - | - | - | 1 | 0 | 0 |
| 1 | ttnn.load_tensor_ttnn.load_tensor | python_fallback | 2 | NaN | NaN | - | NaN | 137428382500949 | 137428399402163 | 16901214 | ... | - | - | - | - | - | - | - | 1 | 0 | 0 |
| 2 | ttnn.load_tensor_ttnn.load_tensor | python_fallback | 3 | NaN | NaN | - | NaN | 137428399802068 | 137428399873758 | 71690 | ... | - | - | - | - | - | - | - | 1 | 0 | 0 |
| 3 | ttnn.load_tensor_ttnn.load_tensor | python_fallback | 4 | NaN | NaN | - | NaN | 137428400102635 | 137428400351033 | 248398 | ... | - | - | - | - | - | - | - | 1 | 0 | 0 |
| 4 | ttnn.load_tensor_ttnn.load_tensor | python_fallback | 5 | NaN | NaN | - | NaN | 137428400548071 | 137428400792528 | 244457 | ... | - | - | - | - | - | - | - | 1 | 0 | 0 |
| ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... |
| 4391 | ttnn.reshape_ttnn.reshape | python_fallback | 4392 | NaN | NaN | - | NaN | 137450414555424 | 137450414599894 | 44470 | ... | - | - | - | - | - | - | - | 1 | 0 | 0 |
| 4392 | ttnn.reshape_ttnn.reshape | python_fallback | 4393 | NaN | NaN | - | NaN | 137450414740752 | 137450414782422 | 41670 | ... | - | - | - | - | - | - | - | 1 | 0 | 0 |
| 4393 | Matmul | tt_dnn_device | 4394 | (bcast_batch=true; output_mem_config=tt::tt_me... | HiFi4-HiFi4 | 108 | MatmulParallelizationStrategy::MULTI_CORE | 137450414881851 | 137450414983440 | 101589 | ... | 1 | 8 | 64 | 32128 | TILE | BFLOAT16 | DEV_0_DRAM_INTERLEAVED | 1 | 0 | 0 |
| 4394 | ttnn.reshape_ttnn.reshape | python_fallback | 4395 | NaN | NaN | - | NaN | 137450415113099 | 137450415158748 | 45649 | ... | - | - | - | - | - | - | - | 1 | 0 | 0 |
| 4395 | ttnn.from_device_ttnn.from_device | python_fallback | 4396 | NaN | NaN | - | NaN | 137450415235897 | 137450453493048 | 38257151 | ... | - | - | - | - | - | - | - | 1 | 0 | 0 |
4396 rows × 44 columns
[ ]: