| #!/bin/sh | |
| # | |
| # Download and install a single iOS provisioning profile | |
| # Requires https://github.com/nomad/cupertino | |
| # | |
| # Usage | |
| # - Login to your account once: | |
| # ios login | |
| # - Configure TEAM and PROFILE (instructions below) | |
| # - Run update_provisioning_profile.sh at anytime, usually after adding/removing devices to the profile |
| Comprehensive Optimization Guidelines for the Apple Neural Engine (ANE) | |
| Tensor Considerations: | |
| Shapes: Utilize tensor shapes that are powers of 2 (e.g., 2, 4, 8, 16) to enhance memory allocation and access. | |
| Sizes: Keep tensor sizes small, aiming for multiples of 16 (e.g., 16, 32, 48, 64) to optimize memory usage. | |
| Alignment: Ensure tensors are aligned to 16-byte boundaries to optimize memory access and computation. This is crucial for both performance and model compatibility with ANE hardware constraints. | |
| ANE Hardware Maximums: | |
| Maximum Tensor Dimension Size: The ANE can only load tensors with a dimension size of at most 16,384. | |
| Maximum Model Block Size: The model block size should not exceed 1024. |
This script lets you expose a CoreML model's intermediate tensors as outputs.
If your CoreML model is spitting out garbage and the inputs look correct it can be painful to find where things are failing in the middle of your model.
Download the script, grab your .mlpackage and fire up https://netron.app to find an interesting tensor.
