Pedro Cuenca pcuenca

## Optimization Guidelines for the Apple Neural Engine.txt
Comprehensive Optimization Guidelines for the Apple Neural Engine (ANE)
Tensor Considerations:

Shapes: Utilize tensor shapes that are powers of 2 (e.g., 2, 4, 8, 16) to enhance memory allocation and access.
Sizes: Keep tensor sizes small, aiming for multiples of 16 (e.g., 16, 32, 48, 64) to optimize memory usage.
Alignment: Ensure tensors are aligned to 16-byte boundaries to optimize memory access and computation. This is crucial for both performance and model compatibility with ANE hardware constraints.
ANE Hardware Maximums:

Maximum Tensor Dimension Size: The ANE can only load tensors with a dimension size of at most 16,384.
Maximum Model Block Size: The model block size should not exceed 1024.

## tiktoken-to-hf.ipynb

      
              1 file
            
          
              2 forks
            
          
              17 comments
            
          
              14 stars
            
          
                xenova
                / tiktoken-to-hf.ipynb
            
            
              Last active
              May 10, 2024 00:59
            
              
                Convert tiktoken tokenizers to the Hugging Face tokenizers format
              
          
      Sorry, something went wrong. Reload?
      Sorry, we cannot display this file.
      Sorry, this file is invalid so it cannot be displayed.
      
          Viewer requires iframe.
      
    
## update_provisioning_profile.sh
#!/bin/sh
#
# Download and install a single iOS provisioning profile
# Requires https://github.com/nomad/cupertino
#
# Usage
# - Login to your account once:
# ios login
# - Configure TEAM and PROFILE (instructions below)
# - Run update_provisioning_profile.sh at anytime, usually after adding/removing devices to the profile
	Comprehensive Optimization Guidelines for the Apple Neural Engine (ANE)
	Tensor Considerations:

	Shapes: Utilize tensor shapes that are powers of 2 (e.g., 2, 4, 8, 16) to enhance memory allocation and access.
	Sizes: Keep tensor sizes small, aiming for multiples of 16 (e.g., 16, 32, 48, 64) to optimize memory usage.
	Alignment: Ensure tensors are aligned to 16-byte boundaries to optimize memory access and computation. This is crucial for both performance and model compatibility with ANE hardware constraints.
	ANE Hardware Maximums:

	Maximum Tensor Dimension Size: The ANE can only load tensors with a dimension size of at most 16,384.
	Maximum Model Block Size: The model block size should not exceed 1024.
	#!/bin/sh
	#
	# Download and install a single iOS provisioning profile
	# Requires https://github.com/nomad/cupertino
	#
	# Usage
	# - Login to your account once:
	# ios login
	# - Configure TEAM and PROFILE (instructions below)
	# - Run update_provisioning_profile.sh at anytime, usually after adding/removing devices to the profile