Metadata-Version: 2.1
Name: tf-lambda
Version: 0.3.0
Summary: A TensorFlow 2 implementation of LambdaNetworks.
Home-page: https://github.com/seanmor5/tf_lambda
Author: Sean Moriarity
Author-email: smoriarity.5@gmail.com
License: UNKNOWN
Description: # Lambda Networks
        
        This is a TensorFlow 2 implementation of a Lambda Layer from: [LambdaNetworks: Modeling Long-Range Interactions Without Attention](https://openreview.net/pdf?id=xTJEN-ggl1b). LambdaNetworks achieve SOTA on ImageNet. For now, this library provides a basic UNTESTED version of the Lambda Layer based off of this [repository](https://github.com/lucidrains/lambda-networks).
        
        ## Usage
        
        ### Global Context
        
        ```python
        import tensorflow as tf
        
        layer = LambdaLayer(
            dim_out = 32,   # channels out
            n = 64 * 64,    # number of input pixels (64 x 64 image)
            dim_k = 16,     # key dimension
            heads = 4,      # number of heads, for multi-query
            dim_u = 1       # 'intra-depth' dimension
        )
        
        x = tf.random.normal(shape=(1, 64, 64, 32))
        layer(x)
        ```
        
        ### Local Context
        
        ```python
        layer = LambdaLayer(
            dim_out = 32,
            r = 23,         # the receptive field for relative positional encoding (23 x 23)
            dim_k = 16,
            heads = 4,
            dim_u = 4
        )
        
        x = tf.random.normal(shape=(1, 64, 64, 32))
        layer(x)
        ```
        
Platform: UNKNOWN
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.6
Description-Content-Type: text/markdown
