[USMP] adding support for U2 and U3 usecases

[manupak]

This commit adds a MemoryPools argument for
the compilation flow according to RFC0029.

Moreover, it is used to provide support for
external pools from the application layer
that could be pinned for different memories
and/or be reused between multiple inferences.

[manupak]

cc : @Mousius @areusch

[Mousius]

Argh! There's a few typos but after that it looks good, much boilerplate for the nodes 😿

[Mousius]

Suggested change

	* \file tvm/relay/executor.h
	* \file tvm/ir/memory_pools.h

[Mousius]

Suggested change

	# The string parameter to indicate read and write access to a pool
	# This needs to be kept in sync with kTargetPoolReadWriteAccess in
	# include/tvm/tir/usmp/utils.h
	READ_WRITE_ACCESS = "rw"
	# The string parameter to indicate read only access to a pool
	# This needs to be kept in sync with kTargetPoolReadOnlyAccess in
	# include/tvm/tir/usmp/utils.h
	READ_ONLY_ACCESS = "ro"
	# The string parameter to indicate read and write access to a pool
	# This needs to be kept in sync with kTargetPoolReadWriteAccess in
	# include/tvm/ir/memory_pools.h
	READ_WRITE_ACCESS = "rw"
	# The string parameter to indicate read only access to a pool
	# This needs to be kept in sync with kTargetPoolReadOnlyAccess in
	# include/tvm/ir/memory_pools.h
	READ_ONLY_ACCESS = "ro"

[Mousius]

Suggested change

	/*!
	* \brief The string parameter to indicate read and write access to a pool
	* This needs to be kept in sync with PoolInfo.READ_WRITE_ACCESS in
	* python/tvm/tir/usmp/utils.py
	*/
	static constexpr const char* kTargetPoolReadWriteAccess = "rw";
	/*!
	* \brief The string parameter to indicate read only access to a pool
	* This needs to be kept in sync with PoolInfo.READ_ONLY_ACCESS in
	* python/tvm/tir/usmp/utils.py
	*/
	static constexpr const char* kTargetPoolReadOnlyAccess = "ro";
	/*!
	* \brief The string parameter to indicate read and write access to a pool
	* This needs to be kept in sync with PoolInfo.READ_WRITE_ACCESS in
	* python/tvm/ir/memory_pools.py
	*/
	static constexpr const char* kTargetPoolReadWriteAccess = "rw";
	/*!
	* \brief The string parameter to indicate read only access to a pool
	* This needs to be kept in sync with PoolInfo.READ_ONLY_ACCESS in
	* python/tvm/ir/memory_pools.py
	*/
	static constexpr const char* kTargetPoolReadOnlyAccess = "ro";

[manupak]

@Mousius I think I've addressed the comments (Thanks! for catching that!). PTAL when you have some time.

[Mousius]

LGTM!

[Mousius]

Thanks @manupa-arm 😸