Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[QST] Where is CuTe ValLayout in TiledMMA as of CUTLASS 3.4.0 #2016

Open
ZhZhang711 opened this issue Dec 27, 2024 · 2 comments
Open

[QST] Where is CuTe ValLayout in TiledMMA as of CUTLASS 3.4.0 #2016

ZhZhang711 opened this issue Dec 27, 2024 · 2 comments

Comments

@ZhZhang711
Copy link

I find that make_tiled_mma no longer takes MMAValLayout as its argument, but the cute document is still using a MMAValLayout to construct a TiledMMA. I wonder where does the MMAValLayout go and how can I replicate a TiledMMA across values. Thanks!

@ccecka
Copy link

ccecka commented Dec 28, 2024

From the documentation:

The above represents a 16x16x4 MMA now, but we can immediately expand this "tile size" up to 32x32x4 instead:

TiledMMA mma = make_tiled_mma(SM70_8x8x4_F32F16F16F32_NT{},
                              Layout<Shape <_2,_2>,
                                     Stride<_2,_1>>{},  // 2x2 n-major layout of Atoms
                              Tile<_32,_32,_4>{});      // 32x32x4 tiler
print_latex(mma);

The Tiler parameter expands the TiledMMA in values. The documentation is up to date and does not mention the prior MMAValLayout.

@ZhZhang711
Copy link
Author

Oh I see, thanks. I thought that Tile<_32,_32,_4>{} was an MMAValLayout, but in fact it is a Permutations.
So if I need TiledShape_MNK that existed prior to CUTLASS 3.4.0, am I expected to call tile_size_mnk thrice for I = 1,2,3?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants