[cmake] Build parameter consistent issue with composable_kernelConfig.cmake

[junliume]

[Observations]:
when building CK for specific platforms such as gfx1100:

sudo CXX=/opt/rocm/bin/amdclang++ cmake -DCMAKE_PREFIX_PATH=/opt/rocm -DCMAKE_BUILD_TYPE=Release -DGPU_ARCHS="gfx1100" ..

naturally /opt/rocm/lib/cmake/composable_kernel/composable_kerneldevice_mha_operationsTargets.cmak is *NOT generated because the platform does not yet fully support MHA operations.

However, when we try to build other libraries which depends on CK, e.g. MIOpen, we will observe the following error:

CMake Error at /opt/rocm/lib/cmake/composable_kernel/composable_kernelConfig.cmake:24 (include):
  include could not find requested file:

    /opt/rocm/lib/cmake/composable_kernel/composable_kerneldevice_mha_operationsTargets.cmake
Call Stack (most recent call first):
  CMakeLists.txt:330 (find_package)

[Reproduce Steps]: listed above

[Analysis]:
when building CK for specific platforms such as gfx1100:

sudo CXX=/opt/rocm/bin/amdclang++ cmake -DCMAKE_PREFIX_PATH=/opt/rocm -DCMAKE_BUILD_TYPE=Release -DGPU_ARCHS="gfx1100" ..

this generated file build/composable_kernelConfig.cmake

set(_composable_kernel_supported_components device_other_operations device_gemm_operations device_conv_operations device_mha_operations device_contraction_operations device_reduction_operations utility)

foreach(_comp ${composable_kernel_FIND_COMPONENTS})
        if(NOT _comp IN_LIST _composable_kernel_supported_components)
                set(composable_kernel_FOUND False)
                set(composable_kernel_NOT_FOUND_MESSAGE "Unsupported component: ${_comp}")
        endif()
        include("${CMAKE_CURRENT_LIST_DIR}/composable_kernel${_comp}Targets.cmake")
endforeach()

Apparently, the _composable_kernel_supported_components needs to be adjusted according to build parameters.

[junliume]

https://github.com/ROCm/composable_kernel/blob/7965d66a81bc4a8189ba5b4f30641f346be935cf/Config.cmake.in

[AngryLoki]

The problem with not only in _composable_kernel_supported_components. Sometimes some generic component is supported, but depending on GPU arch set some functions (namely, xdl functions on offload targets != gfx9xx) are missing in static library.

Given that, I don't see a solution purely on composable_kernel side. So for now I added 2 patches:

• composable-kernel-6.3.0-conditional-kernels.patch - add soft skip if component is not found
• miopen-6.3.0-conditional-ck-components.patch + group of replacements - rework miopen to compile kernel implementations based on MIOPEN_USE_CK_MHA_OPS and MIOPEN_USE_CK_XDL_OPS defines, mostly based on filenames.

Any solutions on your side are welcome, or feel free to apply these patches.