[AMD Official Use Only]
Hi David,
gfx801 is APU (e.g., "Carrizo") and gfx803 is dGPU (e.g., RX 4xx/5xx series).
From a gem5 perspective, basically they are setup differently in how memory is
laid out.
Vega was recently added in 21.2 but from my notes not all of the DNNMark
kernels are working and require docker changes to fix. Anyway you can try by
generally replacing GCN3_X86 with VEGA_X86 and adding --gfx-version=gfx900
--dgpu to application runs:
docker run --rm -v ${PWD}:${PWD} -w ${PWD} -u $UID:$GID
gcr.io/gem5-test/gcn-gpu:v21-2 scons -sQ -j$(nproc) build/VEGA_X86/gem5.opt
docker run --rm -v ${PWD}:${PWD} -v
${PWD}/gem5-resources/src/gpu/DNNMark/cachefiles:/root/.cache/miopen/2.9.0 -w
${PWD} gcr.io/gem5-test/gcn-gpu:v21-2 gem5/build/GCN3_X86/gem5.opt
gem5/configs/example/apu_se.py -n3
--benchmark-root=gem5-resources/src/gpu/DNNMark/build/benchmarks/test_fwd_softmax
-cdnnmark_test_fwd_softmax --options="-config
gem5-resources/src/gpu/DNNMark/config_example/softmax_config.dnnmark -mmap
gem5-resources/src/gpu/DNNMark/mmap.bin" --gfx-version=gfx900 --dgpu
-Matt
From: David Fong <[email protected]>
Sent: Friday, March 4, 2022 10:01 AM
To: Poremba, Matthew <[email protected]>; gem5 users mailing list
<[email protected]>; Bobby Bruce <[email protected]>; Matt Sinclair
<[email protected]>; Kyle Roarty <[email protected]>
Subject: RE: [gem5-users] Re: gem5 + DGPU (GCN3) build error
[AMD Official Use Only]
[CAUTION: External Email]
Hi Matt,
I used gfx801 and it ran ok.
What's the difference between gfx801 and gfx803 ?
Yes. I'm trying the DGPU flow with VEGA (GCN5).
Is this supported for the 21.2.1.0 release with DNNMark?
Please send instructions on how to compile and run DNNMark for VEGA.
Thanks,
David
From: Poremba, Matthew <[email protected]<mailto:[email protected]>>
Sent: Friday, March 4, 2022 9:55 AM
To: gem5 users mailing list <[email protected]<mailto:[email protected]>>;
Bobby Bruce <[email protected]<mailto:[email protected]>>; Matt Sinclair
<[email protected]<mailto:[email protected]>>; Kyle Roarty
<[email protected]<mailto:[email protected]>>
Cc: David Fong <[email protected]<mailto:[email protected]>>
Subject: RE: [gem5-users] Re: gem5 + DGPU (GCN3) build error
[AMD Official Use Only]
Hi,
I don't know if this is what is causing this specific forking problem, but
gfx900 is VEGA not GCN3. There is a separate build for VEGA. If you want GCN3
dGPU you want gfx803.
-Matt
From: David Fong via gem5-users
<[email protected]<mailto:[email protected]>>
Sent: Friday, March 4, 2022 9:34 AM
To: Bobby Bruce <[email protected]<mailto:[email protected]>>; gem5 users
mailing list <[email protected]<mailto:[email protected]>>; Matt Sinclair
<[email protected]<mailto:[email protected]>>; Kyle Roarty
<[email protected]<mailto:[email protected]>>
Cc: David Fong <[email protected]<mailto:[email protected]>>
Subject: [gem5-users] Re: gem5 + DGPU (GCN3) build error
[CAUTION: External Email]
Hi Bobby,
Thanks for your reply.
I tried to rebuild in new directory and rerun same steps. Same results with
error.
In your regression testing, did you run with the --dgpu" and
--gfx-version=gfx900" options?
Maybe --dgpu" requires some other code or options?
The default flow with APU (no --dgpu, --gfx_version=gfx801) can run DNNMark
with no problem.
David
From: Bobby Bruce <[email protected]<mailto:[email protected]>>
Sent: Thursday, March 3, 2022 6:43 PM
To: gem5 users mailing list <[email protected]<mailto:[email protected]>>;
Matt Sinclair <[email protected]<mailto:[email protected]>>; Kyle Roarty
<[email protected]<mailto:[email protected]>>
Cc: David Fong <[email protected]<mailto:[email protected]>>
Subject: Re: [gem5-users] gem5 + DGPU (GCN3) build error
I think, based on the error I'm seeing here, your build is creating tmp files
in the container, which are deleted after DDNMark is built and the docker
container is discarded. These are, for some reason, needed in the run and
cannot be found. Did you follow the README here for DNNMark and follow it
exactly?
https://gem5.googlesource.com/public/gem5-resources/+/refs/heads/stable/src/gpu/DNNMark/<https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Furldefense.proofpoint.com%2Fv2%2Furl%3Fu%3Dhttps-3A__nam11.safelinks.protection.outlook.com_-3Furl-3Dhttps-253A-252F-252Furldefense.proofpoint.com-252Fv2-252Furl-253Fu-253Dhttps-2D3A-5F-5Fgem5.googlesource.com-5Fpublic-5Fgem5-2D2Dresources-5F-2D2B-5Frefs-5Fheads-5Fstable-5Fsrc-5Fgpu-5FDNNMark-5F-2526d-253DDwMFaQ-2526c-253DeuGZstcaTDllvimEN8b7jXrwqOf-2Dv5A-5FCdpgnVfiiMM-2526r-253DOkH-2D8nM02VdNPRt-5FmiVO36vI9580zW1SgNQ4MzWRfqc-2526m-253DaBkzz8UWgg6cGJOqO3QnvVOSrQN0fZg7T-5FjM-2Df-2DYQSc-2526s-253DwaZIPhDvJYcIbOYvZAGH0pL63ezFEBPqm8wLIJL4QUE-2526e-253D-26data-3D04-257C01-257Cmatthew.poremba-2540amd.com-257C88d547e14e03423fd8e808d9fe059fe4-257C3dd8961fe4884e608e11a82d994e183d-257C0-257C0-257C637820122399508528-257CUnknown-257CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0-253D-257C3000-26sdata-3DJe1WdEqTbYAT66t3ZF1oj7JBgVSVn-252FFQ2bHmiU6eWqA-253D-26reserved-3D0%26d%3DDwMFAg%26c%3DeuGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM%26r%3DOkH-8nM02VdNPRt_miVO36vI9580zW1SgNQ4MzWRfqc%26m%3DCXtsBSeEQThimN8UTcOCBJnofsJFkGT_C8Ob0g26Nfw%26s%3DSZgvV9RNqEIdk8AVGvKhAf2gmSFaCQ655_CfMRjsjm4%26e%3D&data=04%7C01%7CMatthew.Poremba%40amd.com%7Cbac89e77f805403fc0e308d9fe08edf4%7C3dd8961fe4884e608e11a82d994e183d%7C0%7C0%7C637820136584990440%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=BbNiobevZ97DkSICBTSn0SavOkCdFMlqatx8ZmC4ty0%3D&reserved=0>.
I admit building and running the GPU code can be tricky as we're heavily
dependent on the docker images and things can easily go wrong.
Matt or Kyle: do either of you have any idea what's going wrong here?
--
Dr. Bobby R. Bruce
Room 3050,
Kemper Hall, UC Davis
Davis,
CA, 95616
web:
https://www.bobbybruce.net<https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Furldefense.proofpoint.com%2Fv2%2Furl%3Fu%3Dhttps-3A__nam11.safelinks.protection.outlook.com_-3Furl-3Dhttps-253A-252F-252Furldefense.proofpoint.com-252Fv2-252Furl-253Fu-253Dhttps-2D3A-5F-5Fwww.bobbybruce.net-2526d-253DDwMFaQ-2526c-253DeuGZstcaTDllvimEN8b7jXrwqOf-2Dv5A-5FCdpgnVfiiMM-2526r-253DOkH-2D8nM02VdNPRt-5FmiVO36vI9580zW1SgNQ4MzWRfqc-2526m-253DaBkzz8UWgg6cGJOqO3QnvVOSrQN0fZg7T-5FjM-2Df-2DYQSc-2526s-253DngqE4VS5UTHp-5FiDKaeA2UgAEOCTJVvsm3o1CfZqeurA-2526e-253D-26data-3D04-257C01-257Cmatthew.poremba-2540amd.com-257C88d547e14e03423fd8e808d9fe059fe4-257C3dd8961fe4884e608e11a82d994e183d-257C0-257C0-257C637820122399508528-257CUnknown-257CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0-253D-257C3000-26sdata-3Dqmxc35H9Rnhwfp8n8qDG-252FVeT3qIR1UgFT4QSpnLXNeQ-253D-26reserved-3D0%26d%3DDwMFAg%26c%3DeuGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM%26r%3DOkH-8nM02VdNPRt_miVO36vI9580zW1SgNQ4MzWRfqc%26m%3DCXtsBSeEQThimN8UTcOCBJnofsJFkGT_C8Ob0g26Nfw%26s%3DAZ8wTwP2SSMwW64B6t4bEawT5GGSIIplivSBTk9Tuhg%26e%3D&data=04%7C01%7CMatthew.Poremba%40amd.com%7Cbac89e77f805403fc0e308d9fe08edf4%7C3dd8961fe4884e608e11a82d994e183d%7C0%7C0%7C637820136584990440%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=b6nM8awXzErkAMFThTud6JPn3O3Mml9tky4NVwXyIEw%3D&reserved=0>
On Wed, Mar 2, 2022 at 4:46 PM David Fong via gem5-users
<[email protected]<mailto:[email protected]>> wrote:
Hi,
I built gem5 + DGPU (GCN3) (gfx900) and ran DNNMark with this command-line
[gem5-resources] docker run --rm -v ${PWD}:${PWD}
-v${PWD}/cachefiles:/root/.cache/miopen/2.9.0 -w ${PWD}
gcr.io/gem5-test/gcn-gpu:v21-2<https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Furldefense.proofpoint.com%2Fv2%2Furl%3Fu%3Dhttps-3A__nam11.safelinks.protection.outlook.com_-3Furl-3Dhttps-253A-252F-252Furldefense.proofpoint.com-252Fv2-252Furl-253Fu-253Dhttp-2D3A-5F-5Fgcr.io-5Fgem5-2D2Dtest-5Fgcn-2D2Dgpu-2D3Av21-2D2D2-2526d-253DDwMFaQ-2526c-253DeuGZstcaTDllvimEN8b7jXrwqOf-2Dv5A-5FCdpgnVfiiMM-2526r-253DOkH-2D8nM02VdNPRt-5FmiVO36vI9580zW1SgNQ4MzWRfqc-2526m-253DaBkzz8UWgg6cGJOqO3QnvVOSrQN0fZg7T-5FjM-2Df-2DYQSc-2526s-253D-2Dkc-2DQcX1EFLM1qzhO2OMnmlH1P1Vx-5Fl9s786ttKmXBY-2526e-253D-26data-3D04-257C01-257Cmatthew.poremba-2540amd.com-257C88d547e14e03423fd8e808d9fe059fe4-257C3dd8961fe4884e608e11a82d994e183d-257C0-257C0-257C637820122399508528-257CUnknown-257CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0-253D-257C3000-26sdata-3DAO0DKhD-252B6XYPMJe0Ih-252B-252BX4fPZ9moDpbh5Fk6gqEx-252BGk-253D-26reserved-3D0%26d%3DDwMFAg%26c%3DeuGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM%26r%3DOkH-8nM02VdNPRt_miVO36vI9580zW1SgNQ4MzWRfqc%26m%3DCXtsBSeEQThimN8UTcOCBJnofsJFkGT_C8Ob0g26Nfw%26s%3D5YUX5eszYu3C84b_Rm3pYiVJA8asGwZOtdUpR-0k9Tk%26e%3D&data=04%7C01%7CMatthew.Poremba%40amd.com%7Cbac89e77f805403fc0e308d9fe08edf4%7C3dd8961fe4884e608e11a82d994e183d%7C0%7C0%7C637820136584990440%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=z7TBx4qC3pbO2rUt6hI%2FaEVbRtJRUNSoqlz03Gwn%2Bq8%3D&reserved=0>
python3 generate_cachefiles.py cachefiles.csv --gfx-version=gfx900 --num-cus=4
[gem5-gpu-dnn] docker run --rm -v ${PWD}:${PWD} -v
${PWD}/gem5/gem5-resources/src/gpu/DNNMark/cachefiles:/root/.cache/miopen/2.9.0
-w ${PWD}
gcr.io/gem5-test/gcn-gpu:v21-2<https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Furldefense.proofpoint.com%2Fv2%2Furl%3Fu%3Dhttps-3A__nam11.safelinks.protection.outlook.com_-3Furl-3Dhttps-253A-252F-252Furldefense.proofpoint.com-252Fv2-252Furl-253Fu-253Dhttp-2D3A-5F-5Fgcr.io-5Fgem5-2D2Dtest-5Fgcn-2D2Dgpu-2D3Av21-2D2D2-2526d-253DDwMFaQ-2526c-253DeuGZstcaTDllvimEN8b7jXrwqOf-2Dv5A-5FCdpgnVfiiMM-2526r-253DOkH-2D8nM02VdNPRt-5FmiVO36vI9580zW1SgNQ4MzWRfqc-2526m-253DaBkzz8UWgg6cGJOqO3QnvVOSrQN0fZg7T-5FjM-2Df-2DYQSc-2526s-253D-2Dkc-2DQcX1EFLM1qzhO2OMnmlH1P1Vx-5Fl9s786ttKmXBY-2526e-253D-26data-3D04-257C01-257Cmatthew.poremba-2540amd.com-257C88d547e14e03423fd8e808d9fe059fe4-257C3dd8961fe4884e608e11a82d994e183d-257C0-257C0-257C637820122399508528-257CUnknown-257CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0-253D-257C3000-26sdata-3DAO0DKhD-252B6XYPMJe0Ih-252B-252BX4fPZ9moDpbh5Fk6gqEx-252BGk-253D-26reserved-3D0%26d%3DDwMFAg%26c%3DeuGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM%26r%3DOkH-8nM02VdNPRt_miVO36vI9580zW1SgNQ4MzWRfqc%26m%3DCXtsBSeEQThimN8UTcOCBJnofsJFkGT_C8Ob0g26Nfw%26s%3D5YUX5eszYu3C84b_Rm3pYiVJA8asGwZOtdUpR-0k9Tk%26e%3D&data=04%7C01%7CMatthew.Poremba%40amd.com%7Cbac89e77f805403fc0e308d9fe08edf4%7C3dd8961fe4884e608e11a82d994e183d%7C0%7C0%7C637820136584990440%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=z7TBx4qC3pbO2rUt6hI%2FaEVbRtJRUNSoqlz03Gwn%2Bq8%3D&reserved=0>
gem5/build/GCN3_X86/gem5.opt gem5/configs/example/apu_se.py --dgpu
--gfx-version=gfx900 -n3
--benchmark-root=gem5/gem5-resources/src/gpu/DNNMark/build/benchmarks/test_fwd_softmax
-cdnnmark_test_fwd_softmax --options="-config
gem5/gem5-resources/src/gpu/DNNMark/config_example/softmax_config.dnnmark -mmap
gem5/gem5-resources/src/gpu/DNNMark/mmap.bin"
and got this error message :
build/GCN3_X86/sim/syscall_emul.cc:683: warn: fcntl: unsupported command 6
build/GCN3_X86/sim/mem_state.cc:443: info: Increasing stack size by one page.
build/GCN3_X86/sim/syscall_emul.cc:74: warn: ignoring syscall mprotect(...)
build/GCN3_X86/sim/syscall_emul.cc:74: warn: ignoring syscall mprotect(...)
build/GCN3_X86/sim/syscall_emul.cc:74: warn: ignoring syscall mprotect(...)
build/GCN3_X86/sim/syscall_emul.cc:74: warn: ignoring syscall mprotect(...)
sh: 1: Cannot fork
MIOpen Error: /root/driver/MLOpen/src/hipoc/hipoc_program.cpp:195: Cant find
file: /tmp/miopen-MIOpenSoftmax.cl-9c04-5b2f-4076-0450/MIOpenSoftmax.cl.o
build/GCN3_X86/sim/syscall_emul.cc:74: warn: ignoring syscall mbind(...)
build/GCN3_X86/sim/syscall_emul.cc:74: warn: ignoring syscall mbind(...)
build/GCN3_X86/sim/syscall_emul.cc:74: warn: ignoring syscall mbind(...)
build/GCN3_X86/sim/syscall_emul.cc:74: warn: ignoring syscall mbind(...)
MIOpen Error: 7 at
/home/dfong/work/ext_ips/gem5-gpu-dnn/gem5/gem5-resources/src/gpu/DNNMark/core/include/dnn_wrapper.h485Ticks:
571357584000
Exiting because exiting with last active thread context
Am I missing a step in compilation process or some other settings ?
Thanks,
David
_______________________________________________
gem5-users mailing list -- [email protected]<mailto:[email protected]>
To unsubscribe send an email to
[email protected]<mailto:[email protected]>
%(web_page_url)slistinfo%(cgiext)s/%(_internal_name)s
_______________________________________________
gem5-users mailing list -- [email protected]
To unsubscribe send an email to [email protected]
%(web_page_url)slistinfo%(cgiext)s/%(_internal_name)s
