Apex Compile Error: expected primary-expression before ‘>’ token

Posted on 2021-08-20 Edited on 2023-01-24 In Machine Learning 评论: Views:

Apex Compile Error

The environment (cuda10.0):

$ conda install pytorch==1.1.0 torchvision==0.3.0 cudatoolkit=10.0 -c pytorch

The apex repo master HEAD:

commit 0c2c6eea6556b208d1a8711197efc94899e754e1 (HEAD -> master, origin/master, origin/HEAD)
Author: Nan Zheng <80790206+nanz-nv@users.noreply.github.com>
Date:   Sat Jul 17 08:53:59 2021 +0800
...

Install apex:

git clone https://github.com/NVIDIA/apex
cd apex
pip install -v --disable-pip-version-check --no-cache-dir --global-option="--cpp_ext" --global-option="--cuda_ext" ./

Compile error like this:

csrc/mlp.cpp:127:54: error: expected primary-expression before ‘>’ token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                      ^

Solution

Similar discussions: https://github.com/NVIDIA/apex/issues/802 https://github.com/NVIDIA/apex/issues/1139

Rollback to an earlier version is not a good solution. Actually, the issue is caused by pytorch/gcc/cuda mismatch.

Therefore, make sure:

gcc version is >= 7 (gcc --version)
pytorch version >= 1.4.0 (conda list)

If not, upgrade them.

Full error message

... csrc/mlp.cpp: In lambda function: csrc/mlp.cpp:126:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare] for (int i = 0; i < num_layers; i++) { ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:127:54: error: expected primary-expression before ‘>’ token w_ptr.push_back(inputs[i + 1].data_ptr()); ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:127:56: error: expected primary-expression before ‘)’ token w_ptr.push_back(inputs[i + 1].data_ptr()); ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:130:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare] for (int i = 0; i < inputs.size(); i++) { ^~~~~~~~~~~~~ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:131:57: error: expected primary-expression before ‘>’ token outputs_ptr.push_back(outputs[i].data_ptr()); ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:131:59: error: expected primary-expression before ‘)’ token outputs_ptr.push_back(outputs[i].data_ptr()); ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:138:44: warning: narrowing conversion of ‘(work_size / sizeof (scalar_t))’ from ‘long unsigned int’ to ‘long int’ i nside { } [-Wnarrowing] auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type()); ~~~~~~~~^~~~~~~ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:138:44: warning: narrowing conversion of ‘(work_size / sizeof (scalar_t))’ from ‘long unsigned int’ to ‘long int’ i nside { } [-Wnarrowing] auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type()); ~~~~~~~~^~~~~~~ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:141:36: error: expected primary-expression before ‘>’ token inputs[0].data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:141:38: error: expected primary-expression before ‘)’ token inputs[0].data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:142:43: error: expected primary-expression before ‘>’ token fprop_outputs[0].data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:142:45: error: expected primary-expression before ‘)’ token fprop_outputs[0].data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:148:46: error: expected primary-expression before ‘>’ token grad_o.contiguous().data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:148:48: error: expected primary-expression before ‘)’ token grad_o.contiguous().data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:149:43: error: expected primary-expression before ‘>’ token fprop_outputs[1].data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:149:45: error: expected primary-expression before ‘)’ token fprop_outputs[1].data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:150:37: error: expected primary-expression before ‘>’ token work_space.data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:150:39: error: expected primary-expression before ‘)’ token work_space.data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp: In lambda function: csrc/mlp.cpp:126:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare] for (int i = 0; i < num_layers; i++) { ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:127:54: error: expected primary-expression before ‘>’ token w_ptr.push_back(inputs[i + 1].data_ptr()); ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:127:56: error: expected primary-expression before ‘)’ token w_ptr.push_back(inputs[i + 1].data_ptr()); ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:130:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare] for (int i = 0; i < inputs.size(); i++) { ^~~~~~~~~~~~~ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:131:57: error: expected primary-expression before ‘>’ token outputs_ptr.push_back(outputs[i].data_ptr()); ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:131:59: error: expected primary-expression before ‘)’ token outputs_ptr.push_back(outputs[i].data_ptr()); ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:138:44: warning: narrowing conversion of ‘(work_size / sizeof (scalar_t))’ from ‘long unsigned int’ to ‘long int’ i nside { } [-Wnarrowing] auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type()); ~~~~~~~~^~~~~~~ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:138:44: warning: narrowing conversion of ‘(work_size / sizeof (scalar_t))’ from ‘long unsigned int’ to ‘long int’ i nside { } [-Wnarrowing] auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type()); ~~~~~~~~^~~~~~~ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:141:36: error: expected primary-expression before ‘>’ token inputs[0].data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:141:38: error: expected primary-expression before ‘)’ token inputs[0].data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:142:43: error: expected primary-expression before ‘>’ token fprop_outputs[0].data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:142:45: error: expected primary-expression before ‘)’ token fprop_outputs[0].data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:148:46: error: expected primary-expression before ‘>’ token grad_o.contiguous().data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:148:48: error: expected primary-expression before ‘)’ token grad_o.contiguous().data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:149:43: error: expected primary-expression before ‘>’ token fprop_outputs[1].data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:149:45: error: expected primary-expression before ‘)’ token fprop_outputs[1].data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:150:37: error: expected primary-expression before ‘>’ token work_space.data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:150:39: error: expected primary-expression before ‘)’ token work_space.data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp: In lambda function: csrc/mlp.cpp:126:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare] for (int i = 0; i < num_layers; i++) { ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:127:54: error: expected primary-expression before ‘>’ token w_ptr.push_back(inputs[i + 1].data_ptr()); ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:127:56: error: expected primary-expression before ‘)’ token w_ptr.push_back(inputs[i + 1].data_ptr()); ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:130:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare] for (int i = 0; i < inputs.size(); i++) { ^~~~~~~~~~~~~ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:131:57: error: expected primary-expression before ‘>’ token outputs_ptr.push_back(outputs[i].data_ptr()); ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:131:59: error: expected primary-expression before ‘)’ token outputs_ptr.push_back(outputs[i].data_ptr()); ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:138:44: warning: narrowing conversion of ‘(work_size / sizeof (scalar_t))’ from ‘long unsigned int’ to ‘long int’ i nside { } [-Wnarrowing] auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type()); ~~~~~~~~^~~~~~~ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:138:44: warning: narrowing conversion of ‘(work_size / sizeof (scalar_t))’ from ‘long unsigned int’ to ‘long int’ i nside { } [-Wnarrowing] auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type()); ~~~~~~~~^~~~~~~ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:141:36: error: expected primary-expression before ‘>’ token inputs[0].data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:141:38: error: expected primary-expression before ‘)’ token inputs[0].data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:142:43: error: expected primary-expression before ‘>’ token fprop_outputs[0].data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:142:45: error: expected primary-expression before ‘)’ token fprop_outputs[0].data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:148:46: error: expected primary-expression before ‘>’ token grad_o.contiguous().data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:148:48: error: expected primary-expression before ‘)’ token grad_o.contiguous().data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:149:43: error: expected primary-expression before ‘>’ token fprop_outputs[1].data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:149:45: error: expected primary-expression before ‘)’ token fprop_outputs[1].data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:150:37: error: expected primary-expression before ‘>’ token work_space.data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ csrc/mlp.cpp:150:39: error: expected primary-expression before ‘)’ token work_space.data_ptr(), ^ /home/user/miniconda3/envs/test/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of mac ro ‘AT_PRIVATE_CASE_TYPE’ return VA_ARGS();
^~~~~~~~~~~ csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’ AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] { ^ error: command 'gcc' failed with exit status 1 Running setup.py install for apex ... error

ERROR: Command errored out with exit status 1: /home/user/miniconda3/envs/test/bin/python -u -c 'import sys, setuptools, tokeni ze; sys.argv[0] = '"'"'/tmp/pip-req-build-z3p6osd_/setup.py'"'"'; file='"'"'/tmp/pip-req-build-z3p6osd_/setup.py'"'"';f=getattr( tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"''"'"', '"'"''"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' --cpp_ext --cuda_ext install --record /tmp/pip-record-p3loelp4/install-record.txt --single-version-externally-man aged --compile --install-headers /home/user/miniconda3/envs/test/include/python3.7m/apex Check the logs for full command output ...