I checked cordova-plugin-fcm but I am not sure where exactly the icon files should be. The documentaion is not clear enough. So based on this answer, you can set the following configuration for the icon files:
The above setting will place the icons at the target location during the build. You can extract APK file to see them.