Missing Pub/Sub providor - AWS IoT

Pigsfoot · September 11, 2020, 7:26pm

I am following this document to create an AWS IoT connection from an application we have created.

I have got to the stage where we need to create a new Pub/Sub Integration but when i click on Add the document suggests i should have three providers, NATS / MQTT and AWS IoT.

We seem to be missing the AWS IoT option.

I’m not sure if this is due to us running version 3.8.4. I have asked in another thread how we do about updating to 3.9.

Are we missing the option due to a version difference or does it need to be added elsewhere ?

htdvisser · September 14, 2020, 8:35am

Hi @Pigsfoot, the AWS IoT integration is indeed new in The Things Enterprise Stack 3.9. See my response to your other question about upgrading your deployment to 3.9.

Pigsfoot · September 14, 2020, 9:40pm

@htdvisser , looks like i am not quite as far ahead as i had hoped.

When we followed the instructions for the deployment guide on the AWS IOT doc we received hundreds of error messages about IAM permissions issues.

https://enterprise.thethingsstack.io/integrations/aws-iot/default/deployment-guide/

As the cloud formation template was created when running version 3.8 of the server so i decided to delete it and start fresh. However since the upgrade to 3.9.1 we are unable to run the cloud formation template for the AWS IOT integration and keep getting the following error messages

2020-09-14 22:26:22 UTC+0100 Bosch-Parking-Sensor-IOT-Stack
ROLLBACK_IN_PROGRESS The following resource(s) failed to create: [ClaimThingFunctionServiceRoleDefaultPolicy7A5A6E1A, CreateThingTypeFunctionServiceRoleDefaultPolicy846D9B20, HandleDownlinkFunctionServiceRoleDefaultPolicy2B9D6C77, CreateThingRule, DeleteThingRule, Configuration, HandleUplinkFunctionServiceRoleDefaultPolicyF1A0596C]. . Rollback requested by user.
2020-09-14 22:26:21 UTC+0100 DeleteThingRule
CREATE_FAILED Resource creation cancelled
2020-09-14 22:26:21 UTC+0100 HandleUplinkFunctionServiceRoleDefaultPolicyF1A0596C
CREATE_FAILED Resource creation cancelled
2020-09-14 22:26:21 UTC+0100 HandleDownlinkFunctionServiceRoleDefaultPolicy2B9D6C77
CREATE_FAILED Resource creation cancelled
2020-09-14 22:26:21 UTC+0100 CreateThingTypeFunctionServiceRoleDefaultPolicy846D9B20
CREATE_FAILED Resource creation cancelled
2020-09-14 22:26:21 UTC+0100 CreateThingRule
CREATE_FAILED Resource creation cancelled
2020-09-14 22:26:21 UTC+0100 ClaimThingFunctionServiceRoleDefaultPolicy7A5A6E1A
CREATE_FAILED Resource creation cancelled
2020-09-14 22:26:20 UTC+0100 Configuration
CREATE_FAILED Failed to create resource. Enable AWS IoT pub/sub integration: rpc error: code = PermissionDenied desc = error:pkg/auth/rights:insufficient_application_rights (insufficient rights for application bosch-parking-sensor@things-enterprise-stack-srv)

The template then roll’s back… do you have any idea’s.

I have tried both self hosted and cloud hosted templates although as we are hosting everything at AWS i’m sure the cloud hosted template is the correct one.

htdvisser · September 15, 2020, 6:56am

Looping in @johan here, since he’s the expert on the AWS IoT integration.

johan · September 15, 2020, 7:40am

This is a mismatch between versions, apologies for that.

Please add the “edit basic application settings” right to the API key and try again.

Pigsfoot · September 15, 2020, 7:54am

Hi @johan, thanks for the reply.

Just added the extra right to the API key, and ran the cloud formation template again and still getting the same error.

2020-09-15 08:50:13 UTC+0100 bosch-parking-sensor-aws-iot-stack
ROLLBACK_IN_PROGRESS The following resource(s) failed to create: [ClaimThingFunctionServiceRoleDefaultPolicy7A5A6E1A, CreateThingTypeFunctionServiceRoleDefaultPolicy846D9B20, HandleDownlinkFunctionServiceRoleDefaultPolicy2B9D6C77, CreateThingRule, DeleteThingRule, Configuration, HandleUplinkFunctionServiceRoleDefaultPolicyF1A0596C]. . Rollback requested by user.
2020-09-15 08:50:12 UTC+0100 DeleteThingRule
CREATE_FAILED Resource creation cancelled
2020-09-15 08:50:12 UTC+0100 HandleUplinkFunctionServiceRoleDefaultPolicyF1A0596C
CREATE_FAILED Resource creation cancelled
2020-09-15 08:50:12 UTC+0100 CreateThingTypeFunctionServiceRoleDefaultPolicy846D9B20
CREATE_FAILED Resource creation cancelled
2020-09-15 08:50:12 UTC+0100 ClaimThingFunctionServiceRoleDefaultPolicy7A5A6E1A
CREATE_FAILED Resource creation cancelled
2020-09-15 08:50:12 UTC+0100 CreateThingRule
CREATE_FAILED Resource creation cancelled
2020-09-15 08:50:12 UTC+0100 HandleDownlinkFunctionServiceRoleDefaultPolicy2B9D6C77
CREATE_FAILED Resource creation cancelled
2020-09-15 08:50:12 UTC+0100 Configuration
CREATE_FAILED Failed to create resource. Enable AWS IoT pub/sub integration: rpc error: code = InvalidArgument desc = error:pkg/errors:validation (invalid ids: embedded message failed validation)

Can i just check that i should be using the “Deploy for Cloud Hosted” template.

Also, might be worth noting the API was created when on server version 3.8. Should i delete and recreate it ?

johan · September 15, 2020, 9:27am

Getting there. Probably something we should fix. What is the Stack Name and the Application ID? You can dm me if that is sensitive info.

Pigsfoot · September 15, 2020, 11:40am

H i @johan, sent you a PM with the details request. Thanks

johan · September 15, 2020, 12:38pm

Issue identified and fixed in v0.13

system · October 11, 2020, 7:42pm

This topic was automatically closed after 30 days. New replies are no longer allowed.