Kong to Kong Data Migration & Kong Consumer Credential Migration

To setup a new kong and migrate data from old kong to new kong.

1. Setup new kong .
2. Take Snapshot from konga from old kong
3. import the konga snapshot to new kong for routes, service, consumer, plugins, upstreams and targets etc.,

Issue :

Since Consumer Password is encrypted by sha1 algorithm by customer id as salt, the konga snapshot will not be migrated properly the credentials of the consumer.

So in order to properly migrate the consumer, kindly follow the steps:

1. Even though consumer password will be different between two kongs, the consumer id and username will be same in both.
2. We need to login to cassandra db console using cqlsh on old kong’s cassandra and get the encoded password and consumer id of all username from the basic_auth_credentails table in kong database.
3. Now we need to get the id of all rows of the respective username in new kong cassandra db, as the update query only works with primary key which is id column, not consumer_id or any other columns
4. Once we get the password of all username from basic_auth_credentails table along with username and consumer_id and id of new kong cassandra db of the all username, we form a query to update new password with id on where condition which is respective to the corresponding consumer_id and username.
5. Once we formed all the queries, then we need to execute all the queries.

Queries :

To get the details from old Kong db.

select consumer_id, username, password from basicauth_credentials

To get the id of all corresponding usernames on the new Kong db.

select id from basicauth_credentials where consumer_id=’consumer_ids’ and username=’usernames’

To update the correct credentials in the new Kong Cassandra DB.

update basicauth_credentials set password=’fetched-password-respective of consumer’ where id=’id’

Rest api’s for creating and updating consumers

for create consumer :
— — — — — — — — — — — — — — — — — — -

curl -i -X POST — url http://{kong_ip}:{kong_port}/consumers — data “username={consumer-name}” — data “custom_id={some_id}”

for update consumer:
— — — — — — — — — — — — — — — — — — -

curl -i -X POST — url http://{kong_ip}:{kong_port}/consumers/{consumer_name or consumer_id} — data “username={new consumer_name}” — data “custom_id={custom_id}”

for delete consumer :
— — — — — — — — — — — — — — — — — — -

curl -i -X DELETE — url http://{kong_ip}:{kong_port}/consumers/{consumer-name}

for create basic-auth for consumer:
— — — — — — — — — — — — — — — — — — -

curl -i -X POST — url http://{kong_ip}:{kong_port}/consumers/{consumer_name or consumer_id}/basic-auth/ — data “username={username}” — data “password={password}”

for update basic-auth for consumer:
— — — — — — — — — — — — — — — — — — -

curl http://{kong_ip}:{kong_port}/consumers/{consumer-name}/basic-auth/ = get the plugin id
curl -i -X PUT — url http://{kong_ip}:{kong_port}/consumers/{consumer-name}/basic-auth/{plugin_id} — data “username={new username}” — data “password={new password}”

for delete basic-auth for consumer:
— — — — — — — — — — — — — — — — — — -

curl http://{kong_ip}:{kong_port}/consumers/{consumer-name}/basic-auth/ = get the plugin id
curl -i -X DELETE — url http://{kong_ip}:{kong_port}/consumers/{consumer-name}/basic-auth/{plugin_id}

CREATE RATE LIMITING
— — — — — — — — — — — —

curl -X POST http://{kong_ip}:{kong_port}/consumers/${consumer_name}/plugins/ \
 — data “name=rate-limiting” \
 — data “config.second={requst count limit per second}” \
 — data “config.minute={requst count limit per minute}” \
 — data “config.hour={requst count limit per hour}” \
 — data “config.day={requst count limit per day}” \
 — data “config.month={requst count limit per month}” \
 — data “config.year={requst count limit per year}” \
 — data “config.policy=cluster” \
 — data “config.hide_client_headers=false”

GET RATE LIMITING DETAILS (plugin id)
— — — — — — — — — — — — — — — — — — — -

CURL http://{kong_ip}:{kong_port}/consumers/{consumer_name}/plugins = here we need to iterate the dictionary object to get ratelimit plugin and fetch plugin id

DELETE RATE LIMITING for consumer
— — — — — — — — — — — — — — — — — — — -

curl -X DELETE http://{kong_ip}:{kong_port}/consumers/{consumer_name}/plugins/{plugin_id}

UPDATE RATE LIMITING for consumer
— — — — — — — — — — — — — — — — — — — — —

curl -X PATCH http://{kong_ip}:{kong_port}/consumers/{consumer_name}/plugins/{plugin_id} \
 — data “name=rate-limiting” \
 — data “config.second=5” \
 — data “config.minute=10” \
 — data “config.hour=10” \
 — data “config.day=100” \
 — data “config.month=1000” \
 — data “config.year=10000” \
 — data “config.policy=cluster” \
 — data “config.hide_client_headers=false”