使用bash脚本从Postman Collection中删除ID-sed和regex

问题描述

我正在尝试解决邮递员收藏的问题。添加到集合中的测试脚本会生成其他字段“ id”。每次将集合导出到文件后，Id字段都会更改。因此，很难理解带有邮递员收藏变更的PR。我想用git pre commit hook和bash脚本解决该问题，该脚本将从collection的脚本对象中删除所有id。

脚本对象中id的三个可能位置：

对象的第一个元素

"script":{
   "id": "83d9076e-64c7-47fa-9b50-b7635718c925","exec": [
       "console.log(\"foo\");"
   ],"type": "text/javascript"
}

对象的中间

"script":{
   "exec": [
       "console.log(\"foo\");"
   ],"id": "83d9076e-64c7-47fa-9b50-b7635718c925","type": "text/javascript"
}

对象结束

"script":{
   "exec": [
       "console.log(\"foo\");"
   ],"type": "text/javascript","id": "83d9076e-64c7-47fa-9b50-b7635718c925"
}

从正则表达式的角度来看，案例1和案例2是相同的：

.*"id": "[a-f0-9-]*",

第3种情况不同，处理此选项的正则表达式为：

,\n.*"id": "[a-f0-9-]*",

如前所述，我想在bash脚本中使用此regexp： postmanClean.sh

#!/bin/bash
COLLECTION_FILES=$(find . -type f -name "*postman_collection.json")
for POSTMAN_COLLECTION in ${COLLECTION_FILES}
do
  echo "Harmonizing Postman $POSTMAN_COLLECTION"
  sed -i -e 's/.*"id": "[a-f0-9-]*"\,//' ${POSTMAN_COLLECTION}          # Remove test/script ID
  sed -i -e 's/\,\n.*"id": "[a-f0-9-]*"//' ${POSTMAN_COLLECTION}          # Remove test/script ID
done

以上解决方法不正确。我尝试了其他选项，但是此regexp无法正常工作。如何正确构建此请求以使其与sed命令一起使用？

收集文件： demo.postman_collection.json

{
    "info": {
        "_postman_id": "258b2fe2-5768-47f8-9e82-70971bab6bbd","name": "demo","schema": "https://schema.getpostman.com/json/collection/v2.1.0/collection.json"
    },"item": [
        {
            "name": "One","item": [
                {
                    "name": "Demo 1","event": [
                        {
                            "listen": "test","script": {
                                "id": "83d9076e-64c7-47fa-9b50-b7635718c925","exec": [
                                    "console.log(\"foo\");"
                                ],"type": "text/javascript"
                            }
                        }
                    ],"protocolProfileBehavior": {
                        "disableBodyPruning": true
                    },"request": {
                        "method": "GET","header": [],"body": {
                            "mode": "raw","raw": "foo"
                        },"url": {
                            "raw": "https://postman-echo.com/delay/1","protocol": "https","host": [
                                "postman-echo","com"
                            ],"path": [
                                "delay","1"
                            ]
                        }
                    },"response": []
                }
            ],"protocolProfileBehavior": {}
        },{
            "name": "Two","item": [
                {
                    "name": "Demo 2","script": {
                                "exec": [
                                    "console.log(\"bar\");"
                                ],"id": "facb28f7-c54d-46e2-adb2-4c929fd1edd3"
                            }
                        }
                    ],"raw": "bar"
                        },"url": {
                            "raw": "https://postman-echo.com/delay/2","2"
                            ]
                        }
                    },"response": []
                },{
                    "name": "Demo 3","script": {
                                "exec": [
                                    "console.log(\"foobar\");"
                                ],"id": "facb28f7-c54d-46e2-adb2-4c929fd1edd3","url": {
                            "raw": "https://postman-echo.com/delay/3","3"
                            ]
                        }
                    },"protocolProfileBehavior": {}
        }
    ],"protocolProfileBehavior": {}
}

解决方法

我认为jq是完成这项工作的正确工具，解决方案将像walk(del(.id?))一样简单。这里使用jq重写了脚本：

#!/bin/bash

COLLECTION_FILES=$(find . -type f -name "*postman_collection.json")
for f in ${COLLECTION_FILES}
do
  echo "Harmonizing Postman $f"
  jq --indent 4 'walk(del(.id?))' "$f" > "$f.tmp" && mv "$f.tmp" "$f"
done

和一个演示（请注意jq如何从,删除多余的"type": "text/javascript",，否则将使json失效）：

$ cp demo.postman_collection.json demo.postman_collection.json.bak
$ ./postmanClean.sh
Harmonizing Postman ./demo.postman_collection.json
$ diff demo.postman_collection.json.bak demo.postman_collection.json
17d16
<                                 "id": "83d9076e-64c7-47fa-9b50-b7635718c925",65,66c64
<                                 "type": "text/javascript",<                                 "id": "facb28f7-c54d-46e2-adb2-4c929fd1edd3"
---
>                                 "type": "text/javascript"
104d101
<                                 "id": "facb28f7-c54d-46e2-adb2-4c929fd1edd3",$

您无需区分这两种模式，因为您可以使用sed来匹配包含"id": "..."模式的任何行，然后使用它删除使用匹配的整行d命令。因此，您无需关心换行符，空格或尾随逗号是否存在。

在您的示例上执行

sed -i '/"id": "[a-f0-9-]*"/d' demo.postman_collection.json

删除所有id行（当然"_postman_id"除外）。

bash postman regex sed