在python中递归地删除json对象列表中的null/空值

Question

我有一个具有这样的值的JSON对象（JSON字符串）：

[
   {
      "id": 1,
      "object_k_id": "",
      "object_type": "report",
      "object_meta": {
         "source_id": 0,
         "report": "Customers"
      },
      "description": "Daily metrics for all customers",
      "business_name": "",
      "business_logic": "",
      "owners": [
         "[email protected]",
          null
      ],
      "stewards": [
         "[email protected]",
         ''
      ],
      "verified_use_cases": [
         null,
         null,
         "c4a48296-fd92-3606-bf84-99aacdf22a20",
         null
      ],
      "classifications": [
         null
      ],
      "domains": []
   }
]

BU我想要的最终格式是删除了nulls和空列表项的内容：类似的内容：

[
   {
      "id": 1,
      "object_k_id": "",
      "object_type": "report",
      "object_meta": {
         "source_id": 0,
         "report": "Customers"
      },
      "description": "Daily metrics for all customers",
      "business_name": "",
      "business_logic": "",
      "owners": [
         "[email protected]"
      ],
      "stewards": [
         "[email protected]"
      ],
      "verified_use_cases": [
         "c4a48296-fd92-3606-bf84-99aacdf22a20"
      ],
      "classifications": [],
      "domains": []
   }
]

我希望输出排除nulls，空字符串并制造。看起来更干净。 我需要对所有JSON中的所有列表进行递归进行此操作。

甚至不仅仅是递归，如果我可以一口气做而不是遍历每个元素，那将是有帮助的。

我只需要清理列表。

有人可以帮我吗？提前致谢

Answer 1

import json


def recursive_dict_clean(d):
    for k, v in d.items():
        if isinstance(v, list):
            v[:] = [i for i in v if i]
        if isinstance(v, dict):
            recursive_dict_lookup(v)


data = json.loads("""[{
    "id": 1,
    "object_k_id": "",
    "object_type": "report",
    "object_meta": {
        "source_id": 0,
        "report": "Customers"
    },
    "description": "Daily metrics for all customers",
    "business_name": "",
    "business_logic": "",
    "owners": [
        "[email protected]",
        null
    ],
    "stewards": [
        "[email protected]"
    ],
    "verified_use_cases": [
        null,
        null,
        "c4a48296-fd92-3606-bf84-99aacdf22a20",
        null
    ],
    "classifications": [
        null
    ],
    "domains": []
}]""")


for d in data:
    recursive_dict_clean(d)

print(data):
[{'id': 1,
  'object_k_id': '',
  'object_type': 'report',
  'object_meta': {'source_id': 0, 'report': 'Customers'},
  'description': 'Daily metrics for all customers',
  'business_name': '',
  'business_logic': '',
  'owners': ['[email protected]'],
  'stewards': ['[email protected]'],
  'verified_use_cases': ['c4a48296-fd92-3606-bf84-99aacdf22a20'],
  'classifications': [],
  'domains': []}]

PS：您的 json 字符串无效。

Answer 2

您可以使用内置 object_pairs_hook 从字符串解码时解析数据。

https://docs.python.org/3/library/json。 html＃json.load

此函数运行的时间都可以调用 dict（）并删除所有 none none 从列表中使用简单列表， ，否则将数据独自一人，让解码器做这件事。

#!/usr/bin/env python3
import json
data_string = """[
   {
      "id": 1,
      "object_k_id": "",
      "object_type": "report",
      "object_meta": {
         "source_id": 0,
         "report": "Customers"
      },
      "description": "Daily metrics for all customers",
      "business_name": "",
      "business_logic": "",
      "owners": [
         "[email protected]",
          null
      ],
      "stewards": [
         "[email protected]",
         ""
      ],
      "verified_use_cases": [
         null,
         null,
         "c4a48296-fd92-3606-bf84-99aacdf22a20",
         null
      ],
      "classifications": [
         null
      ],
      "domains": []
   }
]"""

def json_hook(obj):
    return_obj = {}
    for k, v in obj:
        if isinstance(v, list):
            v = [x for x in v if x is not None]

        return_obj[k] = v

    return return_obj

data = json.loads(data_string, object_pairs_hook=json_hook)

print(json.dumps(data, indent=4))

结果：

[
    {
        "id": 1,
        "object_k_id": "",
        "object_type": "report",
        "object_meta": {
            "source_id": 0,
            "report": "Customers"
        },
        "description": "Daily metrics for all customers",
        "business_name": "",
        "business_logic": "",
        "owners": [
            "[email protected]"
        ],
        "stewards": [
            "[email protected]",
            ""
        ],
        "verified_use_cases": [
            "c4a48296-fd92-3606-bf84-99aacdf22a20"
        ],
        "classifications": [],
        "domains": []
    }
]

在您的示例中，您从 stewards 中删除“” 值，如果您需要该行为，则可以用不是无 >不在（无，“”） ..中，但这似乎是一个错误，因为您将空字符串留在其他地方。

Answer 3

您可以将您的 JSON 转换为 dict 然后使用函数下面的功能，然后将其转换为 JSON 再次：

def clean_dict(input_dict):
    output = {}
    for key, value in input_dict.items():
        if isinstance(value, dict):
            output[key] = clean_dict(value)
        elif isinstance(value, list):
            output[key] = []
            for item in value:
                if isinstance(value, dict):
                    output[key].append(clean_dict(item))
                elif value not in [None, '']:
                    output[key].append(item)
        else:
            output[key] = value
    return output

感谢NO