Delete data from exported time-series from Prometheus / VictoriaMetrics in a time range.

README.md

Usage

• Export your data from Prometheus: https://github.com/VictoriaMetrics/VictoriaMetrics/blob/master/README.md#how-to-export-time-series
• Run this script on the new data python3 delete_timeseries.py -i imported_file.json -o output_file.json --from [unix timestamp] --to [unix timestamp]
• Delete original data from Prometheus: https://docs.victoriametrics.com/#how-to-delete-time-series
• Import the converted data: https://github.com/VictoriaMetrics/VictoriaMetrics/blob/master/README.md#how-to-import-time-series-data

Note that the response cache must be deleted after these steps in order to remove previously cached results - see more details here.

delete_timeseries.py

#!/usr/bin/python3

import json
from argparse import ArgumentParser

parser = ArgumentParser()

parser.add_argument("-i", "--input", dest="input",
                    help="Input JSON file from VictoriaMetrics / Prometheus", metavar="FILE", required=True)
parser.add_argument("-o", "--output", dest="output",
                    help="Output JSON file", metavar="FILE", required=True)
parser.add_argument("--from", dest="from_date",
                    help="Start of the unwanted time-range (UNIX timestamp)", type=int, required=True)
parser.add_argument("--to", dest="to_date",
                    help="End of the unwanted time-range (UNIX timestamp)", type=int, required=True)

args = parser.parse_args()

with open(args.input, "r") as input_file:
    with open(args.output, "w+") as output_file:
        for line in input_file:
            data = json.loads(line)

            indices = []
            for idx, timestamp in enumerate(data['timestamps']):
                if args.from_date <= timestamp <= args.to_date:
                    indices.append(idx)

            data['timestamps'] = [v for i, v in enumerate(data['timestamps']) if i not in indices]
            data['values'] = [v for i, v in enumerate(data['values']) if i not in indices]

            output_file.write(json.dumps(data, separators=(',', ':')) + "\n")

if __name__ == '__main__':
    pass