Compressing feed files

Stay organized with collections Save and categorize content based on your preferences.

Any .json or .pb3 file may be compressed using gzip before uploading. This can significantly reduce the byte size of daily feeds.

Each shard file should be gzip'd and uploaded individually (e.g. with gzip *.json). Compressed feed shards should end in .json.gz or .pb3.gz.