web crawler - Finding the layers and layer sizes for each Docker image

Question

For research purposes I'm trying to crawl the public Docker registry ( https://registry.hub.docker.com/ ) and find out 1) how many layers an average image has and 2) the sizes of these layers to get an idea of the distribution.

However I studied the API and public libraries as well as the details on the github but I cant find any method to:

• retrieve all the public repositories/images (even if those are thousands I still need a starting list to iterate through)
• find all the layers of an image
• find the size for a layer (so not an image but for the individual layer).

Can anyone help me find a way to retrieve this information?

Thank you!

EDIT: is anyone able to verify that searching for '*' in Docker registry is returning all the repositories and not just anything that mentions '*' anywhere? https://registry.hub.docker.com/search?q=*

Answer 1

Check out dive written in golang.

Awesome tool!