Moving Docker's files to a custom location

By: (plus.google.com) +David Herron; Date: January 30, 2018

Tags: Docker

Docker is a wonderful tool that abstracts away all kinds of details about configuring and maintaining Linux Containers. The power to simply type "docker run image-name" and have a bunch of complexity automatically handled is great. But you may want to change Docker's defaults, and just how do you do so? In my case "/var/lib/docker" would be on an SSD drive, and to lengthen its lifetime I want to minimize the number of writes to that drive. Moving this directory to the SSD should help with that goal.

I have an Ubuntu system that's newly setup. Therefore I had to first set up Docker, using the instructions here: (docs.docker.com) https://docs.docker.com/install/linux/docker-ce/ubuntu/ Followed by post-install instructions: https://docs.docker.com/install/linux/linux-postinstall/

Transcript:

45  apt-get remove docker docker-engine docker.io
46  apt-get update
47  apt-get install apt-transport-https ca-certificates curl software-properties-common
48  curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo apt-key add -
49  apt-key fingerprint 0EBFCD88
50  sudo add-apt-repository    "deb [arch=amd64] https://download.docker.com/linux/ubuntu \
$(lsb_release -cs) \
stable"
51  apt-get update
52  sudo add-apt-repository    "deb [arch=amd64] https://download.docker.com/linux/ubuntu \
$(lsb_release -cs) \
stable"
53  docker run hello-world
54  sudo groupadd docker
55  usermod -aG docker david
56  systemctl
57  systemctl enable docker

At this point Docker has its out-of-the-box configuration. It does successfully download and setup containers. What's more important is the file-system image for each container is on the SSD. As containers and images are created, destroyed, and executed, that probably means lots of write operations on the SSD.

The docker info command tells us a bunch of information about the system. One detail is the directory, /var/lib/Docker to keep the images and everything.

Because I used systemctl to enable Docker, we configure Docker using these instructions: (docs.docker.com) https://docs.docker.com/engine/admin/systemd/

That page says we can put a JSON file at /etc/docker/daemon.json

The dockerd documentation lists what can be put in that file: (docs.docker.com) https://docs.docker.com/engine/reference/commandline/dockerd//

{
  "data-root": "/home/docker/root",
  "storage-driver": "overlay2"
}

There's a file at /lib/systemd/system/docker.service containing some configuration settings. It was unclear if anything could be put in that file to affect the location of the data-root directory.

It worked to install the daemon.json file as shown.

Then this sequence of commands are run:

75  ls -d /var/lib/docker
76  ls -ld /var/lib/docker
77  mkdir -p /home/docker/root
78  chmod 711 /home/docker/root
79  ls -ld /home/docker/root
81  systemctl stop docker
82  (cd /var/lib/docker/; tar cf - .) | (cd /home/docker/root/; tar xvf -)
84  mv /var/lib/docker/ /var/lib/docker-old
85  systemctl start docker

We start by inspecting the current /var/lib/docker so the replacement, /home/docker/root, can have the same settings.

Next we stop docker so that the directory contents are quiescent.

Next we copy the current contents in /var/lib/docker to /home/docker/root using a tar pipeline.

Next we, for good measure, we move /var/lib/docker out of the way so that if we'll see whether Docker successfully used the new location for its files. If the declared docker-root direectory is missing, Docker will autocreate it for you.

Afterwards run docker info to check the docker-root location was changed.

Then you can run a couple Docker images, and verify if those images get created in the new docker-root location. This is sufficient to cause a Docker image to download and its container execute: docker run -it python bash

To verify:

103  docker ps -a
105  docker images -a
106  du /home/docker/root/ | less
107  du /var/lib/docker* | less

This lets us view the current set of containers/images and validate that the newly created container/image occurred in the new location.

Finally once you're satisfied Docker is using the new docker-root location:

108  rm -rf /var/lib/docker*
109  ln -s /home/docker/root /var/lib/docker
110  ls -l /var/lib

A symbolic link is left in the old location pointing to the new for good measure -- just in case some piece of software hard-coded that pathname.

« Move Windows Laptop to SSD drive without reinstall, for greater performance Moving /home on Ubuntu to a second drive »
2016 Election Acer C720 Ad block AkashaCMS Amazon Amazon Kindle Amazon Web Services America Amiga and Jon Pertwee Android Anti-Fascism AntiVirus Software Apple Apple Hardware History Apple iPhone Apple iPhone Hardware April 1st Arduino ARM Compilation Artificial Intelligence Astronomy Astrophotography Asynchronous Programming Authoritarianism Automated Social Posting AWS DynamoDB AWS Lambda Ayo.JS Bells Law Big Brother Big Data Big Finish Big Science Bitcoin Mining Black Holes Blade Runner Blockchain Blogger Blogging Books Botnets Cassette Tapes Cellphones China China Manufacturing Christopher Eccleston Chrome Chrome Apps Chromebook Chromebox ChromeOS CIA CitiCards Citizen Journalism Civil Liberties Clinton Cluster Computing Command Line Tools Comment Systems Computer Accessories Computer Hardware Computer Repair Computers Conservatives Cross Compilation Crouton Cryptocurrency Curiosity Rover Currencies Cyber Security Cybermen Cybersecurity Daleks Darth Vader Data backup Data Formats Data Storage Database Database Backup Databases David Tenant DDoS Botnet Department of Defense Department of Justice Detect Adblocker Developers Editors Digital Photography Diskless Booting Disqus DIY DIY Repair DNP3 Do it yourself Docker Docker MAMP Docker Swarm Doctor Who Doctor Who Paradox Doctor Who Review Drobo Drupal Drupal Themes DVD E-Books E-Readers Early Computers Election Hacks Electric Bicycles Electric Vehicles Electron Eliminating Jobs for Human Emdebian Encabulators Energy Efficiency Enterprise Node EPUB ESP8266 Ethical Curation Eurovision Event Driven Asynchronous Express Face Recognition Facebook Fake News Fedora VirtualBox Fifth Doctor File transfer without iTunes FireFly Flash Flickr Fraud Freedom of Speech Front-end Development G Suite Gallifrey git Github GitKraken Gitlab GMAIL Google Google Chrome Google Gnome Google+ Government Spying Great Britain Green Transportation Hate Speech Heat Loss Hibernate Hoax Science Home Automation HTTP Security HTTPS Human ID I2C Protocol Image Analysis Image Conversion Image Processing ImageMagick In-memory Computing InfluxDB Infrared Thermometers Insulation Internet Internet Advertising Internet Law Internet of Things Internet Policy Internet Privacy iOS Devices iPad iPhone iPhone hacking Iron Man iShowU Audio Capture iTunes Janet Fielding Java JavaFX JavaScript JavaScript Injection JDBC John Simms Journalism Joyent Kaspersky Labs Kext Kindle Kindle Marketplace Large Hadron Collider Lets Encrypt LibreOffice Linux Linux Hints Linux Single Board Computers Logging Mac Mini Mac OS Mac OS X Machine Learning Machine Readable ID macOS macOS High Sierra macOS Kext MacOS X setup Make Money Online March For Our Lives MariaDB Mars Mass Violence Matt Lucas MEADS Anti-Missile Mercurial MERN Stack Michele Gomez Micro Apartments Microsoft Military AI Military Hardware Minification Minimized CSS Minimized HTML Minimized JavaScript Missy Mobile Applications Mobile Computers MODBUS Mondas Monetary System MongoDB Mongoose Monty Python MQTT Music Player Music Streaming MySQL NanoPi Nardole NASA Net Neutrality Network Attached Storage Node Web Development Node.js Node.js Database Node.js Performance Node.js Testing Node.JS Web Development Node.x North Korea npm NVIDIA NY Times Online advertising Online Community Online Fraud Online Journalism Online Photography Online Video Open Media Vault Open Source Open Source and Patents Open Source Governance Open Source Licenses Open Source Software OpenAPI OpenJDK OpenVPN Palmtop PDA Patrick Troughton Paywalls Personal Flight Peter Capaldi Peter Davison Phishing Photography PHP Plex Plex Media Server Political Protest Politics Postal Service Power Control President Trump Privacy Production use Public Violence Raspberry Pi Raspberry Pi 3 Raspberry Pi Zero ReactJS Recaptcha Recycling Refurbished Computers Remote Desktop Removable Storage Republicans Retro Computing Retro-Technology Reviews RFID Rich Internet Applications Right to Repair River Song Robotics Robots Rocket Ships RSS News Readers rsync Russia Russia Troll Factory Russian Hacking Rust SCADA Scheme Science Fiction SD Cards Search Engine Ranking Season 1 Season 10 Season 11 Security Security Cameras Server-side JavaScript Serverless Framework Servers Shell Scripts Silence Simsimi Skype SmugMug Social Media Social Media Networks Social Media Warfare Social Network Management Social Networks Software Development Software Patents Space Flight Space Ship Reuse Space Ships SpaceX Spear Phishing Spring Spring Boot Spy Satellites SQLite3 SSD Drives SSD upgrade SSH SSH Key SSL Stand For Truth Strange Parts Swagger Synchronizing Files Tegan Jovanka Telescopes Terrorism The Cybermen The Daleks The Master Time-Series Database Tom Baker Torchwood Total Information Awareness Trump Trump Administration Trump Campaign Twitter Ubuntu Udemy UDOO US Department of Defense Virtual Private Networks VirtualBox VLC VNC VOIP Vue.js Walmart Weapons Systems Web Applications Web Developer Resources Web Development Web Development Tools Web Marketing Webpack Website Advertising Weeping Angels WhatsApp William Hartnell Window Insulation Windows Windows Alternatives Wordpress World Wide Web Yahoo YouTube YouTube Monetization