Use one of the latest Girder version. Place all the icons you'd like to use in the httpd directory and type this URL http://girder/YOURICONNAME.jpg

Of course adapt YOURICONNAME.jpg to match your actual icon names. "http://girder/" is a special name that doesn't actually use HTTP but transfers the images over the existing Girder connection.