Mapping Grayscale Images to Colour Space Using Deep Learning

Document Type : Research Paper

Authors

1 Assistant Professor, Ph.D., Department of Computer Science and Engineering, G. B. Pant Govt. Engineering College, New Delhi, India.

2 Assistant Professor, Department of Computer Science and Engineering, G.B. Pant Govt. Engineering College, New Delhi, India.

Abstract

People are used to exploring grayscale images in their family albums but it is difficult to grasp the reality without colours. Luckily, with advancements in Machine Learning it has been possible to solve problems previously thought impossible. The authors aim to automatically colourize grayscale images using a subset of Machine Learning called Deep Learning. The system will be trained on an image dataset and given an input grayscale image the model will be able to assign aesthetically believable colours. A grayscale photograph has been provided; our approach solves the problem of visualizing a reasonable colour version of the grayscale picture. This issue is undoubtedly under controlled; therefore earlier methods to this problem have either counted majorly on user interaction or it leads to in unsaturated colourizations. The authors put forward a completely automatic approach that will try to produce realistic and vibrant colourizations as much as possible. The proposed system has been applied as a feed-forward in a Convolutional Neural Network and has been trained on over twenty thousand colour images currently.

Keywords

References

Chang, H., Fried, O., Liu, Y., DiVerdi, S., & Finkelstein, A. (2015). Palette-based photo recoloring. ACM Transactions on Graphics (TOG), 34(4), 139.
Chen, X., Zou, D., Zhao, Q., & Tan, P. (2012). Manifold preserving edit propagation. ACM Transactions on Graphics (TOG) 31(6), 132.
Cheng, Z., Yang, Q., & Sheng, B. (2015). Deep Colorization. IEEE International Conference on Computer Vision (ICCV), 415–423.
Chia, A.Y.S., Zhuo, S., Gupta, R.K., Tai, Y.W., Cho, S.Y., Tan, P., & Lin, S. (2011). Semantic colorization with internet images. ACM Transactions on Graphics (TOG). ACM, 30, 156.
Dahl, R. (2016). Automatic colourization. Retrieved from http://tinyclouds.org/colourize
Deshpande, A., Rock, J., & Forsyth, D. (2015). Learning Large-Scale Automatic Image Colourization. IEEE International Conference on Computer Vision (ICCV), 567–575.
Gupta, R.K., Chia, A.Y.S., Rajan, D., Ng, E.S., & Zhiyong, H. (2012). Image colorization using similar images. In Proceedings of the 20th ACM international conference on Multimedia (ACMM  '12). Nara, Japan: ACM, 369–378.
Hertzmann, A., Jacobs, C.E., Oliver, N., Curless, B., & Salesin. D.H. (2001). Image analogies. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques. Los Angeles, CA: ACM.
Huang, Y.C., Tung, Y.S., Chen, J.C., Wang, S.W., & Wu, J.L. (2005). An adaptive edge detection based colorization algorithm and its applications. Proceedings of the 13th annual ACM international conference on Multimedia. Singapore: ACM, 351-354.
Iizuka, S., Simo-Serra, E., & Ishikawa, H. (2016). Let there be Colour: Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colourization with Simultaneous Classification. ACM Transactions on Graphics (TOG), 35(4), Article 110.
Irony, R., Cohen-Or, D., & Lischinski, D. (2005). Colorization by example. Eurographics Symp. on Rendering. Citeseer,2.
Isola, P., Zhu, J.Y., Zhou, T., & Efros, A.A. (2017). Image-to-image translation with conditional adversarial networks. CVPR.
Larsson, G., Maire, M., & Shakhnarovich, G. (2016). Learning Representations for Automatic Colourization. Computer Vision – ECCV 2016, 577-593.
Levin, A., Lischinski, D., & Weiss, Y. (2004). Colorization using Optimization. ACM Transactions on Graphics.
Li, X., Zhao, H., Nie, G., and Huang, H. (2015). Image recoloring using geodesic distance based color harmonization. Computational Visual Media 1(2), 143– 155.
Li, Y., Adelson, E., & Agarwala, A. (2008). ScribbleBoost: Adding Classification to Edge-Aware Interpolation of Local Image and Video Adjustments. Computer Graphics Forum. Wiley Online Library, 27, 1255–1264.
Liu, X., Wan, L., Qu, Y., Wong, T.T., Lin, S., Leung, C.S., & Heng, P.A. (2008). Intrinsic colorization. ACM Transactions on Graphics (TOG). ACM, 27, 152.
Liu, Y., Cohen, M., Uyttendaele, M., & Rusinkiewicz, S. (2014). AutoStyle: automatic style transfer from image collections to users’ images. Computer Graphics Forum. Wiley Online Library, 33, 21–31.
Sangkloy, P., Lu, J., Fang, C., Yu, F., & Hays, J. (2017). Scribbler: Controlling Deep Image Synthesis with Sketch and Color. CVPR (2017).
Simo-Serra, E., Iizuka, S., Sasaki, K., & Ishikawa, H. (2016). Learning to simplify: fully convolutional networks for rough sketch cleanup. ACM Transactions on Graphics (TOG). ACM, 35(4), 121.
Wang, B., Yu, Y., Wong, T.T., Chen, C., & Xu, Y.Q. (2010). Data-driven image color theme enhancement. ACM Transactions on Graphics (TOG). ACM, 29, 146.
Welsh, T., Ashikhmin, M., & Mueller, K. (2002). Transferring color to greyscale images. ACM Transactions on Graphics (TOG). ACM, 21(3), 277–280.
Yan, Z., Zhang, H., Wang, B., Paris, S., & Yu, Y. (2016). Automatic photo adjustment using deep neural networks. ACM Transactions on Graphics (TOG). ACM, 35(2), 11.
Zhang, R., Isola, P., & Efros, A.A. (2016). Colourful Image Colourization. Computer Vision – ECCV 2016, 649-666.
Zhang, R., Zhu, J.U., Isola, P., Geng, X., Lin, A.S., Yu, T., & Efros, A.A. (2017). Real-Time User-Guided Image Colourization with Learned Deep Priors. SIGGRAPH.
Zhou, B., Lapedriza, A., Xiao, J., Torralba, A., & Oliva, A. (2014). Learning deep features for scene recognition using places database. In Proceedings of the 27th International Conference on Neural Information Processing Systems (NIPS '14). Montreal, QC: MIT Press, 487-495.

Files

Share

How to cite

Statistics