Multi-Task Learning by Multi-Wave Optical Diffractive Network

1
Jing Su
Jing Su
2
Yafei Yuan
Yafei Yuan
3
Chunmin Liu
Chunmin Liu
4
Jing Lia
Jing Lia
1 Fudan University

Send Message

To: Author

GJCST Volume 20 Issue A1

Article Fingerprint

ReserarchID

Z0B3B

Multi-Task Learning by Multi-Wave Optical Diffractive  Network Banner
  • English
  • Afrikaans
  • Albanian
  • Amharic
  • Arabic
  • Armenian
  • Azerbaijani
  • Basque
  • Belarusian
  • Bengali
  • Bosnian
  • Bulgarian
  • Catalan
  • Cebuano
  • Chichewa
  • Chinese (Simplified)
  • Chinese (Traditional)
  • Corsican
  • Croatian
  • Czech
  • Danish
  • Dutch
  • Esperanto
  • Estonian
  • Filipino
  • Finnish
  • French
  • Frisian
  • Galician
  • Georgian
  • German
  • Greek
  • Gujarati
  • Haitian Creole
  • Hausa
  • Hawaiian
  • Hebrew
  • Hindi
  • Hmong
  • Hungarian
  • Icelandic
  • Igbo
  • Indonesian
  • Irish
  • Italian
  • Japanese
  • Javanese
  • Kannada
  • Kazakh
  • Khmer
  • Korean
  • Kurdish (Kurmanji)
  • Kyrgyz
  • Lao
  • Latin
  • Latvian
  • Lithuanian
  • Luxembourgish
  • Macedonian
  • Malagasy
  • Malay
  • Malayalam
  • Maltese
  • Maori
  • Marathi
  • Mongolian
  • Myanmar (Burmese)
  • Nepali
  • Norwegian
  • Pashto
  • Persian
  • Polish
  • Portuguese
  • Punjabi
  • Romanian
  • Russian
  • Samoan
  • Scots Gaelic
  • Serbian
  • Sesotho
  • Shona
  • Sindhi
  • Sinhala
  • Slovak
  • Slovenian
  • Somali
  • Spanish
  • Sundanese
  • Swahili
  • Swedish
  • Tajik
  • Tamil
  • Telugu
  • Thai
  • Turkish
  • Ukrainian
  • Urdu
  • Uzbek
  • Vietnamese
  • Welsh
  • Xhosa
  • Yiddish
  • Yoruba
  • Zulu

Recently, there has been tremendous researches in Optical neural networks that could complete comparatively complex computation by optical characteristic with much more fewer dissipation than electrical networks. Existed neural networks based on the optical circuit are structured with an optical grating platform with different diffractive phase at different diffractive points. In this study, it proposed a multi-wave deep diffractive network with approximately 106 synapses, and it is easy to make hardware implementation of neuromorphic networks. In the optical architecture, it can utilize optical diffractive characteristic and different wavelengths to perform different tasks. Different wavelengths and different tasks inputs are independent of each other. Moreover, we can utilize the characteristic of them to inference several tasks, simultaneously. The results of experiments were demonstrated that the network could get a comparable performance to single-wavelength single-task. Compared to the multi-network, single network can save the cost of fabrication with lithography. We train the network on MNIST and MNIST-FASHION which are two different datasets to perform classification of 32*32 inputs with 10 classes. Our method achieves competitive results across both of them. In particular, on the complex task MNIST-FASION, our framework obtains an excellent accuracy improvement with 3.2%. On the meanwhile, MNSIT also have the improvement with 1.15%.

23 Cites in Articles

References

  1. J Jewell,H Gibbs,S Tarng,A Gossard,W Wiegmann (1982). Regenerative pulsations from an intrinsic bistable optical device.
  2. J Kraitl,H Ewald,H Gehring (2005). An optical device to measure blood components by a photoplethysmographic method.
  3. Yingying Liu,Xianqing Lin,Cong Wei,Chuang Zhang,Jiannian Yao,Yong Zhao (2019). 3D-printed optical-electronic integrated devices.
  4. Seyoon Kim,Sergey Menabde,Victor Brar,Min Jang (2019). Functional Mid‐Infrared Polaritonics in van der Waals Crystals.
  5. M Spencer,J Eickholt,J Cheng (2014). A Deep Learning Network Approach to ab initio Protein Secondary Structure Prediction.
  6. X Zhou,R Takayama,S Wang,T Hara,H Fujita (2017). Deep learning of the sectional appearances of 3D CT images for anatomical structure segmentation based on an FCN voting method.
  7. Chengqian Che,Ruogu Lin,Xiangrui Zeng,Karim Elmaaroufi,John Galeotti,Min Xu (2018). Improved deep learning-based macromolecules structure classification from electron cryo-tomograms.
  8. X,R Girshick,P Doll¨¢r,Z Tu,K He (2017). Aggregated Residual Transformations for Deep Neural Networks.
  9. Hein Htet Aung (null). Deep iterative convolutional neural network for face image super-resolution.
  10. D Li Deep learning: from speech recognition to language and multimodal processing.
  11. Shashi Singh,Ajai Kumar,Hemant Darbari,Lenali Singh,Anshika Rastogi,Shikha Jain (2017). Machine translation using deep learning: An overview.
  12. T Kwok,Y Kwok On the design, control, and use of a reconfigurable heterogeneous multicore system-on-a-chip.
  13. T Cianciulli,J Lax,F Cerruti,G Gigena,H Redruello,M Orsi,J Gagliardi,A Dorelle,M Riccitelli,H Prezioso (2010). COMPLEMENTARY VALUE OF TRANSTHORACIC ECHOCARDIOGRAPHY & CINEFLUOROSCOPIC EVALUATION OF MECHANICAL HEART PROSTHETIC VALVES.
  14. A Vincent,J Larroque,W Zhao,N Romdhane,O Bichler,C Gamrat,J-O Klein,S Galdin-Retailleau,D Querlioz (2014). Spin-transfer torque magnetic memory as a stochastic memristive synapse.
  15. Alexander Tait,Mitchell Nahmias,Yue Tian,Bhavin Shastri,Paul Prucnal (2013). Photonic Neuromorphic Signal Processing and Computing.
  16. Carlos Ríos,Matthias Stegmaier,Peiman Hosseini,Di Wang,Torsten Scherer,C Wright,Harish Bhaskaran,Wolfram Pernice (2015). Integrated all-photonic non-volatile multi-level memory.
  17. Roelof Hut,N Mrosovsky,Serge Daan (1999). Nonphotic Entrainment in a Diurnal Mammal, the European Ground Squirrel (<i>Spermophilus citellus</i>).
  18. K Voutsas,G Langner,J Adamy,M Ochse A brain-like neural network for periodicity analysis.
  19. M Dülk,S Fischer,M Bitter,M Caraccia,W Vogt,E Gini,H Melchior,W Hunziker,A Buxens,H Poulsen Ultrafast all-optical demultiplexer based on monolithic Mach-Zehnder interferometer with integrated semiconductor optical amplifiers.
  20. Xing Lin,Yair Rivenson,Nezih Yardimci,Muhammed Veli,Yi Luo,Mona Jarrahi,Aydogan Ozcan (2018). All-optical machine learning using diffractive deep neural networks.
  21. A Campo,C Greiner (2007). SU-8: a photoresist for high-aspect-ratio and 3D submicron lithography.
  22. Y Tian,P Luo,X Wang,X Tang,L Deng The MNIST Database of Handwritten Digit Images for Machine Learning Research [Best of the Web.
  23. C Loan (2011). Computational Frameworks for the Fast Fourier Transform.

Funding

No external funding was declared for this work.

Conflict of Interest

The authors declare no conflict of interest.

Ethical Approval

No ethics committee approval was required for this article type.

Data Availability

Not applicable for this article.

Jing Su. 2021. \u201cMulti-Task Learning by Multi-Wave Optical Diffractive Network\u201d. Global Journal of Computer Science and Technology - A: Hardware & Computation GJCST-A Volume 20 (GJCST Volume 20 Issue A1): .

Download Citation

Issue Cover
GJCST Volume 20 Issue A1
Pg. 31- 37
Journal Specifications

Crossref Journal DOI 10.17406/gjcst

Print ISSN 0975-4350

e-ISSN 0975-4172

Keywords
Classification
GJCST-A Classification: C.2.1
Version of record

v1.2

Issue date

January 9, 2021

Language

English

Experiance in AR

The methods for personal identification and authentication are no exception.

Read in 3D

The methods for personal identification and authentication are no exception.

Article Matrices
Total Views: 4405
Total Downloads: 987
2026 Trends
Research Identity (RIN)
Related Research

Published Article

Recently, there has been tremendous researches in Optical neural networks that could complete comparatively complex computation by optical characteristic with much more fewer dissipation than electrical networks. Existed neural networks based on the optical circuit are structured with an optical grating platform with different diffractive phase at different diffractive points. In this study, it proposed a multi-wave deep diffractive network with approximately 106 synapses, and it is easy to make hardware implementation of neuromorphic networks. In the optical architecture, it can utilize optical diffractive characteristic and different wavelengths to perform different tasks. Different wavelengths and different tasks inputs are independent of each other. Moreover, we can utilize the characteristic of them to inference several tasks, simultaneously. The results of experiments were demonstrated that the network could get a comparable performance to single-wavelength single-task. Compared to the multi-network, single network can save the cost of fabrication with lithography. We train the network on MNIST and MNIST-FASHION which are two different datasets to perform classification of 32*32 inputs with 10 classes. Our method achieves competitive results across both of them. In particular, on the complex task MNIST-FASION, our framework obtains an excellent accuracy improvement with 3.2%. On the meanwhile, MNSIT also have the improvement with 1.15%.

Our website is actively being updated, and changes may occur frequently. Please clear your browser cache if needed. For feedback or error reporting, please email [email protected]
×

This Page is Under Development

We are currently updating this article page for a better experience.

Request Access

Please fill out the form below to request access to this research paper. Your request will be reviewed by the editorial or author team.
X

Quote and Order Details

Contact Person

Invoice Address

Notes or Comments

This is the heading

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Ut elit tellus, luctus nec ullamcorper mattis, pulvinar dapibus leo.

High-quality academic research articles on global topics and journals.

Multi-Task Learning by Multi-Wave Optical Diffractive Network

Jing Su
Jing Su Fudan University
Yafei Yuan
Yafei Yuan
Chunmin Liu
Chunmin Liu
Jing Lia
Jing Lia

Research Journals