[vip-help] Resources for Transformers

[Yadav, Amit Kumar Singh]

Hi William,

Please find below work on transformer neural network.


  1.  Vaswani, N. Shazeer, N. Parmar, et al., “Attention is All You Need,” Proceedings of the Neural Information Processing Systems, December 2017, Long Beach, CA.
     *   https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf



  1.  Strudel, Robin, Ricardo Garcia, Ivan Laptev, and Cordelia Schmid. "Segmenter: Transformer for semantic segmentation." Proceedings of the IEEE/CVF International Conference on Computer Vision, October 2021, Montreal.
     *   https://arxiv.org/pdf/2105.05633.pdf
     *   https://github.com/rstrudel/segmenter



  1.  Namyup Kim, Dongwon Kim, Cuiling Lan, Wenjun Zeng, Suha Kwak; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 2022, New Orleans.
     *   http://cvlab.postech.ac.kr/research/restr/

You may also be interested to look at all the work related to Swim transformers - https://github.com/microsoft/Swin-Transformer<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fmicrosoft%2FSwin-Transformer&data=05%7C01%7Cvip-help%40ecn.purdue.edu%7Cfa617e2d748a46b1fc0908dba8edc44a%7C4130bd397c53419cb1e58758d6d63f21%7C0%7C0%7C638289511371322704%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=VHroSaCtejufU3Zx9Mgz6O05NQQgUpbHSeikyc8YUt0%3D&reserved=0>

Sincerely,
--------------
Amit Kumar Singh Yadav
Ph.D. Candidate
Research Assistant
Video and Image Processing Laboratory (VIPER)
School of Electrical and Computer Engineering
Purdue University
465 Northwestern Avenue
West Lafayette, IN 47907-2035
U.S.A.
Telephone: +1 765 714 7056
email: yadav48 at purdue.edu<mailto:yadav48 at purdue.edu>
--------------


From: vip-help <vip-help-bounces at ecn.purdue.edu> on behalf of Stevens, William Henry <stevenwh at purdue.edu>
Date: Tuesday, August 29, 2023 at 6:45 PM
To: vip-help at ecn.purdue.edu <vip-help at ecn.purdue.edu>
Subject: [vip-help] Resources for Transformers
Hi everyone,

Professor Delp suggested today that I research transformers for the lane detection team this semester. He mentioned that these could improve our segmentation performance. I have zero experience or knowledge of transformers, so Professor Delp suggested I reach out to the PhD students for help. Amit said he would send some resources my way but if anyone else is able to send me some as well it would be greatly appreciated. Thank you.

Sincerely,
William
-------------- next part --------------
An HTML attachment was scrubbed...
URL: </ECN/mailman/archives/vip-help/attachments/20230830/736bb183/attachment-0001.htm>