Просмотр

Материал из MachineLearning.

У вас нет прав на выполнение этой операции по следующим причинам:

• Запрошенное действие могут выполнять только участники из групп emailconfirmed, Администраторы.
• Вы должны подтвердить ваш адрес электронной почты перед правкой страниц. Пожалуйста, введите и подтвердите ваш адрес эл. почты на странице настроек.

Вы можете просмотреть и скопировать исходный текст этой страницы:

__NOTOC__ This is an introductory course on deep learning models and their application for solving different problems of image and text analysis. '''Instructors''': [[Участник:Kropotov|Dmitry Kropotov]], [[Участник:Victor Kitov|Victor Kitov]], Nadezhda Chirkova, Oleg Ivanov and Evgeny Nizhibitsky. The timetable in Autumn 2019: Mondays, lectures begin at 10-30, seminars begin at 12-15, room 526b. For questions: [https://t.me/joinchat/DEBCqg81GIyo4YNkdQtqzw course chat in Telegram] == News == '''09 Sep:''' Today's lecture is cancelled. Seminar will start normally at 12-15. '''06 Sep:''' First theoretical assignment is uploaded to anytask. Deadline: '''15 Sep'''. Please note: this is a strict deadline, no delay is possible. '''01 Oct:''' Second practical assignment is uploaded to anytask. Deadline: '''15 Oct'''. == Rules and grades == We have 7 home assignments during the course. For each assignment, a student may get up to 10 points + possibly bonus points. For some assignments a student is allowed to upload his fulfilled assignment during one week after deadline with grade reduction of 0.5 points per day. All assignments are prepared in English. Also each student may give a small 10-minutes talk in English on some recent DL paper. For this talk a student may get up to 5 points. The total grade for the course is calculated as follows: Round-up (0.3*<Exam_grade> + 0.7*<Semester_grade>), where <Semester_grade> = min(10, (<Assignments_total_grade> + <Talk_grade>) / 7), <Exam_grade> is a grade for the final exam (up to 10 points). {| class="standard" !Final grade !! Total grade !! Necessary conditions |- | 5 || >=8 || all practical assignments are done, exam grade >= 6 and oral talk is given |- | 4 || >=6 || 6 practical assignments are done, exam grade >= 4 |- | 3 || >=4 || 3 practical assignments are done, exam grade >= 4 |- |} == Practical assignments == Practical assignments are provided on course page in ''anytask.org''. Invite code: IXLOwZU == Lectures == {| class="standard" !Date !! No. !! Topic !! Materials |- | 02&nbsp;Sep.&nbsp;2019 || align="center"|1 || Introduction. Fully-connected networks. || |- | 16&nbsp;Sep.&nbsp;2019 || align="center"|2 || Optimization and regularization for neural networks. Convolutional neural networks. || [https://drive.google.com/file/d/1d2Pn4Lb15rQ1p-z1SeOzuh9kmvSV4d3I/view?usp=sharing Presentation (pptx)]<br> [https://drive.google.com/file/d/1sKdXAc1iSSNy4ZrRaPs2UXuWHZE29Bnc/view?usp=sharing Presentation (pdf)]<br> [https://arxiv.org/pdf/1412.6980.pdf A paper about ADAM]<br> [http://jmlr.org/papers/volume15/srivastava14a/srivastava14a.pdf A paper about DropOut]<br> [https://arxiv.org/pdf/1502.03167.pdf A paper about BatchNorm] |- | 23&nbsp;Sep.&nbsp;2019 || align="center"|3 || Semantic image segmentation || [https://yadi.sk/i/qaR_c-9fE0G0Nw Presentation (pdf)]<br>[https://portrait.nizhib.ai/ Portrait Demo] ([https://github.com/nizhib/portrait-demo source]) |- | 30&nbsp;Sep.&nbsp;2019 || align="center"|4 || Object detection on images || [https://yadi.sk/i/WN0IV9TKBkvh5A Presentation (pdf)]<br>[https://yadi.sk/i/WN0IV9TKBkvh5A DS Bowl 2018 report (pdf)] |- | 07&nbsp;Oct.&nbsp;2019 || align="center"|5 || Image style transfer || Presentations [https://yadi.sk/i/1wCKBk6nt3IeLA 1], [https://yadi.sk/i/hl9i5Y1fuPr4Qg 2], [https://yadi.sk/i/eDHSVCRPNTxLpA 3], [https://yadi.sk/i/v-Oc7h8eTgIN-A 4], [https://yadi.sk/i/xwGRhEXa3cl9uA 5], [https://yadi.sk/i/rXAgWiDTLzgnsQ 6]. |- | 14&nbsp;Oct.&nbsp;2019 || align="center"|6 || Recurrent neural networks || |- | 21&nbsp;Oct.&nbsp;2019 || align="center"|7 || Attention and memory in recurrent neural networks || |- | 28&nbsp;Oct.&nbsp;2019 || align="center"|8 || Variational autoencoder || |- | 11&nbsp;Nov.&nbsp;2019 || align="center"|9 || Generative adversarial networks || |- | 18&nbsp;Nov.&nbsp;2019 || align="center"|10 || Reinforcement learning. Q-learning, DQN. || |- | 25&nbsp;Nov.&nbsp;2019 || align="center"|11 || Policy gradient in reinforcement learning || |- | 02&nbsp;Dec.&nbsp;2019 || align="center"|12 || Implicit reparameterization trick. Gumbel-Softmax approach for discrete reparameterization. || |- | 09&nbsp;Dec.&nbsp;2019 || align="center"|13 || Students' talks || |- |} == Seminars == {| class="standard" !Date !! No. !! Topic !! Need laptops !! Materials |- | 2&nbsp;Sep.&nbsp;2019 || align="center"|1 || Matrix calculus, automatic differentiation. || No || [https://drive.google.com/file/d/1Yu790uIPyxp9JIyysxfJDor_LJQu83gQ/view?usp=sharing Synopsis]<br> [https://people.maths.ox.ac.uk/gilesm/files/NA-08-01.pdf pdf] |- | 9&nbsp;Sep.&nbsp;2019 || align="center"|2 || Introduction to Pytorch || Yes || [https://github.com/nadiinchi/dl_labs/blob/master/lab_pytorch.ipynb ipynb] |- | 16&nbsp;Sep.&nbsp;2019 || align="center"|3 || Convolutional neural networks on Pytorch || Yes || [https://github.com/nadiinchi/dl_labs/blob/master/lab_cnn_english.ipynb ipynb] |- | 23&nbsp;Sep.&nbsp;2019 || align="center"|4 || Semantic image segmentation || No || |- | 30&nbsp;Sep.&nbsp;2019 || align="center"|5 || Face recognition || No || |- | 07&nbsp;Oct.&nbsp;2019 || align="center"|6 || Image style transfer || No || |- | 14&nbsp;Oct.&nbsp;2019 || align="center"|7 || DropOut for recurrent neural networks || Yes || |- | 21&nbsp;Oct.&nbsp;2019 || align="center"|8 || Models with attention || Yes || |- | 28&nbsp;Oct.&nbsp;2019 || align="center"|9 || Variational autoencoders, adversarial attacks || Yes || |- | 11&nbsp;Nov.&nbsp;2019 || align="center"|10 || Generative adversarial networks || Yes || |- | 18&nbsp;Nov.&nbsp;2019 || align="center"|11 || Bandits || No || |- | 25&nbsp;Nov.&nbsp;2019 || align="center"|12 || Actor-critic approach in RL || No || |- | 02&nbsp;Dec.&nbsp;2019 || align="center"|13 || Semi-supervised discrete VAE || Yes || |- | 09&nbsp;Dec.&nbsp;2019 || align="center"|14 || Students' talks || No || |- |} == Arxiv == [[Глубинное обучение (курс лекций)/2017|2017]] [[Глубинное обучение (курс лекций)/2016|2016]]

Возврат к странице Глубинное обучение (курс лекций)/2019.