# Session 3: More Complicated NN Architectures Reading List

**URL:** <https://community.intuitivebayes.com/t/session-3-more-complicated-nn-architectures-reading-list/1098>\
**Category:** GenAI\
**Created:** [May 21, 2023, 11:08pm UTC](https://community.intuitivebayes.com/t/session-3-more-complicated-nn-architectures-reading-list/1098 "2023-05-21T23:08:48Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![RavinKumar](https://yyz1.discourse-cdn.com/flex007/user_avatar/community.intuitivebayes.com/ravinkumar/32/13_2.png) [@RavinKumar](https://community.intuitivebayes.com/u/RavinKumar)\
**Post date:** [May 21, 2023, 11:08pm UTC](https://community.intuitivebayes.com/t/session-3-more-complicated-nn-architectures-reading-list/1098/1 "2023-05-21T23:08:48Z")

</div>

Hey Folks,  
The tentative date for our next session is two weeks from now, on June 4th.

As of now we’ll be studying

- More complicated NN structures such as
  - Deeper Dense Networks
  - CNNs and why differing network architectures work
  - Transformers, the one that’s taking over them all

- Good practice for NN code in production

We’re going to focus on this example from Flax, and I’ll be updating and tweaking it as well to fit out book club.

> **[flax/examples/mnist at main · google/flax](https://github.com/google/flax/tree/main/examples/mnist)**
>
> main/examples/mnist

As I go through building out this session I may post additional examples as well.

---

<div class="post-metadata">

**Author:** ![RavinKumar](https://yyz1.discourse-cdn.com/flex007/user_avatar/community.intuitivebayes.com/ravinkumar/32/13_2.png) [@RavinKumar](https://community.intuitivebayes.com/u/RavinKumar)\
**Post date:** [May 27, 2023, 4:59pm UTC](https://community.intuitivebayes.com/t/session-3-more-complicated-nn-architectures-reading-list/1098/2 "2023-05-27T16:59:38Z")

</div>

Hey folks, I’m putting together the material. Here’s what we’ll cover in more depth.

the TDLR is that training NNs these days can basically be summarized into “How do I create the most efficient learning architecture that balances the data and I can train in a finite time with limited hardware as much as possible”

To do this

1. An applied example in Flax showing the differences in performance between a Vanilla NN and a CNN
2. An overview of infrastructure and code setup that makes this efficient
3. A short intro on why transformers are taking over
4. A list of my best references for understanding transformers

Tools we’re going to use

- Flax
- Colab
- Tensorboard

Let me know if there’s any other topics you’d like me to cover!

---

<div class="post-metadata">

**Author:** ![RavinKumar](https://yyz1.discourse-cdn.com/flex007/user_avatar/community.intuitivebayes.com/ravinkumar/32/13_2.png) [@RavinKumar](https://community.intuitivebayes.com/u/RavinKumar)\
**Post date:** [May 28, 2023, 3:18pm UTC](https://community.intuitivebayes.com/t/session-3-more-complicated-nn-architectures-reading-list/1098/3 "2023-05-28T15:18:37Z")

</div>

Third session is scheduled for one week from now! Livestream link below

> **[Intuitive AI - Neural Network Architectures (including transformers) and...](https://www.youtube.com/live/bP8XKzoN9LU?feature=share)**
>
> In this second session of study club we'll continue building our understanding of Large Language Models. In this session we'll cover the intuition of differe...