What is the difference between regular BJJ class and no Gi BJJ class? Simple: you wear a Gi in the regular class and you don’t in the no Gi class.
The more complex difference is, of course, do the two classes “feel” different? For me, yes – they feel very different. With the Gi, there is stuff to grip. There is friction. When you get a hold of something, can hang on to it. With no Gi, stuff slips and slides this way and that – it feels faster.
Do both. Do both to feel the interesting difference. Do both for practicality. Sometimes people are wearing jackets and pants. Sometimes they are wearing a flimsy t-shirt and shorts.