the number of encoder and decoder blocks is wrong in the code

[AvAkanksh]

Kronos/model/kronos.py

Lines 59 to 68 in d5ffd46

	# Encoder Transformer Blocks
	self.encoder = nn.ModuleList([
	TransformerBlock(self.d_model, self.n_heads, self.ff_dim, self.ffn_dropout_p, self.attn_dropout_p, self.resid_dropout_p)
	for _ in range(self.enc_layers - 1)
	])
	# Decoder Transformer Blocks
	self.decoder = nn.ModuleList([
	TransformerBlock(self.d_model, self.n_heads, self.ff_dim, self.ffn_dropout_p, self.attn_dropout_p, self.resid_dropout_p)
	for _ in range(self.dec_layers - 1)
	])

the number of encoder and decoder blocks which are created are one less than mentioned because u have used range(self.enc_layers -1) and range(self.dec_layers -1)

so i think this needs a change in the code.

please tell me if i am wrong.

[AvAkanksh]

@shiyu-coder

[gtktreegrid]

Only N-1 transformer blocks are needed to reach N total encoding layers

[AvAkanksh]

@gtktreegrid y so ? From where do we get that one extra encoding block ? Please let me know I am not sure of it