Rainfall-runoff modeling plays a crucial role in achieving efficient water resource management and flood forecasting, particularly in the context of increasing intensity and frequency of extreme meteorological events induced by climate change. Therefore, the aim of this research is to assess the accuracy of the Long-Short-Term Memory (LSTM) neural networks and the impact of its architecture in predicting runoff, with a particular focus on capturing extreme hydrological discharges in the Ouergha basin; a Moroccan Mediterranean basin with historical implications in many cases of flooding; using solely daily rainfall and runoff data for training. For this purpose, three LSTM models of different depths were constructed, namely LSTM 1 single-layer, LSTM 2 bi-layer, and LSTM 3 tri-layer, their window size and hyperparameters were first tuned, and on seven years of daily data they were trained, then validated and tested on two separate years to ensure the generalization on unseen data. The performance of the three models was compared using hydrogram-plots, Scatter-plots, Taylor diagrams, and several statistical metrics. The results indicate that the single-layer LSTM 1 outperforms the other models, it consistently achieves higher overall performance on the training, validation, and testing periods with a coefficient of determination R-squared of 0.92, 0.97, and 0.95 respectively; and with Nash-Sutcliff efficiency metric of 0.91, 0.94 and 0.94 respectively, challenging the conventional beliefs about the direct link between complexity and effectiveness. Furthermore, all the models are capable of capturing the extreme discharges, although, with a moderate underprediction trend for LSTM 1 and 2 as it does not exceed -25% during the test period. For LSTM 3, even if its underestimation is less pronounced, its increased error rate reduces the confidence in its performance. This study highlights the importance of aligning model complexity with data specifications and suggests the necessity of considering unaccounted factors like upstream dam releases to enhance the efficiency in capturing the peaks of extreme events.