Initially, DeepSeek created their first model with structure much like different open models like LLaMA, aiming to outperform benchmarks.