I believe it's mainly your genetics. There are factors that decline your memory from ageing and lifestyle. Vitamin D plays a part in memory decline. It doesn't make you a brilliant guy.
No twins are the same but they could be close. Intelligence is genetic and stable across life, but it is not...