A documentary reference from 1259 makes us understand that the tower was built by the Muslim inhabitants of Carrícola and Muntis, with hispanic-muslim techniques of boxing of wall, but already with the own constructive pattern of a feudal fort, with its patio and the tower of the homage. The initiative belonged to the Catalan knight Ramon de Timor, who received this sites from the Moorish by the hand of King Jaume I, in the form of a feudal lordship. The castle of Carrícola passes through the centuries in hands of different owners. In 1296 the manor of Carrícola was integrated in the barony of Albaida. Later, Cardinal Joan de Milà and Aragò would move to the new palace in the lower part of the village.