This paper proposes a non-local macro-micro damage model based on the scaled boundary finite element method (SBFEM) framework. It investigated the spatial variability of microscopic physical parameters of the material, and studied the influence of spatial variability of material parameters on the crack propagation process of the structure. The results show that considering the spatial variability of material parameters, the crack propagation path has uncertainty, and the proposed model can well reflect the inherent randomness of materials. As the stress state of the structure becomes more complex and the number of defects in the structure increases, the variability of the crack initiation pattern will also increase. The autocorrelation length and coefficient of variation of parameters have a significant impact on the structural cracking process.