A Cr adhesion layer inserted between Ag nanoparticles and a glass substrate, for the purpose of improving the adhesion of Ag nanoparticles to glass, was observed to cause an abnormal peak shift of extinction spectra in non-specific reactions. The undesired peak shift misleads molecule detection in non-specific reactions. To solve this issue, a practical technique using n-propyl-trimethoxysilane-based passivation for the detection of amyloid-derived diffusible ligands was investigated as a route to eliminate the abnormal peak shifting observed in the non-specific reactions. To evaluate this passivation technique, localized surface plasmon resonance immunoassay experiments were conducted. Experimental results derived with and without the passivation process were investigated as a basis for comparative analysis. Our experimental results demonstrate that this passivation technique effectively eliminates the observed peak shift originating from the Cr adhesion layer.