The objective of this study was to assess factors affecting image quality of 320-row computed tomography angiography (CTA) of coronary arteries in children with congenital heart disease (CHD). We retrospectively reviewed 28 children up to 3 years of age with CHD who underwent prospective electrocardiography (ECG)-gated 320-row CTA with iterative reconstruction. We assessed image quality of proximal coronary artery segments using a five-point scale. Age, body weight, average heart rate, and heart rate variability were recorded and compared between two groups: patients with good diagnostic image quality in all four coronary artery segments and patients with at least one coronary artery segment with nondiagnostic image quality. Altogether, 96 of 112 segments (85.7 %) had diagnostic-quality images. Patients with nondiagnostic segments were significantly younger (10.0 ± 11.6 months) and had lower body weight (5.9 ± 2.9 kg) (each p < 0.05) than patients with diagnostic image quality of all four segments (20.6 ± 13.8 months and 8.4 ± 2.5 kg, respectively; each p < 0.05). Differences in heart rate and heart rate variability between the two imaging groups were not significant. Receiver operating characteristic analyses for predicting patients with nondiagnostic image quality revealed an optimal body weight cutoff of ≤5.6 kg and an optimal age cutoff of ≤12.5 months. Prospective ECG-gated 320-row CTA with iterative reconstruction provided feasible image quality of coronary arteries in children with CHD. Younger age and lower body weight were factors that led to poorer image quality of coronary arteries.