Large amount of hole slag will be produced in the construction of punched cast-in-place piles for highway bridges. It is an effective countermeasure to apply the hole slag to concrete components of highway bridges nearby. Based on the recycling use of recycled coarse aggregates (RCAs) and considering that concrete structures in coastal areas are greatly affected by chloride corrosion, this paper prepared the recycled aggregate concrete mixed with the hole slag by replacing natural sand and natural coarse aggregates with the hole slag and RCAs, respectively. To investigate the effects of the hole slag replacement ratio (0, 50%, 70%, 100%) and RCAs replacement ratio (0, 50%, 70%, 100%) on the compressive and chloride resistance properties of such concrete, this paper carried out compression and chloride resistance tests of 96 specimens (48 cylinders with Φ 150×300 mm for compression test, and 48 cylinders with Φ 100×50 mm for chloride resistance test) made of such concrete, and mercury intrusion tests of the hole slag, river sand, and corresponding mortar. The test results show that: the compressive strength of such concrete decreases gradually with the increase of the replacement ratios of the hole slag and RCAs, and the reductions caused by the two are roughly the same; compared with RCAs, the influence of the hole slag on the elastic modulus and peak strain of such concrete is relatively limited; the chloride ion migration coefficient of such concrete increases gradually with the increase of the replacement ratios of the hole slag and RCAs on the whole, but the influence of the hole slag is obviously lower than that of RCAs; with the increase of the replacement ratio of the hole slag, the porosity of such concrete generally shows a trend of increasing gradually from fast to slow. When the hole slag and RCAs are used simultaneously in practical projects, it is suggested that the maximum replacement ratios of both should be limited to 50%.