Add the following registry key to the SCCM Distribution Point and restart the WDS service:
Location: HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\SMS\DP
Name: RamDiskTFTPBlockSize
TYPE: REG_DWORD Value: 16384
For us this made a massive difference from over 5 mins to under 15 seconds!