Here you can find the locations of 30 caves. This does not include the underwater caves added more recent. There will be a post soon for those locations.
*Updated 14 May 2019.
Credit goes to u/USASgtNickFury from Reddit
1. A1 #teleport yourname -539705.59179 -386756.99687 0
2. A1 #teleport yourname -560102.80659 -452644.86338 0
3. A2 #teleport yourname -79542.04752 -395635.51402 0
4. A3 #teleport yourname 293401.86631 -329186.91731 0
5. B1 #teleport yourname -333700.93743 -43088.78647 0
6. B1 #teleport yourname -523280.35387 -147364.46316 0
7. B1 #teleport yourname -566224.24773 -83439.22453 0
8. B2 #teleport yourname -254915.88072 -159630.84326 0
9. B2 #teleport yourname -62953.283859999996 5906.53635 0
10. B3 #teleport yourname 36789.71963 -49724.29907 0
11. B3 #teleport yourname 233939.25661 -119093.46187 0
12. B3 #teleport yourname 167981.29772 -236640.19048 0
13. B4 #teleport yourname 424219.62189 -117434.58015 0
14. C1 #teleport yourname -350126.16822 169761.68438 0
15. C1 #teleport yourname -537172 188361 41813
16. C2 #teleport yourname -125500.00143 73943.92238 0
17. C2 #teleport yourname 7654.19874 106911.21709 0
18. C2 #teleport yourname 2397.1894 168733.64486 0
19. C2 #teleport yourname -261808.41121 41397.19626 0
20. C2 #teleport yourname -211574.76636 195135.51402 0
21. C3 #teleport yourname 193074.77206 73523.36092 0
22. C3 #teleport yourname 24616.80674 29738.30849 0
23. C3 #teleport yourname 11205.607479999999 103897.19626 0
24. C3 #teleport yourname 115662 159300 39843
25. C4 #teleport yourname 342140.19262 295766.3473 0
26. D1 #teleport yourname -396925.24505 380579.42784 0
27. D2 #teleport yourname -82065.42341 428196.26881 0
28. D2 #teleport yourname -174588.77364 545532.69887 0
29. D3 #teleport yourname 236859.8138 561934.58158 0
30. D4 #teleport yourname 477841.11009 454785.05814 0