On websites without "index.html" files it is possible to see the other files in the server-side directory the url directs to from a browser. Is it possible to examine this information from a script, for a directory which does contain an "index.html" file without having downloaded the webpage?
I assume it's possible in selenium, but would like to avoid it if possible due to speed.
If so, how? If not, why - what goes on when you download a webpage from a browser and get the content?