I have written a function to download certain files to both a local directory and a google drive directory. The files do not appear in Finder, nor via an "ls -la" command in Terminal.
When I run a Terminal Listing within my colab notebook, the files are listed in the expected directory structure:

import os
for root, dirs, files in os.walk("/Users/glenn/Documents/SEC Edgar Data"):
    print("Folder:", root)
    for file in files:
        print("  ", file)

COLAB OUTPUT SAMPLE:

older: /Users/xxxxx/Documents/SEC Edgar Data
   Comerica_10K.html
   test_file.txt

Folder: /Users/xxxxx/Documents/SEC Edgar Data/sec-edgar-filings
Folder: /Users/xxxxx/Documents/SEC Edgar Data/sec-edgar-filings/WTFC
Folder: /Users/xxxxx/Documents/SEC Edgar Data/sec-edgar-filings/WTFC/10-K
Folder: /Users/xxxxx/Documents/SEC Edgar Data/sec-edgar-filings/WTFC/10-K/0001015328-25-000093
   full-submission.txt
Folder: /Users/xxxxx/Documents/SEC Edgar Data/sec-edgar-filings/WTFC/10-K/0000948572-00-000021

I have tried many different debugging options, including looking for hidden files and restarting the finder. Still, no files appear.

Can anybody help me further debug?

I have written a function to download certain files to both a local directory and a google drive directory. The files do not appear in Finder, nor via an "ls -la" command in Terminal.
When I run a Terminal Listing within my colab notebook, the files are listed in the expected directory structure:

import os
for root, dirs, files in os.walk("/Users/glenn/Documents/SEC Edgar Data"):
    print("Folder:", root)
    for file in files:
        print("  ", file)

COLAB OUTPUT SAMPLE:

older: /Users/xxxxx/Documents/SEC Edgar Data
   Comerica_10K.html
   test_file.txt

Folder: /Users/xxxxx/Documents/SEC Edgar Data/sec-edgar-filings
Folder: /Users/xxxxx/Documents/SEC Edgar Data/sec-edgar-filings/WTFC
Folder: /Users/xxxxx/Documents/SEC Edgar Data/sec-edgar-filings/WTFC/10-K
Folder: /Users/xxxxx/Documents/SEC Edgar Data/sec-edgar-filings/WTFC/10-K/0001015328-25-000093
   full-submission.txt
Folder: /Users/xxxxx/Documents/SEC Edgar Data/sec-edgar-filings/WTFC/10-K/0000948572-00-000021

I have tried many different debugging options, including looking for hidden files and restarting the finder. Still, no files appear.

Can anybody help me further debug?

• python
• google-colaboratory

Share Improve this question Follow asked Mar 26 at 18:39 GPBGPB 2,49588 gold badges2727 silver badges3737 bronze badges 3

• When you run an os.walk() command in Colab on what appears to be a local path, Colab is actually checking its own filesystem structure, not your local machine's. – Bhargav Commented Mar 26 at 19:02
• @Bhargav thank you. How do you suggest I reconcile? I've not had a problem writing to my local machine in the past. – GPB Commented Mar 26 at 21:36
• UPDATE: I can see the files which are located by os.walk within the colab directory structure. This is not mirrored in my local drive. This has never been the case in the past - all writes have always been locally mirrored. Is there a setting which might have changed to prevent the mirroring? – GPB Commented Mar 26 at 21:58

Add a comment  | 

1 Answer 1

Sorted by: Reset to default 0

Update - I had a problem with G-Drive, issue has been resolved. Thank you everyone who considered my post.