Gcs dataset#30

Open

vringar wants to merge 12 commits intomasterfrom

Commits on Apr 9, 2021

Removed collect_content from PySparkS3Dataset
Stefan Zabka
committed
Added mode parameter to PySparkS3Dataset

vringar
authored and
Stefan Zabka
committed
Added display_crawl_results

vringar
authored and
Stefan Zabka
committed
Rewrote crawlhistory.py

vringar
authored and
Stefan Zabka
committed
Used typeannotations

vringar
authored and
Stefan Zabka
committed
Fixing display_crawl_history
Stefan Zabka
committed
Added docstrings
Stefan Zabka
committed
Added demo file
Stefan Zabka
committed
Backporting from next
Stefan Zabka
committed
Updated get_option_dict (#22)
Stefan Zabka
committed
GcsDataset implementation
Stefan Zabka
committed
Changing scheme from gcs to gs
Stefan Zabka
committed