DO NOT MERGE Next#27

Draft

vringar wants to merge 36 commits intomasterfrom

Commits on Jun 15, 2020

Commits on Jun 24, 2020

Commits on Jul 13, 2020

We shouldn't try to follow OpenWPMs versions
vringar
committed

Commits on Jul 27, 2020

Fixing display_crawl_history
Stefan Zabka
committed
Added docstrings
Stefan Zabka
committed
Made PySparkS3Dataset forward to S3Dataset
Stefan Zabka
committed
Made PySparkS3Dataset a subclass of S3Dataset
Stefan Zabka
committed

Commits on Aug 7, 2020

Merge branch 'master' into update_option_dict
Stefan Zabka
committed

Commits on Mar 19, 2021

Returning None if something goes wrong during get_matching_rules
Stefan Zabka
committed
Merge branch 'master' into display_crawl_history
Stefan Zabka
committed
Added demo file
Stefan Zabka
committed
Merge branch 'master' into update_option_dict
Stefan Zabka
committed
Merge branch 'display_crawl_history' into next
Stefan Zabka
committed
Merge branch 'fixing_collect_content' into next
Stefan Zabka
committed
GcsDataset implementation
Stefan Zabka
committed

Commits on Mar 22, 2021

Merge branch 'display_crawl_history' into gcsDataset
Stefan Zabka
committed
Changing scheme from gcs to gs
Stefan Zabka
committed
Merge branch 'gcsDataset' into next
Stefan Zabka
committed

Commits on Apr 6, 2021

Big mess
Stefan Zabka
committed
Changing base path
Stefan Zabka
committed
More typing
Stefan Zabka
committed
Elif in load_table
Stefan Zabka
committed

Commits on Apr 9, 2021

Merge branch 'master' into next
Stefan Zabka
committed