updates

Author: ehanson8

README.md

@@ -7,20 +7,27 @@ All of these scripts require a secrets.py file in the same directory that must c
         password='my_dspace_password'    
         filePath = '/Users/dspace_user/dspace-data-collection/data/'
         handlePrefix = 'http://dspace.myuni.edu/handle/'
+        verify = True or False (no quotes). Use False if using an SSH tunnel to connect to the DSpace API
 ```
-The 'filePath' is directory into which output files will be written and 'handlePrefix' may or may not vary from your DSpace URL depending on your configuration. This secrets.py file will be ignored according to the repository's .gitignore file so that DSpace login details will not be inadvertently exposed through Github
+The 'filePath' is directory into which output files will be written and 'handlePrefix' may or may not vary from your DSpace URL depending on your configuration. This secrets.py file will be ignored according to the repository's .gitignore file so that DSpace login details will not be inadvertently exposed through Github.
+
+If you are using both a development server and a production server, you can create a separate secrets.py file with a different name (e.g. secretsProd.py) and containing the production server information. When running each of these scripts, you will be prompted to enter the file name (e.g 'secretsProd' without '.py') of an alternate secrets file. If you skip the prompt or incorrectly type the file name, the scripts will default to the information in the secrets.py file. This ensures that you will only edit the production server if you really intend to.
+
+The command 'requests.packages.urllib3.disable_warnings()' is used to disable the excessive warnings that will be produced if the 'verify' variable is set to False, which necessary if you are using an SSH tunnel to connect to the DSpace API.
+
+
 
 **Note**: All of these scripts skip collection '24' for local reasons. To change this, edit the following portion of the script (typically between line 27-39)
 
 
-Skips collection 24: 
+Skips collection 24:
 
                 for j in range (0, len (collections)):
                         collectionID = collections[j]['id']
                         if collectionID != 24:
                         offset = 0
-            
-            
+
+
 No collections skipped:
 
                 for j in range (0, len (collections)):
@@ -29,12 +36,12 @@ No collections skipped:
                         offset = 0
 
 #### [addKeyValuePairOnHandleCSV.py](addKeyValuePairOnHandleCSV.py)
-Based on user input, this script uses a specified CSV file of DSpace item handles and the value to be added to that item using the specified key. A CSV log is written with all of the changes made and a 'dc.description.provenance' note describing the change is added to the metadata of each item that is updated. 
+Based on user input, this script uses a specified CSV file of DSpace item handles and the value to be added to that item using the specified key. A CSV log is written with all of the changes made and a 'dc.description.provenance' note describing the change is added to the metadata of each item that is updated.
 
 #### [addKeyValuePairToCollection.py](addKeyValuePairToCollection.py)
 
 #### [createItemMetadataFromCSV.py](createItemMetadataFromCSV.py)
-Based on user input, this script created a JSON file of metadata that can be added to a DSpace item from the specified CSV file. The 'createMetadataElement' function in the script is used to create the desired metadata elements based on three variables: 
+Based on user input, this script created a JSON file of metadata that can be added to a DSpace item from the specified CSV file. The 'createMetadataElement' function in the script is used to create the desired metadata elements based on three variables:
         'key' - The Dublin Core property to be used for the element.
         'value' - The column in the CSV that contains the data for the element.
         'language' - The desired language value for the element
@@ -45,13 +52,13 @@ Based on user input, this script created a JSON file of metadata that can be add
 Based on user input, this script creates a community with a specified name and collection with a specified name within that community.  In the specified directory (within the filePath set by the secrets.py file), the script creates items and associated metadata based on a 'collectionMetadata.json' file in the directory. Based on the specified file extension, the script then posts each file in the directory  with that extension as a bitstream for the appropriate item, which is determined by having the file name (minus the file extension) in a 'dc.identifier.other' field in the item metadata record.
 
 #### [removeDuplicateKeyValuePairsFromItems.py](removeDuplicateKeyValuePairsFromItems.py)
-This script finds all items with duplicate key-value pairs and removes the duplicates. A CSV log is written with all of the changes made and a 'dc.description.provenance' note describing the change is added to the metadata of each item that is updated. 
+This script finds all items with duplicate key-value pairs and removes the duplicates. A CSV log is written with all of the changes made and a 'dc.description.provenance' note describing the change is added to the metadata of each item that is updated.
 
 #### [replaceKey.py](replaceKey.py)
-Based on user input, this script replaces one specified key with another specified key in all item metadata across the repository. A CSV log is written with all of the changes made and a 'dc.description.provenance' note describing the change is added to the metadata of each item that is updated. 
+Based on user input, this script replaces one specified key with another specified key in all item metadata across the repository. A CSV log is written with all of the changes made and a 'dc.description.provenance' note describing the change is added to the metadata of each item that is updated.
 
 #### [replaceKeyValuePairsFromCSV.py](replaceKeyValuePairsFromCSV.py)
-Based on user input, this scripts updates key-value pairs from the specified CSV file with the columns: 'replacedKey,' 'replacementKey,'replacedValue,' and 'replacementValue.' A CSV log is written with all of the changes made and a 'dc.description.provenance' note describing the change is added to the metadata of each item that is updated. 
+Based on user input, this scripts updates key-value pairs from the specified CSV file with the columns: 'replacedKey,' 'replacementKey,'replacedValue,' and 'replacementValue.' A CSV log is written with all of the changes made and a 'dc.description.provenance' note describing the change is added to the metadata of each item that is updated.
 
 #### [replaceUnnecessarySpaces.py](replaceUnnecessarySpaces.py)
 Based on user input, this script removes double spaces, triple spaces, and spaces before commas in the values from the specified key in the specified community.
@@ -63,4 +70,4 @@ This scripts creates a folder with a timestamp in the folder name and creates a
 Based on user input, this script restores the metadata from a specified backup folder that was created by the repositoryMetadataBackup.py script.
 
 #### [updateLanguageTagsForKey.py](updateLanguageTagsForKey.py)
-Based on user input, this script updates the language value for the specified key to 'en_us' for all items with that key in the repository. A CSV log is written with all of the changes made and a 'dc.description.provenance' note describing the change is added to the metadata of each item that is updated. 
+Based on user input, this script updates the language value for the specified key to 'en_us' for all items with that key in the repository. A CSV log is written with all of the changes made and a 'dc.description.provenance' note describing the change is added to the metadata of each item that is updated.

addKeyValuePairOnHandleCSV.py

@@ -12,7 +12,9 @@
         print 'Editing Production'
     except ImportError:
         print 'Editing Stage'
-
+else:
+    print 'Editing Stage'
+    
 baseURL = secrets.baseURL
 email = secrets.email
 password = secrets.password

addKeyValuePairToCollection.py

@@ -12,7 +12,9 @@
         print 'Editing Production'
     except ImportError:
         print 'Editing Stage'
-
+else:
+    print 'Editing Stage'
+    
 baseURL = secrets.baseURL
 email = secrets.email
 password = secrets.password

createItemMetadataFromCSV.py

@@ -39,6 +39,10 @@ def createMetadataElementDirect (key, value, language):
         createMetadataElementDirect('dc.language.iso', 'en_US', 'en_US')
         createMetadataElementDirect('dc.type', 'Text', 'en_US')
         createMetadataElementDirect('dc.format.mimetype','application/pdf', 'en_US')
+        createMetadataElementDirect('dc.subject','magazines (periodicals)','en_US')
+        createMetadataElementDirect('dc.subject','Maryland--Baltimore','en_US')
+        createMetadataElementDirect('dc.subject','Engineering','en_US')
+        createMetadataElementDirect('dc.subject','City planning','en_US')
         # createMetadataElementCSV('dc.relation.ispartof', 'location', 'en_US')
         # createMetadataElementCSV('dc.identifier', 'identifier', '')
         # createMetadataElementCSV('dc.format.extent', 'size', '')

deleteKeyFromCollection.py

@@ -12,7 +12,9 @@
         print 'Editing Production'
     except ImportError:
         print 'Editing Stage'
-
+else:
+    print 'Editing Stage'
+    
 baseURL = secrets.baseURL
 email = secrets.email
 password = secrets.password

postCollection.py

@@ -12,7 +12,9 @@
         print 'Editing Production'
     except ImportError:
         print 'Editing Stage'
-
+else:
+    print 'Editing Stage'
+    
 baseURL = secrets.baseURL
 email = secrets.email
 password = secrets.password
@@ -75,14 +77,6 @@
     files = {'file': open(bitstream, 'rb')}
     post = requests.post(baseURL+itemID+'/bitstreams?name='+fileName, headers=headerAuthFileUpload, verify=verify, data=data).json()
 
-
-    # #Post bitstream
-    # bitstream = directory+'/'+fileIdentifier+fileExtension
-    # fileName = bitstream[bitstream.rfind('/')+1:]
-    # data = open(bitstream, 'rb')
-    # files = {'file': open(bitstream, 'rb')}
-    # post = requests.post(baseURL+itemID+'/bitstreams?name='+fileName, headers=headerAuthFileUpload, verify=verify, data=data).json()
-
     #Create provenance notes
     provNote = {}
     provNote['key'] = 'dc.description.provenance'

removeDuplicateKeyValuePairsFromItems.py

@@ -12,7 +12,9 @@
         print 'Editing Production'
     except ImportError:
         print 'Editing Stage'
-
+else:
+    print 'Editing Stage'
+    
 baseURL = secrets.baseURL
 email = secrets.email
 password = secrets.password

replaceKey.py

@@ -12,7 +12,9 @@
         print 'Editing Production'
     except ImportError:
         print 'Editing Stage'
-
+else:
+    print 'Editing Stage'
+    
 baseURL = secrets.baseURL
 email = secrets.email
 password = secrets.password

replaceKeyValuePairsFromCSV.py

@@ -12,7 +12,9 @@
         print 'Editing Production'
     except ImportError:
         print 'Editing Stage'
-
+else:
+    print 'Editing Stage'
+    
 baseURL = secrets.baseURL
 email = secrets.email
 password = secrets.password

replaceUnnecessarySpaces.py

@@ -12,7 +12,9 @@
         print 'Editing Production'
     except ImportError:
         print 'Editing Stage'
-
+else:
+    print 'Editing Stage'
+    
 baseURL = secrets.baseURL
 email = secrets.email
 password = secrets.password