fix: improving the output of get tokenized data function for DQ#184

bayo-ibm wants to merge 3 commits into

foundation-model-stack:mainfoundation-model-stack/fms-model-optimizer:mainfrom

bayo-ibm:DQ_data_handlingbayo-ibm/fms-model-optimizer:DQ_data_handlingCopy head branch name to clipboard