This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import pandas as pd | |
| from datasets import Dataset | |
| import os | |
| import csv | |
| def extract_code(directory_path: str, output_csv_path: str): | |
| """ | |
| Read the folders, sub-folders and files to extract code. Storing them in a csv format. | |
| Currently supporting the below formats - |