birdfsd_yolov5.datasets_manager package

Submodules

birdfsd_yolov5.datasets_manager.construct_dataset module

birdfsd_yolov5.datasets_manager.construct_dataset.construct_dataset(tasks)[source]

Constructs a summarized dataset in Apache Parquet format.

This function gets all the tasks from mongodb, and then sends them to the ray cluster for processing. It then waits for the results to come back, and saves them to a parquet file.

Returns

None

birdfsd_yolov5.datasets_manager.construct_dataset.get_all_tasks_from_mongodb()[source]

This function is used to get all the tasks from mongodb.

Returns

A list of all the tasks in the database.

Return type

list

Module contents