-
Notifications
You must be signed in to change notification settings - Fork 11
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Writing pandas dataframes to disk seems really common. I am going to have to write my own DFNode
class for this. Would you like me to generalize it enough and then contribute it here?
I would imagine something like
class DFNode:
def __init__(self, path: str | ..., kind: Literal["csv", "parquet", ...], load_kwargs: dict[str, Any = {}, save_kwargs: dict[str, Any]):
self.path = path
self.kind = kind
self.load_kwargs = load_kwargs
self.save_kwargs = save_kwargs
def save(self, value: Any) -> None:
saver = getattr(value, f"to_{self.kind}")
saver(self.path, **self.save_kwargs)
def load(self, is_product: bool) -> Any:
if is_product:
return self
loader = getattr(pd, f"read_{self.kind}")
return loader(self.path, **self.load_kwargs)
TinasheMTapera
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request