AHj ddlmZddlZddlmZmZmZddlmZddl m Z ddl m Z ddl mZddlmZej"e5dd lmZddderdd lmZdd lmZdd lmZdd lmZddlmZeddddddddd ddZeddddddddd ddZ y#1swYxYw)) annotationsN)IO TYPE_CHECKINGLiteral)unstable)wrap_ldf) get_sources)!_init_credential_provider_builder) ScanOptions) PyLazyFrame)Path)StorageOptionsDict) DataFrame)CredentialProviderFunction) LazyFramelineTautonamen_rowsrow_index_namerow_index_offsetglobstorage_optionscredential_providerinclude_file_pathsc Ft||||||||| jS)uh Read lines into a string column from a file. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. Parameters ---------- source Path(s) to a file or directory When needing to authenticate for scanning cloud locations, see the `storage_options` parameter. name Name to use for the output column. n_rows Stop reading from parquet file after reading `n_rows`. row_index_name If not None, this will insert a row index column with the given name into the DataFrame row_index_offset Offset to start the row index column (only used if the name is set) glob Expand path given via globbing rules. storage_options Options that indicate how to connect to a cloud provider. The cloud providers currently supported are AWS, GCP, and Azure. See supported keys here: * `aws `_ * `gcp `_ * `azure `_ * Hugging Face (`hf://`): Accepts an API key under the `token` parameter: \ `{'token': '...'}`, or by setting the `HF_TOKEN` environment variable. If `storage_options` is not provided, Polars will try to infer the information from environment variables. credential_provider Provide a function that can be called to provide cloud storage credentials. The function is expected to return a dictionary of credential keys along with an optional credential expiry time. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. include_file_paths Include the path of the source file(s) as a column with this name. See Also -------- scan_lines Examples -------- >>> pl.read_lines(b"Hello\nworld") shape: (2, 1) ┌───────┐ │ line │ │ --- │ │ str │ ╞═══════╡ │ Hello │ │ world │ └───────┘ r) scan_linescollect) sourcerrrrrrrrs G/root/tools/cai/cai_env/lib/python3.12/site-packages/polars/io/lines.py read_linesr"s6r  %) '/- gi c t|} t|| |d} ~tj| t |||fnd|d|fnd|||| |} t | S)u Construct a LazyFrame which scans lines into a string column from a file. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. Parameters ---------- source Path(s) to a file or directory When needing to authenticate for scanning cloud locations, see the `storage_options` parameter. name Name to use for the output column. n_rows Stop reading from parquet file after reading `n_rows`. row_index_name If not None, this will insert a row index column with the given name into the DataFrame row_index_offset Offset to start the row index column (only used if the name is set) glob Expand path given via globbing rules. storage_options Options that indicate how to connect to a cloud provider. The cloud providers currently supported are AWS, GCP, and Azure. See supported keys here: * `aws `_ * `gcp `_ * `azure `_ * Hugging Face (`hf://`): Accepts an API key under the `token` parameter: \ `{'token': '...'}`, or by setting the `HF_TOKEN` environment variable. If `storage_options` is not provided, Polars will try to infer the information from environment variables. credential_provider Provide a function that can be called to provide cloud storage credentials. The function is expected to return a dictionary of credential keys along with an optional credential expiry time. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. include_file_paths Include the path of the source file(s) as a column with this name. See Also -------- read_lines Examples -------- >>> pl.scan_lines(b"Hello\nworld").collect() shape: (2, 1) ┌───────┐ │ line │ │ --- │ │ str │ ╞═══════╡ │ Hello │ │ world │ └───────┘ rNr) row_index pre_slicerrrr)sources scan_optionsr)r r r new_from_scan_linesr r) r rrrrrrrrr'credential_provider_builderpylfs r!rrsr&!G"CWo|#   * * "- !12%+%7q&kT1+ ;   D" D>r#)r cstr | Path | IO[str] | IO[bytes] | bytes | list[str] | list[Path] | list[IO[str]] | list[IO[bytes]]rstrr int | Noner str | NonerintrboolrStorageOptionsDict | Noner3CredentialProviderFunction | Literal['auto'] | Nonerr/returnr)r r,rr-rr.rr/rr0rr1rr2rr3rr/r4r)! __future__r contextlibtypingrrrpolars._utils.unstablerpolars._utils.wraprpolars.io._utilsr ,polars.io.cloud.credential_provider._builderr polars.io.scan_options._optionsr suppress ImportError polars._plrr pathlibr polars._typingrpolars.dataframe.framerpolars.io.cloudrpolars.lazyframe.framerr"rr#r!rFs"--+'(8Z%('(10:0 !%15OU%))b b b bb !b" #b$/%b&M'b(#)b*+b bJ !%15OU%))p p p pp !p" #p$/%p&M'p(#)p*+p pg((s C  C