Skip to content

[COPY FROM s3] SS-62 Initial support for parquet files#34962

Draft
patrickwwbutler wants to merge 19 commits intoMaterializeInc:mainfrom
patrickwwbutler:patrick/copy-from-s3-parquet
Draft

[COPY FROM s3] SS-62 Initial support for parquet files#34962
patrickwwbutler wants to merge 19 commits intoMaterializeInc:mainfrom
patrickwwbutler:patrick/copy-from-s3-parquet

Conversation

@patrickwwbutler
Copy link
Contributor

@patrickwwbutler patrickwwbutler commented Feb 9, 2026

This adds initial support and testing for copying from parquet files into tables using COPY INTO ... FROM ... (FORMAT PARQUET).

Also adds WIP user docs for COPY FROM, to be expanded upon.

Motivation

https://linear.app/materializeinc/issue/SS-62/initial-implementation-for-parquet

Tips for reviewers

This is stacked on #34862, so until that is merged, this PR will also include the changes from there. You may wish to wait for that to be merged.

Checklist

  • This PR has adequate test coverage / QA involvement has been duly considered. (trigger-ci for additional test/nightly runs)
  • This PR has an associated up-to-date design doc, is a design doc (template), or is sufficiently small to not require a design.
  • If this PR evolves an existing $T ⇔ Proto$T mapping (possibly in a backwards-incompatible way), then it is tagged with a T-proto label.
  • If this PR will require changes to cloud orchestration or tests, there is a companion cloud PR to account for those changes that is tagged with the release-blocker label (example).
  • If this PR includes major user-facing behavior changes, I have pinged the relevant PM to schedule a changelog post.

@patrickwwbutler patrickwwbutler force-pushed the patrick/copy-from-s3-parquet branch from a553138 to 2ea12c8 Compare February 10, 2026 17:07
@patrickwwbutler patrickwwbutler changed the title Patrick/copy from s3 parquet [COPY FROM s3] SS-62 Initial support for parquet files Feb 10, 2026
@patrickwwbutler patrickwwbutler requested a review from a team February 10, 2026 21:41
@patrickwwbutler patrickwwbutler marked this pull request as ready for review February 10, 2026 21:41
@patrickwwbutler patrickwwbutler requested review from a team as code owners February 10, 2026 21:41
@patrickwwbutler patrickwwbutler force-pushed the patrick/copy-from-s3-parquet branch 2 times, most recently from 3ce0399 to 49fe499 Compare February 11, 2026 15:48
## Syntax

{{% include-syntax file="examples/copy_from" example="syntax" %}}
{{< diagram "copy-from.svg" >}}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh ... we don't use the railroad diagrams anymore.

Copy link
Contributor

@kay-kim kay-kim left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You might have started on an older branch that didn't catch the change to how we do syntaxes. We don't use railroad diagrams anymore.

@patrickwwbutler patrickwwbutler requested review from a team as code owners February 17, 2026 18:13
@patrickwwbutler
Copy link
Contributor Author

You might have started on an older branch that didn't catch the change to how we do syntaxes. We don't use railroad diagrams anymore.

Ah yes this is exactly what happened, will update

@patrickwwbutler patrickwwbutler marked this pull request as draft February 19, 2026 13:19
@patrickwwbutler patrickwwbutler force-pushed the patrick/copy-from-s3-parquet branch 3 times, most recently from 8dce707 to 695b3d1 Compare February 23, 2026 18:42
@patrickwwbutler patrickwwbutler force-pushed the patrick/copy-from-s3-parquet branch from 695b3d1 to b55e5d8 Compare February 26, 2026 19:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants