beam-commits mailing list archives

[jira] [Resolved] (BEAM-2817) Bigquery queries should allow options to run in batch mode or not

Date

Sat, 10 Mar 2018 18:41:00 GMT

[ https://issues.apache.org/jira/browse/BEAM-2817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Justin Tumale resolved BEAM-2817.
---------------------------------
Resolution: Done
Fix Version/s: 2.4.0
> Bigquery queries should allow options to run in batch mode or not
> -----------------------------------------------------------------
>
> Key: BEAM-2817
> URL: https://issues.apache.org/jira/browse/BEAM-2817
> Project: Beam
> Issue Type: Bug
> Components: io-java-gcp
> Affects Versions: 2.0.0
> Reporter: Lara Schmidt
> Assignee: Justin Tumale
> Priority: Major
> Labels: newbie, starter
> Fix For: 2.4.0
>
> Time Spent: 1h 50m
> Remaining Estimate: 0h
>
> When bigquery read does a query it sets the mode to batch. A batch query can be very
slow to schedule as it batches it with other queries. However it doesn't use batch quota which
is better for some cases. However, in some cases a fast query is better (especially in timed
tests). It would be a good idea to have a configuration to the bigquery source to set this
per-read.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)