Google Bigquery query execution using google cloud dataflow -
is possible execute bigquery's query using google cloud data flow directly , fetch data, not reading data table putting conditions?
for example, pcollections res=p.apply(bigqueryio.execute("select col1,col2 publicdata:samples.shakeseare ...."))
instead of reinventing using iterative method bigquery queries implemented, can use same directly.
thanks , regards
ajay k n
bigqueryio supports reading table , not query or view (faq).
one way work around in main program create bigquery permanent table issuing query before run dataflow job. after, job runs delete table.
Comments
Post a Comment