Last active
July 15, 2024 01:06
-
-
Save hongbo-miao/c65bb869eb9c52bd275bcb9607251d66 to your computer and use it in GitHub Desktop.
Airbyte sync succeed log
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| >> ATTEMPT 1/1 | |
| 2024-07-14 07:46:41 [46mplatform[0m > Cloud storage job log path: /workspace/923/0/logs.log | |
| 2024-07-14 07:47:20 [32mINFO[m i.m.r.Micronaut(start):101 - Startup completed in 2263ms. Server Running: http://orchestrator-repl-job-923-attempt-0:9000 | |
| 2024-07-14 07:47:22 [46mreplication-orchestrator[0m > Writing async status INITIALIZING for KubePodInfo[namespace=production-hm-airbyte, name=orchestrator-repl-job-923-attempt-0, mainContainerInfo=KubeContainerInfo[image=airbyte/container-orchestrator:0.63.6, pullPolicy=IfNotPresent]]... | |
| 2024-07-14 07:46:41 [46mplatform[0m > Executing worker wrapper. Airbyte version: 0.63.6 | |
| 2024-07-14 07:46:41 [46mplatform[0m > | |
| 2024-07-14 07:46:41 [46mplatform[0m > Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' | |
| 2024-07-14 07:46:41 [46mplatform[0m > ----- START CHECK ----- | |
| 2024-07-14 07:46:41 [46mplatform[0m > Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' | |
| 2024-07-14 07:46:41 [46mplatform[0m > | |
| 2024-07-14 07:46:41 [46mplatform[0m > Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' | |
| 2024-07-14 07:46:41 [46mplatform[0m > Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' | |
| 2024-07-14 07:46:41 [46mplatform[0m > Attempting to start pod = source-postgres-check-923-0-nymax for airbyte/source-postgres:3.4.24 with resources ConnectorResourceRequirements[main=io.airbyte.config.ResourceRequirements@25125d66[cpuRequest=1000m,cpuLimit=4000m,memoryRequest=1Gi,memoryLimit=10Gi,additionalProperties={}], heartbeat=io.airbyte.config.ResourceRequirements@2c93b5a4[cpuRequest=0.1,cpuLimit=2.0,memoryRequest=25Mi,memoryLimit=50Mi,additionalProperties={}], stdErr=io.airbyte.config.ResourceRequirements@14b4b04f[cpuRequest=0.25,cpuLimit=2,memoryRequest=25Mi,memoryLimit=50Mi,additionalProperties={}], stdIn=io.airbyte.config.ResourceRequirements@5e676f45[cpuRequest=0.1,cpuLimit=2.0,memoryRequest=25Mi,memoryLimit=50Mi,additionalProperties={}], stdOut=io.airbyte.config.ResourceRequirements@5e676f45[cpuRequest=0.1,cpuLimit=2.0,memoryRequest=25Mi,memoryLimit=50Mi,additionalProperties={}]] and allowedHosts io.airbyte.config.AllowedHosts@2a6c459c[hosts=[daw-db.xxx.us-west-2.rds.amazonaws.com, 34.215.xxx.xxx, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}] | |
| 2024-07-14 07:46:41 [46mplatform[0m > source-postgres-check-923-0-nymax stdoutLocalPort = 9022 | |
| 2024-07-14 07:46:41 [46mplatform[0m > source-postgres-check-923-0-nymax stderrLocalPort = 9023 | |
| 2024-07-14 07:46:41 [46mplatform[0m > Creating stdout socket server... | |
| 2024-07-14 07:46:41 [46mplatform[0m > Creating stderr socket server... | |
| 2024-07-14 07:46:41 [46mplatform[0m > Creating pod source-postgres-check-923-0-nymax... | |
| 2024-07-14 07:46:46 [46mplatform[0m > Waiting for init container to be ready before copying files... | |
| 2024-07-14 07:46:47 [46mplatform[0m > Init container ready.. | |
| 2024-07-14 07:46:47 [46mplatform[0m > Copying files... | |
| 2024-07-14 07:46:47 [46mplatform[0m > Uploading file: source_config.json | |
| 2024-07-14 07:46:47 [46mplatform[0m > kubectl cp /tmp/1f9a3704-b9e4-401f-84b7-16aaf49febe8/source_config.json production-hm-airbyte/source-postgres-check-923-0-nymax:/config/source_config.json -c init --retries=3 | |
| 2024-07-14 07:46:47 [46mplatform[0m > Waiting for kubectl cp to complete | |
| 2024-07-14 07:46:47 [46mplatform[0m > kubectl cp complete, closing process | |
| 2024-07-14 07:46:47 [46mplatform[0m > Uploading file: FINISHED_UPLOADING | |
| 2024-07-14 07:46:47 [46mplatform[0m > kubectl cp /tmp/202c6f32-d3b9-4b6a-86c0-7fe19ba36a83/FINISHED_UPLOADING production-hm-airbyte/source-postgres-check-923-0-nymax:/config/FINISHED_UPLOADING -c init --retries=3 | |
| 2024-07-14 07:46:47 [46mplatform[0m > Waiting for kubectl cp to complete | |
| 2024-07-14 07:46:47 [46mplatform[0m > kubectl cp complete, closing process | |
| 2024-07-14 07:46:47 [46mplatform[0m > Waiting until pod is ready... | |
| 2024-07-14 07:46:48 [46mplatform[0m > Setting stdout... | |
| 2024-07-14 07:46:48 [46mplatform[0m > Setting stderr... | |
| 2024-07-14 07:46:49 [46mplatform[0m > Reading pod IP... | |
| 2024-07-14 07:46:49 [46mplatform[0m > Pod IP: 172.31.130.48 | |
| 2024-07-14 07:46:49 [46mplatform[0m > Using null stdin output stream... | |
| 2024-07-14 07:46:49 [46mplatform[0m > Reading messages from protocol version 0.2.0 | |
| 2024-07-14 07:46:49 [46mplatform[0m > INFO main i.a.i.s.p.PostgresSource(main):691 starting source: class io.airbyte.integrations.source.postgres.PostgresSource | |
| 2024-07-14 07:46:49 [46mplatform[0m > INFO main i.a.c.i.b.IntegrationCliParser$Companion(parseOptions):144 integration args: {check=null, config=source_config.json} | |
| 2024-07-14 07:46:49 [46mplatform[0m > INFO main i.a.c.i.b.IntegrationRunner(runInternal):124 Running integration: io.airbyte.cdk.integrations.base.ssh.SshWrappedSource | |
| 2024-07-14 07:46:49 [46mplatform[0m > INFO main i.a.c.i.b.IntegrationRunner(runInternal):125 Command: CHECK | |
| 2024-07-14 07:46:49 [46mplatform[0m > INFO main i.a.c.i.b.IntegrationRunner(runInternal):126 Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} | |
| 2024-07-14 07:46:49 [46mplatform[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword groups - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:46:49 [46mplatform[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:46:49 [46mplatform[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword group - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:46:49 [46mplatform[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:46:49 [46mplatform[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword always_show - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:46:49 [46mplatform[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword display_type - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:46:49 [46mplatform[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword min - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:46:49 [46mplatform[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword max - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:46:49 [46mplatform[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:46:49 [46mplatform[0m > INFO main i.a.c.i.b.s.SshTunnel$Companion(getInstance):423 Starting connection with method: SSH_KEY_AUTH | |
| 2024-07-14 07:46:50 [46mplatform[0m > INFO main o.a.s.c.u.s.AbstractSecurityProviderRegistrar(getOrCreateProvider):112 getOrCreateProvider(EdDSA) created instance of net.i2p.crypto.eddsa.EdDSASecurityProvider | |
| 2024-07-14 07:46:50 [46mplatform[0m > INFO main o.a.s.c.i.DefaultIoServiceFactoryFactory(getIoServiceProvider):70 Using MinaServiceFactoryFactory | |
| 2024-07-14 07:46:50 [46mplatform[0m > INFO main o.a.s.c.c.h.ConfigFileHostEntryResolver(resolveEffectiveResolver):89 resolveEffectiveResolver([email protected]:22/null) no configuration file at /root/.ssh/config | |
| 2024-07-14 07:46:50 [46mplatform[0m > WARN MinaProcessor-2 o.a.s.c.k.StaticServerKeyVerifier(handleAcceptance):59 Server at /34.215.xxx.xxx:22 presented unverified EC key: SHA256:kzVc0TZ0+EE48t1uRpvZixG8a25P94B8ps2PxuzoOA8 | |
| 2024-07-14 07:46:50 [46mplatform[0m > INFO MinaProcessor-2 o.a.s.c.k.e.p.HostBoundPubkeyAuthentication(parseExtension):58 Server announced support for [email protected] version 0 | |
| 2024-07-14 07:46:50 [46mplatform[0m > INFO main i.a.c.i.b.s.SshTunnel(openTunnel):354 Established tunneling session to daw-db.xxx.us-west-2.rds.amazonaws.com:5432. Port forwarding started on /127.0.0.1:43413 | |
| 2024-07-14 07:46:50 [46mplatform[0m > INFO main i.a.i.s.p.PostgresUtils(isCdc):70 using CDC: true | |
| 2024-07-14 07:46:50 [46mplatform[0m > INFO main i.a.i.s.p.PostgresSource(toSslJdbcParamInternal):917 REQUIRED toSslJdbcParam require | |
| 2024-07-14 07:46:50 [46mplatform[0m > INFO main c.z.h.HikariDataSource(<init>):79 HikariPool-1 - Starting... | |
| 2024-07-14 07:46:50 [46mplatform[0m > INFO main c.z.h.HikariDataSource(<init>):81 HikariPool-1 - Start completed. | |
| 2024-07-14 07:46:51 [46mplatform[0m > INFO main i.a.i.s.p.PostgresUtils(isCdc):70 using CDC: true | |
| 2024-07-14 07:46:51 [46mplatform[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:46:51 [46mplatform[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(accept):33 Set new fetch size: 1481040 rows | |
| 2024-07-14 07:46:51 [46mplatform[0m > INFO main i.a.c.d.j.s.TwoStageSizeEstimator$Companion(getTargetBufferByteSize):80 Max memory limit: 8053063680, JDBC buffer size: 4831838208 | |
| 2024-07-14 07:46:51 [46mplatform[0m > INFO main i.a.i.s.p.PostgresCatalogHelper(getPublicizedTables):123 For CDC, only tables in publication airbyte_public_publication will be included in the sync: [public.bag, public.config, public.con1, public.fli, public.rid, public.pur, public.pil2, public.reg, public.con2, public.tri2, public.daw, public.gue2, public.ope, public.rou, public.dri, public.gue, public.veh_type, public.asy, public.sta, public.act, public.pil, public.tri, public.veh, public.ter, public.off, public.con3] | |
| 2024-07-14 07:46:51 [46mplatform[0m > INFO main i.a.i.s.p.PostgresUtils(isCdc):70 using CDC: true | |
| 2024-07-14 07:46:51 [46mplatform[0m > INFO main i.a.i.s.p.PostgresUtils(isXmin):190 using Xmin: false | |
| 2024-07-14 07:46:51 [46mplatform[0m > INFO main i.a.c.i.s.j.AbstractJdbcSource(getCheckOperations$lambda$6):338 Attempting to get metadata from the database to see if we can connect. | |
| 2024-07-14 07:46:51 [46mplatform[0m > INFO main i.a.c.i.s.j.AbstractJdbcSource(checkUserHasPrivileges):302 Checking if the user can perform select to any table in schema: public | |
| 2024-07-14 07:46:51 [46mplatform[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:46:51 [46mplatform[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(accept):33 Set new fetch size: 1409376 rows | |
| 2024-07-14 07:46:51 [46mplatform[0m > INFO main i.a.c.d.j.s.TwoStageSizeEstimator$Companion(getTargetBufferByteSize):80 Max memory limit: 8053063680, JDBC buffer size: 4831838208 | |
| 2024-07-14 07:46:51 [46mplatform[0m > INFO main i.a.i.s.p.PostgresSource(lambda$getReplicationSlot$3):421 Attempting to find the named replication slot using the query: HikariProxyPreparedStatement@904612411 wrapping SELECT * FROM pg_replication_slots WHERE slot_name = ('airbyte_public_logical_replication_slot') AND plugin = ('pgoutput') AND database = ('daw_db') | |
| 2024-07-14 07:46:51 [46mplatform[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:46:51 [46mplatform[0m > INFO main i.a.i.s.p.PostgresSource(lambda$getCheckOperations$5):453 Attempting to find the publication using the query: HikariProxyPreparedStatement@436949795 wrapping SELECT * FROM pg_publication WHERE pubname = ('airbyte_public_publication') | |
| 2024-07-14 07:46:51 [46mplatform[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:46:51 [46mplatform[0m > INFO main i.a.i.s.p.c.PostgresReplicationConnection(createConnection):44 Creating a replication connection. | |
| 2024-07-14 07:46:51 [46mplatform[0m > INFO main i.a.i.s.p.c.PostgresReplicationConnection(createConnection):47 Validating replication connection. | |
| 2024-07-14 07:46:51 [46mplatform[0m > INFO main c.z.h.HikariDataSource(close):349 HikariPool-1 - Shutdown initiated... | |
| 2024-07-14 07:46:51 [46mplatform[0m > INFO main c.z.h.HikariDataSource(close):351 HikariPool-1 - Shutdown completed. | |
| 2024-07-14 07:46:51 [46mplatform[0m > INFO main i.a.c.i.b.IntegrationRunner(runInternal):269 Completed integration: io.airbyte.cdk.integrations.base.ssh.SshWrappedSource | |
| 2024-07-14 07:46:51 [46mplatform[0m > INFO main i.a.i.s.p.PostgresSource(main):693 completed source: class io.airbyte.integrations.source.postgres.PostgresSource | |
| 2024-07-14 07:46:52 [46mplatform[0m > (pod: production-hm-airbyte / source-postgres-check-923-0-nymax) - Closed all resources for pod | |
| 2024-07-14 07:46:52 [46mplatform[0m > Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@7e644481[status=succeeded,message=<null>,additionalProperties={}] | |
| 2024-07-14 07:46:52 [46mplatform[0m > | |
| 2024-07-14 07:46:52 [46mplatform[0m > ----- END CHECK ----- | |
| 2024-07-14 07:46:52 [46mplatform[0m > | |
| 2024-07-14 07:46:52 [46mplatform[0m > Cloud storage job log path: /workspace/923/0/logs.log | |
| 2024-07-14 07:46:52 [46mplatform[0m > Executing worker wrapper. Airbyte version: 0.63.6 | |
| 2024-07-14 07:46:52 [46mplatform[0m > Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' | |
| 2024-07-14 07:46:52 [46mplatform[0m > | |
| 2024-07-14 07:46:52 [46mplatform[0m > Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' | |
| 2024-07-14 07:46:52 [46mplatform[0m > ----- START CHECK ----- | |
| 2024-07-14 07:46:52 [46mplatform[0m > Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' | |
| 2024-07-14 07:46:52 [46mplatform[0m > | |
| 2024-07-14 07:46:52 [46mplatform[0m > Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' | |
| 2024-07-14 07:46:52 [46mplatform[0m > Attempting to start pod = destination-snowflake-check-923-0-ldebf for airbyte/destination-snowflake:3.11.1 with resources ConnectorResourceRequirements[main=io.airbyte.config.ResourceRequirements@53284111[cpuRequest=1000m,cpuLimit=4000m,memoryRequest=1Gi,memoryLimit=10Gi,additionalProperties={}], heartbeat=io.airbyte.config.ResourceRequirements@2c93b5a4[cpuRequest=0.1,cpuLimit=2.0,memoryRequest=25Mi,memoryLimit=50Mi,additionalProperties={}], stdErr=io.airbyte.config.ResourceRequirements@14b4b04f[cpuRequest=0.25,cpuLimit=2,memoryRequest=25Mi,memoryLimit=50Mi,additionalProperties={}], stdIn=io.airbyte.config.ResourceRequirements@5e676f45[cpuRequest=0.1,cpuLimit=2.0,memoryRequest=25Mi,memoryLimit=50Mi,additionalProperties={}], stdOut=io.airbyte.config.ResourceRequirements@5e676f45[cpuRequest=0.1,cpuLimit=2.0,memoryRequest=25Mi,memoryLimit=50Mi,additionalProperties={}]] and allowedHosts null | |
| 2024-07-14 07:46:52 [46mplatform[0m > destination-snowflake-check-923-0-ldebf stdoutLocalPort = 9024 | |
| 2024-07-14 07:46:52 [46mplatform[0m > destination-snowflake-check-923-0-ldebf stderrLocalPort = 9025 | |
| 2024-07-14 07:46:52 [46mplatform[0m > Creating stdout socket server... | |
| 2024-07-14 07:46:52 [46mplatform[0m > Creating stderr socket server... | |
| 2024-07-14 07:46:52 [46mplatform[0m > Creating pod destination-snowflake-check-923-0-ldebf... | |
| 2024-07-14 07:46:57 [46mplatform[0m > Waiting for init container to be ready before copying files... | |
| 2024-07-14 07:46:59 [46mplatform[0m > Init container ready.. | |
| 2024-07-14 07:46:59 [46mplatform[0m > Copying files... | |
| 2024-07-14 07:46:59 [46mplatform[0m > Uploading file: source_config.json | |
| 2024-07-14 07:46:59 [46mplatform[0m > kubectl cp /tmp/78c6fc37-6ea7-4c55-a5dc-4f3831920836/source_config.json production-hm-airbyte/destination-snowflake-check-923-0-ldebf:/config/source_config.json -c init --retries=3 | |
| 2024-07-14 07:46:59 [46mplatform[0m > Waiting for kubectl cp to complete | |
| 2024-07-14 07:46:59 [46mplatform[0m > kubectl cp complete, closing process | |
| 2024-07-14 07:46:59 [46mplatform[0m > Uploading file: FINISHED_UPLOADING | |
| 2024-07-14 07:46:59 [46mplatform[0m > kubectl cp /tmp/06a35d9f-4771-465a-b304-9297d6e4f52d/FINISHED_UPLOADING production-hm-airbyte/destination-snowflake-check-923-0-ldebf:/config/FINISHED_UPLOADING -c init --retries=3 | |
| 2024-07-14 07:46:59 [46mplatform[0m > Waiting for kubectl cp to complete | |
| 2024-07-14 07:46:59 [46mplatform[0m > kubectl cp complete, closing process | |
| 2024-07-14 07:46:59 [46mplatform[0m > Waiting until pod is ready... | |
| 2024-07-14 07:47:00 [46mplatform[0m > Setting stdout... | |
| 2024-07-14 07:47:00 [46mplatform[0m > Setting stderr... | |
| 2024-07-14 07:47:01 [46mplatform[0m > Reading pod IP... | |
| 2024-07-14 07:47:01 [46mplatform[0m > Pod IP: 172.31.132.121 | |
| 2024-07-14 07:47:01 [46mplatform[0m > Using null stdin output stream... | |
| 2024-07-14 07:47:01 [46mplatform[0m > Reading messages from protocol version 0.2.0 | |
| 2024-07-14 07:47:01 [46mplatform[0m > INFO main i.a.c.i.b.a.AdaptiveDestinationRunner$Runner(getDestination):54 Running destination under deployment mode: OSS | |
| 2024-07-14 07:47:01 [46mplatform[0m > INFO main i.a.c.i.b.a.AdaptiveDestinationRunner$Runner(run):67 Starting destination: io.airbyte.integrations.destination.snowflake.SnowflakeDestination | |
| 2024-07-14 07:47:01 [46mplatform[0m > INFO main i.a.c.i.b.IntegrationCliParser$Companion(parseOptions):144 integration args: {check=null, config=source_config.json} | |
| 2024-07-14 07:47:01 [46mplatform[0m > INFO main i.a.c.i.b.IntegrationRunner(runInternal):124 Running integration: io.airbyte.integrations.destination.snowflake.SnowflakeDestination | |
| 2024-07-14 07:47:01 [46mplatform[0m > INFO main i.a.c.i.b.IntegrationRunner(runInternal):125 Command: CHECK | |
| 2024-07-14 07:47:01 [46mplatform[0m > INFO main i.a.c.i.b.IntegrationRunner(runInternal):126 Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} | |
| 2024-07-14 07:47:01 [46mplatform[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword pattern_descriptor - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:47:01 [46mplatform[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:47:01 [46mplatform[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:47:01 [46mplatform[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:47:01 [46mplatform[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_hidden - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:47:02 [46mplatform[0m > INFO main c.z.h.HikariDataSource(getConnection):109 HikariPool-1 - Starting... | |
| 2024-07-14 07:47:03 [46mplatform[0m > INFO main c.z.h.p.HikariPool(checkFailFast):554 HikariPool-1 - Added connection net.snowflake.client.jdbc.SnowflakeConnectionV1@58ae402b | |
| 2024-07-14 07:47:03 [46mplatform[0m > INFO main c.z.h.HikariDataSource(getConnection):122 HikariPool-1 - Start completed. | |
| 2024-07-14 07:47:03 [46mplatform[0m > INFO main i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:03 [46mplatform[0m > INFO main i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:03 [46mplatform[0m > INFO main i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC._airbyte_connection_test_11147b8d0f5c468a9f4b31eaf4518d9b: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:47:03 [46mplatform[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql bf3df936-3bea-4b69-a99f-42ffe3427a10-47619bfc-d08f-4f9b-8fd4-93622ac2e2c5: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream__airbyte_connection_test_11147b8d0f5c468a9f4b31eaf4518d9b"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:47:04 [46mplatform[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql bf3df936-3bea-4b69-a99f-42ffe3427a10-47619bfc-d08f-4f9b-8fd4-93622ac2e2c5 completed in 199 ms | |
| 2024-07-14 07:47:04 [46mplatform[0m > INFO main i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC._airbyte_connection_test_11147b8d0f5c468a9f4b31eaf4518d9b: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:47:04 [46mplatform[0m > INFO main i.a.i.b.d.o.AbstractStreamOperation(<init>):70 Typing and deduping disabled, skipping final table initialization | |
| 2024-07-14 07:47:04 [46mplatform[0m > INFO main i.a.c.i.d.r.BaseSerializedBuffer(flush):162 Finished writing data to eaa0a3cb-d135-42c4-b206-f0821d3039152920933788707706667.csv.gz (126 bytes) | |
| 2024-07-14 07:47:04 [46mplatform[0m > INFO main i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):54 Buffer flush complete for stream _airbyte_connection_test_11147b8d0f5c468a9f4b31eaf4518d9b (126 bytes) to staging | |
| 2024-07-14 07:47:04 [46mplatform[0m > INFO main i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):84 executing query 2e1b7ed1-6f57-4ac6-a5e1-3b63f018203a, PUT file:///tmp/eaa0a3cb-d135-42c4-b206-f0821d3039152920933788707706667.csv.gz @"airbyte_internal"."XXX_PUBLIC_raw__stream__airbyte_connection_test_11147b8d0f5c468a9f4b31eaf4518d9b"/2024/07/14/07/68B0D98A-6129-420F-8424-E106E4A35692/ PARALLEL = 4; | |
| 2024-07-14 07:47:04 [46mplatform[0m > INFO main i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:04 [46mplatform[0m > INFO main i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):94 query 2e1b7ed1-6f57-4ac6-a5e1-3b63f018203a, completed with [{"source":"eaa0a3cb-d135-42c4-b206-f0821d3039152920933788707706667.csv.gz","target":"eaa0a3cb-d135-42c4-b206-f0821d3039152920933788707706667.csv.gz","source_size":126,"target_size":126,"source_compression":"GZIP","target_compression":"GZIP","status":"UPLOADED","encryption":"","message":""}] | |
| 2024-07-14 07:47:04 [46mplatform[0m > INFO main i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:04 [46mplatform[0m > INFO main i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToStage):70 Successfully loaded records to stage 2024/07/14/07/68B0D98A-6129-420F-8424-E106E4A35692/ with 0 re-attempt(s) | |
| 2024-07-14 07:47:04 [46mplatform[0m > INFO main i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):178 query 7d56499d-9bb2-48b2-9907-54ab9e67c2c1, COPY INTO "airbyte_internal"."XXX_PUBLIC_raw__stream__airbyte_connection_test_11147b8d0f5c468a9f4b31eaf4518d9b" FROM '@"airbyte_internal"."XXX_PUBLIC_raw__stream__airbyte_connection_test_11147b8d0f5c468a9f4b31eaf4518d9b"/2024/07/14/07/68B0D98A-6129-420F-8424-E106E4A35692/' | |
| file_format = ( | |
| type = csv | |
| compression = auto | |
| field_delimiter = ',' | |
| skip_header = 0 | |
| FIELD_OPTIONALLY_ENCLOSED_BY = '"' | |
| NULL_IF=('') | |
| ) files = ('eaa0a3cb-d135-42c4-b206-f0821d3039152920933788707706667.csv.gz'); | |
| 2024-07-14 07:47:05 [46mplatform[0m > INFO main i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:05 [46mplatform[0m > INFO main i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):187 query 7d56499d-9bb2-48b2-9907-54ab9e67c2c1, successfully loaded 1 rows of data into table | |
| 2024-07-14 07:47:05 [46mplatform[0m > INFO main i.a.c.i.d.r.FileBuffer(deleteFile):75 Deleting tempFile data eaa0a3cb-d135-42c4-b206-f0821d3039152920933788707706667.csv.gz | |
| 2024-07-14 07:47:05 [46mplatform[0m > INFO main i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream__airbyte_connection_test_11147b8d0f5c468a9f4b31eaf4518d9b" | |
| 2024-07-14 07:47:06 [46mplatform[0m > INFO main i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC._airbyte_connection_test_11147b8d0f5c468a9f4b31eaf4518d9b. Truncate sync: false; stream success: true | |
| 2024-07-14 07:47:06 [46mplatform[0m > INFO main i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):273 Typing and deduping disabled, skipping final table finalization. Raw records can be found at airbyte_internal.XXX_PUBLIC_raw__stream__airbyte_connection_test_11147b8d0f5c468a9f4b31eaf4518d9b | |
| 2024-07-14 07:47:06 [46mplatform[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql eae4fe3d-ba97-4da2-a3f8-2c6c458a2b4a-462152b0-7606-4b24-9975-24a77301ee99: DROP TABLE IF EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream__airbyte_connection_test_11147b8d0f5c468a9f4b31eaf4518d9b"; | |
| 2024-07-14 07:47:06 [46mplatform[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql eae4fe3d-ba97-4da2-a3f8-2c6c458a2b4a-462152b0-7606-4b24-9975-24a77301ee99 completed in 112 ms | |
| 2024-07-14 07:47:06 [46mplatform[0m > INFO main c.z.h.HikariDataSource(close):349 HikariPool-1 - Shutdown initiated... | |
| 2024-07-14 07:47:06 [46mplatform[0m > INFO main c.z.h.HikariDataSource(close):351 HikariPool-1 - Shutdown completed. | |
| 2024-07-14 07:47:06 [46mplatform[0m > INFO main i.a.c.i.b.IntegrationRunner(runInternal):269 Completed integration: io.airbyte.integrations.destination.snowflake.SnowflakeDestination | |
| 2024-07-14 07:47:06 [46mplatform[0m > INFO main i.a.c.i.b.a.AdaptiveDestinationRunner$Runner(run):69 Completed destination: io.airbyte.integrations.destination.snowflake.SnowflakeDestination | |
| 2024-07-14 07:47:08 [46mplatform[0m > (pod: production-hm-airbyte / destination-snowflake-check-923-0-ldebf) - Closed all resources for pod | |
| 2024-07-14 07:47:08 [46mplatform[0m > Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@639e89e8[status=succeeded,message=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:08 [46mplatform[0m > | |
| 2024-07-14 07:47:08 [46mplatform[0m > ----- END CHECK ----- | |
| 2024-07-14 07:47:08 [46mplatform[0m > | |
| 2024-07-14 07:47:09 [46mplatform[0m > Cloud storage job log path: /workspace/923/0/logs.log | |
| 2024-07-14 07:47:09 [46mplatform[0m > Executing worker wrapper. Airbyte version: 0.63.6 | |
| 2024-07-14 07:47:09 [46mplatform[0m > Creating orchestrator-repl-job-923-attempt-0 for attempt number: 0 | |
| 2024-07-14 07:47:09 [46mplatform[0m > Successfully deleted all running pods for the connection! | |
| 2024-07-14 07:47:14 [46mplatform[0m > Waiting for pod to be running... | |
| 2024-07-14 07:47:15 [46mplatform[0m > Pod production-hm-airbyte/orchestrator-repl-job-923-attempt-0 is running on 172.31.134.179 | |
| 2024-07-14 07:47:15 [46mplatform[0m > Uploading file: envMap.json | |
| 2024-07-14 07:47:15 [46mplatform[0m > kubectl cp /tmp/3d058c2c-c67e-49ea-af72-396518c1db41/envMap.json production-hm-airbyte/orchestrator-repl-job-923-attempt-0:/config/envMap.json -c init --retries=3 | |
| 2024-07-14 07:47:15 [46mplatform[0m > Waiting for kubectl cp to complete | |
| 2024-07-14 07:47:15 [46mplatform[0m > kubectl cp complete, closing process | |
| 2024-07-14 07:47:15 [46mplatform[0m > Uploading file: application.txt | |
| 2024-07-14 07:47:15 [46mplatform[0m > kubectl cp /tmp/764c9e4b-fb55-46b8-ad40-cf40d479a7a3/application.txt production-hm-airbyte/orchestrator-repl-job-923-attempt-0:/config/application.txt -c init --retries=3 | |
| 2024-07-14 07:47:15 [46mplatform[0m > Waiting for kubectl cp to complete | |
| 2024-07-14 07:47:15 [46mplatform[0m > kubectl cp complete, closing process | |
| 2024-07-14 07:47:15 [46mplatform[0m > Uploading file: jobRunConfig.json | |
| 2024-07-14 07:47:15 [46mplatform[0m > kubectl cp /tmp/d0c4e522-f715-4810-ba33-c36b0a731a6d/jobRunConfig.json production-hm-airbyte/orchestrator-repl-job-923-attempt-0:/config/jobRunConfig.json -c init --retries=3 | |
| 2024-07-14 07:47:15 [46mplatform[0m > Waiting for kubectl cp to complete | |
| 2024-07-14 07:47:16 [46mplatform[0m > kubectl cp complete, closing process | |
| 2024-07-14 07:47:16 [46mplatform[0m > Uploading file: destinationLauncherConfig.json | |
| 2024-07-14 07:47:16 [46mplatform[0m > kubectl cp /tmp/09086723-ce9b-4da6-881c-4e2634835ee8/destinationLauncherConfig.json production-hm-airbyte/orchestrator-repl-job-923-attempt-0:/config/destinationLauncherConfig.json -c init --retries=3 | |
| 2024-07-14 07:47:16 [46mplatform[0m > Waiting for kubectl cp to complete | |
| 2024-07-14 07:47:16 [46mplatform[0m > kubectl cp complete, closing process | |
| 2024-07-14 07:47:16 [46mplatform[0m > Uploading file: sourceLauncherConfig.json | |
| 2024-07-14 07:47:16 [46mplatform[0m > kubectl cp /tmp/7a689576-2160-412c-a7c8-a8e95027000e/sourceLauncherConfig.json production-hm-airbyte/orchestrator-repl-job-923-attempt-0:/config/sourceLauncherConfig.json -c init --retries=3 | |
| 2024-07-14 07:47:16 [46mplatform[0m > Waiting for kubectl cp to complete | |
| 2024-07-14 07:47:16 [46mplatform[0m > kubectl cp complete, closing process | |
| 2024-07-14 07:47:16 [46mplatform[0m > Uploading file: input.json | |
| 2024-07-14 07:47:16 [46mplatform[0m > kubectl cp /tmp/cb7e4bca-9b85-4141-8445-104a6dfc19ec/input.json production-hm-airbyte/orchestrator-repl-job-923-attempt-0:/config/input.json -c init --retries=3 | |
| 2024-07-14 07:47:16 [46mplatform[0m > Waiting for kubectl cp to complete | |
| 2024-07-14 07:47:16 [46mplatform[0m > kubectl cp complete, closing process | |
| 2024-07-14 07:47:16 [46mplatform[0m > Uploading file: KUBE_POD_INFO | |
| 2024-07-14 07:47:16 [46mplatform[0m > kubectl cp /tmp/16f9c8a7-855d-440e-9db0-da7701eb58d4/KUBE_POD_INFO production-hm-airbyte/orchestrator-repl-job-923-attempt-0:/config/KUBE_POD_INFO -c init --retries=3 | |
| 2024-07-14 07:47:16 [46mplatform[0m > Waiting for kubectl cp to complete | |
| 2024-07-14 07:47:16 [46mplatform[0m > kubectl cp complete, closing process | |
| 2024-07-14 07:47:16 [46mplatform[0m > Uploading file: FINISHED_UPLOADING | |
| 2024-07-14 07:47:16 [46mplatform[0m > kubectl cp /tmp/db6f7ee7-86fd-4810-a4e6-264875322ebb/FINISHED_UPLOADING production-hm-airbyte/orchestrator-repl-job-923-attempt-0:/config/FINISHED_UPLOADING -c init --retries=3 | |
| 2024-07-14 07:47:16 [46mplatform[0m > Waiting for kubectl cp to complete | |
| 2024-07-14 07:47:16 [46mplatform[0m > kubectl cp complete, closing process | |
| 2024-07-14 07:47:21 [32mINFO[m i.a.f.ConfigFileClient(<init>):105 - path /flags does not exist, will return default flag values | |
| 2024-07-14 07:47:21 [33mWARN[m i.a.m.l.MetricClientFactory(initialize):72 - MetricClient was not recognized or not provided. Accepted values are `datadog` or `otel`. | |
| 2024-07-14 07:47:22 [46mreplication-orchestrator[0m > sourceLauncherConfig is: io.airbyte.persistence.job.models.IntegrationLauncherConfig@17d0d3d7[jobId=923,attemptId=0,connectionId=ef8aca79-0dbe-4226-a9ee-3bf3cefa827f,workspaceId=b076756a-703a-47d2-9cf7-e0b6fb651232,dockerImage=airbyte/source-postgres:3.4.24,protocolVersion=Version{version='0.2.0', major='0', minor='2', patch='0'},isCustomConnector=false,allowedHosts=io.airbyte.config.AllowedHosts@5eae392d[hosts=[daw-db.xxx.us-west-2.rds.amazonaws.com, 34.215.xxx.xxx, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}],additionalEnvironmentVariables=<null>,additionalLabels=<null>,priority=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Unknown keyword airbyte_type - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword or if it should generate annotations AnnotationKeyword | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Concurrent stream read enabled? false | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Setting up source... | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Using default value for environment variable SIDECAR_KUBE_MEMORY_LIMIT: '50Mi' | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Using default value for environment variable SIDECAR_MEMORY_REQUEST: '25Mi' | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Using default value for environment variable SIDECAR_KUBE_MEMORY_LIMIT: '50Mi' | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Using default value for environment variable SIDECAR_MEMORY_REQUEST: '25Mi' | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Using default value for environment variable SIDECAR_KUBE_MEMORY_LIMIT: '50Mi' | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Using default value for environment variable SIDECAR_MEMORY_REQUEST: '25Mi' | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Setting up destination... | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Setting up replication worker... | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > starting state flush thread for connectionId ef8aca79-0dbe-4226-a9ee-3bf3cefa827f | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Using BoundedConcurrentLinkedQueue | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Using BoundedConcurrentLinkedQueue | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Running replication worker... | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > start sync worker. job id: 923 attempt id: 0 | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > ----- START REPLICATION ----- | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Number of Resumed Full Refresh Streams: {0} | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Running destination... | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Attempting to start pod = source-postgres-read-923-0-nkxaa for airbyte/source-postgres:3.4.24 with resources ConnectorResourceRequirements[main=io.airbyte.config.ResourceRequirements@298a6b5e[cpuRequest=1000m,cpuLimit=4000m,memoryRequest=1Gi,memoryLimit=10Gi,additionalProperties={}], heartbeat=io.airbyte.config.ResourceRequirements@2a415198[cpuRequest=0.05,cpuLimit=0.2,memoryRequest=25Mi,memoryLimit=50Mi,additionalProperties={}], stdErr=io.airbyte.config.ResourceRequirements@3e4db354[cpuRequest=0.01,cpuLimit=0.5,memoryRequest=25Mi,memoryLimit=50Mi,additionalProperties={}], stdIn=null, stdOut=io.airbyte.config.ResourceRequirements@72ee2d4d[cpuRequest=0.5,cpuLimit=1,memoryRequest=25Mi,memoryLimit=50Mi,additionalProperties={}]] and allowedHosts io.airbyte.config.AllowedHosts@5eae392d[hosts=[daw-db.xxx.us-west-2.rds.amazonaws.com, 34.215.xxx.xxx, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}] | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Attempting to start pod = destination-snowflake-write-923-0-foxvf for airbyte/destination-snowflake:3.11.1 with resources ConnectorResourceRequirements[main=io.airbyte.config.ResourceRequirements@37a2c7ff[cpuRequest=1000m,cpuLimit=4000m,memoryRequest=1Gi,memoryLimit=10Gi,additionalProperties={}], heartbeat=io.airbyte.config.ResourceRequirements@2a415198[cpuRequest=0.05,cpuLimit=0.2,memoryRequest=25Mi,memoryLimit=50Mi,additionalProperties={}], stdErr=io.airbyte.config.ResourceRequirements@1a5e387c[cpuRequest=0.01,cpuLimit=0.5,memoryRequest=25Mi,memoryLimit=50Mi,additionalProperties={}], stdIn=io.airbyte.config.ResourceRequirements@29763cd5[cpuRequest=0.5,cpuLimit=1,memoryRequest=25Mi,memoryLimit=50Mi,additionalProperties={}], stdOut=io.airbyte.config.ResourceRequirements@735e85d0[cpuRequest=0.01,cpuLimit=0.5,memoryRequest=25Mi,memoryLimit=50Mi,additionalProperties={}]] and allowedHosts null | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > source-postgres-read-923-0-nkxaa stdoutLocalPort = 9877 | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > destination-snowflake-write-923-0-foxvf stdoutLocalPort = 9878 | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > source-postgres-read-923-0-nkxaa stderrLocalPort = 9879 | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > destination-snowflake-write-923-0-foxvf stderrLocalPort = 9880 | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Creating stdout socket server... | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Creating stdout socket server... | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Creating stderr socket server... | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Creating stderr socket server... | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Creating pod source-postgres-read-923-0-nkxaa... | |
| 2024-07-14 07:47:23 [46mreplication-orchestrator[0m > Creating pod destination-snowflake-write-923-0-foxvf... | |
| 2024-07-14 07:47:28 [46mreplication-orchestrator[0m > Waiting for init container to be ready before copying files... | |
| 2024-07-14 07:47:28 [46mreplication-orchestrator[0m > Waiting for init container to be ready before copying files... | |
| 2024-07-14 07:47:29 [46mreplication-orchestrator[0m > Init container ready.. | |
| 2024-07-14 07:47:29 [46mreplication-orchestrator[0m > Copying files... | |
| 2024-07-14 07:47:29 [46mreplication-orchestrator[0m > Uploading file: destination_config.json | |
| 2024-07-14 07:47:29 [46mreplication-orchestrator[0m > kubectl cp /tmp/3c5840f4-5d90-4e88-8c22-22c781da8f64/destination_config.json production-hm-airbyte/destination-snowflake-write-923-0-foxvf:/config/destination_config.json -c init --retries=3 | |
| 2024-07-14 07:47:29 [46mreplication-orchestrator[0m > Waiting for kubectl cp to complete | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > kubectl cp complete, closing process | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > Uploading file: destination_catalog.json | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > kubectl cp /tmp/c0c6a434-74c3-436e-b772-dabe5ab7041a/destination_catalog.json production-hm-airbyte/destination-snowflake-write-923-0-foxvf:/config/destination_catalog.json -c init --retries=3 | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > Waiting for kubectl cp to complete | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > Init container ready.. | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > Copying files... | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > Uploading file: source_config.json | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > kubectl cp /tmp/3547bbe9-6794-42cc-a062-904a4feb300c/source_config.json production-hm-airbyte/source-postgres-read-923-0-nkxaa:/config/source_config.json -c init --retries=3 | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > Waiting for kubectl cp to complete | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > kubectl cp complete, closing process | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > Uploading file: FINISHED_UPLOADING | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > kubectl cp /tmp/2be8508d-5a5d-43fc-b9f6-a1c0399d722a/FINISHED_UPLOADING production-hm-airbyte/destination-snowflake-write-923-0-foxvf:/config/FINISHED_UPLOADING -c init --retries=3 | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > Waiting for kubectl cp to complete | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > kubectl cp complete, closing process | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > Uploading file: source_catalog.json | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > kubectl cp /tmp/aefbc779-5994-4207-aed2-40ee75783b4b/source_catalog.json production-hm-airbyte/source-postgres-read-923-0-nkxaa:/config/source_catalog.json -c init --retries=3 | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > Waiting for kubectl cp to complete | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > kubectl cp complete, closing process | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > Waiting until pod is ready... | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > kubectl cp complete, closing process | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > Uploading file: FINISHED_UPLOADING | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > kubectl cp /tmp/35193045-0105-4ee4-86d1-ea4b7386d3b0/FINISHED_UPLOADING production-hm-airbyte/source-postgres-read-923-0-nkxaa:/config/FINISHED_UPLOADING -c init --retries=3 | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > Waiting for kubectl cp to complete | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > kubectl cp complete, closing process | |
| 2024-07-14 07:47:30 [46mreplication-orchestrator[0m > Waiting until pod is ready... | |
| 2024-07-14 07:47:31 [46mreplication-orchestrator[0m > Setting stdout... | |
| 2024-07-14 07:47:31 [46mreplication-orchestrator[0m > Setting stderr... | |
| 2024-07-14 07:47:32 [46mreplication-orchestrator[0m > Setting stdout... | |
| 2024-07-14 07:47:32 [46mreplication-orchestrator[0m > Reading pod IP... | |
| 2024-07-14 07:47:32 [46mreplication-orchestrator[0m > Pod IP: 172.31.128.116 | |
| 2024-07-14 07:47:32 [46mreplication-orchestrator[0m > Using null stdin output stream... | |
| 2024-07-14 07:47:32 [46mreplication-orchestrator[0m > Reading messages from protocol version 0.2.0 | |
| 2024-07-14 07:47:32 [46mreplication-orchestrator[0m > Setting stderr... | |
| 2024-07-14 07:47:32 [46mreplication-orchestrator[0m > Reading pod IP... | |
| 2024-07-14 07:47:32 [46mreplication-orchestrator[0m > Pod IP: 172.31.176.157 | |
| 2024-07-14 07:47:32 [46mreplication-orchestrator[0m > Creating stdin socket... | |
| 2024-07-14 07:47:32 [46mreplication-orchestrator[0m > Writing messages to protocol version 0.2.0 | |
| 2024-07-14 07:47:32 [46mreplication-orchestrator[0m > Reading messages from protocol version 0.2.0 | |
| 2024-07-14 07:47:32 [46mreplication-orchestrator[0m > Writing async status RUNNING for KubePodInfo[namespace=production-hm-airbyte, name=orchestrator-repl-job-923-attempt-0, mainContainerInfo=KubeContainerInfo[image=airbyte/container-orchestrator:0.63.6, pullPolicy=IfNotPresent]]... | |
| 2024-07-14 07:47:32 [46mreplication-orchestrator[0m > readFromSource: start | |
| 2024-07-14 07:47:32 [46mreplication-orchestrator[0m > Starting source heartbeat check. Will check threshold of 10800 seconds, every 1 minutes. | |
| 2024-07-14 07:47:32 [46mreplication-orchestrator[0m > processMessage: start | |
| 2024-07-14 07:47:32 [46mreplication-orchestrator[0m > writeToDestination: start | |
| 2024-07-14 07:47:32 [46mreplication-orchestrator[0m > readFromDestination: start | |
| 2024-07-14 07:47:32 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(main):691 starting source: class io.airbyte.integrations.source.postgres.PostgresSource | |
| 2024-07-14 07:47:32 [44msource[0m > INFO main i.a.c.i.b.IntegrationCliParser$Companion(parseOptions):144 integration args: {read=null, catalog=source_catalog.json, config=source_config.json} | |
| 2024-07-14 07:47:32 [44msource[0m > INFO main i.a.c.i.b.IntegrationRunner(runInternal):124 Running integration: io.airbyte.cdk.integrations.base.ssh.SshWrappedSource | |
| 2024-07-14 07:47:32 [44msource[0m > INFO main i.a.c.i.b.IntegrationRunner(runInternal):125 Command: READ | |
| 2024-07-14 07:47:32 [44msource[0m > INFO main i.a.c.i.b.IntegrationRunner(runInternal):126 Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='null'} | |
| 2024-07-14 07:47:32 [44msource[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword groups - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:47:32 [44msource[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:47:32 [44msource[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword group - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:47:32 [44msource[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:47:32 [44msource[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword always_show - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:47:32 [44msource[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword display_type - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:47:32 [44msource[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword min - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:47:32 [44msource[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword max - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:47:32 [44msource[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:47:32 [44msource[0m > INFO main i.a.c.i.b.s.SshTunnel$Companion(getInstance):423 Starting connection with method: SSH_KEY_AUTH | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main o.a.s.c.u.s.AbstractSecurityProviderRegistrar(getOrCreateProvider):112 getOrCreateProvider(EdDSA) created instance of net.i2p.crypto.eddsa.EdDSASecurityProvider | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main o.a.s.c.i.DefaultIoServiceFactoryFactory(getIoServiceProvider):70 Using MinaServiceFactoryFactory | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main o.a.s.c.c.h.ConfigFileHostEntryResolver(resolveEffectiveResolver):89 resolveEffectiveResolver([email protected]:22/null) no configuration file at /root/.ssh/config | |
| 2024-07-14 07:47:33 [44msource[0m > WARN MinaProcessor-2 o.a.s.c.k.StaticServerKeyVerifier(handleAcceptance):59 Server at /34.215.xxx.xxx:22 presented unverified EC key: SHA256:kzVc0TZ0+EE48t1uRpvZixG8a25P94B8ps2PxuzoOA8 | |
| 2024-07-14 07:47:33 [44msource[0m > INFO MinaProcessor-2 o.a.s.c.k.e.p.HostBoundPubkeyAuthentication(parseExtension):58 Server announced support for [email protected] version 0 | |
| 2024-07-14 07:47:33 [43mdestination[0m > INFO main i.a.c.i.b.a.AdaptiveDestinationRunner$Runner(getDestination):54 Running destination under deployment mode: OSS | |
| 2024-07-14 07:47:33 [43mdestination[0m > INFO main i.a.c.i.b.a.AdaptiveDestinationRunner$Runner(run):67 Starting destination: io.airbyte.integrations.destination.snowflake.SnowflakeDestination | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.b.s.SshTunnel(openTunnel):354 Established tunneling session to daw-db.xxx.us-west-2.rds.amazonaws.com:5432. Port forwarding started on /127.0.0.1:35061 | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.i.s.p.PostgresUtils(isCdc):70 using CDC: true | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.StateManagerFactory(createStateManager):51 Global state manager selected to manage state object with type GLOBAL. | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_act, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_asy, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_bag, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_config, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_con1, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_con2, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_con3, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_daw, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_dri, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_fli, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_gue, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_gue2, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_off, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_ope, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_pil, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_pil2, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_pur, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_reg, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_rid, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_rou, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_sta, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_ter, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_tri, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_tri2, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_veh, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_db_sources):221 No cursor field set in catalog but not present in state. Stream: public_veh_type, New Cursor Field: _ab_cdc_lsn. Resetting cursor value | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.c.i.s.r.CdcStateManager(<init>):30 Initialized CDC state | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(toSslJdbcParamInternal):917 REQUIRED toSslJdbcParam require | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main c.z.h.HikariDataSource(<init>):79 HikariPool-1 - Starting... | |
| 2024-07-14 07:47:33 [44msource[0m > INFO main c.z.h.HikariDataSource(<init>):81 HikariPool-1 - Start completed. | |
| 2024-07-14 07:47:33 [43mdestination[0m > INFO main i.a.c.i.b.IntegrationCliParser$Companion(parseOptions):144 integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} | |
| 2024-07-14 07:47:33 [43mdestination[0m > INFO main i.a.c.i.b.IntegrationRunner(runInternal):124 Running integration: io.airbyte.integrations.destination.snowflake.SnowflakeDestination | |
| 2024-07-14 07:47:33 [43mdestination[0m > INFO main i.a.c.i.b.IntegrationRunner(runInternal):125 Command: WRITE | |
| 2024-07-14 07:47:33 [43mdestination[0m > INFO main i.a.c.i.b.IntegrationRunner(runInternal):126 Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} | |
| 2024-07-14 07:47:33 [43mdestination[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword pattern_descriptor - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:47:33 [43mdestination[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:47:33 [43mdestination[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:47:33 [43mdestination[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:47:33 [43mdestination[0m > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_hidden - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresUtils(isCdc):70 using CDC: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(accept):33 Set new fetch size: 1481040 rows | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.c.d.j.s.TwoStageSizeEstimator$Companion(getTargetBufferByteSize):80 Max memory limit: 8053063680, JDBC buffer size: 4831838208 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresCatalogHelper(getPublicizedTables):123 For CDC, only tables in publication airbyte_public_publication will be included in the sync: [public.bag, public.config, public.con1, public.fli, public.rid, public.pur, public.pil2, public.reg, public.con2, public.tri2, public.daw, public.gue2, public.ope, public.rou, public.dri, public.gue, public.veh_type, public.asy, public.sta, public.act, public.pil, public.tri, public.veh, public.ter, public.off, public.con3] | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.c.i.s.j.AbstractJdbcSource(logPreSyncDebugData):775 Data source product recognized as PostgreSQL:16.3 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "act" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: act_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: ix_act_actual_ts, Column: actual_ts, Unique: false | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: ix_act_earliest_ts, Column: earliest_ts, Unique: false | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: ix_act_estimated_ts, Column: estimated_ts, Unique: false | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: ix_act_latest_ts, Column: latest_ts, Unique: false | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: ix_act_scheduled_ts, Column: scheduled_ts, Unique: false | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "asy" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: asy_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: ix_asy_request_id, Column: request_id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "bag" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: bag_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "config" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: config_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: config_type_reg_id_key, Column: type, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: config_type_reg_id_key, Column: reg_id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "con1" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: con1_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "con2" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: con2_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "con3" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: con3_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "daw" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: daw_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "dri" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: dri_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "fli" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: fli_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: ix_fli_status, Column: status, Unique: false | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "gue" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: gue_email_key, Column: email, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: gue_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: ix_gue_cognito_google_sub, Column: cognito_google_sub, Unique: false | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: ix_gue_cognito_native_sub, Column: cognito_native_sub, Unique: false | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "gue2" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: gue2_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "off" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: off_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: ix_off_status, Column: status, Unique: false | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "ope" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: ope_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "pil" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: pil_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "pil2" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: pil2_acronym_key, Column: acronym, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: pil2_name_key, Column: name, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: pil2_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "pur" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: pur_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "reg" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: reg_name_key, Column: name, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: reg_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "rid" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: rid_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "rou" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: rou_origin_sta_id_destination_sta_id_key, Column: origin_sta_id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: rou_origin_sta_id_destination_sta_id_key, Column: destination_sta_id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: rou_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "sta" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: sta_description_key, Column: description, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: sta_name_key, Column: name, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: sta_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "ter" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: ter_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: ter_version_key, Column: version, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "tri" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: tri_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "tri2" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: tri2_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "veh" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: unique_tail_number, Column: tail_number, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: veh_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):284 Discovering indexes for schema "public", table "veh_type" | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: veh_type_name_key, Column: name, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(logPreSyncDebugData):286 Index name: veh_type_pkey, Column: id, Unique: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.c.i.s.j.AbstractJdbcSource(discoverInternal):364 Internal schemas to exclude: [catalog_history, information_schema, pg_catalog, pg_internal] | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(accept):33 Set new fetch size: 1409376 rows | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.c.d.j.s.TwoStageSizeEstimator$Companion(getTargetBufferByteSize):80 Max memory limit: 8053063680, JDBC buffer size: 4831838208 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresUtils(isCdc):70 using CDC: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(lambda$getReplicationSlot$3):421 Attempting to find the named replication slot using the query: HikariProxyPreparedStatement@1156135967 wrapping SELECT * FROM pg_replication_slots WHERE slot_name = ('airbyte_public_logical_replication_slot') AND plugin = ('pgoutput') AND database = ('daw_db') | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.c.PostgresDebeziumStateUtil(format):240 Initial Debezium state constructed: {"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878328,\"txId\":2777,\"ts_usec\":1720943254670844}"} | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresUtils(shouldFlushAfterSync):78 Should flush after sync: true | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(toSslJdbcParamInternal):917 REQUIRED toSslJdbcParam require | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main o.a.k.c.c.AbstractConfig(logAll):370 JsonConverterConfig values: | |
| converter.type = key | |
| decimal.format = BASE64 | |
| replace.null.with.default = true | |
| schemas.cache.size = 1000 | |
| schemas.enable = false | |
| 2024-07-14 07:47:34 [43mdestination[0m > INFO main i.a.i.b.d.t.CatalogParser(parseCatalog):132 Running sync with stream configs: [StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=ACT, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_act, originalNamespace=XXX_PUBLIC, originalName=act), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=ACTUAL_TS, originalName=actual_ts, canonicalName=ACTUAL_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=LATEST_TS, originalName=latest_ts, canonicalName=LATEST_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=CREATED_TS, originalName=created_ts, canonicalName=CREATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=UPDATED_TS, originalName=updated_ts, canonicalName=UPDATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)=NUMBER, ColumnId(name=EARLIEST_TS, originalName=earliest_ts, canonicalName=EARLIEST_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=ESTIMATED_TS, originalName=estimated_ts, canonicalName=ESTIMATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=SCHEDULED_TS, originalName=scheduled_ts, canonicalName=SCHEDULED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_DELETED_AT, originalName=_ab_cdc_deleted_at, canonicalName=_AB_CDC_DELETED_AT)=STRING, ColumnId(name=_AB_CDC_UPDATED_AT, originalName=_ab_cdc_updated_at, canonicalName=_AB_CDC_UPDATED_AT)=STRING}, generationId=0, minimumGenerationId=0, syncId=923), StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=ASY, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_asy, originalNamespace=XXX_PUBLIC, originalName=asy), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=META, originalName=meta, canonicalName=META)=STRING, ColumnId(name=STATUS, originalName=status, canonicalName=STATUS)=STRING, ColumnId(name=REQUEST, originalName=request, canonicalName=REQUEST)=STRING, ColumnId(name=RESPONSE, originalName=response, canonicalName=RESPONSE)=STRING, ColumnId(name=CREATED_TS, originalName=created_ts, canonicalName=CREATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=REQUEST_ID, originalName=request_id, canonicalName=REQUEST_ID)=STRING, ColumnId(name=UPDATED_TS, originalName=updated_ts, canonicalName=UPDATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)=NUMBER, ColumnId(name=_AB_CDC_DELETED_AT, originalName=_ab_cdc_deleted_at, canonicalName=_AB_CDC_DELETED_AT)=STRING, ColumnId(name=_AB_CDC_UPDATED_AT, originalName=_ab_cdc_updated_at, canonicalName=_AB_CDC_UPDATED_AT)=STRING}, generationId=0, minimumGenerationId=0, syncId=923), StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=BAG, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_bag, originalNamespace=XXX_PUBLIC, originalName=bag), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=SIZE, originalName=size, canonicalName=SIZE)=STRING, ColumnId(name=TRI_ID, originalName=tri_id, canonicalName=TRI_ID)=STRING, ColumnId(name=CREATED_TS, originalName=created_ts, canonicalName=CREATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=UPDATED_TS, originalName=updated_ts, canonicalName=UPDATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)=NUMBER, ColumnId(name=GUE2_ID, originalName=gue2_id, canonicalName=GUE2_ID)=STRING, ColumnId(name=_AB_CDC_DELETED_AT, originalName=_ab_cdc_deleted_at, canonicalName=_AB_CDC_DELETED_AT)=STRING, ColumnId(name=_AB_CDC_UPDATED_AT, originalName=_ab_cdc_updated_at, canonicalName=_AB_CDC_UPDATED_AT)=STRING, ColumnId(name=MEASURED_WEIGHT_LBS, originalName=measured_weight_lbs, canonicalName=MEASURED_WEIGHT_LBS)=NUMBER, ColumnId(name=ESTIMATED_WEIGHT_LBS, originalName=estimated_weight_lbs, canonicalName=ESTIMATED_WEIGHT_LBS)=NUMBER}, generationId=0, minimumGenerationId=0, syncId=923), StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=CONFIG, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_config, originalNamespace=XXX_PUBLIC, originalName=config), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=TYPE, originalName=type, canonicalName=TYPE)=STRING, ColumnId(name=PAYLOAD, originalName=payload, canonicalName=PAYLOAD)=STRING, ColumnId(name=REG_ID, originalName=reg_id, canonicalName=REG_ID)=STRING, ColumnId(name=CREATED_TS, originalName=created_ts, canonicalName=CREATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=UPDATED_TS, originalName=updated_ts, canonicalName=UPDATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)=NUMBER, ColumnId(name=_AB_CDC_DELETED_AT, originalName=_ab_cdc_deleted_at, canonicalName=_AB_CDC_DELETED_AT)=STRING, ColumnId(name=_AB_CDC_UPDATED_AT, originalName=_ab_cdc_updated_at, canonicalName=_AB_CDC_UPDATED_AT)=STRING}, generationId=0, minimumGenerationId=0, syncId=923), StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=CON1, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_con1, originalNamespace=XXX_PUBLIC, originalName=con1), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=TYPE, originalName=type, canonicalName=TYPE)=STRING, ColumnId(name=SEVERITY, originalName=severity, canonicalName=SEVERITY)=STRING, ColumnId(name=REG_ID, originalName=reg_id, canonicalName=REG_ID)=STRING, ColumnId(name=CREATED_TS, originalName=created_ts, canonicalName=CREATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=UPDATED_TS, originalName=updated_ts, canonicalName=UPDATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)=NUMBER, ColumnId(name=CURRENT_PARAMS, originalName=current_params, canonicalName=CURRENT_PARAMS)=STRING, ColumnId(name=DEFAULT_PARAMS, originalName=default_params, canonicalName=DEFAULT_PARAMS)=STRING, ColumnId(name=_AB_CDC_DELETED_AT, originalName=_ab_cdc_deleted_at, canonicalName=_AB_CDC_DELETED_AT)=STRING, ColumnId(name=_AB_CDC_UPDATED_AT, originalName=_ab_cdc_updated_at, canonicalName=_AB_CDC_UPDATED_AT)=STRING}, generationId=0, minimumGenerationId=0, syncId=923), StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=CON2, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_con2, originalNamespace=XXX_PUBLIC, originalName=con2), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=CREATED_TS, originalName=created_ts, canonicalName=CREATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=UPDATED_TS, originalName=updated_ts, canonicalName=UPDATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)=NUMBER, ColumnId(name=VIOLATION_TS, originalName=violation_ts, canonicalName=VIOLATION_TS)=TIMESTAMP_WITHOUT_TIMEZONE, ColumnId(name=_AB_CDC_DELETED_AT, originalName=_ab_cdc_deleted_at, canonicalName=_AB_CDC_DELETED_AT)=STRING, ColumnId(name=_AB_CDC_UPDATED_AT, originalName=_ab_cdc_updated_at, canonicalName=_AB_CDC_UPDATED_AT)=STRING, ColumnId(name=ADDITIONAL_DETAILS, originalName=additional_details, canonicalName=ADDITIONAL_DETAILS)=STRING, ColumnId(name=CON1_ID, originalName=con1_id, canonicalName=CON1_ID)=STRING}, generationId=0, minimumGenerationId=0, syncId=923), StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=CON3, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_con3, originalNamespace=XXX_PUBLIC, originalName=con3), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=ENTITY_ID, originalName=entity_id, canonicalName=ENTITY_ID)=STRING, ColumnId(name=CREATED_TS, originalName=created_ts, canonicalName=CREATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=UPDATED_TS, originalName=updated_ts, canonicalName=UPDATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)=NUMBER, ColumnId(name=ENTITY_TYPE, originalName=entity_type, canonicalName=ENTITY_TYPE)=STRING, ColumnId(name=_AB_CDC_DELETED_AT, originalName=_ab_cdc_deleted_at, canonicalName=_AB_CDC_DELETED_AT)=STRING, ColumnId(name=_AB_CDC_UPDATED_AT, originalName=_ab_cdc_updated_at, canonicalName=_AB_CDC_UPDATED_AT)=STRING, ColumnId(name=CON2_ID, originalName=con2_id, canonicalName=CON2_ID)=STRING}, generationId=0, minimumGenerationId=0, syncId=923), StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=DAW, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_daw, originalNamespace=XXX_PUBLIC, originalName=daw), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=MODE, originalName=mode, canonicalName=MODE)=STRING, ColumnId(name=CREATED_TS, originalName=created_ts, canonicalName=CREATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=UPDATED_TS, originalName=updated_ts, canonicalName=UPDATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)=NUMBER, ColumnId(name=UPDATED_TS_UTC, originalName=updated_ts_utc, canonicalName=UPDATED_TS_UTC)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=SIMULATION_TS_UTC, originalName=simulation_ts_utc, canonicalName=SIMULATION_TS_UTC)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_DELETED_AT, originalName=_ab_cdc_deleted_at, canonicalName=_AB_CDC_DELETED_AT)=STRING, ColumnId(name=_AB_CDC_UPDATED_AT, originalName=_ab_cdc_updated_at, canonicalName=_AB_CDC_UPDATED_AT)=STRING}, generationId=0, minimumGenerationId=0, syncId=923), StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=DRI, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_dri, originalNamespace=XXX_PUBLIC, originalName=dri), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=EMAIL, originalName=email, canonicalName=EMAIL)=STRING, ColumnId(name=LAST_NAME, originalName=last_name, canonicalName=LAST_NAME)=STRING, ColumnId(name=CREATED_TS, originalName=created_ts, canonicalName=CREATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=FIRST_NAME, originalName=first_name, canonicalName=FIRST_NAME)=STRING, ColumnId(name=UPDATED_TS, originalName=updated_ts, canonicalName=UPDATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)=NUMBER, ColumnId(name=HASHED_PASSWORD, originalName=hashed_password, canonicalName=HASHED_PASSWORD)=STRING, ColumnId(name=_AB_CDC_DELETED_AT, originalName=_ab_cdc_deleted_at, canonicalName=_AB_CDC_DELETED_AT)=STRING, ColumnId(name=_AB_CDC_UPDATED_AT, originalName=_ab_cdc_updated_at, canonicalName=_AB_CDC_UPDATED_AT)=STRING}, generationId=0, minimumGenerationId=0, syncId=923), StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=FLI, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_fli, originalNamespace=XXX_PUBLIC, originalName=fli), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=NUMBER, originalName=number, canonicalName=NUMBER)=STRING, ColumnId(name=STATUS, originalName=status, canonicalName=STATUS)=STRING, ColumnId(name=CREATED_TS, originalName=created_ts, canonicalName=CREATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=UPDATED_TS, originalName=updated_ts, canonicalName=UPDATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)=NUMBER, ColumnId(name=CREATION_TYPE, originalName=creation_type, canonicalName=CREATION_TYPE)=STRING, ColumnId(name=FOREFLI_ID, originalName=forefli_id, canonicalName=FOREFLI_ID)=STRING, ColumnId(name=PIL_ID, originalName=pil_id, canonicalName=PIL_ID)=STRING, ColumnId(name=ORIGIN_STA_ID, originalName=origin_sta_id, canonicalName=ORIGIN_STA_ID)=STRING, ColumnId(name=_AB_CDC_DELETED_AT, originalName=_ab_cdc_deleted_at, canonicalName=_AB_CDC_DELETED_AT)=STRING, ColumnId(name=_AB_CDC_UPDATED_AT, originalName=_ab_cdc_updated_at, canonicalName=_AB_CDC_UPDATED_AT)=STRING, ColumnId(name=ASSIGNED_VEH_ID, originalName=assigned_veh_id, canonicalName=ASSIGNED_VEH_ID)=STRING, ColumnId(name=GATE_IN_ACT_ID, originalName=gate_in_act_id, canonicalName=GATE_IN_ACT_ID)=STRING, ColumnId(name=GATE_OUT_ACT_ID, originalName=gate_out_act_id, canonicalName=GATE_OUT_ACT_ID)=STRING, ColumnId(name=PLANNED_DESTINATION_STA_ID, originalName=planned_destination_sta_id, canonicalName=PLANNED_DESTINATION_STA_ID)=STRING, ColumnId(name=WHEELS_ON_ACT_ID, originalName=wheels_on_act_id, canonicalName=WHEELS_ON_ACT_ID)=STRING, ColumnId(name=WHEELS_OFF_ACT_ID, originalName=wheels_off_act_id, canonicalName=WHEELS_OFF_ACT_ID)=STRING}, generationId=0, minimumGenerationId=0, syncId=923), StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=GUE, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_gue, originalNamespace=XXX_PUBLIC, originalName=gue), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, can… | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main o.a.k.c.c.AbstractConfig(logAll):370 StandaloneConfig values: | |
| access.control.allow.methods = | |
| access.control.allow.origin = | |
| admin.listeners = null | |
| auto.include.jmx.reporter = true | |
| bootstrap.servers = [localhost:9092] | |
| client.dns.lookup = use_all_dns_ips | |
| config.providers = [] | |
| connector.client.config.overrid.policy = All | |
| header.converter = class org.apache.kafka.connect.storage.SimpleHeaderConverter | |
| key.converter = class org.apache.kafka.connect.json.JsonConverter | |
| listeners = [http://:8083] | |
| metric.reporters = [] | |
| metrics.num.samples = 2 | |
| metrics.recording.level = INFO | |
| metrics.sample.window.ms = 30000 | |
| offset.flush.interval.ms = 1000 | |
| offset.flush.timeout.ms = 5000 | |
| offset.storage.file.filename = /tmp/cdc-state-offset13359748974261456804/offset.dat | |
| plugin.discovery = hybrid_warn | |
| plugin.path = null | |
| response.http.headers.config = | |
| rest.advertised.host.name = null | |
| rest.advertised.listener = null | |
| rest.advertised.port = null | |
| rest.extension.classes = [] | |
| ssl.cipher.suites = null | |
| ssl.client.auth = none | |
| ssl.enabled.protocols = [TLSv1.2, TLSv1.3] | |
| ssl.endpoint.identification.algorithm = https | |
| ssl.engine.factory.class = null | |
| ssl.key.password = null | |
| ssl.keymanager.algorithm = SunX509 | |
| ssl.keystore.certificate.chain = null | |
| ssl.keystore.key = null | |
| ssl.keystore.location = null | |
| ssl.keystore.password = null | |
| ssl.keystore.type = JKS | |
| ssl.protocol = TLSv1.3 | |
| ssl.provider = null | |
| ssl.secure.random.implementation = null | |
| ssl.trustmanager.algorithm = PKIX | |
| ssl.truststore.certificates = null | |
| ssl.truststore.location = null | |
| ssl.truststore.password = null | |
| ssl.truststore.type = JKS | |
| task.shutdown.graceful.timeout.ms = 5000 | |
| topic.creation.enable = true | |
| topic.tracking.allow.reset = true | |
| topic.tracking.enable = true | |
| value.converter = class org.apache.kafka.connect.json.JsonConverter | |
| 2024-07-14 07:47:34 [43mdestination[0m > INFO main i.a.i.b.d.o.DefaultSyncOperation(createPerStreamOpClients):52 Preparing required schemas and tables for all streams | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main o.a.k.c.s.FileOffsetBackingStore(start):63 Starting FileOffsetBackingStore with file /tmp/cdc-state-offset13359748974261456804/offset.dat | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main o.a.k.c.c.AbstractConfig(logAll):370 JsonConverterConfig values: | |
| converter.type = key | |
| decimal.format = BASE64 | |
| replace.null.with.default = true | |
| schemas.cache.size = 1000 | |
| schemas.enable = false | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main o.a.k.c.c.AbstractConfig(logAll):370 JsonConverterConfig values: | |
| converter.type = value | |
| decimal.format = BASE64 | |
| replace.null.with.default = true | |
| schemas.cache.size = 1000 | |
| schemas.enable = false | |
| 2024-07-14 07:47:34 [43mdestination[0m > INFO main c.z.h.HikariDataSource(getConnection):109 HikariPool-1 - Starting... | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.d.c.CommonConnectorConfig(getSourceInfoStructMaker):1649 Loading the custom source info struct maker plugin: io.debezium.connector.postgresql.PostgresSourceInfoStructMaker | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.c.PostgresDebeziumStateUtil(extractLsn):191 Found previous partition offset PostgresPartition [sourcePartition={server=daw_db}]: {lsn=20266878328, txId=2777, ts_usec=1720943254670844} | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.c.PostgresDebeziumStateUtil(parseSavedOffset):171 Closing offsetStorageReader and fileOffsetBackingStore | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main o.a.k.c.s.FileOffsetBackingStore(stop):71 Stopped FileOffsetBackingStore | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.c.PostgresDebeziumStateUtil(isSavedOffsetAfterReplicationSlotLSN):69 Replication slot confirmed_flush_lsn : 20132659568 Saved offset LSN : 20266878328 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCdcCtidInitializer(getCtidInitialLoadGlobalStateManager):110 Streams to be synced via ctid : 26 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCdcCtidInitializer(getCtidInitialLoadGlobalStateManager):111 Streams: public.act, public.asy, public.bag, public.config, public.con1, public.con2, public.con3, public.daw, public.dri, public.fli, public.gue, public.gue2, public.off, public.ope, public.pil, public.pil2, public.pur, public.reg, public.rid, public.rou, public.sta, public.ter, public.tri, public.tri2, public.veh, public.veh_type | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."act" is 16475 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."asy" is 16487 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."bag" is 17042 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."config" is 16567 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."con1" is 16583 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."con2" is 16665 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."con3" is 16762 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."daw" is 16498 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."dri" is 16506 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."fli" is 16774 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."gue" is 16597 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."gue2" is 17052 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."off" is 16825 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."ope" is 16515 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."pil" is 16524 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."pil2" is 17023 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."pur" is 16853 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."reg" is 16533 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."rid" is 16615 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."rou" is 16679 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."sta" is 16966 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."ter" is 16544 | |
| 2024-07-14 07:47:34 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."tri" is 16867 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."tri2" is 16703 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."veh" is 16738 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."veh_type" is 16555 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresDebeziumStateUtil(format):240 Initial Debezium state constructed: {"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"} | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresUtils(isCdc):70 using CDC: true | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(getIncrementalIterators):503 Using ctid + CDC | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresUtils(getFirstRecordWaitTime):171 First record waiting time: 1200 seconds | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresUtils(getSubsequentRecordWaitTime):183 Subsequent record waiting time: 60 seconds | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCdcCtidInitializer(cdcCtidIteratorsCombined):142 First record waiting time: 1200 seconds | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCdcCtidInitializer(cdcCtidIteratorsCombined):143 Queue size: 10000 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresDebeziumStateUtil(format):240 Initial Debezium state constructed: {"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2779,\"ts_usec\":1720943255030292}"} | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresUtils(shouldFlushAfterSync):78 Should flush after sync: true | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(toSslJdbcParamInternal):917 REQUIRED toSslJdbcParam require | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main o.a.k.c.c.AbstractConfig(logAll):370 JsonConverterConfig values: | |
| converter.type = key | |
| decimal.format = BASE64 | |
| replace.null.with.default = true | |
| schemas.cache.size = 1000 | |
| schemas.enable = false | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main o.a.k.c.c.AbstractConfig(logAll):370 StandaloneConfig values: | |
| access.control.allow.methods = | |
| access.control.allow.origin = | |
| admin.listeners = null | |
| auto.include.jmx.reporter = true | |
| bootstrap.servers = [localhost:9092] | |
| client.dns.lookup = use_all_dns_ips | |
| config.providers = [] | |
| connector.client.config.overrid.policy = All | |
| header.converter = class org.apache.kafka.connect.storage.SimpleHeaderConverter | |
| key.converter = class org.apache.kafka.connect.json.JsonConverter | |
| listeners = [http://:8083] | |
| metric.reporters = [] | |
| metrics.num.samples = 2 | |
| metrics.recording.level = INFO | |
| metrics.sample.window.ms = 30000 | |
| offset.flush.interval.ms = 1000 | |
| offset.flush.timeout.ms = 5000 | |
| offset.storage.file.filename = /tmp/cdc-state-offset10391561222319537832/offset.dat | |
| plugin.discovery = hybrid_warn | |
| plugin.path = null | |
| response.http.headers.config = | |
| rest.advertised.host.name = null | |
| rest.advertised.listener = null | |
| rest.advertised.port = null | |
| rest.extension.classes = [] | |
| ssl.cipher.suites = null | |
| ssl.client.auth = none | |
| ssl.enabled.protocols = [TLSv1.2, TLSv1.3] | |
| ssl.endpoint.identification.algorithm = https | |
| ssl.engine.factory.class = null | |
| ssl.key.password = null | |
| ssl.keymanager.algorithm = SunX509 | |
| ssl.keystore.certificate.chain = null | |
| ssl.keystore.key = null | |
| ssl.keystore.location = null | |
| ssl.keystore.password = null | |
| ssl.keystore.type = JKS | |
| ssl.protocol = TLSv1.3 | |
| ssl.provider = null | |
| ssl.secure.random.implementation = null | |
| ssl.trustmanager.algorithm = PKIX | |
| ssl.truststore.certificates = null | |
| ssl.truststore.location = null | |
| ssl.truststore.password = null | |
| ssl.truststore.type = JKS | |
| task.shutdown.graceful.timeout.ms = 5000 | |
| topic.creation.enable = true | |
| topic.tracking.allow.reset = true | |
| topic.tracking.enable = true | |
| value.converter = class org.apache.kafka.connect.json.JsonConverter | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main o.a.k.c.s.FileOffsetBackingStore(start):63 Starting FileOffsetBackingStore with file /tmp/cdc-state-offset10391561222319537832/offset.dat | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main o.a.k.c.c.AbstractConfig(logAll):370 JsonConverterConfig values: | |
| converter.type = key | |
| decimal.format = BASE64 | |
| replace.null.with.default = true | |
| schemas.cache.size = 1000 | |
| schemas.enable = false | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main o.a.k.c.c.AbstractConfig(logAll):370 JsonConverterConfig values: | |
| converter.type = value | |
| decimal.format = BASE64 | |
| replace.null.with.default = true | |
| schemas.cache.size = 1000 | |
| schemas.enable = false | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.d.c.CommonConnectorConfig(getSourceInfoStructMaker):1649 Loading the custom source info struct maker plugin: io.debezium.connector.postgresql.PostgresSourceInfoStructMaker | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresDebeziumStateUtil(extractLsn):191 Found previous partition offset PostgresPartition [sourcePartition={server=daw_db}]: {lsn=20266878376, txId=2779, ts_usec=1720943255030292} | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresDebeziumStateUtil(parseSavedOffset):171 Closing offsetStorageReader and fileOffsetBackingStore | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main o.a.k.c.s.FileOffsetBackingStore(stop):71 Stopped FileOffsetBackingStore | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresUtils(shouldFlushAfterSync):78 Should flush after sync: true | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresDebeziumStateUtil(commitLSNToPostgresDatabase):104 Committing upto LSN: 20266878376 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresReplicationConnection(createConnection):44 Creating a replication connection. | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresReplicationConnection(createConnection):47 Validating replication connection. | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."act" is 16475 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."asy" is 16487 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."bag" is 17042 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."config" is 16567 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."con1" is 16583 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."con2" is 16665 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."con3" is 16762 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."daw" is 16498 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."dri" is 16506 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."fli" is 16774 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."gue" is 16597 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."gue2" is 17052 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."off" is 16825 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."ope" is 16515 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."pil" is 16524 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."pil2" is 17023 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."pur" is 16853 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."reg" is 16533 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."rid" is 16615 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."rou" is 16679 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."sta" is 16966 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."ter" is 16544 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."tri" is 16867 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."tri2" is 16703 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."veh" is 16738 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."veh2" is 16555 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCdcCtidInitializer(cdcCtidIteratorsCombined):213 Streams to be synced via ctid : 26 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."act" relation size is 8192. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."asy" relation size is 0. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."bag" relation size is 0. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."config" relation size is 0. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."con1" relation size is 0. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."con2" relation size is 0. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."con3" relation size is 0. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."daw" relation size is 0. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."dri" relation size is 0. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."fli" relation size is 8192. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."gue" relation size is 8192. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."gue2" relation size is 0. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."off" relation size is 0. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."ope" relation size is 0. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."pil" relation size is 8192. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."pil2" relation size is 8192. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."pur" relation size is 0. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."reg" relation size is 8192. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."rid" relation size is 0. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."rou" relation size is 8192. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."sta" relation size is 8192. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."ter" relation size is 0. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."tri" relation size is 0. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."tri2" relation size is 0. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."veh" relation size is 8192. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(getTableBlockSizeForStream):299 Stream "public"."veh_type" relation size is 8192. block size 8192 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: act | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: asy | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: bag | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: config | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: con1 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: con2 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: con3 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: daw | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: dri | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: fli | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: gue | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: gue2 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: off | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: ope | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: pil | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: pil2 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: pur | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: reg | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: rid | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: rou | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: sta | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: ter | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: tri | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: tri2 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: veh | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCtidHandler(queryTableCtid):157 Queueing query for table: veh_type | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCdcTargetPosition(targetPosition):52 identified target lsn: PgLsn{lsn=20266878472} | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresUtils(shouldFlushAfterSync):78 Should flush after sync: true | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(toSslJdbcParamInternal):917 REQUIRED toSslJdbcParam require | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:35 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:act | |
| 2024-07-14 07:47:35 [46mreplication-orchestrator[0m > Sending update for public:act - null -> RUNNING | |
| 2024-07-14 07:47:35 [46mreplication-orchestrator[0m > Stream Status Update Received: public:act - RUNNING | |
| 2024-07-14 07:47:35 [46mreplication-orchestrator[0m > Creating status: public:act - RUNNING | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."act" is 16475 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: act | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table act: SELECT ctid::text, "id","created_ts","updated_ts","earliest_ts","latest_ts","scheduled_ts","estimated_ts","actual_ts" FROM "public"."act" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(accept):33 Set new fetch size: 175465 rows | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.c.d.j.s.TwoStageSizeEstimator$Companion(getTargetBufferByteSize):80 Max memory limit: 8053063680, JDBC buffer size: 4831838208 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."act" is 16475 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16475 for stream public_act is equal to the last file node 16475 known to Airbyte. | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_act, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@97a145b[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@c386958[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@157ec23b[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@44d64d4e[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:35 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:asy | |
| 2024-07-14 07:47:35 [46mreplication-orchestrator[0m > Sending update for public:asy - null -> RUNNING | |
| 2024-07-14 07:47:35 [46mreplication-orchestrator[0m > Stream Status Update Received: public:asy - RUNNING | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."asy" is 16487 | |
| 2024-07-14 07:47:35 [46mreplication-orchestrator[0m > Creating status: public:asy - RUNNING | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: asy | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table asy: SELECT ctid::text, "id","created_ts","updated_ts","request_id","request","status","response","meta" FROM "public"."asy" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."asy" is 16487 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16487 for stream public_asy is equal to the last file node 16487 known to Airbyte. | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_asy, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@619f2afc[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@df921b1[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@4db60246[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2152ab30[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3902bd2c[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7d32e714[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:35 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:bag | |
| 2024-07-14 07:47:35 [46mreplication-orchestrator[0m > Sending update for public:bag - null -> RUNNING | |
| 2024-07-14 07:47:35 [46mreplication-orchestrator[0m > Stream Status Update Received: public:bag - RUNNING | |
| 2024-07-14 07:47:35 [46mreplication-orchestrator[0m > Creating status: public:bag - RUNNING | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."bag" is 17042 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: bag | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table bag: SELECT ctid::text, "id","created_ts","updated_ts","measured_weight_lbs","estimated_weight_lbs","size","tri_id","gue2_id" FROM "public"."bag" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."bag" is 17042 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 17042 for stream public_bag is equal to the last file node 17042 known to Airbyte. | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_bag, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@34d45ec0[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@18137eab[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@727320fa[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2935fd2c[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3f018494[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3ce443f9[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@57fbc06f[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@51a18b21[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:35 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:config | |
| 2024-07-14 07:47:35 [46mreplication-orchestrator[0m > Sending update for public:config - null -> RUNNING | |
| 2024-07-14 07:47:35 [46mreplication-orchestrator[0m > Stream Status Update Received: public:config - RUNNING | |
| 2024-07-14 07:47:35 [46mreplication-orchestrator[0m > Creating status: public:config - RUNNING | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."config" is 16567 | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: config | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table config: SELECT ctid::text, "id","created_ts","updated_ts","type","payload","reg_id" FROM "public"."config" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:35 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."config" is 16567 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16567 for stream public_config is equal to the last file node 16567 known to Airbyte. | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_config, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@7c52fc81[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@7523a3dc[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@2806d6da[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@766a49c7[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@1db7157f[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@75e27856[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6bccd036[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@4f4c88f9[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6a756082[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@cb39552[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:con1 | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Sending update for public:con1 - null -> RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream Status Update Received: public:con1 - RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Creating status: public:con1 - RUNNING | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."con1" is 16583 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: con1 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table con1: SELECT ctid::text, "id","created_ts","updated_ts","reg_id","type","severity","default_params","current_params" FROM "public"."con1" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:36 [43mdestination[0m > INFO main c.z.h.p.HikariPool(checkFailFast):554 HikariPool-1 - Added connection net.snowflake.client.jdbc.SnowflakeConnectionV1@2921199d | |
| 2024-07-14 07:47:36 [43mdestination[0m > INFO main c.z.h.HikariDataSource(getConnection):122 HikariPool-1 - Start completed. | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."con1" is 16583 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16583 for stream public_con1 is equal to the last file node 16583 known to Airbyte. | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_con1, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@2a53f215[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@6b63e6ad[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@7beae796[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@6749fe50[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@52bf7bf6[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@261db982[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@ae73c80[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@22f4f8f2[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@bbd4791[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@40a72ecd[name=con1,namespace=public,additionalProperties={}],streamState={"stream_name":"con1","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@73971965[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@76a14c8d[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:con2 | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Sending update for public:con2 - null -> RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream Status Update Received: public:con2 - RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Creating status: public:con2 - RUNNING | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."con2" is 16665 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: con2 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table con2: SELECT ctid::text, "id","created_ts","updated_ts","con1_id","additional_details","violation_ts" FROM "public"."con2" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."con2" is 16665 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16665 for stream public_con2 is equal to the last file node 16665 known to Airbyte. | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_con2, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@6ee99964[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@257ef9ed[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@59c70ceb[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@46f902e0[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@64f981e2[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@361abd01[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@575b5f7d[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@59bbb974[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7165d530[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@12f49ca8[name=con1,namespace=public,additionalProperties={}],streamState={"stream_name":"con1","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@1fd9893c[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1b2df3aa[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@44be69aa[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7219ac49[name=con2,namespace=public,additionalProperties={}],streamState={"stream_name":"con2","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:con3 | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Sending update for public:con3 - null -> RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream Status Update Received: public:con3 - RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Creating status: public:con3 - RUNNING | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."con3" is 16762 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: con3 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table con3: SELECT ctid::text, "id","created_ts","updated_ts","con2_id","entity_type","entity_id" FROM "public"."con3" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."con3" is 16762 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16762 for stream public_con3 is equal to the last file node 16762 known to Airbyte. | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_con3, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@551e4c6d[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@625a9c5d[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@5d1e0fbb[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2eed37f4[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@9b76b60[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3fb9a67f[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@127705e4[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@5562c2c9[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@673c4f6e[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@15c487a8[name=con1,namespace=public,additionalProperties={}],streamState={"stream_name":"con1","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3f36e8d1[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7c011174[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@794366a5[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@480b57e2[name=con3,namespace=public,additionalProperties={}],streamState={"stream_name":"con3","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@40f35e52[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@340d6d89[name=con2,namespace=public,additionalProperties={}],streamState={"stream_name":"con2","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:daw | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Sending update for public:daw - null -> RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream Status Update Received: public:daw - RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Creating status: public:daw - RUNNING | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."daw" is 16498 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: daw | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table daw: SELECT ctid::text, "id","created_ts","updated_ts","mode","simulation_ts_utc","updated_ts_utc" FROM "public"."daw" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."daw" is 16498 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16498 for stream public_daw is equal to the last file node 16498 known to Airbyte. | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_daw, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@443faa85[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@1ee47d9e[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@41da3aee[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@5dc0ff7d[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@64920dc2[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@59a79443[name=daw,namespace=public,additionalProperties={}],streamState={"stream_name":"daw","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@493ac8d3[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@13dbed9e[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@67531e3a[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2b38b1f[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@1d50a7ca[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@51ab1ee3[name=con1,namespace=public,additionalProperties={}],streamState={"stream_name":"con1","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2e766822[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3003e580[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@28757abd[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@21a02556[name=con3,namespace=public,additionalProperties={}],streamState={"stream_name":"con3","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3c8a7e38[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@138aa3cc[name=con2,namespace=public,additionalProperties={}],streamState={"stream_name":"con2","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:dri | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Sending update for public:dri - null -> RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream Status Update Received: public:dri - RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Creating status: public:dri - RUNNING | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."dri" is 16506 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: dri | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table dri: SELECT ctid::text, "id","created_ts","updated_ts","email","first_name","last_name","hashed_password" FROM "public"."dri" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."dri" is 16506 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16506 for stream public_dri is equal to the last file node 16506 known to Airbyte. | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_dri, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@30839e44[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@5f174dd2[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@1945113f[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@45aca496[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@697173d9[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@ceddaf8[name=daw,namespace=public,additionalProperties={}],streamState={"stream_name":"daw","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3d90eeb3[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1db87583[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7fb53256[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1d6d1d42[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@27329d2a[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7978e022[name=con1,namespace=public,additionalProperties={}],streamState={"stream_name":"con1","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2f894ad9[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@5afbd567[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6993c8df[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@57545c3f[name=con3,namespace=public,additionalProperties={}],streamState={"stream_name":"con3","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@326e0b8e[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@36baa049[name=dri,namespace=public,additionalProperties={}],streamState={"stream_name":"dri","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@41184371[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@34585ac9[name=con2,namespace=public,additionalProperties={}],streamState={"stream_name":"con2","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:fli | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Sending update for public:fli - null -> RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream Status Update Received: public:fli - RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Creating status: public:fli - RUNNING | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."fli" is 16774 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: fli | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table fli: SELECT ctid::text, "id","created_ts","updated_ts","number","status","assigned_veh_id","pil_id","creation_type","forefli_id","gate_out_act_id","wheels_off_act_id","wheels_on_act_id","gate_in_act_id","origin_sta_id","planned_destination_sta_id" FROM "public"."fli" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."fli" is 16774 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16774 for stream public_fli is equal to the last file node 16774 known to Airbyte. | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_fli, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@15f35bc3[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@167381c7[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@608b1fd2[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@56382bc9[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@591a4f8e[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@53ed80d3[name=daw,namespace=public,additionalProperties={}],streamState={"stream_name":"daw","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6ba060f3[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7c51782d[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@77bc2e16[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@48e8c32a[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@20a7953c[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@57c00115[name=con1,namespace=public,additionalProperties={}],streamState={"stream_name":"con1","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@411a5965[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@4fe533ff[name=fli,namespace=public,additionalProperties={}],streamState={"stream_name":"fli","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@5377414a[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@4e83a98[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@17aa8a11[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@71b639d0[name=con3,namespace=public,additionalProperties={}],streamState={"stream_name":"con3","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@18a25bbd[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@5d5b9ecb[name=dri,namespace=public,additionalProperties={}],streamState={"stream_name":"dri","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@1ee27d73[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@5e5aafc6[name=con2,namespace=public,additionalProperties={}],streamState={"stream_name":"con2","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:gue | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."gue" is 16597 | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Sending update for public:gue - null -> RUNNING | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: gue | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream Status Update Received: public:gue - RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Creating status: public:gue - RUNNING | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table gue: SELECT ctid::text, "id","created_ts","updated_ts","hashed_password","email","first_name","last_name","address","city","zip","state","country","estimated_weight_lbs","cognito_native_sub","cognito_google_sub","signed_tos_id","birth_date" FROM "public"."gue" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."gue" is 16597 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16597 for stream public_gue is equal to the last file node 16597 known to Airbyte. | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_gue, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@316acbb5[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@56f730b2[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@47311277[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7930ffa9[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@1e60b459[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@717d7587[name=daw,namespace=public,additionalProperties={}],streamState={"stream_name":"daw","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3e906375[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@40230eb9[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@5b7aa898[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@41b13f3d[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7c0777b5[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2489e84a[name=con1,namespace=public,additionalProperties={}],streamState={"stream_name":"con1","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2a39aa2b[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@62b93086[name=fli,namespace=public,additionalProperties={}],streamState={"stream_name":"fli","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@254449bb[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@4e642ee1[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@29ebbdf4[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2fd954f[name=con3,namespace=public,additionalProperties={}],streamState={"stream_name":"con3","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@5731d3a[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@6a0f2853[name=dri,namespace=public,additionalProperties={}],streamState={"stream_name":"dri","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@1eff3cfb[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@70c69586[name=gue,namespace=public,additionalProperties={}],streamState={"stream_name":"gue","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6dc1dc69[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7e9f2c32[name=con2,namespace=public,additionalProperties={}],streamState={"stream_name":"con2","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:gue2 | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Sending update for public:gue2 - null -> RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream Status Update Received: public:gue2 - RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Creating status: public:gue2 - RUNNING | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."gue2" is 17052 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: gue2 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table gue2: SELECT ctid::text, "id","created_ts","updated_ts","measured_weight_lbs","estimated_weight_lbs","email","name","seat_number","status","is_sanitized","tri_id","gue_id" FROM "public"."gue2" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."gue2" is 17052 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 17052 for stream public_gue2 is equal to the last file node 17052 known to Airbyte. | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_gue2, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@5d4e13e1[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@3e0fbeb5[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@3976ebfa[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2676dc05[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@b0a1231[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@4833eff3[name=daw,namespace=public,additionalProperties={}],streamState={"stream_name":"daw","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@4694f434[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@56928e17[name=gue2,namespace=public,additionalProperties={}],streamState={"stream_name":"gue2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@dd2856e[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@5a49af50[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3b1dc579[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@793d163b[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@60dd0587[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@77f905e3[name=con1,namespace=public,additionalProperties={}],streamState={"stream_name":"con1","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@221a2068[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@338766de[name=fli,namespace=public,additionalProperties={}],streamState={"stream_name":"fli","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3b7eac14[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@4976085[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@777d191f[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7fc420b8[name=con3,namespace=public,additionalProperties={}],streamState={"stream_name":"con3","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@31142d58[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@e38f0b7[name=dri,namespace=public,additionalProperties={}],streamState={"stream_name":"dri","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@1192b58e[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@4f8d86e4[name=gue,namespace=public,additionalProperties={}],streamState={"stream_name":"gue","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@5f631ca0[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1697f2b3[name=con2,namespace=public,additionalProperties={}],streamState={"stream_name":"con2","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:off | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Sending update for public:off - null -> RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream Status Update Received: public:off - RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Creating status: public:off - RUNNING | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."off" is 16825 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: off | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table off: SELECT ctid::text, "id","created_ts","updated_ts","fare_usd","rank","status","tri2_id","first_mile_rid_id","last_mile_rid_id","fli_id","estimated_first_mile_pickup_ts","estimated_first_mile_dropoff_ts","estimated_last_mile_pickup_ts","estimated_last_mile_dropoff_ts" FROM "public"."off" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."off" is 16825 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16825 for stream public_off is equal to the last file node 16825 known to Airbyte. | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_off, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@3134153d[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@767599a7[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@5f5effb0[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@25d0cb3a[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@345cbf40[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@6e3eb0cd[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@463561c5[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@659feb22[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3468ee6e[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2f4b98f6[name=con1,namespace=public,additionalProperties={}],streamState={"stream_name":"con1","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@421def93[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@58c1da09[name=fli,namespace=public,additionalProperties={}],streamState={"stream_name":"fli","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2b2954e1[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@58d6e55a[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@751ae8a4[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@235d659c[name=con2,namespace=public,additionalProperties={}],streamState={"stream_name":"con2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@4232b34a[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2da16263[name=daw,namespace=public,additionalProperties={}],streamState={"stream_name":"daw","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@f5ce0bb[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@47e51549[name=gue2,namespace=public,additionalProperties={}],streamState={"stream_name":"gue2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@101a461c[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@360e9c06[name=off,namespace=public,additionalProperties={}],streamState={"stream_name":"off","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@5ebffb44[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@311ff287[name=con3,namespace=public,additionalProperties={}],streamState={"stream_name":"con3","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7377781e[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@31db34da[name=dri,namespace=public,additionalProperties={}],streamState={"stream_name":"dri","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@109f8c7e[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@5edacf20[name=gue,namespace=public,additionalProperties={}],streamState={"stream_name":"gue","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:ope | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Sending update for public:ope - null -> RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream Status Update Received: public:ope - RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Creating status: public:ope - RUNNING | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."ope" is 16515 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: ope | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table ope: SELECT ctid::text, "id","created_ts","updated_ts","email","hashed_password","first_name","last_name" FROM "public"."ope" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."ope" is 16515 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16515 for stream public_ope is equal to the last file node 16515 known to Airbyte. | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_ope, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@7e307087[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@1220ef43[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@1a8b81e8[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@234cff57[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@5e8507f1[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@4bcaa195[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@d08edc5[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@49fa1d74[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3f362135[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@21eee94f[name=con1,namespace=public,additionalProperties={}],streamState={"stream_name":"con1","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6bc24e72[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@724aefc3[name=fli,namespace=public,additionalProperties={}],streamState={"stream_name":"fli","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7cfb4736[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2a097d77[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@53c1179a[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7650ded6[name=con2,namespace=public,additionalProperties={}],streamState={"stream_name":"con2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@5034f5dd[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@31b7d869[name=daw,namespace=public,additionalProperties={}],streamState={"stream_name":"daw","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6a916402[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1a47a1e8[name=gue2,namespace=public,additionalProperties={}],streamState={"stream_name":"gue2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6d2a2560[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@62d1dc3c[name=ope,namespace=public,additionalProperties={}],streamState={"stream_name":"ope","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3811510[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@24eeac69[name=off,namespace=public,additionalProperties={}],streamState={"stream_name":"off","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@18539cb1[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@748f93bb[name=con3,namespace=public,additionalProperties={}],streamState={"stream_name":"con3","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7f2d31af[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2e7157c7[name=dri,namespace=public,additionalProperties={}],streamState={"stream_name":"dri","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2a43e0ac[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@22d9bc14[name=gue,namespace=public,additionalProperties={}],streamState={"stream_name":"gue","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:pil | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Sending update for public:pil - null -> RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream Status Update Received: public:pil - RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Creating status: public:pil - RUNNING | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."pil" is 16524 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: pil | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table pil: SELECT ctid::text, "id","created_ts","updated_ts","email","first_name","last_name","hashed_password" FROM "public"."pil" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."pil" is 16524 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16524 for stream public_pil is equal to the last file node 16524 known to Airbyte. | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_pil, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@1084f78c[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@25f723b0[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@4aa11206[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@40d60f2[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3382cf68[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2f74900b[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6d8796c1[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2e26173[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@27be17c8[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2c413ffc[name=con1,namespace=public,additionalProperties={}],streamState={"stream_name":"con1","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7d21852b[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@6cd98a05[name=fli,namespace=public,additionalProperties={}],streamState={"stream_name":"fli","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3b8ec001[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1e95b653[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6f6c6077[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@4fc5563d[name=con2,namespace=public,additionalProperties={}],streamState={"stream_name":"con2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@286090c[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@31120021[name=pil,namespace=public,additionalProperties={}],streamState={"stream_name":"pil","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3df1a1ac[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@58606c91[name=daw,namespace=public,additionalProperties={}],streamState={"stream_name":"daw","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6a9cd0f8[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@4baed682[name=gue2,namespace=public,additionalProperties={}],streamState={"stream_name":"gue2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7be2f29a[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@203d1d93[name=ope,namespace=public,additionalProperties={}],streamState={"stream_name":"ope","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2c2a027c[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@118dcbbd[name=off,namespace=public,additionalProperties={}],streamState={"stream_name":"off","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7d979d34[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@350ec690[name=con3,namespace=public,additionalProperties={}],streamState={"stream_name":"con3","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@49cb1baf[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3664f108[name=dri,namespace=public,additionalProperties={}],streamState={"stream_name":"dri","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@77dba4cd[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@34a2d6e0[name=gue,namespace=public,additionalProperties={}],streamState={"stream_name":"gue","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:pil2 | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Sending update for public:pil2 - null -> RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream Status Update Received: public:pil2 - RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Creating status: public:pil2 - RUNNING | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."pil2" is 17023 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: pil2 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table pil2: SELECT ctid::text, "id","created_ts","updated_ts","name","acronym" FROM "public"."pil2" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."pil2" is 17023 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 17023 for stream public_pil2 is equal to the last file node 17023 known to Airbyte. | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_pil2, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@7f973a14[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@76130a29[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@124d02b2[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3451f01d[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@72503b19[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1cfc2538[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@66deec87[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@5d342959[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2ecf5915[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@53e76c11[name=con1,namespace=public,additionalProperties={}],streamState={"stream_name":"con1","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@42cc183e[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3e4e8fdf[name=fli,namespace=public,additionalProperties={}],streamState={"stream_name":"fli","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6a1d6ef2[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2721044[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@205df5dc[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@6aa7b67f[name=pil2,namespace=public,additionalProperties={}],streamState={"stream_name":"pil2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6bcc3f27[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@79aee22a[name=con2,namespace=public,additionalProperties={}],streamState={"stream_name":"con2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@36920bd6[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@61514735[name=pil,namespace=public,additionalProperties={}],streamState={"stream_name":"pil","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6bee793f[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@655f69da[name=daw,namespace=public,additionalProperties={}],streamState={"stream_name":"daw","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@43b5021c[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@28369db0[name=gue2,namespace=public,additionalProperties={}],streamState={"stream_name":"gue2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@30893e08[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2e86807a[name=ope,namespace=public,additionalProperties={}],streamState={"stream_name":"ope","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@4548d254[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@590f0c50[name=off,namespace=public,additionalProperties={}],streamState={"stream_name":"off","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@208f0007[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3a90c13c[name=con3,namespace=public,additionalProperties={}],streamState={"stream_name":"con3","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@39c96e48[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@188598ad[name=dri,namespace=public,additionalProperties={}],streamState={"stream_name":"dri","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@40d23c82[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7cf78c85[name=gue,namespace=public,additionalProperties={}],streamState={"stream_name":"gue","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:pur | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Sending update for public:pur - null -> RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream Status Update Received: public:pur - RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Creating status: public:pur - RUNNING | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."pur" is 16853 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: pur | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table pur: SELECT ctid::text, "id","created_ts","updated_ts","status","failure_code","off_id" FROM "public"."pur" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."pur" is 16853 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16853 for stream public_pur is equal to the last file node 16853 known to Airbyte. | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_pur, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@550de6b8[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@3a1706e1[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@3c6c4689[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@63cf9de0[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@594d9f07[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@5befbac1[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@5e9f73b[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1a565afb[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2fd64b11[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@949c598[name=con1,namespace=public,additionalProperties={}],streamState={"stream_name":"con1","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@43d3aba5[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@6bfaa0a6[name=fli,namespace=public,additionalProperties={}],streamState={"stream_name":"fli","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@76e9f00b[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@314b9e4b[name=pur,namespace=public,additionalProperties={}],streamState={"stream_name":"pur","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6f1b8544[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@51dae791[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@688a2c09[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@5de5e95[name=pil2,namespace=public,additionalProperties={}],streamState={"stream_name":"pil2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@365cdacf[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@303c55fa[name=con2,namespace=public,additionalProperties={}],streamState={"stream_name":"con2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@9efcd90[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7eb200ce[name=pil,namespace=public,additionalProperties={}],streamState={"stream_name":"pil","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2ee83775[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7c2924d7[name=daw,namespace=public,additionalProperties={}],streamState={"stream_name":"daw","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@b5de58f[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@6587305a[name=gue2,namespace=public,additionalProperties={}],streamState={"stream_name":"gue2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@abbe000[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3f81621c[name=ope,namespace=public,additionalProperties={}],streamState={"stream_name":"ope","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@5b9499fe[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@74d6736[name=off,namespace=public,additionalProperties={}],streamState={"stream_name":"off","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@52a33c3f[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@668625f5[name=con3,namespace=public,additionalProperties={}],streamState={"stream_name":"con3","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@19a20bb2[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@75babb67[name=dri,namespace=public,additionalProperties={}],streamState={"stream_name":"dri","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3eb3232b[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@69cd1085[name=gue,namespace=public,additionalProperties={}],streamState={"stream_name":"gue","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:reg | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Sending update for public:reg - null -> RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream Status Update Received: public:reg - RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Creating status: public:reg - RUNNING | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."reg" is 16533 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: reg | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table reg: SELECT ctid::text, "id","created_ts","updated_ts","name","queue_url","tzinfo" FROM "public"."reg" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."reg" is 16533 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16533 for stream public_reg is equal to the last file node 16533 known to Airbyte. | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_reg, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@40fa8766[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@67774e29[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@663f237a[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@5d7399f9[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@49a6f486[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@14fded9d[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@bc6288b[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@4a3bd45b[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@34c70b5e[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@4f2d995e[name=con1,namespace=public,additionalProperties={}],streamState={"stream_name":"con1","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@75156240[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@6198e9b5[name=fli,namespace=public,additionalProperties={}],streamState={"stream_name":"fli","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6d099323[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@4ecd00b5[name=pur,namespace=public,additionalProperties={}],streamState={"stream_name":"pur","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@10947c4e[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3667faa8[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@1756f7cc[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3138953b[name=pil2,namespace=public,additionalProperties={}],streamState={"stream_name":"pil2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@27df95e[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@b46e103[name=reg,namespace=public,additionalProperties={}],streamState={"stream_name":"reg","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2b0e9f30[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@5eea5627[name=con2,namespace=public,additionalProperties={}],streamState={"stream_name":"con2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3330f3ad[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@f425231[name=pil,namespace=public,additionalProperties={}],streamState={"stream_name":"pil","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@506aabf6[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@5cbd94b2[name=daw,namespace=public,additionalProperties={}],streamState={"stream_name":"daw","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6824b913[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@756aadfc[name=gue2,namespace=public,additionalProperties={}],streamState={"stream_name":"gue2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@705a8dbc[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@40729f01[name=ope,namespace=public,additionalProperties={}],streamState={"stream_name":"ope","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@d535a3d[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2d760326[name=off,namespace=public,additionalProperties={}],streamState={"stream_name":"off","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@9e54c59[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@5dbb50f3[name=con3,namespace=public,additionalProperties={}],streamState={"stream_name":"con3","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@4a2e7bcb[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@575c3e9b[name=dri,namespace=public,additionalProperties={}],streamState={"stream_name":"dri","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@74f827ad[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@73c3cd09[name=gue,namespace=public,additionalProperties={}],streamState={"stream_name":"gue","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:rid | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Sending update for public:rid - null -> RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream Status Update Received: public:rid - RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Creating status: public:rid - RUNNING | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."rid" is 16615 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: rid | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table rid: SELECT ctid::text, "id","created_ts","updated_ts","status","origin_lat","origin_lng","destination_lat","destination_lng","dri_id","dispatch_act_id","arrive_act_id","pickup_act_id","dropoff_act_id" FROM "public"."rid" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."rid" is 16615 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16615 for stream public_rid is equal to the last file node 16615 known to Airbyte. | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_rid, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@7c1447b5[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@49e4c2d5[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@24a2e565[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3e36b7a0[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@60c1663c[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@f5cf29b[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3c66b7d8[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@37e69c43[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@5c7dfc05[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@345d053b[name=con1,namespace=public,additionalProperties={}],streamState={"stream_name":"con1","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3d0cac1f[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3e8b3b79[name=fli,namespace=public,additionalProperties={}],streamState={"stream_name":"fli","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@d257579[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@518ddd3b[name=rid,namespace=public,additionalProperties={}],streamState={"stream_name":"rid","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@939ff41[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@6e0e5dec[name=pur,namespace=public,additionalProperties={}],streamState={"stream_name":"pur","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@48a663e9[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@777d0bc3[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3178219a[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2d85fb64[name=pil2,namespace=public,additionalProperties={}],streamState={"stream_name":"pil2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@56476c16[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@497b560e[name=reg,namespace=public,additionalProperties={}],streamState={"stream_name":"reg","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@39ffda4a[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3ba348ca[name=con2,namespace=public,additionalProperties={}],streamState={"stream_name":"con2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@56e9a474[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@45b15381[name=pil,namespace=public,additionalProperties={}],streamState={"stream_name":"pil","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2dbfcf7[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@239f017e[name=daw,namespace=public,additionalProperties={}],streamState={"stream_name":"daw","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@38cedb7d[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@772caabe[name=gue2,namespace=public,additionalProperties={}],streamState={"stream_name":"gue2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2acdcce8[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7102ac3e[name=ope,namespace=public,additionalProperties={}],streamState={"stream_name":"ope","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3f598450[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2db2a05f[name=off,namespace=public,additionalProperties={}],streamState={"stream_name":"off","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@695c938d[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@d5bb1c4[name=con3,namespace=public,additionalProperties={}],streamState={"stream_name":"con3","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7ed3df3b[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@465b38e6[name=dri,namespace=public,additionalProperties={}],streamState={"stream_name":"dri","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@4b960b5b[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1b13467c[name=gue,namespace=public,additionalProperties={}],streamState={"stream_name":"gue","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:rou | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Sending update for public:rou - null -> RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Stream Status Update Received: public:rou - RUNNING | |
| 2024-07-14 07:47:36 [46mreplication-orchestrator[0m > Creating status: public:rou - RUNNING | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."rou" is 16679 | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: rou | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table rou: SELECT ctid::text, "id","created_ts","updated_ts","distance_miles","duration_minutes","base_fare_usd","reg_id","origin_sta_id","destination_sta_id" FROM "public"."rou" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:36 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."rou" is 16679 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16679 for stream public_rou is equal to the last file node 16679 known to Airbyte. | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_rou, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@64dae3b7[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@1fedf0a4[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@1e4c6583[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2ee48610[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@1d901f20[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@6d08b4e6[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@1015a4b9[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1acb74ad[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7bf01cb[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2f382a5e[name=con1,namespace=public,additionalProperties={}],streamState={"stream_name":"con1","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@12b5736c[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@539a138b[name=fli,namespace=public,additionalProperties={}],streamState={"stream_name":"fli","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2cd4e16a[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@42505474[name=rid,namespace=public,additionalProperties={}],streamState={"stream_name":"rid","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7b477141[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@784223e9[name=pur,namespace=public,additionalProperties={}],streamState={"stream_name":"pur","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7316523a[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@33a55bd8[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@73a8e994[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1a1cc163[name=pil2,namespace=public,additionalProperties={}],streamState={"stream_name":"pil2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@5b5ac798[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@42383cb0[name=reg,namespace=public,additionalProperties={}],streamState={"stream_name":"reg","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7668892a[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@a83495d[name=con2,namespace=public,additionalProperties={}],streamState={"stream_name":"con2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7e83992[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@4364863[name=pil,namespace=public,additionalProperties={}],streamState={"stream_name":"pil","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3625a016[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@267cde2e[name=daw,namespace=public,additionalProperties={}],streamState={"stream_name":"daw","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@609e57da[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@56dd6efa[name=gue2,namespace=public,additionalProperties={}],streamState={"stream_name":"gue2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@4d634127[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@d2e6b0b[name=ope,namespace=public,additionalProperties={}],streamState={"stream_name":"ope","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@1f1cddf3[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@228bda54[name=rou,namespace=public,additionalProperties={}],streamState={"stream_name":"rou","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@75b6dd5b[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@b3e86d5[name=off,namespace=public,additionalProperties={}],streamState={"stream_name":"off","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@72b43104[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@e111c7c[name=con3,namespace=public,additionalProperties={}],streamState={"stream_name":"con3","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@4d0e54e0[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@32f96bba[name=dri,namespace=public,additionalProperties={}],streamState={"stream_name":"dri","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@611640f0[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@67e25252[name=gue,namespace=public,additionalProperties={}],streamState={"stream_name":"gue","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:sta | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."sta" is 16966 | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Sending update for public:sta - null -> RUNNING | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: sta | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Stream Status Update Received: public:sta - RUNNING | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Creating status: public:sta - RUNNING | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table sta: SELECT ctid::text, "id","created_ts","updated_ts","name","description","lat","lng","taxi_minutes","num_fato","max_total_aircraft","reg_id","icao_code","iata_code","faa_code","max_runway_length_ft","fato_diameter_ft" FROM "public"."sta" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:37 [43mdestination[0m > INFO main i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."sta" is 16966 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16966 for stream public_sta is equal to the last file node 16966 known to Airbyte. | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_sta, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@21a9a705[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@72eb6200[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@76ececd[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7affc159[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@1682c08c[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3fd05b3e[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@4eb9f2af[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@4a481728[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@4ace284d[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@77fa9381[name=con1,namespace=public,additionalProperties={}],streamState={"stream_name":"con1","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@76d72b5b[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7cac93fe[name=fli,namespace=public,additionalProperties={}],streamState={"stream_name":"fli","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@479b5066[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@64deb58f[name=rid,namespace=public,additionalProperties={}],streamState={"stream_name":"rid","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2b1cd7bc[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@33379242[name=sta,namespace=public,additionalProperties={}],streamState={"stream_name":"sta","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2e32fc22[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3f5156a6[name=pur,namespace=public,additionalProperties={}],streamState={"stream_name":"pur","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@72bdd7c7[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7d17ee50[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@44fdce3c[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@712c5463[name=pil2,namespace=public,additionalProperties={}],streamState={"stream_name":"pil2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6d33a66e[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2f14b0f6[name=reg,namespace=public,additionalProperties={}],streamState={"stream_name":"reg","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@5b20706[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@16aed49f[name=con2,namespace=public,additionalProperties={}],streamState={"stream_name":"con2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@66de00f2[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@6c479fdf[name=pil,namespace=public,additionalProperties={}],streamState={"stream_name":"pil","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@79d82f66[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@19b206ee[name=daw,namespace=public,additionalProperties={}],streamState={"stream_name":"daw","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@ffd4cba[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@5f1483fd[name=gue2,namespace=public,additionalProperties={}],streamState={"stream_name":"gue2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@670f2466[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@6e03db1f[name=ope,namespace=public,additionalProperties={}],streamState={"stream_name":"ope","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@bfec2f9[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@708eb310[name=rou,namespace=public,additionalProperties={}],streamState={"stream_name":"rou","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6ebc9573[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1e977098[name=off,namespace=public,additionalProperties={}],streamState={"stream_name":"off","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@630390b9[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@6690b9fa[name=con3,namespace=public,additionalProperties={}],streamState={"stream_name":"con3","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6c8dbf56[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@493b01ef[name=dri,namespace=public,additionalProperties={}],streamState={"stream_name":"dri","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@36c2d629[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@55fee662[name=gue,namespace=public,additionalProperties={}],streamState={"stream_name":"gue","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:ter | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Sending update for public:ter - null -> RUNNING | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Stream Status Update Received: public:ter - RUNNING | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Creating status: public:ter - RUNNING | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."ter" is 16544 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: ter | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table ter: SELECT ctid::text, "id","created_ts","updated_ts","version","content" FROM "public"."ter" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."ter" is 16544 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16544 for stream public_ter is equal to the last file node 16544 known to Airbyte. | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_ter, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@45adc393[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@65fe2691[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@479111ba[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@57ad1178[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7c37f145[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@68699afc[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@273a5a8a[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1823b9c4[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@5b5dce5c[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7f4701b1[name=con1,namespace=public,additionalProperties={}],streamState={"stream_name":"con1","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@adcfad9[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@fb49fdf[name=fli,namespace=public,additionalProperties={}],streamState={"stream_name":"fli","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3a2e9f5b[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7da34b26[name=rid,namespace=public,additionalProperties={}],streamState={"stream_name":"rid","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@10c47c79[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3b2553d9[name=sta,namespace=public,additionalProperties={}],streamState={"stream_name":"sta","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@753fd7a1[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@12a2585b[name=pur,namespace=public,additionalProperties={}],streamState={"stream_name":"pur","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@21b6c9c2[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@309cedb6[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3b95a6db[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3bf54172[name=pil2,namespace=public,additionalProperties={}],streamState={"stream_name":"pil2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2c9a6717[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7b3cde6f[name=reg,namespace=public,additionalProperties={}],streamState={"stream_name":"reg","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6d091cad[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7c663eaf[name=con2,namespace=public,additionalProperties={}],streamState={"stream_name":"con2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3bb5ceb[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1e692555[name=pil,namespace=public,additionalProperties={}],streamState={"stream_name":"pil","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3ba0ae41[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@76fe6cdc[name=daw,namespace=public,additionalProperties={}],streamState={"stream_name":"daw","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2ffb3aec[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@786ff1cb[name=gue2,namespace=public,additionalProperties={}],streamState={"stream_name":"gue2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@46039a21[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@431e86b1[name=ter,namespace=public,additionalProperties={}],streamState={"stream_name":"ter","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@35c4e864[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@32a2a6be[name=ope,namespace=public,additionalProperties={}],streamState={"stream_name":"ope","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@682af059[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@5f36c8e3[name=rou,namespace=public,additionalProperties={}],streamState={"stream_name":"rou","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@4da39ca9[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@6a9344f5[name=off,namespace=public,additionalProperties={}],streamState={"stream_name":"off","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@5584d9c6[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3c9c6245[name=con3,namespace=public,additionalProperties={}],streamState={"stream_name":"con3","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6d0be7ab[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1d4fb213[name=dri,namespace=public,additionalProperties={}],streamState={"stream_name":"dri","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6ef60295[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3127cb44[name=gue,namespace=public,additionalProperties={}],streamState={"stream_name":"gue","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:tri | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Sending update for public:tri - null -> RUNNING | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Stream Status Update Received: public:tri - RUNNING | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Creating status: public:tri - RUNNING | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."tri" is 16867 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: tri | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table tri: SELECT ctid::text, "id","created_ts","updated_ts","reg_id","gue_id","tri2_id","booked_off_id","booked_first_mile_rid_id","booked_fli_id","booked_last_mile_rid_id","status" FROM "public"."tri" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."tri" is 16867 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16867 for stream public_tri is equal to the last file node 16867 known to Airbyte. | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_tri, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@631cb129[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@3d20e575[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@3252747e[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2b4b96a4[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2dd8ff1d[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@17e9bc9e[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@36b9cb99[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@4130955c[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2bfaba70[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@71adfedd[name=con1,namespace=public,additionalProperties={}],streamState={"stream_name":"con1","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@9301672[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@4ceff87d[name=fli,namespace=public,additionalProperties={}],streamState={"stream_name":"fli","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3238e2aa[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2c7db926[name=rid,namespace=public,additionalProperties={}],streamState={"stream_name":"rid","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2577a95d[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1668919e[name=sta,namespace=public,additionalProperties={}],streamState={"stream_name":"sta","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@63300c4b[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@22c53d82[name=pur,namespace=public,additionalProperties={}],streamState={"stream_name":"pur","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3a6045c6[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@68d6d775[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@b67cc70[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@45c9b3[name=pil2,namespace=public,additionalProperties={}],streamState={"stream_name":"pil2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@38b3f208[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@6680f714[name=reg,namespace=public,additionalProperties={}],streamState={"stream_name":"reg","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@53b1a3f8[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7d97e06c[name=con2,namespace=public,additionalProperties={}],streamState={"stream_name":"con2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@5a936e64[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3b4a1a75[name=pil,namespace=public,additionalProperties={}],streamState={"stream_name":"pil","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@65bad087[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@276cc8dc[name=tri,namespace=public,additionalProperties={}],streamState={"stream_name":"tri","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@66cd621b[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@d3f4505[name=daw,namespace=public,additionalProperties={}],streamState={"stream_name":"daw","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3eb292cd[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7fd987ef[name=gue2,namespace=public,additionalProperties={}],streamState={"stream_name":"gue2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7209ffb5[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@5e99b9c[name=ter,namespace=public,additionalProperties={}],streamState={"stream_name":"ter","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2fe74516[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1c3259fa[name=ope,namespace=public,additionalProperties={}],streamState={"stream_name":"ope","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@217bf99e[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@6807a356[name=rou,namespace=public,additionalProperties={}],streamState={"stream_name":"rou","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7ddd84b5[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@73aeef7d[name=off,namespace=public,additionalProperties={}],streamState={"stream_name":"off","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@d675f9f[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@58af5076[name=con3,namespace=public,additionalProperties={}],streamState={"stream_name":"con3","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@49469ffa[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@4d9754a8[name=dri,namespace=public,additionalProperties={}],streamState={"stream_name":"dri","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7a3b7122[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@58b5a2f3[name=gue,namespace=public,additionalProperties={}],streamState={"stream_name":"gue","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:tri2 | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Sending update for public:tri2 - null -> RUNNING | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Stream Status Update Received: public:tri2 - RUNNING | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Creating status: public:tri2 - RUNNING | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."tri2" is 16703 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: tri2 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table tri2: SELECT ctid::text, "id","created_ts","updated_ts","reg_id","objective","objective_timestamp","origin_lat","origin_lng","first_mile_is_serviced","destination_lat","destination_lng","last_mile_is_serviced","params","gue_id","original_tri2_id","origin_sta_id","destination_sta_id" FROM "public"."tri2" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."tri2" is 16703 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16703 for stream public_tri2 is equal to the last file node 16703 known to Airbyte. | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_tri2, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@52b46d52[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@7327a447[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@67022ea[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2954f6ab[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@58fbd02e[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@163042ea[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@11d045b4[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1fbf088b[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@1943c1f2[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@d70f722[name=con1,namespace=public,additionalProperties={}],streamState={"stream_name":"con1","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@1e1eeedd[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@798256c5[name=fli,namespace=public,additionalProperties={}],streamState={"stream_name":"fli","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7ec95456[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@748a654a[name=rid,namespace=public,additionalProperties={}],streamState={"stream_name":"rid","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@1d8b0500[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@76544c0a[name=sta,namespace=public,additionalProperties={}],streamState={"stream_name":"sta","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@428bdd72[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@650c405c[name=pur,namespace=public,additionalProperties={}],streamState={"stream_name":"pur","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@20eaeaf8[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@748ac6f3[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@68f6e55d[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@6fff46bf[name=pil2,namespace=public,additionalProperties={}],streamState={"stream_name":"pil2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@1835dc92[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3aaa3c39[name=reg,namespace=public,additionalProperties={}],streamState={"stream_name":"reg","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@65a9ea3c[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@70f68288[name=con2,namespace=public,additionalProperties={}],streamState={"stream_name":"con2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@46911148[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2db1b657[name=pil,namespace=public,additionalProperties={}],streamState={"stream_name":"pil","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7e351d7[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@43c57161[name=tri2,namespace=public,additionalProperties={}],streamState={"stream_name":"tri2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@d902300[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2db33feb[name=tri,namespace=public,additionalProperties={}],streamState={"stream_name":"tri","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@30c3ae63[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@58658f63[name=daw,namespace=public,additionalProperties={}],streamState={"stream_name":"daw","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@54e12f4c[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@60990e5c[name=gue2,namespace=public,additionalProperties={}],streamState={"stream_name":"gue2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@4d84049a[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@39ee94de[name=ter,namespace=public,additionalProperties={}],streamState={"stream_name":"ter","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@642857e0[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@4c6b4ed7[name=ope,namespace=public,additionalProperties={}],streamState={"stream_name":"ope","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@21263314[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@6ca30b8a[name=rou,namespace=public,additionalProperties={}],streamState={"stream_name":"rou","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@4a92c6a9[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@5c9934da[name=off,namespace=public,additionalProperties={}],streamState={"stream_name":"off","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@4cb702ce[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@383caf89[name=con3,namespace=public,additionalProperties={}],streamState={"stream_name":"con3","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@64c781a9[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@71ed560f[name=dri,namespace=public,additionalProperties={}],streamState={"stream_name":"dri","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@5b88b8e[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@58253c57[name=gue,namespace=public,additionalProperties={}],streamState={"stream_name":"gue","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:veh | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Sending update for public:veh - null -> RUNNING | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Stream Status Update Received: public:veh - RUNNING | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Creating status: public:veh - RUNNING | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."veh" is 16738 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: veh | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table veh: SELECT ctid::text, "id","created_ts","updated_ts","tail_number","serial_number","latest_lat","latest_lng","veh_type_id","reg_id","latest_sta_id","capable_of_vtol","capable_of_ctol","min_runway_length_for_ctol","pax_capacity","max_cargo_lbs","max_takeoff_weight_lbs","max_landing_weight_lbs","max_zero_fuel_weight_lbs","operating_empty_weight_lbs","minimum_pilots","operator_code" FROM "public"."veh" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."veh" is 16738 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16738 for stream public_veh is equal to the last file node 16738 known to Airbyte. | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_veh, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@1bf14704[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@5a545b0f[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@2be21396[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@124dac75[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@315105f[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7b61bf11[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@40247d48[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3ff54f3d[name=con1,namespace=public,additionalProperties={}],streamState={"stream_name":"con1","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@14c93774[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@62a68bcb[name=fli,namespace=public,additionalProperties={}],streamState={"stream_name":"fli","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@18b74ea[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@14924f41[name=rid,namespace=public,additionalProperties={}],streamState={"stream_name":"rid","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@493da830[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1f939a0f[name=pur,namespace=public,additionalProperties={}],streamState={"stream_name":"pur","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@45658133[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@430b2699[name=pil2,namespace=public,additionalProperties={}],streamState={"stream_name":"pil2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@67536ae0[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@6413d7e7[name=reg,namespace=public,additionalProperties={}],streamState={"stream_name":"reg","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@d16be4f[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@17b37e9a[name=con2,namespace=public,additionalProperties={}],streamState={"stream_name":"con2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6bcb12e6[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@111d5c97[name=tri2,namespace=public,additionalProperties={}],streamState={"stream_name":"tri2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@29c17c3d[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@250a9031[name=daw,namespace=public,additionalProperties={}],streamState={"stream_name":"daw","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@1665fa54[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@6d67f5eb[name=gue2,namespace=public,additionalProperties={}],streamState={"stream_name":"gue2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@4f654cee[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3e1fd62b[name=ope,namespace=public,additionalProperties={}],streamState={"stream_name":"ope","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7112ce6[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@558b4942[name=rou,namespace=public,additionalProperties={}],streamState={"stream_name":"rou","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@30ec7d21[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@70025b99[name=dri,namespace=public,additionalProperties={}],streamState={"stream_name":"dri","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7efa3f63[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7134b8a7[name=gue,namespace=public,additionalProperties={}],streamState={"stream_name":"gue","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2262d6d5[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@40de8f93[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6ff0b1cc[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3b55dd15[name=sta,namespace=public,additionalProperties={}],streamState={"stream_name":"sta","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@f3560d4[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3ba3d4b6[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@51b77cdf[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@441fbe89[name=pil,namespace=public,additionalProperties={}],streamState={"stream_name":"pil","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6088451e[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@45ab3bdd[name=tri,namespace=public,additionalProperties={}],streamState={"stream_name":"tri","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2f10f633[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1642eeae[name=veh,namespace=public,additionalProperties={}],streamState={"stream_name":"veh","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3440e9cd[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@28a9494b[name=ter,namespace=public,additionalProperties={}],streamState={"stream_name":"ter","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@a09303[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1163a27[name=off,namespace=public,additionalProperties={}],streamState={"stream_name":"off","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@322ba549[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@502a4156[name=con3,namespace=public,additionalProperties={}],streamState={"stream_name":"con3","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(ctidQueryPlan):220 Will read 131072 pages to get 1GB | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Stream status TRACE received of status: STARTED for stream public:veh_type | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."veh_type" is 16555 | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Sending update for public:veh_type - null -> RUNNING | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):277 Preparing query for table: veh_type | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Stream Status Update Received: public:veh_type - RUNNING | |
| 2024-07-14 07:47:37 [46mreplication-orchestrator[0m > Creating status: public:veh_type - RUNNING | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(createCtidQueryStatement):292 Executing query for table veh_type: SELECT ctid::text, "id","created_ts","updated_ts","name","type_designator","capable_of_vtol","capable_of_ctol","min_runway_length_for_ctol_ft" FROM "public"."veh_type" WHERE ctid > ?::tid with binding (0,0) | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.PostgresQueryUtils(fileNodeForIndividualStream):235 Relation filenode is for stream "public"."veh_type" is 16555 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.InitialSyncCtidIterator(computeNext):118 The latest file node 16555 for stream public_veh_type is equal to the last file node 16555 known to Airbyte. | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.i.s.p.c.CtidStateManager(createFinalStateMessage):115 Finished initial sync of stream public_veh_type, Emitting final state, state is io.airbyte.protocol.models.v0.AirbyteStateMessage@64e1377c[type=GLOBAL,stream=<null>,global=io.airbyte.protocol.models.v0.AirbyteGlobalState@b0fd744[sharedState={"state":{"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"transaction_id\":null,\"lsn\":20266878376,\"txId\":2778,\"ts_usec\":1720943255016665}"}},streamStates=[io.airbyte.protocol.models.v0.AirbyteStreamState@92d1782[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@6a1ef65c[name=bag,namespace=public,additionalProperties={}],streamState={"stream_name":"bag","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@72976b4[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@726934e2[name=config,namespace=public,additionalProperties={}],streamState={"stream_name":"config","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@1319bc2a[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@e280403[name=con1,namespace=public,additionalProperties={}],streamState={"stream_name":"con1","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@42f85fa4[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@798dad3d[name=fli,namespace=public,additionalProperties={}],streamState={"stream_name":"fli","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@27abb6ca[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@696db620[name=rid,namespace=public,additionalProperties={}],streamState={"stream_name":"rid","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6968c1d6[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7d986d83[name=pur,namespace=public,additionalProperties={}],streamState={"stream_name":"pur","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@77f991c[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3a7e365[name=pil2,namespace=public,additionalProperties={}],streamState={"stream_name":"pil2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2ceee4b6[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@12a470dd[name=reg,namespace=public,additionalProperties={}],streamState={"stream_name":"reg","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6968bcec[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@5568c66f[name=con2,namespace=public,additionalProperties={}],streamState={"stream_name":"con2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@e784320[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3f6bf8aa[name=tri2,namespace=public,additionalProperties={}],streamState={"stream_name":"tri2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@13c8ac77[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@4bdf[name=daw,namespace=public,additionalProperties={}],streamState={"stream_name":"daw","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@4cad79bc[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@2c63762b[name=gue2,namespace=public,additionalProperties={}],streamState={"stream_name":"gue2","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7a9eccc4[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@78422efb[name=ope,namespace=public,additionalProperties={}],streamState={"stream_name":"ope","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@5f05c8d6[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@68e02f33[name=rou,namespace=public,additionalProperties={}],streamState={"stream_name":"rou","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@64942607[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@d48e998[name=dri,namespace=public,additionalProperties={}],streamState={"stream_name":"dri","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7cfac39f[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@158ae284[name=gue,namespace=public,additionalProperties={}],streamState={"stream_name":"gue","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@50eb4a2c[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1a256d80[name=veh_type,namespace=public,additionalProperties={}],streamState={"stream_name":"veh_type","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3069a360[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@7235f92b[name=asy,namespace=public,additionalProperties={}],streamState={"stream_name":"asy","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@7885776b[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@497d4c96[name=sta,namespace=public,additionalProperties={}],streamState={"stream_name":"sta","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3472947a[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@69d3cf7e[name=act,namespace=public,additionalProperties={}],streamState={"stream_name":"act","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@3a3ed300[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@1984212d[name=pil,namespace=public,additionalProperties={}],streamState={"stream_name":"pil","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@39f5b723[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@4eaa375c[name=tri,namespace=public,additionalProperties={}],streamState={"stream_name":"tri","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2404b5a[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@3af58f76[name=veh,namespace=public,additionalProperties={}],streamState={"stream_name":"veh","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@2ead6ba4[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@31a2a9fa[name=ter,namespace=public,additionalProperties={}],streamState={"stream_name":"ter","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@31b82e0f[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@27a09971[name=off,namespace=public,additionalProperties={}],streamState={"stream_name":"off","stream_namespace":"public","cursor_field":[]},additionalProperties={}], io.airbyte.protocol.models.v0.AirbyteStreamState@6215366a[streamDescriptor=io.airbyte.protocol.models.v0.StreamDescriptor@46dcbeab[name=con3,namespace=public,additionalProperties={}],streamState={"stream_name":"con3","stream_namespace":"public","cursor_field":[]},additionalProperties={}]],additionalProperties={}],data=<null>,sourceStats=<null>,destinationStats=<null>,additionalProperties={}] | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.c.i.d.AirbyteDebeziumHandler(getIncrementalIterators):74 Using CDC: true | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main i.a.c.i.d.AirbyteDebeziumHandler(getIncrementalIterators):75 Using DBZ version: 2.6.2.Final | |
| 2024-07-14 07:47:37 [44msource[0m > WARN main i.d.e.DebeziumEngine(determineBuilderFactory):346 More than one Debezium engine builder implementation was found, using class io.debezium.embedded.ConvertingEngineBuilderFactory (in Debezium 2.6 you can ignore this warning) | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main o.a.k.c.c.AbstractConfig(logAll):370 JsonConverterConfig values: | |
| converter.type = key | |
| decimal.format = BASE64 | |
| replace.null.with.default = true | |
| schemas.cache.size = 1000 | |
| schemas.enable = false | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main o.a.k.c.c.AbstractConfig(logAll):370 JsonConverterConfig values: | |
| converter.type = value | |
| decimal.format = BASE64 | |
| replace.null.with.default = true | |
| schemas.cache.size = 1000 | |
| schemas.enable = false | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main o.a.k.c.c.AbstractConfig(logAll):370 EmbeddedWorkerConfig values: | |
| access.control.allow.methods = | |
| access.control.allow.origin = | |
| admin.listeners = null | |
| auto.include.jmx.reporter = true | |
| bootstrap.servers = [localhost:9092] | |
| client.dns.lookup = use_all_dns_ips | |
| config.providers = [] | |
| connector.client.config.overrid.policy = All | |
| header.converter = class org.apache.kafka.connect.storage.SimpleHeaderConverter | |
| key.converter = class org.apache.kafka.connect.json.JsonConverter | |
| listeners = [http://:8083] | |
| metric.reporters = [] | |
| metrics.num.samples = 2 | |
| metrics.recording.level = INFO | |
| metrics.sample.window.ms = 30000 | |
| offset.flush.interval.ms = 1000 | |
| offset.flush.timeout.ms = 5000 | |
| offset.storage.file.filename = /tmp/cdc-state-offset638010705988033408/offset.dat | |
| offset.storage.partitions = null | |
| offset.storage.replication.factor = null | |
| offset.storage.topic = | |
| plugin.discovery = hybrid_warn | |
| plugin.path = null | |
| response.http.headers.config = | |
| rest.advertised.host.name = null | |
| rest.advertised.listener = null | |
| rest.advertised.port = null | |
| rest.extension.classes = [] | |
| ssl.cipher.suites = null | |
| ssl.client.auth = none | |
| ssl.enabled.protocols = [TLSv1.2, TLSv1.3] | |
| ssl.endpoint.identification.algorithm = https | |
| ssl.engine.factory.class = null | |
| ssl.key.password = null | |
| ssl.keymanager.algorithm = SunX509 | |
| ssl.keystore.certificate.chain = null | |
| ssl.keystore.key = null | |
| ssl.keystore.location = null | |
| ssl.keystore.password = null | |
| ssl.keystore.type = JKS | |
| ssl.protocol = TLSv1.3 | |
| ssl.provider = null | |
| ssl.secure.random.implementation = null | |
| ssl.trustmanager.algorithm = PKIX | |
| ssl.truststore.certificates = null | |
| ssl.truststore.location = null | |
| ssl.truststore.password = null | |
| ssl.truststore.type = JKS | |
| task.shutdown.graceful.timeout.ms = 5000 | |
| topic.creation.enable = true | |
| topic.tracking.allow.reset = true | |
| topic.tracking.enable = true | |
| value.converter = class org.apache.kafka.connect.json.JsonConverter | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main o.a.k.c.c.AbstractConfig(logAll):370 JsonConverterConfig values: | |
| converter.type = key | |
| decimal.format = BASE64 | |
| replace.null.with.default = true | |
| schemas.cache.size = 1000 | |
| schemas.enable = false | |
| 2024-07-14 07:47:37 [44msource[0m > INFO main o.a.k.c.c.AbstractConfig(logAll):370 JsonConverterConfig values: | |
| converter.type = value | |
| decimal.format = BASE64 | |
| replace.null.with.default = false | |
| schemas.cache.size = 1000 | |
| schemas.enable = false | |
| 2024-07-14 07:47:37 [44msource[0m > WARN pool-5-thread-1 i.d.c.p.PostgresConnectorConfig(validateFlushLsnSource):1205 Property 'flush.lsn.source' is set to 'false', the LSN will not be flushed to the database source and WAL logs will not be cleared. User is expected to handle this outside Debezium. | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.CommonConnectorConfig(getSourceInfoStructMaker):1649 Loading the custom source info struct maker plugin: io.debezium.connector.postgresql.PostgresSourceInfoStructMaker | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.p.PostgresConnector(testConnection):147 Successfully tested connection for jdbc:postgresql://127.0.0.1:35061/daw_db with user 'airbyte_user' | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-6-thread-1 i.d.j.JdbcConnection(lambda$doClose$4):952 Connection gracefully closed | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 o.a.k.c.c.AbstractConfig(logAll):370 JsonConverterConfig values: | |
| converter.type = key | |
| decimal.format = BASE64 | |
| replace.null.with.default = true | |
| schemas.cache.size = 1000 | |
| schemas.enable = false | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 o.a.k.c.s.FileOffsetBackingStore(start):63 Starting FileOffsetBackingStore with file /tmp/cdc-state-offset638010705988033408/offset.dat | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.i.DebeziumRecordPublisher$start$3(connectorStarted):79 DebeziumEngine notify: connector started | |
| 2024-07-14 07:47:37 [44msource[0m > WARN pool-5-thread-1 i.d.c.p.PostgresConnectorConfig(validateFlushLsnSource):1205 Property 'flush.lsn.source' is set to 'false', the LSN will not be flushed to the database source and WAL logs will not be cleared. User is expected to handle this outside Debezium. | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(start):242 Starting PostgresConnectorTask with configuration: | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 connector.class = io.debezium.connector.postgresql.PostgresConnector | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 max.queue.size = 8192 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 slot.name = airbyte_public_logical_replication_slot | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 publication.name = airbyte_public_publication | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 value.converter.replace.null.with.default = false | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 database.sslmode = require | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 topic.prefix = daw_db | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 heartbeat.action.query = insert into public._airbyte_heartbeat (id, timestamp) values (1, now()) on conflict (id) do update set timestamp = excluded.timestamp; | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 offset.storage.file.filename = /tmp/cdc-state-offset638010705988033408/offset.dat | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 decimal.handling.mode = string | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 flush.lsn.source = false | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 converters = datetime | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 errors.retry.delay.initial.ms = 299 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 datetime.type = io.airbyte.integrations.source.postgres.cdc.PostgresConverter | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 value.converter = org.apache.kafka.connect.json.JsonConverter | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 key.converter = org.apache.kafka.connect.json.JsonConverter | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 publication.autocreate.mode = disabled | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 database.user = airbyte_user | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 database.dbname = daw_db | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 offset.storage = org.apache.kafka.connect.storage.FileOffsetBackingStore | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 max.queue.size.in.bytes = 268435456 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 errors.retry.delay.max.ms = 300 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 offset.flush.timeout.ms = 5000 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 heartbeat.interval.ms = 10000 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 column.include.list = \Qpublic.act\E\.(\Qid\E|\Qactual_ts\E|\Qlatest_ts\E|\Qcreated_ts\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Qearliest_ts\E|\Qestimated_ts\E|\Qscheduled_ts\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E),\Qpublic.asy\E\.(\Qid\E|\Qmeta\E|\Qstatus\E|\Qrequest\E|\Qresponse\E|\Qcreated_ts\E|\Qrequest_id\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E),\Qpublic.bag\E\.(\Qid\E|\Qsize\E|\Qtri_id\E|\Qcreated_ts\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Qgue2_id\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E|\Qmeasured_weight_lbs\E|\Qestimated_weight_lbs\E),\Qpublic.config\E\.(\Qid\E|\Qtype\E|\Qpayload\E|\Qreg_id\E|\Qcreated_ts\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E),\Qpublic.con1\E\.(\Qid\E|\Qtype\E|\Qseverity\E|\Qreg_id\E|\Qcreated_ts\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Qcurrent_params\E|\Qdefault_params\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E),\Qpublic.con2\E\.(\Qid\E|\Qcreated_ts\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Qviolation_ts\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E|\Qadditional_details\E|\Qcon1_id\E),\Qpublic.con3\E\.(\Qid\E|\Qentity_id\E|\Qcreated_ts\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Qentity_type\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E|\Qcon2_id\E),\Qpublic.daw\E\.(\Qid\E|\Qmode\E|\Qcreated_ts\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Qupdated_ts_utc\E|\Qsimulation_ts_utc\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E),\Qpublic.dri\E\.(\Qid\E|\Qemail\E|\Qlast_name\E|\Qcreated_ts\E|\Qfirst_name\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Qhashed_password\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E),\Qpublic.fli\E\.(\Qid\E|\Qnumber\E|\Qstatus\E|\Qcreated_ts\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Qcreation_type\E|\Qforefli_id\E|\Qpil_id\E|\Qorigin_sta_id\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E|\Qassigned_veh_id\E|\Qgate_in_act_id\E|\Qgate_out_act_id\E|\Qplanned_destination_sta_id\E|\Qwheels_on_act_id\E|\Qwheels_off_act_id\E),\Qpublic.gue\E\.(\Qid\E|\Qzip\E|\Qcity\E|\Qemail\E|\Qstate\E|\Qaddress\E|\Qcountry\E|\Qlast_name\E|\Qbirth_date\E|\Qcreated_ts\E|\Qfirst_name\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Qsigned_tos_id\E|\Qhashed_password\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E|\Qcognito_google_sub\E|\Qcognito_native_sub\E|\Qestimated_weight_lbs\E),\Qpublic.gue2\E\.(\Qid\E|\Qname\E|\Qemail\E|\Qstatus\E|\Qtri_id\E|\Qcreated_ts\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Qseat_number\E|\Qis_sanitized\E|\Qgue_id\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E|\Qmeasured_weight_lbs\E|\Qestimated_weight_lbs\E),\Qpublic.off\E\.(\Qid\E|\Qrank\E|\Qstatus\E|\Qfare_usd\E|\Qfli_id\E|\Qcreated_ts\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Qtri2_id\E|\Qlast_mile_rid_id\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E|\Qfirst_mile_rid_id\E|\Qestimated_last_mile_pickup_ts\E|\Qestimated_first_mile_pickup_ts\E|\Qestimated_last_mile_dropoff_ts\E|\Qestimated_first_mile_dropoff_ts\E),\Qpublic.ope\E\.(\Qid\E|\Qemail\E|\Qlast_name\E|\Qcreated_ts\E|\Qfirst_name\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Qhashed_password\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E),\Qpublic.pil\E\.(\Qid\E|\Qemail\E|\Qlast_name\E|\Qcreated_ts\E|\Qfirst_name\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Qhashed_password\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E),\Qpublic.pil2\E\.(\Qid\E|\Qname\E|\Qacronym\E|\Qcreated_ts\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E),\Qpublic.pur\E\.(\Qid\E|\Qstatus\E|\Qoff_id\E|\Qcreated_ts\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Qfailure_code\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E),\Qpublic.reg\E\.(\Qid\E|\Qname\E|\Qtzinfo\E|\Qqueue_url\E|\Qcreated_ts\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E),\Qpublic.rid\E\.(\Qid\E|\Qstatus\E|\Qcreated_ts\E|\Qorigin_lat\E|\Qorigin_lng\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Qdestination_lat\E|\Qdestination_lng\E|\Qdri_id\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E|\Qarrive_act_id\E|\Qpickup_act_id\E|\Qdropoff_act_id\E|\Qdispatch_act_id\E),\Qpublic.rou\E\.(\Qid\E|\Qreg_id\E|\Qcreated_ts\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Qbase_fare_usd\E|\Qdistance_miles\E|\Qduration_minutes\E|\Qorigin_sta_id\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E|\Qdestination_sta_id\E),\Qpublic.sta\E\.(\Qid\E|\Qlat\E|\Qlng\E|\Qname\E|\Qfaa_code\E|\Qnum_fato\E|\Qiata_code\E|\Qicao_code\E|\Qreg_id\E|\Qcreated_ts\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Qdescription\E|\Qtaxi_minutes\E|\Qfato_diameter_ft\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E|\Qmax_total_aircraft\E|\Qmax_runway_length_ft\E),\Qpublic.ter\E\.(\Qid\E|\Qcontent\E|\Qversion\E|\Qcreated_ts\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E),\Qpublic.tri\E\.(\Qid\E|\Qstatus\E|\Qreg_id\E|\Qcreated_ts\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Qbooked_off_id\E|\Qtri2_id\E|\Qbooked_fli_id\E|\Qgue_id\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E|\Qbooked_last_mile_rid_id\E|\Qbooked_first_mile_rid_id\E),\Qpublic.tri2\E\.(\Qid\E|\Qparams\E|\Qobjective\E|\Qreg_id\E|\Qcreated_ts\E|\Qorigin_lat\E|\Qorigin_lng\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Qdestination_lat\E|\Qdestination_lng\E|\Qgue_id\E|\Qorigin_sta_id\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E|\Qobjective_timestamp\E|\Qlast_mile_is_serviced\E|\Qdestination_sta_id\E|\Qfirst_mile_is_serviced\E|\Qoriginal_tri2_id\E),\Qpublic.veh\E\.(\Qid\E|\Qreg_id\E|\Qcreated_ts\E|\Qlatest_lat\E|\Qlatest_lng\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Qtail_number\E|\Qpax_capacity\E|\Qmax_cargo_lbs\E|\Qoperator_code\E|\Qserial_number\E|\Qminimum_pilots\E|\Qcapable_of_ctol\E|\Qcapable_of_vtol\E|\Qveh_type_id\E|\Qlatest_sta_id\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E|\Qmax_landing_weight_lbs\E|\Qmax_takeoff_weight_lbs\E|\Qmax_zero_fuel_weight_lbs\E|\Qmin_runway_length_for_ctol\E|\Qoperating_empty_weight_lbs\E),\Qpublic.veh_type\E\.(\Qid\E|\Qname\E|\Qcreated_ts\E|\Qupdated_ts\E|\Q_ab_cdc_lsn\E|\Qcapable_of_ctol\E|\Qcapable_of_vtol\E|\Qtype_designator\E|\Q_ab_cdc_deleted_at\E|\Q_ab_cdc_updated_at\E|\Qmin_runway_length_for_ctol_ft\E) | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 plugin.name = pgoutput | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 database.port = 35061 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 offset.flush.interval.ms = 1000 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 key.converter.schemas.enable = false | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 include.unknown.datatypes = true | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 errors.max.retries = 0 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 database.hostname = 127.0.0.1 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 database.password = ******** | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 value.converter.schemas.enable = false | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 name = daw_db | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 max.batch.size = 2048 | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 table.include.list = \Qpublic.act\E,\Qpublic.asy\E,\Qpublic.bag\E,\Qpublic.config\E,\Qpublic.con1\E,\Qpublic.con2\E,\Qpublic.con3\E,\Qpublic.daw\E,\Qpublic.dri\E,\Qpublic.fli\E,\Qpublic.gue\E,\Qpublic.gue2\E,\Qpublic.off\E,\Qpublic.ope\E,\Qpublic.pil\E,\Qpublic.pil2\E,\Qpublic.pur\E,\Qpublic.reg\E,\Qpublic.rid\E,\Qpublic.rou\E,\Qpublic.sta\E,\Qpublic.ter\E,\Qpublic.tri\E,\Qpublic.tri2\E,\Qpublic.veh\E,\Qpublic.veh_type\E | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(lambda$start$0):244 snapshot.mode = initial | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.CommonConnectorConfig(getSourceInfoStructMaker):1649 Loading the custom source info struct maker plugin: io.debezium.connector.postgresql.PostgresSourceInfoStructMaker | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.CommonConnectorConfig(getTopicNamingStrategy):1357 Loading the custom topic naming strategy plugin: io.debezium.schema.SchemaTopicNamingStrategy | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-7-thread-1 i.d.j.JdbcConnection(lambda$doClose$4):952 Connection gracefully closed | |
| 2024-07-14 07:47:37 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(getPreviousOffsets):501 Found previous partition offset PostgresPartition [sourcePartition={server=daw_db}]: {lsn=20266878376, txId=2778, ts_usec=1720943255016665} | |
| 2024-07-14 07:47:38 [44msource[0m > INFO pool-5-thread-1 i.d.c.p.c.PostgresConnection(readReplicationSlotInfo):337 Obtained valid replication slot ReplicationSlot [active=false, latestFlushedLsn=LSN{4/B80005A8}, catalogXmin=2736] | |
| 2024-07-14 07:47:38 [43mdestination[0m > INFO main i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:38 [44msource[0m > INFO pool-5-thread-1 i.d.c.p.PostgresConnectorTask(start):156 user 'airbyte_user' connected to database 'daw_db' on PostgreSQL 16.3 on aarch64-unknown-linux-gnu, compiled by gcc (GCC) 7.3.1 20180712 (Red Hat 7.3.1-6), 64-bit with roles: | |
| role 'rds_replication' [superuser: false, replication: false, inherit: true, create role: false, create db: false, can log in: false] | |
| role 'airbyte_user' [superuser: false, replication: false, inherit: true, create role: false, create db: false, can log in: true] | |
| 2024-07-14 07:47:38 [44msource[0m > INFO pool-5-thread-1 i.d.c.p.c.PostgresConnection(readReplicationSlotInfo):337 Obtained valid replication slot ReplicationSlot [active=false, latestFlushedLsn=LSN{4/B80005A8}, catalogXmin=2736] | |
| 2024-07-14 07:47:38 [44msource[0m > INFO pool-5-thread-1 i.d.c.p.PostgresConnectorTask(start):168 Found previous offset PostgresOffsetContext [sourceInfoSchema=Schema{io.debezium.connector.postgresql.Source:STRUCT}, sourceInfo=source_info[server='daw_db'db='daw_db', lsn=LSN{4/B80005A8}, txId=2778, timestamp=2024-07-14T07:47:35.016665Z, snapshot=FALSE, schema=, table=], lastSnapshotRecord=false, lastCompletelyProcessedLsn=null, lastCommitLsn=null, streamingStoppingLsn=null, transactionContext=TransactionContext [currentTransactionId=null, perTableEventCount={}, totalEventCount=0], incrementalSnapshotContext=IncrementalSnapshotContext [windowOpened=false, chunkEndPosition=null, dataCollectionsToSnapshot=[], lastEventKeySent=null, maximumKey=null]] | |
| 2024-07-14 07:47:38 [44msource[0m > INFO pool-5-thread-1 i.d.u.Threads(threadFactory):271 Requested thread factory for connector PostgresConnector, id = daw_db named = SignalProcessor | |
| 2024-07-14 07:47:38 [44msource[0m > INFO pool-5-thread-1 i.d.u.Threads(threadFactory):271 Requested thread factory for connector PostgresConnector, id = daw_db named = change-event-source-coordinator | |
| 2024-07-14 07:47:38 [44msource[0m > INFO pool-5-thread-1 i.d.u.Threads(threadFactory):271 Requested thread factory for connector PostgresConnector, id = daw_db named = blocking-snapshot | |
| 2024-07-14 07:47:38 [44msource[0m > INFO pool-5-thread-1 i.d.u.Threads$3(newThread):288 Creating thread debezium-postgresconnector-daw_db-change-event-source-coordinator | |
| 2024-07-14 07:47:38 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.i.DebeziumRecordPublisher$start$3(taskStarted):87 DebeziumEngine notify: task started | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.p.ChangeEventSourceCoordinator(lambda$start$0):134 Metrics registered | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.p.ChangeEventSourceCoordinator(lambda$start$0):137 Context created | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSnapshotChangeEventSource(getSnapshottingTask):77 A previous offset indicating a completed snapshot has been found. | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSnapshotChangeEventSource(getSnapshottingTask):85 According to the connector configuration no snapshot will be executed | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.p.ChangeEventSourceCoordinator(doSnapshot):254 Snapshot ended with SnapshotResult [status=SKIPPED, offset=PostgresOffsetContext [sourceInfoSchema=Schema{io.debezium.connector.postgresql.Source:STRUCT}, sourceInfo=source_info[server='daw_db'db='daw_db', lsn=LSN{4/B80005A8}, txId=2778, timestamp=2024-07-14T07:47:35.016665Z, snapshot=FALSE, schema=, table=], lastSnapshotRecord=false, lastCompletelyProcessedLsn=null, lastCommitLsn=null, streamingStoppingLsn=null, transactionContext=TransactionContext [currentTransactionId=null, perTableEventCount={}, totalEventCount=0], incrementalSnapshotContext=IncrementalSnapshotContext [windowOpened=false, chunkEndPosition=null, dataCollectionsToSnapshot=[], lastEventKeySent=null, maximumKey=null]]] | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.p.ChangeEventSourceCoordinator(streamingConnected):433 Connected metrics set to 'true' | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.reg' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.tri2' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.ope' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.asy' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.con1' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.veh_type' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.act' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.fli' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.pur' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.bag' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.rou' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.ter' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.daw' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.con2' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.tri' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.config' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.sta' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.rid' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.veh' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.con3' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.pil2' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.dri' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.gue2' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.gue' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.off' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.pil' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.a.c.d.j.DateTimeConverter(convertToTimestampWithTimezone):82 Unknown class for Timestamp with time zone data type class java.lang.String | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.p.s.SignalProcessor(start):105 SignalProcessor started. Scheduling it every 5000ms | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.u.Threads$3(newThread):288 Creating thread debezium-postgresconnector-daw_db-SignalProcessor | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.p.ChangeEventSourceCoordinator(streamEvents):279 Starting streaming | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresStreamingChangeEventSource(execute):137 Retrieved latest position from stored offset 'LSN{4/B80005A8}' | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.c.WalPositionLocator(<init>):48 Looking for WAL restart position for last commit LSN 'null' and last change LSN 'LSN{4/B80005A8}' | |
| 2024-07-14 07:47:38 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.c.PostgresReplicationConnection(initPublication):150 Initializing PgOutput logical decoder publication | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.c.PostgresConnection(readReplicationSlotInfo):337 Obtained valid replication slot ReplicationSlot [active=false, latestFlushedLsn=LSN{4/B80005A8}, catalogXmin=2736] | |
| 2024-07-14 07:47:39 [44msource[0m > INFO pool-8-thread-1 i.d.j.JdbcConnection(lambda$doClose$4):952 Connection gracefully closed | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.u.Threads(threadFactory):271 Requested thread factory for connector PostgresConnector, id = daw_db named = keep-alive | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.u.Threads$3(newThread):288 Creating thread debezium-postgresconnector-daw_db-keep-alive | |
| 2024-07-14 07:47:39 [43mdestination[0m > INFO main i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:39 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_act | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.reg' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.tri2' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.ope' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.asy' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.con1' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.veh_type' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.act' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.fli' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.pur' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.bag' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.rou' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.ter' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.daw' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.con2' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.tri' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.config' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.sta' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.rid' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.veh' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.con3' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.pil2' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.dri' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.gue2' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.gue' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.off' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresSchema(printReplicaIdentityInfo):100 REPLICA IDENTITY for 'public.pil' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns | |
| 2024-07-14 07:47:39 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.c.p.PostgresStreamingChangeEventSource(processMessages):212 Processing messages | |
| 2024-07-14 07:47:39 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_act_airbyte_tmp | |
| 2024-07-14 07:47:39 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_asy | |
| 2024-07-14 07:47:39 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_asy_airbyte_tmp | |
| 2024-07-14 07:47:40 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_bag | |
| 2024-07-14 07:47:40 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_bag_airbyte_tmp | |
| 2024-07-14 07:47:40 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_config | |
| 2024-07-14 07:47:40 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_config_airbyte_tmp | |
| 2024-07-14 07:47:40 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_con1 | |
| 2024-07-14 07:47:41 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_con1_airbyte_tmp | |
| 2024-07-14 07:47:41 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_con2 | |
| 2024-07-14 07:47:41 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_con2_airbyte_tmp | |
| 2024-07-14 07:47:41 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_con3 | |
| 2024-07-14 07:47:42 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_con3_airbyte_tmp | |
| 2024-07-14 07:47:42 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_daw | |
| 2024-07-14 07:47:42 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_daw_airbyte_tmp | |
| 2024-07-14 07:47:42 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_dri | |
| 2024-07-14 07:47:43 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_dri_airbyte_tmp | |
| 2024-07-14 07:47:43 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_fli | |
| 2024-07-14 07:47:43 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_fli_airbyte_tmp | |
| 2024-07-14 07:47:43 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_gue | |
| 2024-07-14 07:47:43 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_gue_airbyte_tmp | |
| 2024-07-14 07:47:43 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_gue2 | |
| 2024-07-14 07:47:44 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_gue2_airbyte_tmp | |
| 2024-07-14 07:47:44 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_off | |
| 2024-07-14 07:47:44 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_off_airbyte_tmp | |
| 2024-07-14 07:47:44 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_ope | |
| 2024-07-14 07:47:45 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_ope_airbyte_tmp | |
| 2024-07-14 07:47:45 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_pil | |
| 2024-07-14 07:47:45 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_pil_airbyte_tmp | |
| 2024-07-14 07:47:45 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_pil2 | |
| 2024-07-14 07:47:45 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_pil2_airbyte_tmp | |
| 2024-07-14 07:47:45 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_pur | |
| 2024-07-14 07:47:46 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_pur_airbyte_tmp | |
| 2024-07-14 07:47:46 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_reg | |
| 2024-07-14 07:47:46 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_reg_airbyte_tmp | |
| 2024-07-14 07:47:46 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_rid | |
| 2024-07-14 07:47:46 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_rid_airbyte_tmp | |
| 2024-07-14 07:47:47 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_rou | |
| 2024-07-14 07:47:47 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_rou_airbyte_tmp | |
| 2024-07-14 07:47:47 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_sta | |
| 2024-07-14 07:47:47 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_sta_airbyte_tmp | |
| 2024-07-14 07:47:47 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_ter | |
| 2024-07-14 07:47:48 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_ter_airbyte_tmp | |
| 2024-07-14 07:47:48 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_tri | |
| 2024-07-14 07:47:48 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_tri_airbyte_tmp | |
| 2024-07-14 07:47:48 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(logStatistics):323 1 records sent during previous 00:00:11.253, last recorded offset of {server=daw_db} partition is {lsn=20266878376, txId=2778, ts_usec=1720943255016665} | |
| 2024-07-14 07:47:48 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:47:48 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_tri2 | |
| 2024-07-14 07:47:49 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_tri2_airbyte_tmp | |
| 2024-07-14 07:47:49 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_veh | |
| 2024-07-14 07:47:49 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_veh_airbyte_tmp | |
| 2024-07-14 07:47:49 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_veh_type | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_veh_type_airbyte_tmp | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.act. | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.asy. | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.bag. | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.config. | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.con1. | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-5 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-4 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-1 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.con2. | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-3 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-2 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.con3. | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-7 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.daw. | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-8 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream ASY | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream CON1 | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.dri. | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream DAW | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream BAG | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream CONFIG | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream CON3 | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream CON2 | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream ACT | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-9 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.fli. | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream DRI | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-10 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream FLI | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_asy in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_act in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_fli in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_daw in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_con3 in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_con2 in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_con1 in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_dri in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_config in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_bag in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-6 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-10 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-1 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-9 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-5 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-2 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-7 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-8 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-4 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:50 [43mdestination[0m > INFO sync-operations-3 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:51 [43mdestination[0m > INFO sync-operations-10 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:51 [43mdestination[0m > INFO sync-operations-7 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:51 [43mdestination[0m > INFO sync-operations-5 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:51 [43mdestination[0m > INFO sync-operations-2 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:51 [43mdestination[0m > INFO sync-operations-6 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:51 [43mdestination[0m > INFO sync-operations-3 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:51 [43mdestination[0m > INFO sync-operations-1 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:51 [43mdestination[0m > INFO sync-operations-8 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:51 [43mdestination[0m > INFO sync-operations-4 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:51 [43mdestination[0m > INFO sync-operations-9 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-10 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: FLI | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.gue. | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-10 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream GUE | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_gue in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-5 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: CON1 | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.gue2. | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-5 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream GUE2 | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_gue2 in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-7 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: CON3 | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.off. | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-7 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream OFF | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_off in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-2 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: ASY | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.ope. | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-2 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream OPE | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_ope in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-6 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: CON2 | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.pil. | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream PIL | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_pil in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-10 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-1 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: ACT | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.pil2. | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-1 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream PIL2 | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_pil2 in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-8 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: DAW | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.pur. | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-8 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream PUR | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_pur in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-3 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: BAG | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.reg. | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-3 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream REG | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_reg in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-7 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-5 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-6 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-2 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-4 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: CONFIG | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.rid. | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-4 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream RID | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_rid in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-9 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: DRI | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.rou. | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-9 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream ROU | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_rou in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-1 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-3 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-8 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-4 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:52 [43mdestination[0m > INFO sync-operations-9 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:53 [43mdestination[0m > INFO sync-operations-5 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:53 [43mdestination[0m > INFO sync-operations-10 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:53 [43mdestination[0m > INFO sync-operations-2 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:53 [43mdestination[0m > INFO sync-operations-7 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:53 [43mdestination[0m > INFO sync-operations-6 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:53 [43mdestination[0m > INFO sync-operations-1 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:53 [43mdestination[0m > INFO sync-operations-3 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:53 [43mdestination[0m > INFO sync-operations-4 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:53 [43mdestination[0m > INFO sync-operations-8 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:53 [43mdestination[0m > INFO sync-operations-9 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-5 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: GUE2 | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.sta. | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-5 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream STA | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_sta in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-2 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: OPE | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.ter. | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-2 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream TER | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_ter in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-6 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: PIL | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.tri. | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream TRI | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_tri in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-10 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: GUE | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.tri2. | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-10 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream TRI2 | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_tri2 in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-7 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: OFF | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.veh. | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-7 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream VEH | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_veh in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-1 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: true, A v1 raw table exists: false | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: PIL2 | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream XXX_PUBLIC.veh_type. | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-1 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):20 Assessing whether migration is necessary for stream VEH_TYPE | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):44 Checking whether v1 raw table _airbyte_raw_veh_type in dataset XXX_PUBLIC exists | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-5 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-2 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-6 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-10 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-4 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: RID | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-3 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: REG | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-7 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-9 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: ROU | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-8 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: PUR | |
| 2024-07-14 07:47:54 [43mdestination[0m > INFO sync-operations-1 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:55 [43mdestination[0m > INFO sync-operations-5 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:55 [43mdestination[0m > INFO sync-operations-2 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:55 [43mdestination[0m > INFO sync-operations-10 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:55 [43mdestination[0m > INFO sync-operations-6 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:55 [43mdestination[0m > INFO sync-operations-7 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:55 [43mdestination[0m > INFO sync-operations-1 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:55 [43mdestination[0m > INFO sync-operations-5 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:55 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:55 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: STA | |
| 2024-07-14 07:47:55 [43mdestination[0m > INFO sync-operations-2 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:55 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:55 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: TER | |
| 2024-07-14 07:47:55 [43mdestination[0m > INFO sync-operations-10 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:55 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:55 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: TRI2 | |
| 2024-07-14 07:47:56 [43mdestination[0m > INFO sync-operations-7 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:56 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:56 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: VEH | |
| 2024-07-14 07:47:56 [43mdestination[0m > INFO sync-operations-1 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:56 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:56 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: VEH_TYPE | |
| 2024-07-14 07:47:56 [43mdestination[0m > INFO sync-operations-6 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:56 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):52 Migration Info: Required for Sync mode: true, No existing v2 raw tables: false, A v1 raw table exists: false | |
| 2024-07-14 07:47:56 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):31 No Migration Required for stream: TRI | |
| 2024-07-14 07:47:56 [43mdestination[0m > INFO main i.a.i.b.d.t.TyperDeduperUtil(executeRawTableMigrations):66 Refetching initial state for streams: [StreamId(finalNamespace=XXX_PUBLIC, finalName=ACT, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_act, originalNamespace=XXX_PUBLIC, originalName=act), StreamId(finalNamespace=XXX_PUBLIC, finalName=ASY, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_asy, originalNamespace=XXX_PUBLIC, originalName=asy), StreamId(finalNamespace=XXX_PUBLIC, finalName=BAG, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_bag, originalNamespace=XXX_PUBLIC, originalName=bag), StreamId(finalNamespace=XXX_PUBLIC, finalName=CONFIG, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_config, originalNamespace=XXX_PUBLIC, originalName=config), StreamId(finalNamespace=XXX_PUBLIC, finalName=CON1, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_con1, originalNamespace=XXX_PUBLIC, originalName=con1), StreamId(finalNamespace=XXX_PUBLIC, finalName=CON2, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_con2, originalNamespace=XXX_PUBLIC, originalName=con2), StreamId(finalNamespace=XXX_PUBLIC, finalName=CON3, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_con3, originalNamespace=XXX_PUBLIC, originalName=con3), StreamId(finalNamespace=XXX_PUBLIC, finalName=DAW, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_daw, originalNamespace=XXX_PUBLIC, originalName=daw), StreamId(finalNamespace=XXX_PUBLIC, finalName=DRI, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_dri, originalNamespace=XXX_PUBLIC, originalName=dri), StreamId(finalNamespace=XXX_PUBLIC, finalName=FLI, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_fli, originalNamespace=XXX_PUBLIC, originalName=fli), StreamId(finalNamespace=XXX_PUBLIC, finalName=GUE, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_gue, originalNamespace=XXX_PUBLIC, originalName=gue), StreamId(finalNamespace=XXX_PUBLIC, finalName=GUE2, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_gue2, originalNamespace=XXX_PUBLIC, originalName=gue2), StreamId(finalNamespace=XXX_PUBLIC, finalName=OFF, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_off, originalNamespace=XXX_PUBLIC, originalName=off), StreamId(finalNamespace=XXX_PUBLIC, finalName=OPE, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_ope, originalNamespace=XXX_PUBLIC, originalName=ope), StreamId(finalNamespace=XXX_PUBLIC, finalName=PIL, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_pil, originalNamespace=XXX_PUBLIC, originalName=pil), StreamId(finalNamespace=XXX_PUBLIC, finalName=PIL2, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_pil2, originalNamespace=XXX_PUBLIC, originalName=pil2), StreamId(finalNamespace=XXX_PUBLIC, finalName=PUR, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_pur, originalNamespace=XXX_PUBLIC, originalName=pur), StreamId(finalNamespace=XXX_PUBLIC, finalName=REG, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_reg, originalNamespace=XXX_PUBLIC, originalName=reg), StreamId(finalNamespace=XXX_PUBLIC, finalName=RID, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_rid, originalNamespace=XXX_PUBLIC, originalName=rid), StreamId(finalNamespace=XXX_PUBLIC, finalName=ROU, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_rou, originalNamespace=XXX_PUBLIC, originalName=rou), StreamId(finalNamespace=XXX_PUBLIC, finalName=STA, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_sta, originalNamespace=XXX_PUBLIC, originalName=sta), StreamId(finalNamespace=XXX_PUBLIC, finalName=TER, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_ter, originalNamespace=XXX_PUBLIC, originalName=ter), StreamId(finalNamespace=XXX_PUBLIC, finalName=TRI, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_tri, originalNamespace=XXX_PUBLIC, originalName=tri), StreamId(finalNamespace=XXX_PUBLIC, finalName=TRI2, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_tri2, originalNamespace=XXX_PUBLIC, originalName=tri2), StreamId(finalNamespace=XXX_PUBLIC, finalName=VEH, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_veh, originalNamespace=XXX_PUBLIC, originalName=veh), StreamId(finalNamespace=XXX_PUBLIC, finalName=VEH_TYPE, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_veh_type, originalNamespace=XXX_PUBLIC, originalName=veh_type)] | |
| 2024-07-14 07:47:56 [43mdestination[0m > INFO main i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:57 [43mdestination[0m > INFO main i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:58 [43mdestination[0m > INFO main i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:47:58 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_act | |
| 2024-07-14 07:47:58 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_act_airbyte_tmp | |
| 2024-07-14 07:47:58 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_asy | |
| 2024-07-14 07:47:58 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(logStatistics):323 1 records sent during previous 00:00:10.026, last recorded offset of {server=daw_db} partition is {lsn=20266878376, txId=2778, ts_usec=1720943255016665} | |
| 2024-07-14 07:47:58 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:47:58 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_asy_airbyte_tmp | |
| 2024-07-14 07:47:59 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_bag | |
| 2024-07-14 07:47:59 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_bag_airbyte_tmp | |
| 2024-07-14 07:47:59 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_config | |
| 2024-07-14 07:47:59 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_config_airbyte_tmp | |
| 2024-07-14 07:48:00 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_con1 | |
| 2024-07-14 07:48:00 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_con1_airbyte_tmp | |
| 2024-07-14 07:48:00 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_con2 | |
| 2024-07-14 07:48:00 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_con2_airbyte_tmp | |
| 2024-07-14 07:48:01 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_con3 | |
| 2024-07-14 07:48:01 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_con3_airbyte_tmp | |
| 2024-07-14 07:48:01 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_daw | |
| 2024-07-14 07:48:01 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_daw_airbyte_tmp | |
| 2024-07-14 07:48:01 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_dri | |
| 2024-07-14 07:48:02 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_dri_airbyte_tmp | |
| 2024-07-14 07:48:02 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_fli | |
| 2024-07-14 07:48:02 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_fli_airbyte_tmp | |
| 2024-07-14 07:48:02 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_gue | |
| 2024-07-14 07:48:02 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_gue_airbyte_tmp | |
| 2024-07-14 07:48:03 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_gue2 | |
| 2024-07-14 07:48:03 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_gue2_airbyte_tmp | |
| 2024-07-14 07:48:03 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_off | |
| 2024-07-14 07:48:03 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_off_airbyte_tmp | |
| 2024-07-14 07:48:04 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_ope | |
| 2024-07-14 07:48:04 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_ope_airbyte_tmp | |
| 2024-07-14 07:48:04 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_pil | |
| 2024-07-14 07:48:04 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_pil_airbyte_tmp | |
| 2024-07-14 07:48:05 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_pil2 | |
| 2024-07-14 07:48:05 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_pil2_airbyte_tmp | |
| 2024-07-14 07:48:05 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_pur | |
| 2024-07-14 07:48:05 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_pur_airbyte_tmp | |
| 2024-07-14 07:48:05 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_reg | |
| 2024-07-14 07:48:06 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_reg_airbyte_tmp | |
| 2024-07-14 07:48:06 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_rid | |
| 2024-07-14 07:48:06 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_rid_airbyte_tmp | |
| 2024-07-14 07:48:06 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_rou | |
| 2024-07-14 07:48:06 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_rou_airbyte_tmp | |
| 2024-07-14 07:48:07 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_sta | |
| 2024-07-14 07:48:07 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_sta_airbyte_tmp | |
| 2024-07-14 07:48:07 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_ter | |
| 2024-07-14 07:48:07 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_ter_airbyte_tmp | |
| 2024-07-14 07:48:07 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_tri | |
| 2024-07-14 07:48:08 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_tri_airbyte_tmp | |
| 2024-07-14 07:48:08 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_tri2 | |
| 2024-07-14 07:48:08 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_tri2_airbyte_tmp | |
| 2024-07-14 07:48:08 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_veh | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_veh_airbyte_tmp | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_veh_type | |
| 2024-07-14 07:48:09 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_veh_type_airbyte_tmp | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO main i.a.i.b.d.t.TyperDeduperUtil(executeRawTableMigrations):73 Updated states: [DestinationInitialStatus(streamConfig=StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=ACT, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_act, originalNamespace=XXX_PUBLIC, originalName=act), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=ACTUAL_TS, originalName=actual_ts, canonicalName=ACTUAL_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=LATEST_TS, originalName=latest_ts, canonicalName=LATEST_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=CREATED_TS, originalName=created_ts, canonicalName=CREATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=UPDATED_TS, originalName=updated_ts, canonicalName=UPDATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)=NUMBER, ColumnId(name=EARLIEST_TS, originalName=earliest_ts, canonicalName=EARLIEST_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=ESTIMATED_TS, originalName=estimated_ts, canonicalName=ESTIMATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=SCHEDULED_TS, originalName=scheduled_ts, canonicalName=SCHEDULED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_DELETED_AT, originalName=_ab_cdc_deleted_at, canonicalName=_AB_CDC_DELETED_AT)=STRING, ColumnId(name=_AB_CDC_UPDATED_AT, originalName=_ab_cdc_updated_at, canonicalName=_AB_CDC_UPDATED_AT)=STRING}, generationId=0, minimumGenerationId=0, syncId=923), isFinalTablePresent=true, initialRawTableStatus=InitialRawTableStatus(rawTableExists=true, hasUnprocessedRecords=true, maxProcessedTimestamp=Optional[2024-07-14T07:17:08.244999999Z]), initialTempRawTableStatus=InitialRawTableStatus(rawTableExists=false, hasUnprocessedRecords=false, maxProcessedTimestamp=Optional.empty), isSchemaMismatch=false, isFinalTableEmpty=true, destinationState=SnowflakeState(needsSoftReset=false, isAirbyteMetaPresentInRaw=true)), DestinationInitialStatus(streamConfig=StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=ASY, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_asy, originalNamespace=XXX_PUBLIC, originalName=asy), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=META, originalName=meta, canonicalName=META)=STRING, ColumnId(name=STATUS, originalName=status, canonicalName=STATUS)=STRING, ColumnId(name=REQUEST, originalName=request, canonicalName=REQUEST)=STRING, ColumnId(name=RESPONSE, originalName=response, canonicalName=RESPONSE)=STRING, ColumnId(name=CREATED_TS, originalName=created_ts, canonicalName=CREATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=REQUEST_ID, originalName=request_id, canonicalName=REQUEST_ID)=STRING, ColumnId(name=UPDATED_TS, originalName=updated_ts, canonicalName=UPDATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)=NUMBER, ColumnId(name=_AB_CDC_DELETED_AT, originalName=_ab_cdc_deleted_at, canonicalName=_AB_CDC_DELETED_AT)=STRING, ColumnId(name=_AB_CDC_UPDATED_AT, originalName=_ab_cdc_updated_at, canonicalName=_AB_CDC_UPDATED_AT)=STRING}, generationId=0, minimumGenerationId=0, syncId=923), isFinalTablePresent=true, initialRawTableStatus=InitialRawTableStatus(rawTableExists=true, hasUnprocessedRecords=false, maxProcessedTimestamp=Optional.empty), initialTempRawTableStatus=InitialRawTableStatus(rawTableExists=false, hasUnprocessedRecords=false, maxProcessedTimestamp=Optional.empty), isSchemaMismatch=false, isFinalTableEmpty=true, destinationState=SnowflakeState(needsSoftReset=false, isAirbyteMetaPresentInRaw=true)), DestinationInitialStatus(streamConfig=StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=BAG, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_bag, originalNamespace=XXX_PUBLIC, originalName=bag), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=SIZE, originalName=size, canonicalName=SIZE)=STRING, ColumnId(name=TRI_ID, originalName=tri_id, canonicalName=TRI_ID)=STRING, ColumnId(name=CREATED_TS, originalName=created_ts, canonicalName=CREATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=UPDATED_TS, originalName=updated_ts, canonicalName=UPDATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)=NUMBER, ColumnId(name=GUE2_ID, originalName=gue2_id, canonicalName=GUE2_ID)=STRING, ColumnId(name=_AB_CDC_DELETED_AT, originalName=_ab_cdc_deleted_at, canonicalName=_AB_CDC_DELETED_AT)=STRING, ColumnId(name=_AB_CDC_UPDATED_AT, originalName=_ab_cdc_updated_at, canonicalName=_AB_CDC_UPDATED_AT)=STRING, ColumnId(name=MEASURED_WEIGHT_LBS, originalName=measured_weight_lbs, canonicalName=MEASURED_WEIGHT_LBS)=NUMBER, ColumnId(name=ESTIMATED_WEIGHT_LBS, originalName=estimated_weight_lbs, canonicalName=ESTIMATED_WEIGHT_LBS)=NUMBER}, generationId=0, minimumGenerationId=0, syncId=923), isFinalTablePresent=true, initialRawTableStatus=InitialRawTableStatus(rawTableExists=true, hasUnprocessedRecords=false, maxProcessedTimestamp=Optional.empty), initialTempRawTableStatus=InitialRawTableStatus(rawTableExists=false, hasUnprocessedRecords=false, maxProcessedTimestamp=Optional.empty), isSchemaMismatch=true, isFinalTableEmpty=true, destinationState=SnowflakeState(needsSoftReset=false, isAirbyteMetaPresentInRaw=true)), DestinationInitialStatus(streamConfig=StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=CONFIG, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_config, originalNamespace=XXX_PUBLIC, originalName=config), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=TYPE, originalName=type, canonicalName=TYPE)=STRING, ColumnId(name=PAYLOAD, originalName=payload, canonicalName=PAYLOAD)=STRING, ColumnId(name=REG_ID, originalName=reg_id, canonicalName=REG_ID)=STRING, ColumnId(name=CREATED_TS, originalName=created_ts, canonicalName=CREATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=UPDATED_TS, originalName=updated_ts, canonicalName=UPDATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)=NUMBER, ColumnId(name=_AB_CDC_DELETED_AT, originalName=_ab_cdc_deleted_at, canonicalName=_AB_CDC_DELETED_AT)=STRING, ColumnId(name=_AB_CDC_UPDATED_AT, originalName=_ab_cdc_updated_at, canonicalName=_AB_CDC_UPDATED_AT)=STRING}, generationId=0, minimumGenerationId=0, syncId=923), isFinalTablePresent=true, initialRawTableStatus=InitialRawTableStatus(rawTableExists=true, hasUnprocessedRecords=false, maxProcessedTimestamp=Optional[2024-07-12T12:31:45.221Z]), initialTempRawTableStatus=InitialRawTableStatus(rawTableExists=false, hasUnprocessedRecords=false, maxProcessedTimestamp=Optional.empty), isSchemaMismatch=false, isFinalTableEmpty=true, destinationState=SnowflakeState(needsSoftReset=false, isAirbyteMetaPresentInRaw=true)), DestinationInitialStatus(streamConfig=StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=CON1, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_con1, originalNamespace=XXX_PUBLIC, originalName=con1), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=TYPE, originalName=type, canonicalName=TYPE)=STRING, ColumnId(name=SEVERITY, originalName=severity, canonicalName=SEVERITY)=STRING, ColumnId(name=REG_ID, originalName=reg_id, canonicalName=REG_ID)=STRING, ColumnId(name=CREATED_TS, originalName=created_ts, canonicalName=CREATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=UPDATED_TS, originalName=updated_ts, canonicalName=UPDATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)=NUMBER, ColumnId(name=CURRENT_PARAMS, originalName=current_params, canonicalName=CURRENT_PARAMS)=STRING, ColumnId(name=DEFAULT_PARAMS, originalName=default_params, canonicalName=DEFAULT_PARAMS)=STRING, ColumnId(name=_AB_CDC_DELETED_AT, originalName=_ab_cdc_deleted_at, canonicalName=_AB_CDC_DELETED_AT)=STRING, ColumnId(name=_AB_CDC_UPDATED_AT, originalName=_ab_cdc_updated_at, canonicalName=_AB_CDC_UPDATED_AT)=STRING}, generationId=0, minimumGenerationId=0, syncId=923), isFinalTablePresent=true, initialRawTableStatus=InitialRawTableStatus(rawTableExists=true, hasUnprocessedRecords=false, maxProcessedTimestamp=Optional.empty), initialTempRawTableStatus=InitialRawTableStatus(rawTableExists=false, hasUnprocessedRecords=false, maxProcessedTimestamp=Optional.empty), isSchemaMismatch=false, isFinalTableEmpty=true, destinationState=SnowflakeState(needsSoftReset=false, isAirbyteMetaPresentInRaw=true)), DestinationInitialStatus(streamConfig=StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=CON2, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_con2, originalNamespace=XXX_PUBLIC, originalName=con2), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=CREATED_TS, originalName=created_ts, canonicalName=CREATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=UPDATED_TS, originalName=updated_ts, canonicalName=UPDATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)=NUMBER, ColumnId(name=VIOLATION_TS, originalName=violation_ts, canonicalName=VIOLATION_TS)=TIMESTAMP_WITHOUT_TIMEZONE, ColumnId(name=_AB_CDC_DELETED_AT, originalName=_ab_cdc_deleted_at, canonicalName=_AB_CDC_DELETED_AT)=STRING, ColumnId(name=_AB_CDC_UPDATED_AT, originalName=_ab_cdc_updated_at, canonicalName=_AB_CDC_UPDATED_AT)=STRING, ColumnId(name=ADDITIONAL_DETAILS, originalName=additional_details, canonicalName=ADDITIONAL_DETAILS)=STRING, ColumnId(name=CON1_ID, originalName=con1_id, canonicalName=CON1_ID)=STRING}, generationId=0, minimumGenerationId=0, syncId=923), isFinalTablePresent=true, initialRawTableStatus=InitialRawTableStatus(rawTableExists=true, hasUnprocessedRecords=false, maxProcessedTimestamp=Optional.empty), initialTempRawTableStatus=InitialRawTableStatus(rawTableExists=false, hasUnprocessedRecords=false, maxProcessedTimestamp=Optional.empty), isSchemaMismatch=false, isFinalTableEmpty=true, destinationState=SnowflakeState(needsSoftReset=false, isAirbyteMetaPresentInRaw=true)), DestinationInitialStatus(streamConfig=StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=CON3, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_con3, originalNamespace=XXX_PUBLIC, originalName=con3), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=ENTITY_ID, originalName=entity_id, canonicalName=ENTITY_ID)=STRING, ColumnId(name=CREATED_TS, originalName=created_ts, canonicalName=CREATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=UPDATED_TS, originalName=updated_ts, canonicalName=UPDATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)=NUMBER, ColumnId(name=ENTITY_TYPE, originalName=entity_type, canonicalName=ENTITY_TYPE)=STRING, ColumnId(name=_AB_CDC_DELETED_AT, originalName=_ab_cdc_deleted_at, canonicalName=_AB_CDC_DELETED_AT)=STRING, ColumnId(name=_AB_CDC_UPDATED_AT, originalName=_ab_cdc_updated_at, canonicalName=_AB_CDC_UPDATED_AT)=STRING, ColumnId(name=CON2_ID, originalName=con2_id, canonicalName=CON2_ID)=STRING}, generationId=0, minimumGenerationId=0, syncId=923), isFinalTablePresent=true, initialRawTableStatus=InitialRawTableStatus(rawTableExists=true, hasUnprocessedRecords=false, maxProcessedTimestamp=Optional.empty), initialTempRawTableStatus=InitialRawTableStatus(rawTableExists=false, hasUnprocessedRecords=false, maxProcessedTimestamp=Optional.empty), isSchemaMismatch=false, isFinalTableEmpty=true, destinationState=SnowflakeState(needsSoftReset=false, isAirbyteMetaPresentInRaw=true)), DestinationInitialStatus(streamConfig=StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=DAW, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_daw, originalNamespace=XXX_PUBLIC, originalName=daw), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=MODE, originalName=mode, canonicalName=MODE)=STRING, ColumnId(name=CREATED_TS, originalName=created_ts, canonicalName=CREATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=UPDATED_TS, originalName=updated_ts, canonicalName=UPDATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)=NUMBER, ColumnId(name=UPDATED_TS_UTC, originalName=updated_ts_utc, canonicalName=UPDATED_TS_UTC)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=SIMULATION_TS_UTC, originalName=simulation_ts_utc, canonicalName=SIMULATION_TS_UTC)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_DELETED_AT, originalName=_ab_cdc_deleted_at, canonicalName=_AB_CDC_DELETED_AT)=STRING, ColumnId(name=_AB_CDC_UPDATED_AT, originalName=_ab_cdc_updated_at, canonicalName=_AB_CDC_UPDATED_AT)=STRING}, generationId=0, minimumGenerationId=0, syncId=923), isFinalTablePresent=true, initialRawTableStatus=InitialRawTableStatus(rawTableExists=true, hasUnprocessedRecords=false, maxProcessedTimestamp=Optional[2024-07-12T12:31:45.444Z]), initialTempRawTableStatus=InitialRawTableStatus(rawTableExists=false, hasUnprocessedRecords=false, maxProcessedTimestamp=Optional.empty), isSchemaMismatch=false, isFinalTableEmpty=true, destinationState=SnowflakeState(needsSoftReset=false, isAirbyteMetaPresentInRaw=true)), DestinationInitialStatus(streamConfig=StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=DRI, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_dri, originalNamespace=XXX_PUBLIC, originalName=dri), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={Colum… | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.act. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.bag. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.asy. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.config. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.con1. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.con2. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.con3. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.daw. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.fli. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.dri. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-2 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-2 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.con2 because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-2 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.CON2 because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.gue. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-8 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-8 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.config because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-8 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.CONFIG because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.gue2. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-10 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-10 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.con3 because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-10 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.CON3 because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-7 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-4 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.off. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-4 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.act because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-7 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.daw because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-4 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.ACT because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-7 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.DAW because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.ope. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.pil. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-9 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-1 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-6 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.fli because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-1 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.dri because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-9 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.bag because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.FLI because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-1 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.DRI because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.pil2. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.pur. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-9 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):110 Migrating generation_id for table XXX_PUBLIC.BAG | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):30 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.pil2 because the raw table doesn't exist for sync mode append | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.reg. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-5 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-5 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.con1 because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-5 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.CON1 because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.rid. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-3 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-3 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.asy because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-3 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.ASY because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.rou. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-2 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-2 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.gue because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-2 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.GUE because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.sta. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-4 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-8 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-6 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-1 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-4 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.ope because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-8 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.gue2 because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.reg because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-1 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.pur because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-4 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.OPE because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-8 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):110 Migrating generation_id for table XXX_PUBLIC.GUE2 | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-1 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.PUR because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.REG because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.ter. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.tri. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.tri2. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-10 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-10 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.off because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-10 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.OFF because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.veh. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-5 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-5 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.rid because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-5 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.RID because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeAbMetaAndGenIdMigration migration for stream XXX_PUBLIC.veh_type. | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-3 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-7 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-3 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.rou because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-7 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.pil because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-3 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.ROU because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-7 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.PIL because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-2 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-2 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.sta because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-2 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.STA because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-4 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-10 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-4 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.ter because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-6 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-10 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.veh because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-4 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.TER because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-10 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.VEH because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.tri2 because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.TRI2 because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-1 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-1 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.tri because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-1 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.TRI because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-5 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-5 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):86 Skipping airbyte_meta/generation_id migration for XXX_PUBLIC.veh_type because the raw table already has the airbyte_meta column | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO sync-operations-5 i.a.i.d.s.m.SnowflakeAbMetaAndGenIdMigration(migrateIfNecessary):130 skipping migration of generation_id for table XXX_PUBLIC.VEH_TYPE because schemas match | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO main i.a.i.b.d.t.TyperDeduperUtil(executeRawTableMigrations):66 Refetching initial state for streams: [StreamId(finalNamespace=XXX_PUBLIC, finalName=BAG, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_bag, originalNamespace=XXX_PUBLIC, originalName=bag), StreamId(finalNamespace=XXX_PUBLIC, finalName=GUE2, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_gue2, originalNamespace=XXX_PUBLIC, originalName=gue2)] | |
| 2024-07-14 07:48:09 [43mdestination[0m > INFO main i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:10 [43mdestination[0m > INFO main i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:11 [43mdestination[0m > INFO main i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:11 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_bag | |
| 2024-07-14 07:48:11 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_bag_airbyte_tmp | |
| 2024-07-14 07:48:11 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_gue2 | |
| 2024-07-14 07:48:12 [43mdestination[0m > INFO main i.a.i.d.s.t.SnowflakeDestinationHandler(getInitialRawTableState$lambda$3):94 Retrieving table from Db metadata: airbyte_internal XXX_PUBLIC_raw__stream_gue2_airbyte_tmp | |
| 2024-07-14 07:48:12 [43mdestination[0m > INFO main i.a.i.b.d.t.TyperDeduperUtil(executeRawTableMigrations):73 Updated states: [DestinationInitialStatus(streamConfig=StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=BAG, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_bag, originalNamespace=XXX_PUBLIC, originalName=bag), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=SIZE, originalName=size, canonicalName=SIZE)=STRING, ColumnId(name=TRI_ID, originalName=tri_id, canonicalName=TRI_ID)=STRING, ColumnId(name=CREATED_TS, originalName=created_ts, canonicalName=CREATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=UPDATED_TS, originalName=updated_ts, canonicalName=UPDATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)=NUMBER, ColumnId(name=GUE2_ID, originalName=gue2_id, canonicalName=GUE2_ID)=STRING, ColumnId(name=_AB_CDC_DELETED_AT, originalName=_ab_cdc_deleted_at, canonicalName=_AB_CDC_DELETED_AT)=STRING, ColumnId(name=_AB_CDC_UPDATED_AT, originalName=_ab_cdc_updated_at, canonicalName=_AB_CDC_UPDATED_AT)=STRING, ColumnId(name=MEASURED_WEIGHT_LBS, originalName=measured_weight_lbs, canonicalName=MEASURED_WEIGHT_LBS)=NUMBER, ColumnId(name=ESTIMATED_WEIGHT_LBS, originalName=estimated_weight_lbs, canonicalName=ESTIMATED_WEIGHT_LBS)=NUMBER}, generationId=0, minimumGenerationId=0, syncId=923), isFinalTablePresent=true, initialRawTableStatus=InitialRawTableStatus(rawTableExists=true, hasUnprocessedRecords=false, maxProcessedTimestamp=Optional.empty), initialTempRawTableStatus=InitialRawTableStatus(rawTableExists=false, hasUnprocessedRecords=false, maxProcessedTimestamp=Optional.empty), isSchemaMismatch=true, isFinalTableEmpty=true, destinationState=SnowflakeState(needsSoftReset=false, isAirbyteMetaPresentInRaw=true)), DestinationInitialStatus(streamConfig=StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=GUE2, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_gue2, originalNamespace=XXX_PUBLIC, originalName=gue2), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=NAME, originalName=name, canonicalName=NAME)=STRING, ColumnId(name=EMAIL, originalName=email, canonicalName=EMAIL)=STRING, ColumnId(name=STATUS, originalName=status, canonicalName=STATUS)=STRING, ColumnId(name=TRI_ID, originalName=tri_id, canonicalName=TRI_ID)=STRING, ColumnId(name=CREATED_TS, originalName=created_ts, canonicalName=CREATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=UPDATED_TS, originalName=updated_ts, canonicalName=UPDATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)=NUMBER, ColumnId(name=SEAT_NUMBER, originalName=seat_number, canonicalName=SEAT_NUMBER)=STRING, ColumnId(name=IS_SANITIZED, originalName=is_sanitized, canonicalName=IS_SANITIZED)=BOOLEAN, ColumnId(name=GUE_ID, originalName=gue_id, canonicalName=GUE_ID)=STRING, ColumnId(name=_AB_CDC_DELETED_AT, originalName=_ab_cdc_deleted_at, canonicalName=_AB_CDC_DELETED_AT)=STRING, ColumnId(name=_AB_CDC_UPDATED_AT, originalName=_ab_cdc_updated_at, canonicalName=_AB_CDC_UPDATED_AT)=STRING, ColumnId(name=MEASURED_WEIGHT_LBS, originalName=measured_weight_lbs, canonicalName=MEASURED_WEIGHT_LBS)=NUMBER, ColumnId(name=ESTIMATED_WEIGHT_LBS, originalName=estimated_weight_lbs, canonicalName=ESTIMATED_WEIGHT_LBS)=NUMBER}, generationId=0, minimumGenerationId=0, syncId=923), isFinalTablePresent=true, initialRawTableStatus=InitialRawTableStatus(rawTableExists=true, hasUnprocessedRecords=false, maxProcessedTimestamp=Optional[2024-07-12T12:31:45.667Z]), initialTempRawTableStatus=InitialRawTableStatus(rawTableExists=false, hasUnprocessedRecords=false, maxProcessedTimestamp=Optional.empty), isSchemaMismatch=true, isFinalTableEmpty=true, destinationState=SnowflakeState(needsSoftReset=false, isAirbyteMetaPresentInRaw=true))] | |
| 2024-07-14 07:48:12 [43mdestination[0m > INFO main i.a.c.d.j.JdbcDatabase(executeWithinTransaction$lambda$1):47 executing query within transaction: delete from "airbyte_internal"."_airbyte_destination_state" where (("name" = 'act' and "namespace" = 'XXX_PUBLIC') or ("name" = 'asy' and "namespace" = 'XXX_PUBLIC') or ("name" = 'bag' and "namespace" = 'XXX_PUBLIC') or ("name" = 'config' and "namespace" = 'XXX_PUBLIC') or ("name" = 'con1' and "namespace" = 'XXX_PUBLIC') or ("name" = 'con2' and "namespace" = 'XXX_PUBLIC') or ("name" = 'con3' and "namespace" = 'XXX_PUBLIC') or ("name" = 'daw' and "namespace" = 'XXX_PUBLIC') or ("name" = 'dri' and "namespace" = 'XXX_PUBLIC') or ("name" = 'fli' and "namespace" = 'XXX_PUBLIC') or ("name" = 'gue' and "namespace" = 'XXX_PUBLIC') or ("name" = 'gue2' and "namespace" = 'XXX_PUBLIC') or ("name" = 'off' and "namespace" = 'XXX_PUBLIC') or ("name" = 'ope' and "namespace" = 'XXX_PUBLIC') or ("name" = 'pil' and "namespace" = 'XXX_PUBLIC') or ("name" = 'pil2' and "namespace" = 'XXX_PUBLIC') or ("name" = 'pur' and "namespace" = 'XXX_PUBLIC') or ("name" = 'reg' and "namespace" = 'XXX_PUBLIC') or ("name" = 'rid' and "namespace" = 'XXX_PUBLIC') or ("name" = 'rou' and "namespace" = 'XXX_PUBLIC') or ("name" = 'sta' and "namespace" = 'XXX_PUBLIC') or ("name" = 'ter' and "namespace" = 'XXX_PUBLIC') or ("name" = 'tri' and "namespace" = 'XXX_PUBLIC') or ("name" = 'tri2' and "namespace" = 'XXX_PUBLIC') or ("name" = 'veh' and "namespace" = 'XXX_PUBLIC') or ("name" = 'veh_type' and "namespace" = 'XXX_PUBLIC')) | |
| 2024-07-14 07:48:12 [43mdestination[0m > INFO main i.a.c.d.j.JdbcDatabase(executeWithinTransaction$lambda$1):51 done executing query within transaction: delete from "airbyte_internal"."_airbyte_destination_state" where (("name" = 'act' and "namespace" = 'XXX_PUBLIC') or ("name" = 'asy' and "namespace" = 'XXX_PUBLIC') or ("name" = 'bag' and "namespace" = 'XXX_PUBLIC') or ("name" = 'config' and "namespace" = 'XXX_PUBLIC') or ("name" = 'con1' and "namespace" = 'XXX_PUBLIC') or ("name" = 'con2' and "namespace" = 'XXX_PUBLIC') or ("name" = 'con3' and "namespace" = 'XXX_PUBLIC') or ("name" = 'daw' and "namespace" = 'XXX_PUBLIC') or ("name" = 'dri' and "namespace" = 'XXX_PUBLIC') or ("name" = 'fli' and "namespace" = 'XXX_PUBLIC') or ("name" = 'gue' and "namespace" = 'XXX_PUBLIC') or ("name" = 'gue2' and "namespace" = 'XXX_PUBLIC') or ("name" = 'off' and "namespace" = 'XXX_PUBLIC') or ("name" = 'ope' and "namespace" = 'XXX_PUBLIC') or ("name" = 'pil' and "namespace" = 'XXX_PUBLIC') or ("name" = 'pil2' and "namespace" = 'XXX_PUBLIC') or ("name" = 'pur' and "namespace" = 'XXX_PUBLIC') or ("name" = 'reg' and "namespace" = 'XXX_PUBLIC') or ("name" = 'rid' and "namespace" = 'XXX_PUBLIC') or ("name" = 'rou' and "namespace" = 'XXX_PUBLIC') or ("name" = 'sta' and "namespace" = 'XXX_PUBLIC') or ("name" = 'ter' and "namespace" = 'XXX_PUBLIC') or ("name" = 'tri' and "namespace" = 'XXX_PUBLIC') or ("name" = 'tri2' and "namespace" = 'XXX_PUBLIC') or ("name" = 'veh' and "namespace" = 'XXX_PUBLIC') or ("name" = 'veh_type' and "namespace" = 'XXX_PUBLIC')) | |
| 2024-07-14 07:48:12 [43mdestination[0m > INFO main i.a.c.d.j.JdbcDatabase(executeWithinTransaction$lambda$1):47 executing query within transaction: insert into "airbyte_internal"."_airbyte_destination_state" ("name", "namespace", "destination_state", "updated_at") values ('act', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.278602209Z'), ('asy', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.289947173Z'), ('bag', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.290113186Z'), ('config', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.290296069Z'), ('con1', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.290436421Z'), ('con2', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.290671665Z'), ('con3', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.290842198Z'), ('daw', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.291002460Z'), ('dri', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.291165043Z'), ('fli', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.291339557Z'), ('gue', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.291504249Z'), ('gue2', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.291633461Z'), ('off', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.291768413Z'), ('ope', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.291929626Z'), ('pil', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.292060608Z'), ('pil2', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.292176850Z'), ('pur', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.292336032Z'), ('reg', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.292496835Z'), ('rid', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.292661787Z'), ('rou', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.292809790Z'), ('sta', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.292939042Z'), ('ter', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.293085345Z'), ('tri', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.293199466Z'), ('tri2', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.293326029Z'), ('veh', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.293459960Z'), ('veh_type', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.293691404Z') | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO main i.a.c.d.j.JdbcDatabase(executeWithinTransaction$lambda$1):51 done executing query within transaction: insert into "airbyte_internal"."_airbyte_destination_state" ("name", "namespace", "destination_state", "updated_at") values ('act', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.278602209Z'), ('asy', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.289947173Z'), ('bag', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.290113186Z'), ('config', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.290296069Z'), ('con1', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.290436421Z'), ('con2', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.290671665Z'), ('con3', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.290842198Z'), ('daw', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.291002460Z'), ('dri', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.291165043Z'), ('fli', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.291339557Z'), ('gue', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.291504249Z'), ('gue2', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.291633461Z'), ('off', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.291768413Z'), ('ope', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.291929626Z'), ('pil', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.292060608Z'), ('pil2', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.292176850Z'), ('pur', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.292336032Z'), ('reg', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.292496835Z'), ('rid', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.292661787Z'), ('rou', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.292809790Z'), ('sta', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.292939042Z'), ('ter', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.293085345Z'), ('tri', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.293199466Z'), ('tri2', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.293326029Z'), ('veh', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.293459960Z'), ('veh_type', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:12.293691404Z') | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO main i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO main i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.fli: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.act: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.con2: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.con3: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.asy: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.con1: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.daw: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.dri: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.bag: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.config: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql c105ab38-eaf2-49f6-9272-54a84c7f16ee-09ee8ca8-33ed-4bdf-ade2-3437f7024cdb: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_con3"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-10 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql c778cf8c-8e8f-4431-a933-b9a9dc199e0e-664395ae-dcc3-4ec5-99ce-d231ba9ea136: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_con2"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-1 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 72fe2022-6b28-4305-b2ac-f0f1fa391252-683b278f-99e8-4339-96c6-f6c07b25ace3: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_daw"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-9 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql a72041ba-67b6-4332-bee4-bc35b32a8d58-cb6bb8f2-c926-4f20-97b4-df32dc412a25: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_config"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-8 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 55dde230-ab29-452c-bb14-f28d41edb556-d74b1a53-269a-4110-a87f-9b10b6060c73: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_fli"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-2 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql a353d5b9-817a-4ef4-a788-1f225b91f10a-b3e7186f-851c-4b33-8b3b-1d4ce92878a5: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_bag"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-4 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql cfbb8785-37a4-4fb8-8c40-05cb1680e71b-93e92652-d64a-4b5a-80cd-495cf7f00f10: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_con1"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-3 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 6b5baf7b-d557-4963-8592-1aff5c720f67-e951fdf0-f131-482f-9e9e-0cafb571c92d: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_act"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-5 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql b9b7bb01-9830-4f49-8180-df99abf1e2e5-644fe3be-ba51-4c0d-95b1-25530beb66be: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_dri"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-7 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 23e33d68-7b6e-4ea0-91ae-11aee0370320-49cc9679-a89f-49f5-85a2-ff6fa6fa7701: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_asy"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-10 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql c778cf8c-8e8f-4431-a933-b9a9dc199e0e-664395ae-dcc3-4ec5-99ce-d231ba9ea136 completed in 51 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-1 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 72fe2022-6b28-4305-b2ac-f0f1fa391252-683b278f-99e8-4339-96c6-f6c07b25ace3 completed in 50 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql c105ab38-eaf2-49f6-9272-54a84c7f16ee-09ee8ca8-33ed-4bdf-ade2-3437f7024cdb completed in 51 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-2 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql a353d5b9-817a-4ef4-a788-1f225b91f10a-b3e7186f-851c-4b33-8b3b-1d4ce92878a5 completed in 52 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-4 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql cfbb8785-37a4-4fb8-8c40-05cb1680e71b-93e92652-d64a-4b5a-80cd-495cf7f00f10 completed in 52 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-3 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 6b5baf7b-d557-4963-8592-1aff5c720f67-e951fdf0-f131-482f-9e9e-0cafb571c92d completed in 52 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-5 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql b9b7bb01-9830-4f49-8180-df99abf1e2e5-644fe3be-ba51-4c0d-95b1-25530beb66be completed in 52 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-7 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 23e33d68-7b6e-4ea0-91ae-11aee0370320-49cc9679-a89f-49f5-85a2-ff6fa6fa7701 completed in 51 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-9 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql a72041ba-67b6-4332-bee4-bc35b32a8d58-cb6bb8f2-c926-4f20-97b4-df32dc412a25 completed in 67 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-8 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 55dde230-ab29-452c-bb14-f28d41edb556-d74b1a53-269a-4110-a87f-9b10b6060c73 completed in 67 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.con3: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.asy: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream ASY | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.con2: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.con1: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.dri: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.daw: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream CON3 | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream DAW | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream CON1 | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.gue: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.bag: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.off: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.ope: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream BAG | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream CON2 | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.gue2: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.pil: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-1 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql df6ca319-d139-4ae0-8da4-dc9e7528f58e-bd7b0376-a9f5-4392-b90d-effe8402e5f9: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_off"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream DRI | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 39017978-b939-4740-bfca-ab0c3f907687-5cebddd1-5994-4104-9ea2-3db3b0b0317e: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_gue2"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-10 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql b92ded25-abd7-4963-b42f-91bf36cbb63d-c0c3179e-aa61-4273-b810-a0a3c5f49bb6: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_pil"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.pil2: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):200 Executing soft-reset on final table of stream StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=BAG, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_bag, originalNamespace=XXX_PUBLIC, originalName=bag), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=SIZE, originalName=size, canonicalName=SIZE)=STRING, ColumnId(name=TRI_ID, originalName=tri_id, canonicalName=TRI_ID)=STRING, ColumnId(name=CREATED_TS, originalName=created_ts, canonicalName=CREATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=UPDATED_TS, originalName=updated_ts, canonicalName=UPDATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)=NUMBER, ColumnId(name=GUE2_ID, originalName=gue2_id, canonicalName=GUE2_ID)=STRING, ColumnId(name=_AB_CDC_DELETED_AT, originalName=_ab_cdc_deleted_at, canonicalName=_AB_CDC_DELETED_AT)=STRING, ColumnId(name=_AB_CDC_UPDATED_AT, originalName=_ab_cdc_updated_at, canonicalName=_AB_CDC_UPDATED_AT)=STRING, ColumnId(name=MEASURED_WEIGHT_LBS, originalName=measured_weight_lbs, canonicalName=MEASURED_WEIGHT_LBS)=NUMBER, ColumnId(name=ESTIMATED_WEIGHT_LBS, originalName=estimated_weight_lbs, canonicalName=ESTIMATED_WEIGHT_LBS)=NUMBER}, generationId=0, minimumGenerationId=0, syncId=923) | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.t.TyperDeduperUtil(executeSoftReset):261 Attempting soft reset for stream XXX_PUBLIC bag | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-5 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql d1d748b0-ab42-42b2-a537-a237ab9786cd-e2c8971c-5e0c-4ae5-83aa-3fc7e202b9af: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_pil2"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-4 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 902530ae-1d3f-4a45-8f44-fb5296b31942-fbbfc295-379d-4eed-92bc-3144d8c377a2: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_ope"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-7 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql a5ef2d76-0b0c-47ca-abe9-13ca70bf21a2-3440a757-dafb-4b98-af58-e22d7ba5e428: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_gue"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-2 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 4a05abc9-23d6-4373-88bf-c7be4dbac013-dc83f624-3aad-4fc8-aa42-9e8a22c94e29: CREATE OR REPLACE TABLE "XXX_PUBLIC"."BAG_AB_SOFT_RESET" ( | |
| "_AIRBYTE_RAW_ID" TEXT NOT NULL, | |
| "_AIRBYTE_EXTRACTED_AT" TIMESTAMP_TZ NOT NULL, | |
| "_AIRBYTE_META" VARIANT NOT NULL, | |
| "_AIRBYTE_GENERATION_ID" INTEGER | |
| ,"ID" TEXT | |
| ,"SIZE" TEXT | |
| ,"TRI_ID" TEXT | |
| ,"CREATED_TS" TIMESTAMP_TZ | |
| ,"UPDATED_TS" TIMESTAMP_TZ | |
| ,"_AB_CDC_LSN" FLOAT | |
| ,"GUE2_ID" TEXT | |
| ,"_AB_CDC_DELETED_AT" TEXT | |
| ,"_AB_CDC_UPDATED_AT" TEXT | |
| ,"MEASURED_WEIGHT_LBS" FLOAT | |
| ,"ESTIMATED_WEIGHT_LBS" FLOAT | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.act: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream ACT | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.pur: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-3 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql b8fc96d4-bb67-4d98-a422-295a778c760f-35b5b598-8049-4dea-9134-5556d80499eb: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_pur"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.fli: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream FLI | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.reg: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-8 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql feb60e35-16f0-48b2-bc07-971ac1c9bc2f-8951d769-d7bb-4b9b-bd4c-cd51a3088c9e: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_reg"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.config: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream CONFIG | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.rid: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-9 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 6d9af821-59bf-4147-8833-b3cf391fbed9-90d9cce4-9572-4d4f-9bd8-0ba859e91aad: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_rid"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-4 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 902530ae-1d3f-4a45-8f44-fb5296b31942-fbbfc295-379d-4eed-92bc-3144d8c377a2 completed in 35 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 39017978-b939-4740-bfca-ab0c3f907687-5cebddd1-5994-4104-9ea2-3db3b0b0317e completed in 36 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-10 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql b92ded25-abd7-4963-b42f-91bf36cbb63d-c0c3179e-aa61-4273-b810-a0a3c5f49bb6 completed in 37 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-1 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql df6ca319-d139-4ae0-8da4-dc9e7528f58e-bd7b0376-a9f5-4392-b90d-effe8402e5f9 completed in 37 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-7 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql a5ef2d76-0b0c-47ca-abe9-13ca70bf21a2-3440a757-dafb-4b98-af58-e22d7ba5e428 completed in 37 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-3 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql b8fc96d4-bb67-4d98-a422-295a778c760f-35b5b598-8049-4dea-9134-5556d80499eb completed in 35 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-9 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 6d9af821-59bf-4147-8833-b3cf391fbed9-90d9cce4-9572-4d4f-9bd8-0ba859e91aad completed in 54 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-8 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql feb60e35-16f0-48b2-bc07-971ac1c9bc2f-8951d769-d7bb-4b9b-bd4c-cd51a3088c9e completed in 70 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.gue2: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.pil: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.off: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream GUE2 | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream PIL | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream OFF | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):200 Executing soft-reset on final table of stream StreamConfig(id=StreamId(finalNamespace=XXX_PUBLIC, finalName=GUE2, rawNamespace=airbyte_internal, rawName=XXX_PUBLIC_raw__stream_gue2, originalNamespace=XXX_PUBLIC, originalName=gue2), destinationSyncMode=append, primaryKey=[ColumnId(name=ID, originalName=id, canonicalName=ID)], cursor=Optional[ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)], columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=NAME, originalName=name, canonicalName=NAME)=STRING, ColumnId(name=EMAIL, originalName=email, canonicalName=EMAIL)=STRING, ColumnId(name=STATUS, originalName=status, canonicalName=STATUS)=STRING, ColumnId(name=TRI_ID, originalName=tri_id, canonicalName=TRI_ID)=STRING, ColumnId(name=CREATED_TS, originalName=created_ts, canonicalName=CREATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=UPDATED_TS, originalName=updated_ts, canonicalName=UPDATED_TS)=TIMESTAMP_WITH_TIMEZONE, ColumnId(name=_AB_CDC_LSN, originalName=_ab_cdc_lsn, canonicalName=_AB_CDC_LSN)=NUMBER, ColumnId(name=SEAT_NUMBER, originalName=seat_number, canonicalName=SEAT_NUMBER)=STRING, ColumnId(name=IS_SANITIZED, originalName=is_sanitized, canonicalName=IS_SANITIZED)=BOOLEAN, ColumnId(name=GUE_ID, originalName=gue_id, canonicalName=GUE_ID)=STRING, ColumnId(name=_AB_CDC_DELETED_AT, originalName=_ab_cdc_deleted_at, canonicalName=_AB_CDC_DELETED_AT)=STRING, ColumnId(name=_AB_CDC_UPDATED_AT, originalName=_ab_cdc_updated_at, canonicalName=_AB_CDC_UPDATED_AT)=STRING, ColumnId(name=MEASURED_WEIGHT_LBS, originalName=measured_weight_lbs, canonicalName=MEASURED_WEIGHT_LBS)=NUMBER, ColumnId(name=ESTIMATED_WEIGHT_LBS, originalName=estimated_weight_lbs, canonicalName=ESTIMATED_WEIGHT_LBS)=NUMBER}, generationId=0, minimumGenerationId=0, syncId=923) | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.rou: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.sta: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.t.TyperDeduperUtil(executeSoftReset):261 Attempting soft reset for stream XXX_PUBLIC gue2 | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 1e736ce7-ad88-4232-b321-6139a4159cf6-fc27a734-3177-48df-b8ed-677e062f30bc: CREATE OR REPLACE TABLE "XXX_PUBLIC"."GUE2_AB_SOFT_RESET" ( | |
| "_AIRBYTE_RAW_ID" TEXT NOT NULL, | |
| "_AIRBYTE_EXTRACTED_AT" TIMESTAMP_TZ NOT NULL, | |
| "_AIRBYTE_META" VARIANT NOT NULL, | |
| "_AIRBYTE_GENERATION_ID" INTEGER | |
| ,"ID" TEXT | |
| ,"NAME" TEXT | |
| ,"EMAIL" TEXT | |
| ,"STATUS" TEXT | |
| ,"TRI_ID" TEXT | |
| ,"CREATED_TS" TIMESTAMP_TZ | |
| ,"UPDATED_TS" TIMESTAMP_TZ | |
| ,"_AB_CDC_LSN" FLOAT | |
| ,"SEAT_NUMBER" TEXT | |
| ,"IS_SANITIZED" BOOLEAN | |
| ,"GUE_ID" TEXT | |
| ,"_AB_CDC_DELETED_AT" TEXT | |
| ,"_AB_CDC_UPDATED_AT" TEXT | |
| ,"MEASURED_WEIGHT_LBS" FLOAT | |
| ,"ESTIMATED_WEIGHT_LBS" FLOAT | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-1 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 1345ec23-96ee-4485-ad40-9018efaccc4b-75b5a5a9-2bf0-4a53-a744-84629251239f: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_sta"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-10 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 5c27b846-6628-497b-b400-d623ae8ad53c-ed8fc559-8e7b-403c-b6c4-6036ef16c5a7: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_rou"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-2 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 4a05abc9-23d6-4373-88bf-c7be4dbac013-dc83f624-3aad-4fc8-aa42-9e8a22c94e29 completed in 176 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-2 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 4a05abc9-23d6-4373-88bf-c7be4dbac013-03c47879-a142-4f52-a9d3-d932d67817da: UPDATE "airbyte_internal"."XXX_PUBLIC_raw__stream_bag" SET "_airbyte_loaded_at" = NULL; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.gue: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream GUE | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.ter: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.pur: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream PUR | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.tri: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-7 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql e2e936b1-ee42-4631-a5a0-d6f0d86dba4d-1e1f4f0f-9617-49ab-9cc0-93ba23724087: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_ter"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-3 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 16ad1e3d-6673-44c0-8b53-916703ec6b73-14e500d2-33ee-45a0-9f2c-3102b58259e8: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_tri"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.reg: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.rid: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream REG | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream RID | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.tri2: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.veh: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-8 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql f8377c88-19bd-42c5-b743-ea6cbea04fd5-1d193f51-1c24-44d2-81ea-6a81c6ec3e8b: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_tri2"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-9 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql d8b5188c-0cd2-4ee8-bfe3-e2dcc5796dc6-4c544523-0815-4a90-9db9-c1f5d2cca775: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_veh"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-5 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql d1d748b0-ab42-42b2-a537-a237ab9786cd-e2c8971c-5e0c-4ae5-83aa-3fc7e202b9af completed in 205 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.ope: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-10 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 5c27b846-6628-497b-b400-d623ae8ad53c-ed8fc559-8e7b-403c-b6c4-6036ef16c5a7 completed in 34 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-1 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 1345ec23-96ee-4485-ad40-9018efaccc4b-75b5a5a9-2bf0-4a53-a744-84629251239f completed in 35 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream OPE | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):80 XXX_PUBLIC.veh_type: non-truncate sync. Creating raw table if not exists. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-4 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 25c49781-96a8-4fab-b139-ed05ae43d292-b8a34a7f-7598-4b5f-bfd6-e5be6645763e: CREATE TABLE IF NOT EXISTS "airbyte_internal"."XXX_PUBLIC_raw__stream_veh_type"( | |
| "_airbyte_raw_id" VARCHAR PRIMARY KEY, | |
| "_airbyte_extracted_at" TIMESTAMP WITH TIME ZONE DEFAULT current_timestamp(), | |
| "_airbyte_loaded_at" TIMESTAMP WITH TIME ZONE DEFAULT NULL, | |
| "_airbyte_data" VARIANT, | |
| "_airbyte_meta" VARIANT DEFAULT NULL, | |
| "_airbyte_generation_id" INTEGER DEFAULT NULL | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-9 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql d8b5188c-0cd2-4ee8-bfe3-e2dcc5796dc6-4c544523-0815-4a90-9db9-c1f5d2cca775 completed in 36 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-4 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 25c49781-96a8-4fab-b139-ed05ae43d292-b8a34a7f-7598-4b5f-bfd6-e5be6645763e completed in 38 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-8 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql f8377c88-19bd-42c5-b743-ea6cbea04fd5-1d193f51-1c24-44d2-81ea-6a81c6ec3e8b completed in 45 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-3 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 16ad1e3d-6673-44c0-8b53-916703ec6b73-14e500d2-33ee-45a0-9f2c-3102b58259e8 completed in 97 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-7 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql e2e936b1-ee42-4631-a5a0-d6f0d86dba4d-1e1f4f0f-9617-49ab-9cc0-93ba23724087 completed in 106 ms | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.sta: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream STA | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.pil2: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):181 Final table does not exist for stream PIL2, creating. | |
| 2024-07-14 07:48:13 [43mdestination[0m > INFO sync-operations-5 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 8557f573-071e-43cb-a699-436f515cba36-36288d48-0588-483e-bcdb-a1f696a7fd96: CREATE TABLE "XXX_PUBLIC"."PIL2" ( | |
| "_AIRBYTE_RAW_ID" TEXT NOT NULL, | |
| "_AIRBYTE_EXTRACTED_AT" TIMESTAMP_TZ NOT NULL, | |
| "_AIRBYTE_META" VARIANT NOT NULL, | |
| "_AIRBYTE_GENERATION_ID" INTEGER | |
| ,"ID" TEXT | |
| ,"NAME" TEXT | |
| ,"ACRONYM" TEXT | |
| ,"CREATED_TS" TIMESTAMP_TZ | |
| ,"UPDATED_TS" TIMESTAMP_TZ | |
| ,"_AB_CDC_LSN" FLOAT | |
| ,"_AB_CDC_DELETED_AT" TEXT | |
| ,"_AB_CDC_UPDATED_AT" TEXT | |
| ) data_retention_time_in_days = 1; | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.rou: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream ROU | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.veh: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream VEH | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.veh_type: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream VEH_TYPE | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 1e736ce7-ad88-4232-b321-6139a4159cf6-fc27a734-3177-48df-b8ed-677e062f30bc completed in 197 ms | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 1e736ce7-ad88-4232-b321-6139a4159cf6-8086481e-9a24-42a4-ba37-a6ba2efabcaf: UPDATE "airbyte_internal"."XXX_PUBLIC_raw__stream_gue2" SET "_airbyte_loaded_at" = NULL; | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-2 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 4a05abc9-23d6-4373-88bf-c7be4dbac013-03c47879-a142-4f52-a9d3-d932d67817da completed in 201 ms | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.t.TyperDeduperUtil(executeTypeAndDedupe):212 Attempting typing and deduping for XXX_PUBLIC.bag with suffix _ab_soft_reset | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-2 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 58b93155-4e2f-4d58-a814-fb8b6b8e8efa-41f82460-6596-44a6-9f99-7a59c2c9e414: BEGIN TRANSACTION; | |
| INSERT INTO "XXX_PUBLIC"."BAG_AB_SOFT_RESET" | |
| ( | |
| "ID", | |
| "SIZE", | |
| "TRI_ID", | |
| "CREATED_TS", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "GUE2_ID", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| "MEASURED_WEIGHT_LBS", | |
| "ESTIMATED_WEIGHT_LBS", | |
| "_AIRBYTE_META", | |
| "_AIRBYTE_RAW_ID", | |
| "_AIRBYTE_EXTRACTED_AT", | |
| "_AIRBYTE_GENERATION_ID" | |
| ) | |
| WITH intermediate_data AS ( | |
| SELECT | |
| (("_airbyte_data":"id")::text) as "ID", | |
| (("_airbyte_data":"size")::text) as "SIZE", | |
| (("_airbyte_data":"tri_id")::text) as "TRI_ID", | |
| CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "CREATED_TS", | |
| CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "UPDATED_TS", | |
| CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) as "_AB_CDC_LSN", | |
| (("_airbyte_data":"gue2_id")::text) as "GUE2_ID", | |
| (("_airbyte_data":"_ab_cdc_deleted_at")::text) as "_AB_CDC_DELETED_AT", | |
| (("_airbyte_data":"_ab_cdc_updated_at")::text) as "_AB_CDC_UPDATED_AT", | |
| CAST(("_airbyte_data":"measured_weight_lbs")::text as FLOAT) as "MEASURED_WEIGHT_LBS", | |
| CAST(("_airbyte_data":"estimated_weight_lbs")::text as FLOAT) as "ESTIMATED_WEIGHT_LBS", | |
| ARRAY_COMPACT( | |
| ARRAY_CAT( | |
| CASE WHEN "_airbyte_meta":"changes" IS NOT NULL | |
| THEN "_airbyte_meta":"changes" | |
| ELSE ARRAY_CONSTRUCT() | |
| END, | |
| ARRAY_CONSTRUCT(CASE | |
| WHEN (TYPEOF("_airbyte_data":"id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"size") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"size")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'size', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"tri_id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"tri_id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'tri_id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"created_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'created_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"updated_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'updated_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_lsn") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_lsn', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"gue2_id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"gue2_id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'gue2_id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_deleted_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_deleted_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_deleted_at', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_updated_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_updated_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_updated_at', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"measured_weight_lbs") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"measured_weight_lbs")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'measured_weight_lbs', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"estimated_weight_lbs") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"estimated_weight_lbs")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'estimated_weight_lbs', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END))) as "_airbyte_cast_errors", | |
| "_airbyte_raw_id", | |
| TIMESTAMPADD( | |
| HOUR, | |
| EXTRACT(timezone_hour from "_airbyte_extracted_at"), | |
| TIMESTAMPADD( | |
| MINUTE, | |
| EXTRACT(timezone_minute from "_airbyte_extracted_at"), | |
| CONVERT_TIMEZONE('UTC', "_airbyte_extracted_at") | |
| ) | |
| ) | |
| as "_airbyte_extracted_at", | |
| "_airbyte_meta", | |
| "_airbyte_generation_id" | |
| FROM "airbyte_internal"."XXX_PUBLIC_raw__stream_bag" | |
| WHERE | |
| "_airbyte_loaded_at" IS NULL | |
| ) | |
| SELECT | |
| "ID", | |
| "SIZE", | |
| "TRI_ID", | |
| "CREATED_TS", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "GUE2_ID", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| "MEASURED_WEIGHT_LBS", | |
| "ESTIMATED_WEIGHT_LBS", | |
| CASE WHEN "_airbyte_meta" IS NOT NULL | |
| THEN OBJECT_INSERT("_airbyte_meta", 'changes', "_airbyte_cast_errors", true) | |
| ELSE OBJECT_CONSTRUCT('changes', "_airbyte_cast_errors") | |
| END AS "_AIRBYTE_META", | |
| "_airbyte_raw_id" AS "_AIRBYTE_RAW_ID", | |
| "_airbyte_extracted_at" AS "_AIRBYTE_EXTRACTED_AT", | |
| "_airbyte_generation_id" AS "_AIRBYTE_GENERATION_ID" | |
| FROM intermediate_data; | |
| UPDATE "airbyte_internal"."XXX_PUBLIC_raw__stream_bag" | |
| SET "_airbyte_loaded_at" = CURRENT_TIMESTAMP() | |
| WHERE "_airbyte_loaded_at" IS NULL | |
| ; | |
| COMMIT; | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.tri: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream TRI | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.ter: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream TER | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-5 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 8557f573-071e-43cb-a699-436f515cba36-36288d48-0588-483e-bcdb-a1f696a7fd96 completed in 221 ms | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.o.AbstractStreamOperation(prepareStageForNormalSync):126 XXX_PUBLIC.tri2: non-truncate sync and no temp raw table. Initial raw table status is null. | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.o.AbstractStreamOperation(prepareFinalTable):188 Final Table exists for stream TRI2 | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 1e736ce7-ad88-4232-b321-6139a4159cf6-8086481e-9a24-42a4-ba37-a6ba2efabcaf completed in 540 ms | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.t.TyperDeduperUtil(executeTypeAndDedupe):212 Attempting typing and deduping for XXX_PUBLIC.gue2 with suffix _ab_soft_reset | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 721e5b2c-7fe1-419f-a746-1ccc09baefcf-fd264d26-62fd-4d46-a16e-5717e07a0687: BEGIN TRANSACTION; | |
| INSERT INTO "XXX_PUBLIC"."GUE2_AB_SOFT_RESET" | |
| ( | |
| "ID", | |
| "NAME", | |
| "EMAIL", | |
| "STATUS", | |
| "TRI_ID", | |
| "CREATED_TS", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "SEAT_NUMBER", | |
| "IS_SANITIZED", | |
| "GUE_ID", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| "MEASURED_WEIGHT_LBS", | |
| "ESTIMATED_WEIGHT_LBS", | |
| "_AIRBYTE_META", | |
| "_AIRBYTE_RAW_ID", | |
| "_AIRBYTE_EXTRACTED_AT", | |
| "_AIRBYTE_GENERATION_ID" | |
| ) | |
| WITH intermediate_data AS ( | |
| SELECT | |
| (("_airbyte_data":"id")::text) as "ID", | |
| (("_airbyte_data":"name")::text) as "NAME", | |
| (("_airbyte_data":"email")::text) as "EMAIL", | |
| (("_airbyte_data":"status")::text) as "STATUS", | |
| (("_airbyte_data":"tri_id")::text) as "TRI_ID", | |
| CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "CREATED_TS", | |
| CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "UPDATED_TS", | |
| CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) as "_AB_CDC_LSN", | |
| (("_airbyte_data":"seat_number")::text) as "SEAT_NUMBER", | |
| CAST(("_airbyte_data":"is_sanitized")::text as BOOLEAN) as "IS_SANITIZED", | |
| (("_airbyte_data":"gue_id")::text) as "GUE_ID", | |
| (("_airbyte_data":"_ab_cdc_deleted_at")::text) as "_AB_CDC_DELETED_AT", | |
| (("_airbyte_data":"_ab_cdc_updated_at")::text) as "_AB_CDC_UPDATED_AT", | |
| CAST(("_airbyte_data":"measured_weight_lbs")::text as FLOAT) as "MEASURED_WEIGHT_LBS", | |
| CAST(("_airbyte_data":"estimated_weight_lbs")::text as FLOAT) as "ESTIMATED_WEIGHT_LBS", | |
| ARRAY_COMPACT( | |
| ARRAY_CAT( | |
| CASE WHEN "_airbyte_meta":"changes" IS NOT NULL | |
| THEN "_airbyte_meta":"changes" | |
| ELSE ARRAY_CONSTRUCT() | |
| END, | |
| ARRAY_CONSTRUCT(CASE | |
| WHEN (TYPEOF("_airbyte_data":"id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"name") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"name")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'name', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"email") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"email")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'email', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"status") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"status")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'status', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"tri_id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"tri_id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'tri_id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"created_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'created_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"updated_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'updated_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_lsn") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_lsn', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"seat_number") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"seat_number")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'seat_number', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"is_sanitized") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"is_sanitized")::text as BOOLEAN) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'is_sanitized', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"gue_id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"gue_id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'gue_id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_deleted_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_deleted_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_deleted_at', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_updated_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_updated_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_updated_at', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"measured_weight_lbs") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"measured_weight_lbs")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'measured_weight_lbs', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"estimated_weight_lbs") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"estimated_weight_lbs")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'estimated_weight_lbs', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END))) as "_airbyte_cast_errors", | |
| "_airbyte_raw_id", | |
| TIMESTAMPADD( | |
| HOUR, | |
| EXTRACT(timezone_hour from "_airbyte_extracted_at"), | |
| TIMESTAMPADD( | |
| MINUTE, | |
| EXTRACT(timezone_minute from "_airbyte_extracted_at"), | |
| CONVERT_TIMEZONE('UTC', "_airbyte_extracted_at") | |
| ) | |
| ) | |
| as "_airbyte_extracted_at", | |
| "_airbyte_meta", | |
| "_airbyte_generation_id" | |
| FROM "airbyte_internal"."XXX_PUBLIC_raw__stream_gue2" | |
| WHERE | |
| "_airbyte_loaded_at" IS NULL | |
| ) | |
| SELECT | |
| "ID", | |
| "NAME", | |
| "EMAIL", | |
| "STATUS", | |
| "TRI_ID", | |
| "CREATED_TS", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "SEAT_NUMBER", | |
| "IS_SANITIZED", | |
| "GUE_ID", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| "MEASURED_WEIGHT_LBS", | |
| "ESTIMATED_WEIGHT_LBS", | |
| CASE WHEN "_airbyte_meta" IS NOT NULL | |
| THEN OBJECT_INSERT("_airbyte_meta", 'changes', "_airbyte_cast_errors", true) | |
| ELSE OBJECT_CONSTRUCT('changes', "_airbyte_cast_errors") | |
| END AS "_AIRBYTE_META", | |
| "_airbyte_raw_id" AS "_AIRBYTE_RAW_ID", | |
| "_airbyte_extracted_at" AS "_AIRBYTE_EXTRACTED_AT", | |
| "_airbyte_generation_id" AS "_AIRBYTE_GENERATION_ID" | |
| FROM intermediate_data; | |
| UPDATE "airbyte_internal"."XXX_PUBLIC_raw__stream_gue2" | |
| SET "_airbyte_loaded_at" = CURRENT_TIMESTAMP() | |
| WHERE "_airbyte_loaded_at" IS NULL | |
| ; | |
| COMMIT; | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-2 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 58b93155-4e2f-4d58-a814-fb8b6b8e8efa-41f82460-6596-44a6-9f99-7a59c2c9e414 completed in 841 ms | |
| 2024-07-14 07:48:14 [43mdestination[0m > INFO sync-operations-2 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 4e7e7b39-fab2-4e96-ba97-67997c4df948-99d98cbd-a31d-4179-a3fd-26e506ba631e: BEGIN TRANSACTION; | |
| DROP TABLE IF EXISTS "XXX_PUBLIC"."BAG"; | |
| ALTER TABLE "XXX_PUBLIC"."BAG_AB_SOFT_RESET" RENAME TO "XXX_PUBLIC"."BAG"; | |
| COMMIT; | |
| 2024-07-14 07:48:15 [43mdestination[0m > INFO sync-operations-2 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 4e7e7b39-fab2-4e96-ba97-67997c4df948-99d98cbd-a31d-4179-a3fd-26e506ba631e completed in 766 ms | |
| 2024-07-14 07:48:16 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 721e5b2c-7fe1-419f-a746-1ccc09baefcf-fd264d26-62fd-4d46-a16e-5717e07a0687 completed in 1477 ms | |
| 2024-07-14 07:48:16 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 99d1074d-5e0d-428b-8980-c9de93a66126-21e8c503-cdf4-41dc-8cd1-dc8dda9ebb52: BEGIN TRANSACTION; | |
| DROP TABLE IF EXISTS "XXX_PUBLIC"."GUE2"; | |
| ALTER TABLE "XXX_PUBLIC"."GUE2_AB_SOFT_RESET" RENAME TO "XXX_PUBLIC"."GUE2"; | |
| COMMIT; | |
| 2024-07-14 07:48:16 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 99d1074d-5e0d-428b-8980-c9de93a66126-21e8c503-cdf4-41dc-8cd1-dc8dda9ebb52 completed in 444 ms | |
| 2024-07-14 07:48:16 [43mdestination[0m > INFO main i.a.c.d.j.JdbcDatabase(executeWithinTransaction$lambda$1):47 executing query within transaction: delete from "airbyte_internal"."_airbyte_destination_state" where (("name" = 'act' and "namespace" = 'XXX_PUBLIC') or ("name" = 'asy' and "namespace" = 'XXX_PUBLIC') or ("name" = 'bag' and "namespace" = 'XXX_PUBLIC') or ("name" = 'config' and "namespace" = 'XXX_PUBLIC') or ("name" = 'con1' and "namespace" = 'XXX_PUBLIC') or ("name" = 'con2' and "namespace" = 'XXX_PUBLIC') or ("name" = 'con3' and "namespace" = 'XXX_PUBLIC') or ("name" = 'daw' and "namespace" = 'XXX_PUBLIC') or ("name" = 'dri' and "namespace" = 'XXX_PUBLIC') or ("name" = 'fli' and "namespace" = 'XXX_PUBLIC') or ("name" = 'gue' and "namespace" = 'XXX_PUBLIC') or ("name" = 'gue2' and "namespace" = 'XXX_PUBLIC') or ("name" = 'off' and "namespace" = 'XXX_PUBLIC') or ("name" = 'ope' and "namespace" = 'XXX_PUBLIC') or ("name" = 'pil' and "namespace" = 'XXX_PUBLIC') or ("name" = 'pil2' and "namespace" = 'XXX_PUBLIC') or ("name" = 'pur' and "namespace" = 'XXX_PUBLIC') or ("name" = 'reg' and "namespace" = 'XXX_PUBLIC') or ("name" = 'rid' and "namespace" = 'XXX_PUBLIC') or ("name" = 'rou' and "namespace" = 'XXX_PUBLIC') or ("name" = 'sta' and "namespace" = 'XXX_PUBLIC') or ("name" = 'ter' and "namespace" = 'XXX_PUBLIC') or ("name" = 'tri' and "namespace" = 'XXX_PUBLIC') or ("name" = 'tri2' and "namespace" = 'XXX_PUBLIC') or ("name" = 'veh' and "namespace" = 'XXX_PUBLIC') or ("name" = 'veh_type' and "namespace" = 'XXX_PUBLIC')) | |
| 2024-07-14 07:48:16 [43mdestination[0m > INFO main i.a.c.d.j.JdbcDatabase(executeWithinTransaction$lambda$1):51 done executing query within transaction: delete from "airbyte_internal"."_airbyte_destination_state" where (("name" = 'act' and "namespace" = 'XXX_PUBLIC') or ("name" = 'asy' and "namespace" = 'XXX_PUBLIC') or ("name" = 'bag' and "namespace" = 'XXX_PUBLIC') or ("name" = 'config' and "namespace" = 'XXX_PUBLIC') or ("name" = 'con1' and "namespace" = 'XXX_PUBLIC') or ("name" = 'con2' and "namespace" = 'XXX_PUBLIC') or ("name" = 'con3' and "namespace" = 'XXX_PUBLIC') or ("name" = 'daw' and "namespace" = 'XXX_PUBLIC') or ("name" = 'dri' and "namespace" = 'XXX_PUBLIC') or ("name" = 'fli' and "namespace" = 'XXX_PUBLIC') or ("name" = 'gue' and "namespace" = 'XXX_PUBLIC') or ("name" = 'gue2' and "namespace" = 'XXX_PUBLIC') or ("name" = 'off' and "namespace" = 'XXX_PUBLIC') or ("name" = 'ope' and "namespace" = 'XXX_PUBLIC') or ("name" = 'pil' and "namespace" = 'XXX_PUBLIC') or ("name" = 'pil2' and "namespace" = 'XXX_PUBLIC') or ("name" = 'pur' and "namespace" = 'XXX_PUBLIC') or ("name" = 'reg' and "namespace" = 'XXX_PUBLIC') or ("name" = 'rid' and "namespace" = 'XXX_PUBLIC') or ("name" = 'rou' and "namespace" = 'XXX_PUBLIC') or ("name" = 'sta' and "namespace" = 'XXX_PUBLIC') or ("name" = 'ter' and "namespace" = 'XXX_PUBLIC') or ("name" = 'tri' and "namespace" = 'XXX_PUBLIC') or ("name" = 'tri2' and "namespace" = 'XXX_PUBLIC') or ("name" = 'veh' and "namespace" = 'XXX_PUBLIC') or ("name" = 'veh_type' and "namespace" = 'XXX_PUBLIC')) | |
| 2024-07-14 07:48:16 [43mdestination[0m > INFO main i.a.c.d.j.JdbcDatabase(executeWithinTransaction$lambda$1):47 executing query within transaction: insert into "airbyte_internal"."_airbyte_destination_state" ("name", "namespace", "destination_state", "updated_at") values ('act', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.524120675Z'), ('asy', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.524262788Z'), ('bag', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.524354299Z'), ('config', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.524441960Z'), ('con1', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.524535932Z'), ('con2', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.524623963Z'), ('con3', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.524767196Z'), ('daw', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.524857307Z'), ('dri', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.524945458Z'), ('fli', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.525032451Z'), ('gue', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.525118302Z'), ('gue2', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.525204033Z'), ('off', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.525296795Z'), ('ope', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.525381576Z'), ('pil', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.525464387Z'), ('pil2', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.525550248Z'), ('pur', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.525635080Z'), ('reg', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.525717801Z'), ('rid', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.525830713Z'), ('rou', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.525918255Z'), ('sta', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.526003166Z'), ('ter', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.526223620Z'), ('tri', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.526386152Z'), ('tri2', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.526472574Z'), ('veh', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.526552815Z'), ('veh_type', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.526668997Z') | |
| 2024-07-14 07:48:17 [43mdestination[0m > INFO main i.a.c.d.j.JdbcDatabase(executeWithinTransaction$lambda$1):51 done executing query within transaction: insert into "airbyte_internal"."_airbyte_destination_state" ("name", "namespace", "destination_state", "updated_at") values ('act', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.524120675Z'), ('asy', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.524262788Z'), ('bag', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.524354299Z'), ('config', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.524441960Z'), ('con1', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.524535932Z'), ('con2', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.524623963Z'), ('con3', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.524767196Z'), ('daw', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.524857307Z'), ('dri', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.524945458Z'), ('fli', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.525032451Z'), ('gue', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.525118302Z'), ('gue2', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.525204033Z'), ('off', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.525296795Z'), ('ope', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.525381576Z'), ('pil', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.525464387Z'), ('pil2', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.525550248Z'), ('pur', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.525635080Z'), ('reg', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.525717801Z'), ('rid', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.525830713Z'), ('rou', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.525918255Z'), ('sta', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.526003166Z'), ('ter', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.526223620Z'), ('tri', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.526386152Z'), ('tri2', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.526472574Z'), ('veh', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.526552815Z'), ('veh_type', 'XXX_PUBLIC', '{"needsSoftReset":false,"airbyteMetaPresentInRaw":true}', '2024-07-14T07:48:16.526668997Z') | |
| 2024-07-14 07:48:17 [43mdestination[0m > INFO main i.a.c.i.d.a.b.BufferManager(<init>):48 Max 'memory' available for buffer allocation 3 GB | |
| 2024-07-14 07:48:17 [43mdestination[0m > INFO main i.a.c.i.b.IntegrationRunner$Companion(consumeWriteStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_core):424 Starting buffered read of input stream | |
| 2024-07-14 07:48:17 [43mdestination[0m > INFO main i.a.c.i.d.a.FlushWorkers(start):73 Start async buffer supervisor | |
| 2024-07-14 07:48:17 [43mdestination[0m > INFO pool-34-thread-1 i.a.c.i.d.a.b.BufferManager(printQueueInfo):94 [ASYNC QUEUE INFO] Global: max: 3.75 GB, allocated: 10 MB (10.0 MB), %% used: 0.0026041666666666665 | State Manager memory usage: Allocated: 10 MB, Used: 0 bytes, percentage Used 0.0 | |
| 2024-07-14 07:48:17 [43mdestination[0m > INFO pool-37-thread-1 i.a.c.i.d.a.FlushWorkers(printWorkerInfo):127 [ASYNC WORKER INFO] Pool queue size: 0, Active threads: 0 | |
| 2024-07-14 07:48:17 [43mdestination[0m > INFO main i.a.c.i.d.a.AsyncStreamConsumer(start):89 class io.airbyte.cdk.integrations.destination.async.AsyncStreamConsumer started. | |
| 2024-07-14 07:48:19 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(logStatistics):323 2 records sent during previous 00:00:20.544, last recorded offset of {server=daw_db} partition is {lsn=20266878376, txId=2778, ts_usec=1720943255016665} | |
| 2024-07-14 07:48:19 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:48:29 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:48:39 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:48:50 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:49:00 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(logStatistics):323 4 records sent during previous 00:00:40.587, last recorded offset of {server=daw_db} partition is {lsn=20266878376, txId=2778, ts_usec=1720943255016665} | |
| 2024-07-14 07:49:00 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:49:10 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:49:17 [43mdestination[0m > INFO pool-34-thread-1 i.a.c.i.d.a.b.BufferManager(printQueueInfo):94 [ASYNC QUEUE INFO] Global: max: 3.75 GB, allocated: 90 MB (90.0 MB), %% used: 0.0234375 | Queue `act`, num records: 16, num bytes: 9.42 KB, allocated bytes: 10 MB | Queue `sta`, num records: 3, num bytes: 2.06 KB, allocated bytes: 10 MB | Queue `pil2`, num records: 2, num bytes: 900 bytes, allocated bytes: 10 MB | Queue `reg`, num records: 1, num bytes: 521 bytes, allocated bytes: 10 MB | Queue `gue`, num records: 1, num bytes: 766 bytes, allocated bytes: 10 MB | Queue `pil`, num records: 1, num bytes: 566 bytes, allocated bytes: 10 MB | Queue `fli`, num records: 4, num bytes: 4 KB, allocated bytes: 10 MB | Queue `rou`, num records: 6, num bytes: 3.8 KB, allocated bytes: 10 MB | State Manager memory usage: Allocated: 10 MB, Used: 0 bytes, percentage Used 0.0 | |
| 2024-07-14 07:49:17 [43mdestination[0m > INFO pool-37-thread-1 i.a.c.i.d.a.FlushWorkers(printWorkerInfo):127 [ASYNC WORKER INFO] Pool queue size: 0, Active threads: 0 | |
| 2024-07-14 07:49:20 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:49:30 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:49:40 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:49:50 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:50:00 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:50:10 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:50:17 [43mdestination[0m > INFO pool-34-thread-1 i.a.c.i.d.a.b.BufferManager(printQueueInfo):94 [ASYNC QUEUE INFO] Global: max: 3.75 GB, allocated: 90 MB (90.0 MB), %% used: 0.0234375 | Queue `act`, num records: 16, num bytes: 9.42 KB, allocated bytes: 10 MB | Queue `sta`, num records: 3, num bytes: 2.06 KB, allocated bytes: 10 MB | Queue `pil2`, num records: 2, num bytes: 900 bytes, allocated bytes: 10 MB | Queue `reg`, num records: 1, num bytes: 521 bytes, allocated bytes: 10 MB | Queue `gue`, num records: 1, num bytes: 766 bytes, allocated bytes: 10 MB | Queue `pil`, num records: 1, num bytes: 566 bytes, allocated bytes: 10 MB | Queue `fli`, num records: 4, num bytes: 4 KB, allocated bytes: 10 MB | Queue `rou`, num records: 6, num bytes: 3.8 KB, allocated bytes: 10 MB | State Manager memory usage: Allocated: 10 MB, Used: 0 bytes, percentage Used 0.0 | |
| 2024-07-14 07:50:17 [43mdestination[0m > INFO pool-37-thread-1 i.a.c.i.d.a.FlushWorkers(printWorkerInfo):127 [ASYNC WORKER INFO] Pool queue size: 0, Active threads: 0 | |
| 2024-07-14 07:50:20 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(logStatistics):323 8 records sent during previous 00:01:20.67, last recorded offset of {server=daw_db} partition is {lsn=20266878376, txId=2778, ts_usec=1720943255016665} | |
| 2024-07-14 07:50:20 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:50:31 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:50:41 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:50:51 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:51:01 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:51:11 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:51:17 [43mdestination[0m > INFO pool-34-thread-1 i.a.c.i.d.a.b.BufferManager(printQueueInfo):94 [ASYNC QUEUE INFO] Global: max: 3.75 GB, allocated: 90 MB (90.0 MB), %% used: 0.0234375 | Queue `act`, num records: 16, num bytes: 9.42 KB, allocated bytes: 10 MB | Queue `sta`, num records: 3, num bytes: 2.06 KB, allocated bytes: 10 MB | Queue `pil2`, num records: 2, num bytes: 900 bytes, allocated bytes: 10 MB | Queue `reg`, num records: 1, num bytes: 521 bytes, allocated bytes: 10 MB | Queue `gue`, num records: 1, num bytes: 766 bytes, allocated bytes: 10 MB | Queue `pil`, num records: 1, num bytes: 566 bytes, allocated bytes: 10 MB | Queue `fli`, num records: 4, num bytes: 4 KB, allocated bytes: 10 MB | Queue `rou`, num records: 6, num bytes: 3.8 KB, allocated bytes: 10 MB | State Manager memory usage: Allocated: 10 MB, Used: 0 bytes, percentage Used 0.0 | |
| 2024-07-14 07:51:17 [43mdestination[0m > INFO pool-37-thread-1 i.a.c.i.d.a.FlushWorkers(printWorkerInfo):127 [ASYNC WORKER INFO] Pool queue size: 0, Active threads: 0 | |
| 2024-07-14 07:51:21 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:51:31 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:51:41 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:51:51 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:52:01 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:52:12 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:52:17 [43mdestination[0m > INFO pool-34-thread-1 i.a.c.i.d.a.b.BufferManager(printQueueInfo):94 [ASYNC QUEUE INFO] Global: max: 3.75 GB, allocated: 90 MB (90.0 MB), %% used: 0.0234375 | Queue `act`, num records: 16, num bytes: 9.42 KB, allocated bytes: 10 MB | Queue `sta`, num records: 3, num bytes: 2.06 KB, allocated bytes: 10 MB | Queue `pil2`, num records: 2, num bytes: 900 bytes, allocated bytes: 10 MB | Queue `reg`, num records: 1, num bytes: 521 bytes, allocated bytes: 10 MB | Queue `gue`, num records: 1, num bytes: 766 bytes, allocated bytes: 10 MB | Queue `pil`, num records: 1, num bytes: 566 bytes, allocated bytes: 10 MB | Queue `fli`, num records: 4, num bytes: 4 KB, allocated bytes: 10 MB | Queue `rou`, num records: 6, num bytes: 3.8 KB, allocated bytes: 10 MB | State Manager memory usage: Allocated: 10 MB, Used: 0 bytes, percentage Used 0.0 | |
| 2024-07-14 07:52:17 [43mdestination[0m > INFO pool-37-thread-1 i.a.c.i.d.a.FlushWorkers(printWorkerInfo):127 [ASYNC WORKER INFO] Pool queue size: 0, Active threads: 0 | |
| 2024-07-14 07:52:22 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:52:32 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:52:42 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:52:52 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:53:03 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(logStatistics):323 16 records sent during previous 00:02:42.34, last recorded offset of {server=daw_db} partition is {lsn=20266878376, txId=2778, ts_usec=1720943255016665} | |
| 2024-07-14 07:53:03 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:53:13 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:53:17 [43mdestination[0m > INFO pool-34-thread-1 i.a.c.i.d.a.b.BufferManager(printQueueInfo):94 [ASYNC QUEUE INFO] Global: max: 3.75 GB, allocated: 90 MB (90.0 MB), %% used: 0.0234375 | Queue `act`, num records: 16, num bytes: 9.42 KB, allocated bytes: 10 MB | Queue `sta`, num records: 3, num bytes: 2.06 KB, allocated bytes: 10 MB | Queue `pil2`, num records: 2, num bytes: 900 bytes, allocated bytes: 10 MB | Queue `reg`, num records: 1, num bytes: 521 bytes, allocated bytes: 10 MB | Queue `gue`, num records: 1, num bytes: 766 bytes, allocated bytes: 10 MB | Queue `pil`, num records: 1, num bytes: 566 bytes, allocated bytes: 10 MB | Queue `fli`, num records: 4, num bytes: 4 KB, allocated bytes: 10 MB | Queue `rou`, num records: 6, num bytes: 3.8 KB, allocated bytes: 10 MB | State Manager memory usage: Allocated: 10 MB, Used: 0 bytes, percentage Used 0.0 | |
| 2024-07-14 07:53:17 [43mdestination[0m > INFO pool-37-thread-1 i.a.c.i.d.a.FlushWorkers(printWorkerInfo):127 [ASYNC WORKER INFO] Pool queue size: 0, Active threads: 0 | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-36-thread-1 i.a.c.i.d.a.DetectStreamToFlush(getNextStreamToFlush):109 flushing: trigger info: null - act, time trigger: true , size trigger: false current threshold b: 200 MB, queue size b: 9.42 KB, penalty b: 0 bytes, after penalty b: 9.42 KB | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-36-thread-1 i.a.c.i.d.a.DetectStreamToFlush(getNextStreamToFlush):109 flushing: trigger info: null - fli, time trigger: true , size trigger: false current threshold b: 200 MB, queue size b: 4 KB, penalty b: 0 bytes, after penalty b: 4 KB | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):135 Flush Worker (7cf86) -- Worker picked up work. | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-36-thread-1 i.a.c.i.d.a.DetectStreamToFlush(getNextStreamToFlush):109 flushing: trigger info: null - rou, time trigger: true , size trigger: false current threshold b: 200 MB, queue size b: 3.8 KB, penalty b: 0 bytes, after penalty b: 3.8 KB | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):135 Flush Worker (9776d) -- Worker picked up work. | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):141 Flush Worker (7cf86) -- Attempting to read from queue namespace: null, stream: act. | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):141 Flush Worker (9776d) -- Attempting to read from queue namespace: null, stream: fli. | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-36-thread-1 i.a.c.i.d.a.DetectStreamToFlush(getNextStreamToFlush):109 flushing: trigger info: null - sta, time trigger: true , size trigger: false current threshold b: 200 MB, queue size b: 2.06 KB, penalty b: 0 bytes, after penalty b: 2.06 KB | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):135 Flush Worker (8aee5) -- Worker picked up work. | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):141 Flush Worker (8aee5) -- Attempting to read from queue namespace: null, stream: rou. | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-36-thread-1 i.a.c.i.d.a.DetectStreamToFlush(getNextStreamToFlush):109 flushing: trigger info: null - pil2, time trigger: true , size trigger: false current threshold b: 200 MB, queue size b: 900 bytes, penalty b: 0 bytes, after penalty b: 900 bytes | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):135 Flush Worker (07190) -- Worker picked up work. | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):141 Flush Worker (07190) -- Attempting to read from queue namespace: null, stream: sta. | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):135 Flush Worker (7e117) -- Worker picked up work. | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 10476112 bytes.. | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 10481870 bytes.. | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):141 Flush Worker (7e117) -- Attempting to read from queue namespace: null, stream: pil2. | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 10483653 bytes.. | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 10481664 bytes.. | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 10484860 bytes.. | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):159 Flush Worker (07190) -- Batch contains: 3 records, 2.06 KB bytes. | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):159 Flush Worker (8aee5) -- Batch contains: 6 records, 3.8 KB bytes. | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):159 Flush Worker (7cf86) -- Batch contains: 16 records, 9.42 KB bytes. | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):159 Flush Worker (7e117) -- Batch contains: 2 records, 900 bytes bytes. | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):159 Flush Worker (9776d) -- Batch contains: 4 records, 4 KB bytes. | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.r.BaseSerializedBuffer(flush):162 Finished writing data to dc4b68ef-4cf6-4a5a-8047-b898d4fed3b42598242906830763470.csv.gz (604 bytes) | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.r.BaseSerializedBuffer(flush):162 Finished writing data to 6cf76e6a-cd67-4251-9d40-88c5dab2ac735569759190399850079.csv.gz (332 bytes) | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.r.BaseSerializedBuffer(flush):162 Finished writing data to 278ba222-3167-46d4-a29f-29b405601ca05760888016654691440.csv.gz (1 KB) | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.r.BaseSerializedBuffer(flush):162 Finished writing data to 53e54029-bbd9-429a-863d-380b00b966d28521252878092917028.csv.gz (724 bytes) | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):54 Buffer flush complete for stream sta (604 bytes) to staging | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):54 Buffer flush complete for stream pil2 (332 bytes) to staging | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):54 Buffer flush complete for stream rou (724 bytes) to staging | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):54 Buffer flush complete for stream fli (1 KB) to staging | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-3 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):84 executing query 4004e971-470d-430d-baf7-0596d53870a5, PUT file:///tmp/53e54029-bbd9-429a-863d-380b00b966d28521252878092917028.csv.gz @"airbyte_internal"."XXX_PUBLIC_raw__stream_rou"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ PARALLEL = 4; | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-2 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):84 executing query 484b778a-cfcf-4b73-b76c-e4a33192abae, PUT file:///tmp/278ba222-3167-46d4-a29f-29b405601ca05760888016654691440.csv.gz @"airbyte_internal"."XXX_PUBLIC_raw__stream_fli"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ PARALLEL = 4; | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-4 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):84 executing query 7152d7e0-6d11-4152-b5cf-85f14619c8bf, PUT file:///tmp/dc4b68ef-4cf6-4a5a-8047-b898d4fed3b42598242906830763470.csv.gz @"airbyte_internal"."XXX_PUBLIC_raw__stream_sta"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ PARALLEL = 4; | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-5 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):84 executing query 83102ef7-d056-4b38-ab9a-47ba83db135c, PUT file:///tmp/6cf76e6a-cd67-4251-9d40-88c5dab2ac735569759190399850079.csv.gz @"airbyte_internal"."XXX_PUBLIC_raw__stream_pil2"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ PARALLEL = 4; | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.r.BaseSerializedBuffer(flush):162 Finished writing data to 20fab464-c2be-4e24-91b1-6716e270774e6591455061809216643.csv.gz (1 KB) | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):54 Buffer flush complete for stream act (1 KB) to staging | |
| 2024-07-14 07:53:19 [43mdestination[0m > INFO pool-35-thread-1 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):84 executing query 06e0f354-30f5-4f39-abbb-4c5643df9240, PUT file:///tmp/20fab464-c2be-4e24-91b1-6716e270774e6591455061809216643.csv.gz @"airbyte_internal"."XXX_PUBLIC_raw__stream_act"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ PARALLEL = 4; | |
| 2024-07-14 07:53:20 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:20 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:20 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:20 [43mdestination[0m > INFO pool-35-thread-4 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):94 query 7152d7e0-6d11-4152-b5cf-85f14619c8bf, completed with [{"source":"dc4b68ef-4cf6-4a5a-8047-b898d4fed3b42598242906830763470.csv.gz","target":"dc4b68ef-4cf6-4a5a-8047-b898d4fed3b42598242906830763470.csv.gz","source_size":604,"target_size":604,"source_compression":"GZIP","target_compression":"GZIP","status":"UPLOADED","encryption":"","message":""}] | |
| 2024-07-14 07:53:20 [43mdestination[0m > INFO pool-35-thread-3 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):94 query 4004e971-470d-430d-baf7-0596d53870a5, completed with [{"source":"53e54029-bbd9-429a-863d-380b00b966d28521252878092917028.csv.gz","target":"53e54029-bbd9-429a-863d-380b00b966d28521252878092917028.csv.gz","source_size":724,"target_size":724,"source_compression":"GZIP","target_compression":"GZIP","status":"UPLOADED","encryption":"","message":""}] | |
| 2024-07-14 07:53:20 [43mdestination[0m > INFO pool-35-thread-5 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):94 query 83102ef7-d056-4b38-ab9a-47ba83db135c, completed with [{"source":"6cf76e6a-cd67-4251-9d40-88c5dab2ac735569759190399850079.csv.gz","target":"6cf76e6a-cd67-4251-9d40-88c5dab2ac735569759190399850079.csv.gz","source_size":332,"target_size":332,"source_compression":"GZIP","target_compression":"GZIP","status":"UPLOADED","encryption":"","message":""}] | |
| 2024-07-14 07:53:20 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:20 [43mdestination[0m > INFO pool-35-thread-1 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):94 query 06e0f354-30f5-4f39-abbb-4c5643df9240, completed with [{"source":"20fab464-c2be-4e24-91b1-6716e270774e6591455061809216643.csv.gz","target":"20fab464-c2be-4e24-91b1-6716e270774e6591455061809216643.csv.gz","source_size":1193,"target_size":1193,"source_compression":"GZIP","target_compression":"GZIP","status":"UPLOADED","encryption":"","message":""}] | |
| 2024-07-14 07:53:20 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:20 [43mdestination[0m > INFO pool-35-thread-2 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):94 query 484b778a-cfcf-4b73-b76c-e4a33192abae, completed with [{"source":"278ba222-3167-46d4-a29f-29b405601ca05760888016654691440.csv.gz","target":"278ba222-3167-46d4-a29f-29b405601ca05760888016654691440.csv.gz","source_size":1115,"target_size":1115,"source_compression":"GZIP","target_compression":"GZIP","status":"UPLOADED","encryption":"","message":""}] | |
| 2024-07-14 07:53:20 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:20 [43mdestination[0m > INFO pool-35-thread-5 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToStage):70 Successfully loaded records to stage 2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ with 0 re-attempt(s) | |
| 2024-07-14 07:53:20 [43mdestination[0m > INFO pool-35-thread-5 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):178 query 65d4c26b-133e-4db0-9634-7719738ef48e, COPY INTO "airbyte_internal"."XXX_PUBLIC_raw__stream_pil2" FROM '@"airbyte_internal"."XXX_PUBLIC_raw__stream_pil2"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/' | |
| file_format = ( | |
| type = csv | |
| compression = auto | |
| field_delimiter = ',' | |
| skip_header = 0 | |
| FIELD_OPTIONALLY_ENCLOSED_BY = '"' | |
| NULL_IF=('') | |
| ) files = ('6cf76e6a-cd67-4251-9d40-88c5dab2ac735569759190399850079.csv.gz'); | |
| 2024-07-14 07:53:20 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:20 [43mdestination[0m > INFO pool-35-thread-2 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToStage):70 Successfully loaded records to stage 2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ with 0 re-attempt(s) | |
| 2024-07-14 07:53:20 [43mdestination[0m > INFO pool-35-thread-2 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):178 query b10a74ba-0f98-4b8d-b2dc-f8a6c46b5a3d, COPY INTO "airbyte_internal"."XXX_PUBLIC_raw__stream_fli" FROM '@"airbyte_internal"."XXX_PUBLIC_raw__stream_fli"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/' | |
| file_format = ( | |
| type = csv | |
| compression = auto | |
| field_delimiter = ',' | |
| skip_header = 0 | |
| FIELD_OPTIONALLY_ENCLOSED_BY = '"' | |
| NULL_IF=('') | |
| ) files = ('278ba222-3167-46d4-a29f-29b405601ca05760888016654691440.csv.gz'); | |
| 2024-07-14 07:53:20 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:20 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:20 [43mdestination[0m > INFO pool-35-thread-1 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToStage):70 Successfully loaded records to stage 2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ with 0 re-attempt(s) | |
| 2024-07-14 07:53:20 [43mdestination[0m > INFO pool-35-thread-3 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToStage):70 Successfully loaded records to stage 2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ with 0 re-attempt(s) | |
| 2024-07-14 07:53:20 [43mdestination[0m > INFO pool-35-thread-1 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):178 query 41e2d360-c34a-4f79-9e7c-284b396aa2fe, COPY INTO "airbyte_internal"."XXX_PUBLIC_raw__stream_act" FROM '@"airbyte_internal"."XXX_PUBLIC_raw__stream_act"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/' | |
| file_format = ( | |
| type = csv | |
| compression = auto | |
| field_delimiter = ',' | |
| skip_header = 0 | |
| FIELD_OPTIONALLY_ENCLOSED_BY = '"' | |
| NULL_IF=('') | |
| ) files = ('20fab464-c2be-4e24-91b1-6716e270774e6591455061809216643.csv.gz'); | |
| 2024-07-14 07:53:20 [43mdestination[0m > INFO pool-35-thread-3 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):178 query da0f832e-5eab-4366-b89b-3682fcc66796, COPY INTO "airbyte_internal"."XXX_PUBLIC_raw__stream_rou" FROM '@"airbyte_internal"."XXX_PUBLIC_raw__stream_rou"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/' | |
| file_format = ( | |
| type = csv | |
| compression = auto | |
| field_delimiter = ',' | |
| skip_header = 0 | |
| FIELD_OPTIONALLY_ENCLOSED_BY = '"' | |
| NULL_IF=('') | |
| ) files = ('53e54029-bbd9-429a-863d-380b00b966d28521252878092917028.csv.gz'); | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-4 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToStage):70 Successfully loaded records to stage 2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ with 0 re-attempt(s) | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-4 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):178 query 90b6bbc4-d682-4456-874c-8497c7f7055f, COPY INTO "airbyte_internal"."XXX_PUBLIC_raw__stream_sta" FROM '@"airbyte_internal"."XXX_PUBLIC_raw__stream_sta"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/' | |
| file_format = ( | |
| type = csv | |
| compression = auto | |
| field_delimiter = ',' | |
| skip_header = 0 | |
| FIELD_OPTIONALLY_ENCLOSED_BY = '"' | |
| NULL_IF=('') | |
| ) files = ('dc4b68ef-4cf6-4a5a-8047-b898d4fed3b42598242906830763470.csv.gz'); | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-5 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):187 query 65d4c26b-133e-4db0-9634-7719738ef48e, successfully loaded 2 rows of data into table | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.r.FileBuffer(deleteFile):75 Deleting tempFile data 6cf76e6a-cd67-4251-9d40-88c5dab2ac735569759190399850079.csv.gz | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):153 Flushing states | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):207 Flushing states complete | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 900 bytes.. | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):170 Flush Worker (7e117) -- Worker finished flushing. Current queue size: 0 | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-36-thread-1 i.a.c.i.d.a.DetectStreamToFlush(getNextStreamToFlush):109 flushing: trigger info: null - gue, time trigger: true , size trigger: false current threshold b: 200 MB, queue size b: 766 bytes, penalty b: 0 bytes, after penalty b: 766 bytes | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):135 Flush Worker (fe879) -- Worker picked up work. | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):141 Flush Worker (fe879) -- Attempting to read from queue namespace: null, stream: gue. | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 10484994 bytes.. | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):159 Flush Worker (fe879) -- Batch contains: 1 records, 766 bytes bytes. | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.r.BaseSerializedBuffer(flush):162 Finished writing data to 9437ad22-56b8-4f5f-ba49-81310b1eedb51886709941197458739.csv.gz (464 bytes) | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):54 Buffer flush complete for stream gue (464 bytes) to staging | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-5 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):84 executing query dc9a7324-e1db-4197-9720-0269e9fe011d, PUT file:///tmp/9437ad22-56b8-4f5f-ba49-81310b1eedb51886709941197458739.csv.gz @"airbyte_internal"."XXX_PUBLIC_raw__stream_gue"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ PARALLEL = 4; | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-3 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):187 query da0f832e-5eab-4366-b89b-3682fcc66796, successfully loaded 6 rows of data into table | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.r.FileBuffer(deleteFile):75 Deleting tempFile data 53e54029-bbd9-429a-863d-380b00b966d28521252878092917028.csv.gz | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):153 Flushing states | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):207 Flushing states complete | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 3890 bytes.. | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):170 Flush Worker (8aee5) -- Worker finished flushing. Current queue size: 0 | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-2 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):187 query b10a74ba-0f98-4b8d-b2dc-f8a6c46b5a3d, successfully loaded 4 rows of data into table | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.r.FileBuffer(deleteFile):75 Deleting tempFile data 278ba222-3167-46d4-a29f-29b405601ca05760888016654691440.csv.gz | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):153 Flushing states | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):207 Flushing states complete | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 4096 bytes.. | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):170 Flush Worker (9776d) -- Worker finished flushing. Current queue size: 0 | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-5 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):94 query dc9a7324-e1db-4197-9720-0269e9fe011d, completed with [{"source":"9437ad22-56b8-4f5f-ba49-81310b1eedb51886709941197458739.csv.gz","target":"9437ad22-56b8-4f5f-ba49-81310b1eedb51886709941197458739.csv.gz","source_size":464,"target_size":464,"source_compression":"GZIP","target_compression":"GZIP","status":"UPLOADED","encryption":"","message":""}] | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-1 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):187 query 41e2d360-c34a-4f79-9e7c-284b396aa2fe, successfully loaded 16 rows of data into table | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.r.FileBuffer(deleteFile):75 Deleting tempFile data 20fab464-c2be-4e24-91b1-6716e270774e6591455061809216643.csv.gz | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):153 Flushing states | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-5 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToStage):70 Successfully loaded records to stage 2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ with 0 re-attempt(s) | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-5 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):178 query d0f1cf7e-af83-40d1-8648-301b3e2a9501, COPY INTO "airbyte_internal"."XXX_PUBLIC_raw__stream_gue" FROM '@"airbyte_internal"."XXX_PUBLIC_raw__stream_gue"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/' | |
| file_format = ( | |
| type = csv | |
| compression = auto | |
| field_delimiter = ',' | |
| skip_header = 0 | |
| FIELD_OPTIONALLY_ENCLOSED_BY = '"' | |
| NULL_IF=('') | |
| ) files = ('9437ad22-56b8-4f5f-ba49-81310b1eedb51886709941197458739.csv.gz'); | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 2 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 3 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 4 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 5 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 5 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 5 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 5 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 5 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 5 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 5 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 5 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 5 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 5 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 5 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 5 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 5 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 5 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 5 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 5 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 5 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 5 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 5 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 5 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 5 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 5 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 6 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 6 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 6 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 6 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 6 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 6 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 6 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 6 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 6 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 6 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 6 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 6 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 6 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 6 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 6 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 6 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 6 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 6 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 6 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 6 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 6 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 7 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 7 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 7 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 7 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 7 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 7 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 7 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 7 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 7 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 7 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 7 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 7 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 7 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 7 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 7 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 7 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 7 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 7 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 7 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 7 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 8 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 8 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 8 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 8 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 8 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 8 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 8 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 8 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 8 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 8 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 8 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 8 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 8 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 8 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 8 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 8 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 8 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 8 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 8 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 9 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 9 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 9 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 9 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 9 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 9 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 9 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 9 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 9 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 9 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 9 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 9 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 9 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 9 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 9 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 9 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 9 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 9 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 10 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 10 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 10 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 10 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 10 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 10 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 10 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 10 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 10 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 10 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 10 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 10 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 10 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 10 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 10 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 10 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 10 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 11 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 11 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 11 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 11 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 11 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 11 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 11 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 11 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 11 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 11 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 11 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 11 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 11 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 11 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 11 in the stagedStatsList | |
| 2024-07-14 07:53:21 [46mreplication-orchestrator[0m > Could not find the state message with id 11 in the stagedStatsList | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):207 Flushing states complete | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 12672 bytes.. | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 9648 bytes.. | |
| 2024-07-14 07:53:21 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):170 Flush Worker (7cf86) -- Worker finished flushing. Current queue size: 0 | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-4 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):187 query 90b6bbc4-d682-4456-874c-8497c7f7055f, successfully loaded 3 rows of data into table | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.r.FileBuffer(deleteFile):75 Deleting tempFile data dc4b68ef-4cf6-4a5a-8047-b898d4fed3b42598242906830763470.csv.gz | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):153 Flushing states | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):207 Flushing states complete | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 2107 bytes.. | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):170 Flush Worker (07190) -- Worker finished flushing. Current queue size: 0 | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-5 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):187 query d0f1cf7e-af83-40d1-8648-301b3e2a9501, successfully loaded 1 rows of data into table | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.r.FileBuffer(deleteFile):75 Deleting tempFile data 9437ad22-56b8-4f5f-ba49-81310b1eedb51886709941197458739.csv.gz | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):153 Flushing states | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 12 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 12 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 12 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 12 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 12 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 12 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 12 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 12 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 12 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 12 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 12 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 12 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 12 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 12 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 12 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 13 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 13 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 13 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 13 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 13 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 13 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 13 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 13 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 13 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 13 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 13 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 13 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 13 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 13 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 14 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 14 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 14 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 14 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 14 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 14 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 14 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 14 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 14 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 14 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 14 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 14 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 14 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 15 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 15 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 15 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 15 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 15 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 15 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 15 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 15 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 15 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 15 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 15 in the stagedStatsList | |
| 2024-07-14 07:53:22 [46mreplication-orchestrator[0m > Could not find the state message with id 15 in the stagedStatsList | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):207 Flushing states complete | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 9656 bytes.. | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 766 bytes.. | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):170 Flush Worker (fe879) -- Worker finished flushing. Current queue size: 0 | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-36-thread-1 i.a.c.i.d.a.DetectStreamToFlush(getNextStreamToFlush):109 flushing: trigger info: null - pil, time trigger: true , size trigger: false current threshold b: 200 MB, queue size b: 566 bytes, penalty b: 0 bytes, after penalty b: 566 bytes | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):135 Flush Worker (d3d60) -- Worker picked up work. | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-36-thread-1 i.a.c.i.d.a.DetectStreamToFlush(getNextStreamToFlush):109 flushing: trigger info: null - reg, time trigger: true , size trigger: false current threshold b: 200 MB, queue size b: 521 bytes, penalty b: 0 bytes, after penalty b: 521 bytes | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):141 Flush Worker (d3d60) -- Attempting to read from queue namespace: null, stream: pil. | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 10485194 bytes.. | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):135 Flush Worker (90980) -- Worker picked up work. | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):159 Flush Worker (d3d60) -- Batch contains: 1 records, 566 bytes bytes. | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):141 Flush Worker (90980) -- Attempting to read from queue namespace: null, stream: reg. | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 10485239 bytes.. | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):159 Flush Worker (90980) -- Batch contains: 1 records, 521 bytes bytes. | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.r.BaseSerializedBuffer(flush):162 Finished writing data to 3c21f386-73bb-4717-a0c1-611825089c6f7400967146058415724.csv.gz (347 bytes) | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.r.BaseSerializedBuffer(flush):162 Finished writing data to 4c7b02e9-936b-4922-9ac2-8cd48f4579158207383228585160042.csv.gz (318 bytes) | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):54 Buffer flush complete for stream pil (347 bytes) to staging | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):54 Buffer flush complete for stream reg (318 bytes) to staging | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):84 executing query 953516b1-c968-400a-a396-0e27ebd86553, PUT file:///tmp/3c21f386-73bb-4717-a0c1-611825089c6f7400967146058415724.csv.gz @"airbyte_internal"."XXX_PUBLIC_raw__stream_pil"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ PARALLEL = 4; | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-2 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):84 executing query 6bd1a0b6-43b9-4f03-9422-73f0f4f95a71, PUT file:///tmp/4c7b02e9-936b-4922-9ac2-8cd48f4579158207383228585160042.csv.gz @"airbyte_internal"."XXX_PUBLIC_raw__stream_reg"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ PARALLEL = 4; | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):94 query 953516b1-c968-400a-a396-0e27ebd86553, completed with [{"source":"3c21f386-73bb-4717-a0c1-611825089c6f7400967146058415724.csv.gz","target":"3c21f386-73bb-4717-a0c1-611825089c6f7400967146058415724.csv.gz","source_size":347,"target_size":347,"source_compression":"GZIP","target_compression":"GZIP","status":"UPLOADED","encryption":"","message":""}] | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-2 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):94 query 6bd1a0b6-43b9-4f03-9422-73f0f4f95a71, completed with [{"source":"4c7b02e9-936b-4922-9ac2-8cd48f4579158207383228585160042.csv.gz","target":"4c7b02e9-936b-4922-9ac2-8cd48f4579158207383228585160042.csv.gz","source_size":318,"target_size":318,"source_compression":"GZIP","target_compression":"GZIP","status":"UPLOADED","encryption":"","message":""}] | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToStage):70 Successfully loaded records to stage 2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ with 0 re-attempt(s) | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-2 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToStage):70 Successfully loaded records to stage 2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ with 0 re-attempt(s) | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):178 query aaa23f3e-fa89-4185-b60c-60a924dc49aa, COPY INTO "airbyte_internal"."XXX_PUBLIC_raw__stream_pil" FROM '@"airbyte_internal"."XXX_PUBLIC_raw__stream_pil"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/' | |
| file_format = ( | |
| type = csv | |
| compression = auto | |
| field_delimiter = ',' | |
| skip_header = 0 | |
| FIELD_OPTIONALLY_ENCLOSED_BY = '"' | |
| NULL_IF=('') | |
| ) files = ('3c21f386-73bb-4717-a0c1-611825089c6f7400967146058415724.csv.gz'); | |
| 2024-07-14 07:53:22 [43mdestination[0m > INFO pool-35-thread-2 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):178 query 6aa1e3ac-e74f-4d28-9704-335e2114b0f2, COPY INTO "airbyte_internal"."XXX_PUBLIC_raw__stream_reg" FROM '@"airbyte_internal"."XXX_PUBLIC_raw__stream_reg"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/' | |
| file_format = ( | |
| type = csv | |
| compression = auto | |
| field_delimiter = ',' | |
| skip_header = 0 | |
| FIELD_OPTIONALLY_ENCLOSED_BY = '"' | |
| NULL_IF=('') | |
| ) files = ('4c7b02e9-936b-4922-9ac2-8cd48f4579158207383228585160042.csv.gz'); | |
| 2024-07-14 07:53:23 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:53:23 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:23 [43mdestination[0m > INFO pool-35-thread-3 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):187 query aaa23f3e-fa89-4185-b60c-60a924dc49aa, successfully loaded 1 rows of data into table | |
| 2024-07-14 07:53:23 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.r.FileBuffer(deleteFile):75 Deleting tempFile data 3c21f386-73bb-4717-a0c1-611825089c6f7400967146058415724.csv.gz | |
| 2024-07-14 07:53:23 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):153 Flushing states | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 16 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 16 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 16 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 16 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 16 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 16 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 16 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 16 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 16 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 16 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 16 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 17 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 17 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 17 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 17 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 17 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 17 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 17 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 17 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 17 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 17 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 18 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 18 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 18 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 18 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 18 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 18 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 18 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 18 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 18 in the stagedStatsList | |
| 2024-07-14 07:53:23 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):207 Flushing states complete | |
| 2024-07-14 07:53:23 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 8944 bytes.. | |
| 2024-07-14 07:53:23 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 566 bytes.. | |
| 2024-07-14 07:53:23 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):170 Flush Worker (d3d60) -- Worker finished flushing. Current queue size: 0 | |
| 2024-07-14 07:53:23 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 07:53:23 [43mdestination[0m > INFO pool-35-thread-2 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):187 query 6aa1e3ac-e74f-4d28-9704-335e2114b0f2, successfully loaded 1 rows of data into table | |
| 2024-07-14 07:53:23 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.r.FileBuffer(deleteFile):75 Deleting tempFile data 4c7b02e9-936b-4922-9ac2-8cd48f4579158207383228585160042.csv.gz | |
| 2024-07-14 07:53:23 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):153 Flushing states | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 19 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 19 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 19 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 19 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 19 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 19 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 19 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 19 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 20 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 20 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 20 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 20 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 20 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 20 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 20 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 21 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 21 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 21 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 21 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 21 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 21 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 22 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 22 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 22 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 22 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 22 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 23 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 23 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 23 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 23 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 24 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 24 in the stagedStatsList | |
| 2024-07-14 07:53:23 [46mreplication-orchestrator[0m > Could not find the state message with id 24 in the stagedStatsList | |
| 2024-07-14 07:53:23 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):207 Flushing states complete | |
| 2024-07-14 07:53:23 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 21995 bytes.. | |
| 2024-07-14 07:53:23 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 521 bytes.. | |
| 2024-07-14 07:53:23 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):170 Flush Worker (90980) -- Worker finished flushing. Current queue size: 0 | |
| 2024-07-14 07:53:33 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:53:43 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:53:53 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:54:03 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:54:13 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:54:17 [43mdestination[0m > INFO pool-34-thread-1 i.a.c.i.d.a.b.BufferManager(printQueueInfo):94 [ASYNC QUEUE INFO] Global: max: 3.75 GB, allocated: 9.95 MB (9.949200630187988 MB), %% used: 0.0025909376641114553 | Queue `act`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `sta`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `pil2`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `reg`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `gue`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `pil`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `fli`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `rou`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | State Manager memory usage: Allocated: 9 MB, Used: -53267 bytes, percentage Used -0.00510587450190477 | |
| 2024-07-14 07:54:17 [43mdestination[0m > INFO pool-37-thread-1 i.a.c.i.d.a.FlushWorkers(printWorkerInfo):127 [ASYNC WORKER INFO] Pool queue size: 0, Active threads: 0 | |
| 2024-07-14 07:54:23 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:54:33 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:54:44 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:54:54 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:55:04 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:55:14 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:55:17 [43mdestination[0m > INFO pool-34-thread-1 i.a.c.i.d.a.b.BufferManager(printQueueInfo):94 [ASYNC QUEUE INFO] Global: max: 3.75 GB, allocated: 9.95 MB (9.949200630187988 MB), %% used: 0.0025909376641114553 | Queue `act`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `sta`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `pil2`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `reg`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `gue`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `pil`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `fli`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `rou`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | State Manager memory usage: Allocated: 9 MB, Used: -53267 bytes, percentage Used -0.00510587450190477 | |
| 2024-07-14 07:55:17 [43mdestination[0m > INFO pool-37-thread-1 i.a.c.i.d.a.FlushWorkers(printWorkerInfo):127 [ASYNC WORKER INFO] Pool queue size: 0, Active threads: 0 | |
| 2024-07-14 07:55:24 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:55:34 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:55:44 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:55:54 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:56:04 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:56:15 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:56:17 [43mdestination[0m > INFO pool-34-thread-1 i.a.c.i.d.a.b.BufferManager(printQueueInfo):94 [ASYNC QUEUE INFO] Global: max: 3.75 GB, allocated: 9.95 MB (9.949200630187988 MB), %% used: 0.0025909376641114553 | Queue `act`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `sta`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `pil2`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `reg`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `gue`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `pil`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `fli`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `rou`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | State Manager memory usage: Allocated: 9 MB, Used: -53267 bytes, percentage Used -0.00510587450190477 | |
| 2024-07-14 07:56:17 [43mdestination[0m > INFO pool-37-thread-1 i.a.c.i.d.a.FlushWorkers(printWorkerInfo):127 [ASYNC WORKER INFO] Pool queue size: 0, Active threads: 0 | |
| 2024-07-14 07:56:25 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:56:35 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:56:45 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:56:55 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:57:05 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:57:16 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:57:17 [43mdestination[0m > INFO pool-34-thread-1 i.a.c.i.d.a.b.BufferManager(printQueueInfo):94 [ASYNC QUEUE INFO] Global: max: 3.75 GB, allocated: 9.95 MB (9.949200630187988 MB), %% used: 0.0025909376641114553 | Queue `act`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `sta`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `pil2`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `reg`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `gue`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `pil`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `fli`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `rou`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | State Manager memory usage: Allocated: 9 MB, Used: -53267 bytes, percentage Used -0.00510587450190477 | |
| 2024-07-14 07:57:17 [43mdestination[0m > INFO pool-37-thread-1 i.a.c.i.d.a.FlushWorkers(printWorkerInfo):127 [ASYNC WORKER INFO] Pool queue size: 0, Active threads: 0 | |
| 2024-07-14 07:57:26 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:57:36 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:57:46 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:57:56 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:58:06 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:58:16 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(logStatistics):323 31 records sent during previous 00:05:13.659, last recorded offset of {server=daw_db} partition is {lsn=20266878376, txId=2778, ts_usec=1720943255016665} | |
| 2024-07-14 07:58:16 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:58:17 [43mdestination[0m > INFO pool-34-thread-1 i.a.c.i.d.a.b.BufferManager(printQueueInfo):94 [ASYNC QUEUE INFO] Global: max: 3.75 GB, allocated: 9.95 MB (9.949200630187988 MB), %% used: 0.0025909376641114553 | Queue `act`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `sta`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `pil2`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `reg`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `gue`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `pil`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `fli`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `rou`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | State Manager memory usage: Allocated: 9 MB, Used: -53267 bytes, percentage Used -0.00510587450190477 | |
| 2024-07-14 07:58:17 [43mdestination[0m > INFO pool-37-thread-1 i.a.c.i.d.a.FlushWorkers(printWorkerInfo):127 [ASYNC WORKER INFO] Pool queue size: 0, Active threads: 0 | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-36-thread-1 i.a.c.i.d.a.DetectStreamToFlush(getNextStreamToFlush):109 flushing: trigger info: null - act, time trigger: true , size trigger: false current threshold b: 200 MB, queue size b: 0 bytes, penalty b: 0 bytes, after penalty b: 0 bytes | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-36-thread-1 i.a.c.i.d.a.DetectStreamToFlush(getNextStreamToFlush):109 flushing: trigger info: null - fli, time trigger: true , size trigger: false current threshold b: 200 MB, queue size b: 0 bytes, penalty b: 0 bytes, after penalty b: 0 bytes | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):135 Flush Worker (ac48a) -- Worker picked up work. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):141 Flush Worker (ac48a) -- Attempting to read from queue namespace: null, stream: act. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):135 Flush Worker (a54cd) -- Worker picked up work. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-36-thread-1 i.a.c.i.d.a.DetectStreamToFlush(getNextStreamToFlush):109 flushing: trigger info: null - pil2, time trigger: true , size trigger: false current threshold b: 200 MB, queue size b: 0 bytes, penalty b: 0 bytes, after penalty b: 0 bytes | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):141 Flush Worker (a54cd) -- Attempting to read from queue namespace: null, stream: fli. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):159 Flush Worker (ac48a) -- Batch contains: 0 records, 0 bytes bytes. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-36-thread-1 i.a.c.i.d.a.DetectStreamToFlush(getNextStreamToFlush):109 flushing: trigger info: null - rou, time trigger: true , size trigger: false current threshold b: 200 MB, queue size b: 0 bytes, penalty b: 0 bytes, after penalty b: 0 bytes | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):135 Flush Worker (aff7a) -- Worker picked up work. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):159 Flush Worker (a54cd) -- Batch contains: 0 records, 0 bytes bytes. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):141 Flush Worker (aff7a) -- Attempting to read from queue namespace: null, stream: pil2. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):135 Flush Worker (97c65) -- Worker picked up work. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-36-thread-1 i.a.c.i.d.a.DetectStreamToFlush(getNextStreamToFlush):109 flushing: trigger info: null - sta, time trigger: true , size trigger: false current threshold b: 200 MB, queue size b: 0 bytes, penalty b: 0 bytes, after penalty b: 0 bytes | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):159 Flush Worker (aff7a) -- Batch contains: 0 records, 0 bytes bytes. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):141 Flush Worker (97c65) -- Attempting to read from queue namespace: null, stream: rou. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):135 Flush Worker (45fc5) -- Worker picked up work. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):141 Flush Worker (45fc5) -- Attempting to read from queue namespace: null, stream: sta. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):159 Flush Worker (97c65) -- Batch contains: 0 records, 0 bytes bytes. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):159 Flush Worker (45fc5) -- Batch contains: 0 records, 0 bytes bytes. | |
| 2024-07-14 07:58:20 [43mdestination[0m > WARN pool-35-thread-3 i.a.c.i.d.s.c.CsvSerializedBuffer(flushWriter):95 Trying to flush but no printer is initialized. | |
| 2024-07-14 07:58:20 [43mdestination[0m > WARN pool-35-thread-5 i.a.c.i.d.s.c.CsvSerializedBuffer(flushWriter):95 Trying to flush but no printer is initialized. | |
| 2024-07-14 07:58:20 [43mdestination[0m > WARN pool-35-thread-2 i.a.c.i.d.s.c.CsvSerializedBuffer(flushWriter):95 Trying to flush but no printer is initialized. | |
| 2024-07-14 07:58:20 [43mdestination[0m > WARN pool-35-thread-1 i.a.c.i.d.s.c.CsvSerializedBuffer(flushWriter):95 Trying to flush but no printer is initialized. | |
| 2024-07-14 07:58:20 [43mdestination[0m > WARN pool-35-thread-4 i.a.c.i.d.s.c.CsvSerializedBuffer(flushWriter):95 Trying to flush but no printer is initialized. | |
| 2024-07-14 07:58:20 [43mdestination[0m > WARN pool-35-thread-4 i.a.c.i.d.s.c.CsvSerializedBuffer(closeWriter):106 Trying to close but no printer is initialized. | |
| 2024-07-14 07:58:20 [43mdestination[0m > WARN pool-35-thread-5 i.a.c.i.d.s.c.CsvSerializedBuffer(closeWriter):106 Trying to close but no printer is initialized. | |
| 2024-07-14 07:58:20 [43mdestination[0m > WARN pool-35-thread-2 i.a.c.i.d.s.c.CsvSerializedBuffer(closeWriter):106 Trying to close but no printer is initialized. | |
| 2024-07-14 07:58:20 [43mdestination[0m > WARN pool-35-thread-3 i.a.c.i.d.s.c.CsvSerializedBuffer(closeWriter):106 Trying to close but no printer is initialized. | |
| 2024-07-14 07:58:20 [43mdestination[0m > WARN pool-35-thread-1 i.a.c.i.d.s.c.CsvSerializedBuffer(closeWriter):106 Trying to close but no printer is initialized. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.r.BaseSerializedBuffer(flush):162 Finished writing data to f0906d9e-6f69-46a8-b46e-9e570661c80010433316818515432357.csv.gz (0 bytes) | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.r.BaseSerializedBuffer(flush):162 Finished writing data to f6ba2238-24e5-4dcd-b9bc-961c2de390c68652765118102136908.csv.gz (0 bytes) | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.r.BaseSerializedBuffer(flush):162 Finished writing data to 4122ddcb-0c2c-4203-bb32-17e6b0de117a8786385883814170499.csv.gz (0 bytes) | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):54 Buffer flush complete for stream fli (0 bytes) to staging | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.r.BaseSerializedBuffer(flush):162 Finished writing data to dac0d343-b5bf-453f-8bc8-75c05be9d9ca8709606376244985174.csv.gz (0 bytes) | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.r.BaseSerializedBuffer(flush):162 Finished writing data to 66e11e65-c986-4e46-b4ba-b4ee5028d71e12026897085893520028.csv.gz (0 bytes) | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):54 Buffer flush complete for stream sta (0 bytes) to staging | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):54 Buffer flush complete for stream rou (0 bytes) to staging | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):54 Buffer flush complete for stream pil2 (0 bytes) to staging | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):54 Buffer flush complete for stream act (0 bytes) to staging | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):60 Skipping writing to storage since there are no bytes to write | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):60 Skipping writing to storage since there are no bytes to write | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):60 Skipping writing to storage since there are no bytes to write | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):60 Skipping writing to storage since there are no bytes to write | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):60 Skipping writing to storage since there are no bytes to write | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.r.FileBuffer(deleteFile):75 Deleting tempFile data 66e11e65-c986-4e46-b4ba-b4ee5028d71e12026897085893520028.csv.gz | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.r.FileBuffer(deleteFile):75 Deleting tempFile data f0906d9e-6f69-46a8-b46e-9e570661c80010433316818515432357.csv.gz | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.r.FileBuffer(deleteFile):75 Deleting tempFile data dac0d343-b5bf-453f-8bc8-75c05be9d9ca8709606376244985174.csv.gz | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.r.FileBuffer(deleteFile):75 Deleting tempFile data 4122ddcb-0c2c-4203-bb32-17e6b0de117a8786385883814170499.csv.gz | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):153 Flushing states | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):153 Flushing states | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.r.FileBuffer(deleteFile):75 Deleting tempFile data f6ba2238-24e5-4dcd-b9bc-961c2de390c68652765118102136908.csv.gz | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):153 Flushing states | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):153 Flushing states | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):207 Flushing states complete | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):207 Flushing states complete | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):207 Flushing states complete | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):153 Flushing states | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):207 Flushing states complete | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):207 Flushing states complete | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):170 Flush Worker (97c65) -- Worker finished flushing. Current queue size: 0 | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):170 Flush Worker (a54cd) -- Worker finished flushing. Current queue size: 0 | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):170 Flush Worker (ac48a) -- Worker finished flushing. Current queue size: 0 | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):170 Flush Worker (aff7a) -- Worker finished flushing. Current queue size: 0 | |
| 2024-07-14 07:58:20 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):170 Flush Worker (45fc5) -- Worker finished flushing. Current queue size: 0 | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-36-thread-1 i.a.c.i.d.a.DetectStreamToFlush(getNextStreamToFlush):109 flushing: trigger info: null - gue, time trigger: true , size trigger: false current threshold b: 200 MB, queue size b: 0 bytes, penalty b: 0 bytes, after penalty b: 0 bytes | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):135 Flush Worker (0e422) -- Worker picked up work. | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-36-thread-1 i.a.c.i.d.a.DetectStreamToFlush(getNextStreamToFlush):109 flushing: trigger info: null - pil, time trigger: true , size trigger: false current threshold b: 200 MB, queue size b: 0 bytes, penalty b: 0 bytes, after penalty b: 0 bytes | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):141 Flush Worker (0e422) -- Attempting to read from queue namespace: null, stream: gue. | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):135 Flush Worker (39b98) -- Worker picked up work. | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-36-thread-1 i.a.c.i.d.a.DetectStreamToFlush(getNextStreamToFlush):109 flushing: trigger info: null - reg, time trigger: true , size trigger: false current threshold b: 200 MB, queue size b: 0 bytes, penalty b: 0 bytes, after penalty b: 0 bytes | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):141 Flush Worker (39b98) -- Attempting to read from queue namespace: null, stream: pil. | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):159 Flush Worker (0e422) -- Batch contains: 0 records, 0 bytes bytes. | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):135 Flush Worker (6ea1a) -- Worker picked up work. | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):141 Flush Worker (6ea1a) -- Attempting to read from queue namespace: null, stream: reg. | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):159 Flush Worker (39b98) -- Batch contains: 0 records, 0 bytes bytes. | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:22 [43mdestination[0m > WARN pool-35-thread-3 i.a.c.i.d.s.c.CsvSerializedBuffer(flushWriter):95 Trying to flush but no printer is initialized. | |
| 2024-07-14 07:58:22 [43mdestination[0m > WARN pool-35-thread-3 i.a.c.i.d.s.c.CsvSerializedBuffer(closeWriter):106 Trying to close but no printer is initialized. | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):159 Flush Worker (6ea1a) -- Batch contains: 0 records, 0 bytes bytes. | |
| 2024-07-14 07:58:22 [43mdestination[0m > WARN pool-35-thread-4 i.a.c.i.d.s.c.CsvSerializedBuffer(flushWriter):95 Trying to flush but no printer is initialized. | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.r.BaseSerializedBuffer(flush):162 Finished writing data to 1b4e8205-e645-4359-9ec3-6d8f1666b8387506824175926334861.csv.gz (0 bytes) | |
| 2024-07-14 07:58:22 [43mdestination[0m > WARN pool-35-thread-4 i.a.c.i.d.s.c.CsvSerializedBuffer(closeWriter):106 Trying to close but no printer is initialized. | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):54 Buffer flush complete for stream gue (0 bytes) to staging | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.r.BaseSerializedBuffer(flush):162 Finished writing data to 13518c74-6003-4166-a167-0f21baaedd2315255539735912856951.csv.gz (0 bytes) | |
| 2024-07-14 07:58:22 [43mdestination[0m > WARN pool-35-thread-1 i.a.c.i.d.s.c.CsvSerializedBuffer(flushWriter):95 Trying to flush but no printer is initialized. | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):60 Skipping writing to storage since there are no bytes to write | |
| 2024-07-14 07:58:22 [43mdestination[0m > WARN pool-35-thread-1 i.a.c.i.d.s.c.CsvSerializedBuffer(closeWriter):106 Trying to close but no printer is initialized. | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.r.FileBuffer(deleteFile):75 Deleting tempFile data 1b4e8205-e645-4359-9ec3-6d8f1666b8387506824175926334861.csv.gz | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):54 Buffer flush complete for stream pil (0 bytes) to staging | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.r.BaseSerializedBuffer(flush):162 Finished writing data to d0da3221-4315-4bdd-9682-b4b44ce94c549701783153830967449.csv.gz (0 bytes) | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):60 Skipping writing to storage since there are no bytes to write | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):54 Buffer flush complete for stream reg (0 bytes) to staging | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):153 Flushing states | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):60 Skipping writing to storage since there are no bytes to write | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.r.FileBuffer(deleteFile):75 Deleting tempFile data 13518c74-6003-4166-a167-0f21baaedd2315255539735912856951.csv.gz | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):207 Flushing states complete | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.r.FileBuffer(deleteFile):75 Deleting tempFile data d0da3221-4315-4bdd-9682-b4b44ce94c549701783153830967449.csv.gz | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):153 Flushing states | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):207 Flushing states complete | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):153 Flushing states | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):170 Flush Worker (0e422) -- Worker finished flushing. Current queue size: 0 | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):207 Flushing states complete | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):170 Flush Worker (39b98) -- Worker finished flushing. Current queue size: 0 | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 07:58:22 [43mdestination[0m > INFO pool-35-thread-1 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):170 Flush Worker (6ea1a) -- Worker finished flushing. Current queue size: 0 | |
| 2024-07-14 07:58:26 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:58:36 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:58:46 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:58:57 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:59:07 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:59:17 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:59:17 [43mdestination[0m > INFO pool-34-thread-1 i.a.c.i.d.a.b.BufferManager(printQueueInfo):94 [ASYNC QUEUE INFO] Global: max: 3.75 GB, allocated: 9.95 MB (9.949200630187988 MB), %% used: 0.0025909376641114553 | Queue `act`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `sta`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `pil2`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `reg`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `gue`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `pil`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `fli`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `rou`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | State Manager memory usage: Allocated: 9 MB, Used: -53267 bytes, percentage Used -0.00510587450190477 | |
| 2024-07-14 07:59:17 [43mdestination[0m > INFO pool-37-thread-1 i.a.c.i.d.a.FlushWorkers(printWorkerInfo):127 [ASYNC WORKER INFO] Pool queue size: 0, Active threads: 0 | |
| 2024-07-14 07:59:27 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:59:37 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:59:47 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 07:59:57 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 08:00:07 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 08:00:17 [43mdestination[0m > INFO pool-34-thread-1 i.a.c.i.d.a.b.BufferManager(printQueueInfo):94 [ASYNC QUEUE INFO] Global: max: 3.75 GB, allocated: 9.95 MB (9.949200630187988 MB), %% used: 0.0025909376641114553 | Queue `act`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `sta`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `pil2`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `reg`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `gue`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `pil`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `fli`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | Queue `rou`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | State Manager memory usage: Allocated: 9 MB, Used: -53267 bytes, percentage Used -0.00510587450190477 | |
| 2024-07-14 08:00:17 [43mdestination[0m > INFO pool-37-thread-1 i.a.c.i.d.a.FlushWorkers(printWorkerInfo):127 [ASYNC WORKER INFO] Pool queue size: 0, Active threads: 0 | |
| 2024-07-14 08:00:17 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.AirbyteDebeziumHandler$CapacityReportingBlockingQueue(reportQueueUtilization):49 CDC events queue size: 0. remaining 10000 | |
| 2024-07-14 08:00:25 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCdcTargetPosition(reachedTargetPosition):70 Signalling close because record's LSN : PgLsn{lsn=20468204464} is after target LSN : PgLsn{lsn=20266878472} | |
| 2024-07-14 08:00:25 [44msource[0m > INFO main i.a.c.i.d.i.DebeziumRecordIterator(requestClose):215 Closing: Change event reached target position | |
| 2024-07-14 08:00:25 [44msource[0m > INFO main i.d.e.EmbeddedEngine(stop):957 Stopping the embedded engine | |
| 2024-07-14 08:00:25 [44msource[0m > INFO main i.d.e.EmbeddedEngine(stop):964 Waiting for PT5M for connector to stop | |
| 2024-07-14 08:00:25 [46mreplication-orchestrator[0m > SOURCE analytics [airbyte/source-postgres:3.4.24] | Type: db-sources-debezium-close-reason | Value: CHANGE_EVENT_REACHED_TARGET_POSITION | |
| 2024-07-14 08:00:26 [44msource[0m > INFO pool-5-thread-1 i.d.e.EmbeddedEngine(stopTaskAndCommitOffset):765 Stopping the task and engine | |
| 2024-07-14 08:00:26 [44msource[0m > INFO pool-5-thread-1 i.d.c.c.BaseSourceTask(stop):406 Stopping down connector | |
| 2024-07-14 08:00:26 [44msource[0m > INFO pool-9-thread-1 i.d.j.JdbcConnection(lambda$doClose$4):952 Connection gracefully closed | |
| 2024-07-14 08:00:26 [44msource[0m > INFO pool-10-thread-1 i.d.j.JdbcConnection(lambda$doClose$4):952 Connection gracefully closed | |
| 2024-07-14 08:00:26 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.p.ChangeEventSourceCoordinator(streamEvents):281 Finished streaming | |
| 2024-07-14 08:00:26 [44msource[0m > INFO debezium-postgresconnector-daw_db-change-event-source-coordinator i.d.p.ChangeEventSourceCoordinator(streamingConnected):433 Connected metrics set to 'false' | |
| 2024-07-14 08:00:26 [44msource[0m > INFO pool-5-thread-1 i.d.p.s.SignalProcessor(stop):127 SignalProcessor stopped | |
| 2024-07-14 08:00:26 [44msource[0m > INFO pool-11-thread-1 i.d.j.JdbcConnection(lambda$doClose$4):952 Connection gracefully closed | |
| 2024-07-14 08:00:26 [44msource[0m > INFO pool-5-thread-1 i.d.s.DefaultServiceRegistry(close):105 Debezium ServiceRegistry stopped. | |
| 2024-07-14 08:00:26 [44msource[0m > INFO pool-12-thread-1 i.d.j.JdbcConnection(lambda$doClose$4):952 Connection gracefully closed | |
| 2024-07-14 08:00:26 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.i.DebeziumRecordPublisher$start$3(taskStopped):91 DebeziumEngine notify: task stopped | |
| 2024-07-14 08:00:26 [44msource[0m > INFO pool-5-thread-1 o.a.k.c.s.FileOffsetBackingStore(stop):71 Stopped FileOffsetBackingStore | |
| 2024-07-14 08:00:26 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.i.DebeziumRecordPublisher$start$3(connectorStopped):83 DebeziumEngine notify: connector stopped | |
| 2024-07-14 08:00:26 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.i.DebeziumRecordPublisher(start$lambda$1):60 Debezium engine shutdown. Engine terminated successfully : true | |
| 2024-07-14 08:00:26 [44msource[0m > INFO pool-5-thread-1 i.a.c.i.d.i.DebeziumRecordPublisher(start$lambda$1):63 Connector 'io.debezium.connector.postgresql.PostgresConnector' completed normally. | |
| 2024-07-14 08:00:26 [44msource[0m > INFO main i.a.i.s.p.c.PostgresCdcStateHandler(saveState):38 debezium state: {"[\"daw_db\",{\"server\":\"daw_db\"}]":"{\"lsn_proc\":20468219312,\"messageType\":\"INSERT\",\"lsn_commit\":20468217264,\"lsn\":20468219312,\"txId\":2875,\"ts_usec\":1720944025264710}"} | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:act | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:asy | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:bag | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:config | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:con1 | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:con2 | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:con3 | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:daw | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:dri | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:fli | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:gue | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:gue2 | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:off | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:ope | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:pil | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:pil2 | |
| 2024-07-14 08:00:26 [44msource[0m > INFO main i.a.c.i.s.r.AbstractDbSource(read$lambda$5):178 Closing database connection pool. | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:pur | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:reg | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:rid | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:rou | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:sta | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:ter | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:tri | |
| 2024-07-14 08:00:26 [44msource[0m > INFO main c.z.h.HikariDataSource(close):349 HikariPool-1 - Shutdown initiated... | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:tri2 | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:veh | |
| 2024-07-14 08:00:26 [46mreplication-orchestrator[0m > Stream status TRACE received of status: COMPLETE for stream public:veh_type | |
| 2024-07-14 08:00:26 [44msource[0m > INFO main c.z.h.HikariDataSource(close):351 HikariPool-1 - Shutdown completed. | |
| 2024-07-14 08:00:26 [44msource[0m > INFO main i.a.c.i.s.r.AbstractDbSource(read$lambda$5):180 Closed database connection pool. | |
| 2024-07-14 08:00:26 [44msource[0m > INFO main i.a.c.i.b.IntegrationRunner(runInternal):269 Completed integration: io.airbyte.cdk.integrations.base.ssh.SshWrappedSource | |
| 2024-07-14 08:00:26 [44msource[0m > INFO main i.a.i.s.p.PostgresSource(main):693 completed source: class io.airbyte.integrations.source.postgres.PostgresSource | |
| 2024-07-14 08:00:27 [46mreplication-orchestrator[0m > (pod: production-hm-airbyte / source-postgres-read-923-0-nkxaa) - Closed all resources for pod | |
| 2024-07-14 08:00:27 [46mreplication-orchestrator[0m > Total records read: 138 (28 KB) | |
| 2024-07-14 08:00:27 [46mreplication-orchestrator[0m > Schema validation was performed to a max of 10 records with errors per stream. | |
| 2024-07-14 08:00:27 [46mreplication-orchestrator[0m > Schema validation errors found for stream public_veh. Error messages: [$._ab_cdc_deleted_at: null found, string expected] | |
| 2024-07-14 08:00:27 [46mreplication-orchestrator[0m > Schema validation errors found for stream public_fli. Error messages: [$._ab_cdc_deleted_at: null found, string expected, $.forefli_id: null found, string expected] | |
| 2024-07-14 08:00:27 [46mreplication-orchestrator[0m > Schema validation errors found for stream public_sta. Error messages: [$._ab_cdc_deleted_at: null found, string expected] | |
| 2024-07-14 08:00:27 [46mreplication-orchestrator[0m > Schema validation errors found for stream public_rou. Error messages: [$._ab_cdc_deleted_at: null found, string expected] | |
| 2024-07-14 08:00:27 [46mreplication-orchestrator[0m > Schema validation errors found for stream public_act. Error messages: [$._ab_cdc_deleted_at: null found, string expected, $.actual_ts: null found, string expected] | |
| 2024-07-14 08:00:27 [46mreplication-orchestrator[0m > Schema validation errors found for stream public_pil2. Error messages: [$._ab_cdc_deleted_at: null found, string expected] | |
| 2024-07-14 08:00:27 [46mreplication-orchestrator[0m > Schema validation errors found for stream public_gue. Error messages: [$.birth_date: null found, string expected, $.signed_tos_id: null found, number expected, $._ab_cdc_deleted_at: null found, string expected, $.cognito_google_sub: null found, string expected, $.cognito_native_sub: null found, string expected] | |
| 2024-07-14 08:00:27 [46mreplication-orchestrator[0m > Schema validation errors found for stream public_reg. Error messages: [$._ab_cdc_deleted_at: null found, string expected] | |
| 2024-07-14 08:00:27 [46mreplication-orchestrator[0m > Schema validation errors found for stream public_pil. Error messages: [$._ab_cdc_deleted_at: null found, string expected] | |
| 2024-07-14 08:00:27 [46mreplication-orchestrator[0m > Schema validation errors found for stream public_veh_type. Error messages: [$._ab_cdc_deleted_at: null found, string expected] | |
| 2024-07-14 08:00:27 [46mreplication-orchestrator[0m > readFromSource: done. (source.isFinished:true, fromSource.isClosed:false) | |
| 2024-07-14 08:00:27 [46mreplication-orchestrator[0m > thread status... heartbeat thread: false , replication thread: true | |
| 2024-07-14 08:00:27 [46mreplication-orchestrator[0m > processMessage: done. (fromSource.isDone:true, forDest.isClosed:false) | |
| 2024-07-14 08:00:27 [46mreplication-orchestrator[0m > writeToDestination: done. (forDest.isDone:true, isDestRunning:true) | |
| 2024-07-14 08:00:27 [46mreplication-orchestrator[0m > thread status... timeout thread: false , replication thread: true | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO main i.a.c.i.b.IntegrationRunner$Companion(consumeWriteStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_core):446 Finished buffered read of input stream | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO main i.a.c.i.d.a.FlushWorkers(close):193 Closing flush workers -- waiting for all buffers to flush | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO main i.a.c.i.d.a.FlushWorkers(close):226 REMAINING_BUFFERS_INFO | |
| Namespace: null Stream: act -- remaining records: 16 Namespace: null Stream: veh -- remaining records: 3 Namespace: null Stream: fli -- remaining records: 4 Namespace: null Stream: veh_type -- remaining records: 1 | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO main i.a.c.i.d.a.FlushWorkers(close):227 Waiting for all streams to flush. | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-36-thread-1 i.a.c.i.d.a.DetectStreamToFlush(getNextStreamToFlush):109 flushing: trigger info: null - act, time trigger: false , size trigger: true current threshold b: 0 bytes, queue size b: 9.33 KB, penalty b: 0 bytes, after penalty b: 9.33 KB | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):135 Flush Worker (20a1a) -- Worker picked up work. | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-36-thread-1 i.a.c.i.d.a.DetectStreamToFlush(getNextStreamToFlush):109 flushing: trigger info: null - fli, time trigger: false , size trigger: true current threshold b: 0 bytes, queue size b: 3.98 KB, penalty b: 0 bytes, after penalty b: 3.98 KB | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):141 Flush Worker (20a1a) -- Attempting to read from queue namespace: null, stream: act. | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):135 Flush Worker (2f07d) -- Worker picked up work. | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-36-thread-1 i.a.c.i.d.a.DetectStreamToFlush(getNextStreamToFlush):109 flushing: trigger info: null - veh, time trigger: false , size trigger: true current threshold b: 0 bytes, queue size b: 2.74 KB, penalty b: 0 bytes, after penalty b: 2.74 KB | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 10476208 bytes.. | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):141 Flush Worker (2f07d) -- Attempting to read from queue namespace: null, stream: fli. | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-36-thread-1 i.a.c.i.d.a.DetectStreamToFlush(getNextStreamToFlush):109 flushing: trigger info: null - veh_type, time trigger: false , size trigger: true current threshold b: 0 bytes, queue size b: 536 bytes, penalty b: 0 bytes, after penalty b: 536 bytes | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):135 Flush Worker (da2a7) -- Worker picked up work. | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 10481688 bytes.. | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):159 Flush Worker (20a1a) -- Batch contains: 16 records, 9.33 KB bytes. | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):141 Flush Worker (da2a7) -- Attempting to read from queue namespace: null, stream: veh. | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):135 Flush Worker (f3686) -- Worker picked up work. | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 10482956 bytes.. | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):141 Flush Worker (f3686) -- Attempting to read from queue namespace: null, stream: veh_type. | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):159 Flush Worker (2f07d) -- Batch contains: 4 records, 3.98 KB bytes. | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 10485224 bytes.. | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):159 Flush Worker (da2a7) -- Batch contains: 3 records, 2.74 KB bytes. | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):159 Flush Worker (f3686) -- Batch contains: 1 records, 536 bytes bytes. | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.r.BaseSerializedBuffer(flush):162 Finished writing data to 2052e56e-1d03-4a92-8566-ba2c089231d413095649559752078282.csv.gz (308 bytes) | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):54 Buffer flush complete for stream veh_type (308 bytes) to staging | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.r.BaseSerializedBuffer(flush):162 Finished writing data to fcd79bc0-f6a7-4490-bcae-59eab52e6df617683070543494687811.csv.gz (643 bytes) | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.r.BaseSerializedBuffer(flush):162 Finished writing data to 1ad5871d-28e0-48f3-8670-1df6e187653c15152610063965667755.csv.gz (1 KB) | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-4 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):84 executing query a1a57934-3230-4bbe-bcf3-798489f4a703, PUT file:///tmp/2052e56e-1d03-4a92-8566-ba2c089231d413095649559752078282.csv.gz @"airbyte_internal"."XXX_PUBLIC_raw__stream_veh_type"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ PARALLEL = 4; | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):54 Buffer flush complete for stream veh (643 bytes) to staging | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):54 Buffer flush complete for stream fli (1 KB) to staging | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-3 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):84 executing query 20124371-7a39-45be-a93f-01de55195d73, PUT file:///tmp/fcd79bc0-f6a7-4490-bcae-59eab52e6df617683070543494687811.csv.gz @"airbyte_internal"."XXX_PUBLIC_raw__stream_veh"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ PARALLEL = 4; | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-5 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):84 executing query 2fddfe41-59a2-41e8-a9d3-ee0a8e044aa2, PUT file:///tmp/1ad5871d-28e0-48f3-8670-1df6e187653c15152610063965667755.csv.gz @"airbyte_internal"."XXX_PUBLIC_raw__stream_fli"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ PARALLEL = 4; | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.r.BaseSerializedBuffer(flush):162 Finished writing data to f1043f21-512c-4aa7-b4dc-d9618f7c31be2301044702242046528.csv.gz (1 KB) | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.s.o.StagingStreamOperations(writeRecordsImpl):54 Buffer flush complete for stream act (1 KB) to staging | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-2 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):84 executing query c62d608b-804e-4bb9-b863-f4ee8f8f1895, PUT file:///tmp/f1043f21-512c-4aa7-b4dc-d9618f7c31be2301044702242046528.csv.gz @"airbyte_internal"."XXX_PUBLIC_raw__stream_act"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ PARALLEL = 4; | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-2 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):94 query c62d608b-804e-4bb9-b863-f4ee8f8f1895, completed with [{"source":"f1043f21-512c-4aa7-b4dc-d9618f7c31be2301044702242046528.csv.gz","target":"f1043f21-512c-4aa7-b4dc-d9618f7c31be2301044702242046528.csv.gz","source_size":1265,"target_size":1265,"source_compression":"GZIP","target_compression":"GZIP","status":"UPLOADED","encryption":"","message":""}] | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-5 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):94 query 2fddfe41-59a2-41e8-a9d3-ee0a8e044aa2, completed with [{"source":"1ad5871d-28e0-48f3-8670-1df6e187653c15152610063965667755.csv.gz","target":"1ad5871d-28e0-48f3-8670-1df6e187653c15152610063965667755.csv.gz","source_size":1139,"target_size":1139,"source_compression":"GZIP","target_compression":"GZIP","status":"UPLOADED","encryption":"","message":""}] | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-3 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):94 query 20124371-7a39-45be-a93f-01de55195d73, completed with [{"source":"fcd79bc0-f6a7-4490-bcae-59eab52e6df617683070543494687811.csv.gz","target":"fcd79bc0-f6a7-4490-bcae-59eab52e6df617683070543494687811.csv.gz","source_size":643,"target_size":643,"source_compression":"GZIP","target_compression":"GZIP","status":"UPLOADED","encryption":"","message":""}] | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-4 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToBucket):94 query a1a57934-3230-4bbe-bcf3-798489f4a703, completed with [{"source":"2052e56e-1d03-4a92-8566-ba2c089231d413095649559752078282.csv.gz","target":"2052e56e-1d03-4a92-8566-ba2c089231d413095649559752078282.csv.gz","source_size":308,"target_size":308,"source_compression":"GZIP","target_compression":"GZIP","status":"UPLOADED","encryption":"","message":""}] | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-2 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToStage):70 Successfully loaded records to stage 2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ with 0 re-attempt(s) | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-5 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToStage):70 Successfully loaded records to stage 2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ with 0 re-attempt(s) | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-2 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):178 query 84cc5d2e-15dd-406b-a826-ada6dc0d1795, COPY INTO "airbyte_internal"."XXX_PUBLIC_raw__stream_act" FROM '@"airbyte_internal"."XXX_PUBLIC_raw__stream_act"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/' | |
| file_format = ( | |
| type = csv | |
| compression = auto | |
| field_delimiter = ',' | |
| skip_header = 0 | |
| FIELD_OPTIONALLY_ENCLOSED_BY = '"' | |
| NULL_IF=('') | |
| ) files = ('f1043f21-512c-4aa7-b4dc-d9618f7c31be2301044702242046528.csv.gz'); | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-5 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):178 query 36b53710-0f5d-47a1-9f4e-263da5fdb8cb, COPY INTO "airbyte_internal"."XXX_PUBLIC_raw__stream_fli" FROM '@"airbyte_internal"."XXX_PUBLIC_raw__stream_fli"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/' | |
| file_format = ( | |
| type = csv | |
| compression = auto | |
| field_delimiter = ',' | |
| skip_header = 0 | |
| FIELD_OPTIONALLY_ENCLOSED_BY = '"' | |
| NULL_IF=('') | |
| ) files = ('1ad5871d-28e0-48f3-8670-1df6e187653c15152610063965667755.csv.gz'); | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-3 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToStage):70 Successfully loaded records to stage 2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ with 0 re-attempt(s) | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-3 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):178 query 4922dd38-ab4f-49a6-8f24-677f360c6feb, COPY INTO "airbyte_internal"."XXX_PUBLIC_raw__stream_veh" FROM '@"airbyte_internal"."XXX_PUBLIC_raw__stream_veh"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/' | |
| file_format = ( | |
| type = csv | |
| compression = auto | |
| field_delimiter = ',' | |
| skip_header = 0 | |
| FIELD_OPTIONALLY_ENCLOSED_BY = '"' | |
| NULL_IF=('') | |
| ) files = ('fcd79bc0-f6a7-4490-bcae-59eab52e6df617683070543494687811.csv.gz'); | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-4 i.a.i.d.s.o.SnowflakeStagingClient(uploadRecordsToStage):70 Successfully loaded records to stage 2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/ with 0 re-attempt(s) | |
| 2024-07-14 08:00:28 [43mdestination[0m > INFO pool-35-thread-4 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):178 query 4435bb70-0c49-435e-a111-1b9992af64f0, COPY INTO "airbyte_internal"."XXX_PUBLIC_raw__stream_veh_type" FROM '@"airbyte_internal"."XXX_PUBLIC_raw__stream_veh_type"/2024/07/14/07/FDF8859E-D2A1-4272-811B-C3DD3234B3BD/' | |
| file_format = ( | |
| type = csv | |
| compression = auto | |
| field_delimiter = ',' | |
| skip_header = 0 | |
| FIELD_OPTIONALLY_ENCLOSED_BY = '"' | |
| NULL_IF=('') | |
| ) files = ('2052e56e-1d03-4a92-8566-ba2c089231d413095649559752078282.csv.gz'); | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO main i.a.c.i.d.a.FlushWorkers(close):230 Closing flush workers -- all buffers flushed | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO main i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):153 Flushing states | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Could not find the state message with id 25 in the stagedStatsList | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Could not find the state message with id 25 in the stagedStatsList | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO main i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):207 Flushing states complete | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO main i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 4202 bytes.. | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO main i.a.c.i.d.a.FlushWorkers(close):238 Closing flush workers -- supervisor shut down | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO main i.a.c.i.d.a.FlushWorkers(close):240 Closing flush workers -- Starting worker pool shutdown.. | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-4 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):187 query 4435bb70-0c49-435e-a111-1b9992af64f0, successfully loaded 1 rows of data into table | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.r.FileBuffer(deleteFile):75 Deleting tempFile data 2052e56e-1d03-4a92-8566-ba2c089231d413095649559752078282.csv.gz | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):153 Flushing states | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):207 Flushing states complete | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 536 bytes.. | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-4 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):170 Flush Worker (f3686) -- Worker finished flushing. Current queue size: 0 | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-5 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):187 query 36b53710-0f5d-47a1-9f4e-263da5fdb8cb, successfully loaded 4 rows of data into table | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.r.FileBuffer(deleteFile):75 Deleting tempFile data 1ad5871d-28e0-48f3-8670-1df6e187653c15152610063965667755.csv.gz | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):153 Flushing states | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):207 Flushing states complete | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 0 bytes.. | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 4072 bytes.. | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-5 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):170 Flush Worker (2f07d) -- Worker finished flushing. Current queue size: 0 | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-3 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):187 query 4922dd38-ab4f-49a6-8f24-677f360c6feb, successfully loaded 3 rows of data into table | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.r.FileBuffer(deleteFile):75 Deleting tempFile data fcd79bc0-f6a7-4490-bcae-59eab52e6df617683070543494687811.csv.gz | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):153 Flushing states | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Could not find the state message with id 26 in the stagedStatsList | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):207 Flushing states complete | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 8861 bytes.. | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 2804 bytes.. | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-3 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):170 Flush Worker (da2a7) -- Worker finished flushing. Current queue size: 0 | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):126 closing connection | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-2 i.a.i.d.s.o.SnowflakeStagingClient(copyIntoTableFromStage):187 query 84cc5d2e-15dd-406b-a826-ada6dc0d1795, successfully loaded 16 rows of data into table | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.r.FileBuffer(deleteFile):75 Deleting tempFile data f1043f21-512c-4aa7-b4dc-d9618f7c31be2301044702242046528.csv.gz | |
| 2024-07-14 08:00:29 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):153 Flushing states | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Destination complete for GLOBAL | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Stream Status Update Received: public:config - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Updating status: public:config - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Stream Status Update Received: public:rid - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Updating status: public:rid - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Stream Status Update Received: public:gue - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Updating status: public:gue - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Stream Status Update Received: public:pil2 - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Updating status: public:pil2 - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Stream Status Update Received: public:asy - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Updating status: public:asy - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Stream Status Update Received: public:daw - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Updating status: public:daw - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Stream Status Update Received: public:fli - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Updating status: public:fli - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Stream Status Update Received: public:sta - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Updating status: public:sta - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Stream Status Update Received: public:tri2 - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Updating status: public:tri2 - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Stream Status Update Received: public:off - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Updating status: public:off - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Stream Status Update Received: public:veh_type - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Updating status: public:veh_type - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Stream Status Update Received: public:dri - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Updating status: public:dri - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Stream Status Update Received: public:pur - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Updating status: public:pur - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Stream Status Update Received: public:con1 - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Updating status: public:con1 - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Stream Status Update Received: public:reg - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Updating status: public:reg - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Stream Status Update Received: public:bag - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Updating status: public:bag - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Stream Status Update Received: public:gue2 - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Updating status: public:gue2 - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Stream Status Update Received: public:con2 - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Updating status: public:con2 - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Stream Status Update Received: public:rou - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Updating status: public:rou - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Stream Status Update Received: public:tri - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Updating status: public:tri - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Stream Status Update Received: public:ter - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Updating status: public:ter - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Stream Status Update Received: public:con3 - COMPLETE | |
| 2024-07-14 08:00:29 [46mreplication-orchestrator[0m > Updating status: public:con3 - COMPLETE | |
| 2024-07-14 08:00:30 [46mreplication-orchestrator[0m > Stream Status Update Received: public:act - COMPLETE | |
| 2024-07-14 08:00:30 [46mreplication-orchestrator[0m > Updating status: public:act - COMPLETE | |
| 2024-07-14 08:00:30 [46mreplication-orchestrator[0m > Stream Status Update Received: public:ope - COMPLETE | |
| 2024-07-14 08:00:30 [46mreplication-orchestrator[0m > Updating status: public:ope - COMPLETE | |
| 2024-07-14 08:00:30 [46mreplication-orchestrator[0m > Stream Status Update Received: public:pil - COMPLETE | |
| 2024-07-14 08:00:30 [46mreplication-orchestrator[0m > Updating status: public:pil - COMPLETE | |
| 2024-07-14 08:00:30 [46mreplication-orchestrator[0m > Stream Status Update Received: public:veh - COMPLETE | |
| 2024-07-14 08:00:30 [46mreplication-orchestrator[0m > Updating status: public:veh - COMPLETE | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.s.GlobalAsyncStateManager(flushStates):207 Flushing states complete | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 7499 bytes.. | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.GlobalMemoryManager(free):78 Freeing 9552 bytes.. | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO pool-35-thread-2 i.a.c.i.d.a.FlushWorkers(flush$lambda$6):170 Flush Worker (20a1a) -- Worker finished flushing. Current queue size: 0 | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO main i.a.c.i.d.a.FlushWorkers(close):245 Closing flush workers -- workers shut down | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO main i.a.c.i.d.a.b.BufferManager(close):73 Buffers cleared.. | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-3 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_pur" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-7 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_config" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-10 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_asy" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-2 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_pil2" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-9 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_daw" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-8 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_off" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-1 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_ope" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_dri" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-4 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_reg" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-5 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_veh_type" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.off. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.pil2. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.t.TyperDeduperUtil(executeTypeAndDedupe):212 Attempting typing and deduping for XXX_PUBLIC.pil2 with suffix | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):288 Skipping typing and deduping for stream XXX_PUBLIC.off because it had no records during this sync and no unprocessed records from a previous sync. | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-2 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 3bd028e3-20f5-45a8-ac35-51d63745c7e5-22cc4384-b6b2-4373-88f6-607179599268: BEGIN TRANSACTION; | |
| INSERT INTO "XXX_PUBLIC"."PIL2" | |
| ( | |
| "ID", | |
| "NAME", | |
| "ACRONYM", | |
| "CREATED_TS", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| "_AIRBYTE_META", | |
| "_AIRBYTE_RAW_ID", | |
| "_AIRBYTE_EXTRACTED_AT", | |
| "_AIRBYTE_GENERATION_ID" | |
| ) | |
| WITH intermediate_data AS ( | |
| SELECT | |
| (("_airbyte_data":"id")::text) as "ID", | |
| (("_airbyte_data":"name")::text) as "NAME", | |
| (("_airbyte_data":"acronym")::text) as "ACRONYM", | |
| CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "CREATED_TS", | |
| CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "UPDATED_TS", | |
| CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) as "_AB_CDC_LSN", | |
| (("_airbyte_data":"_ab_cdc_deleted_at")::text) as "_AB_CDC_DELETED_AT", | |
| (("_airbyte_data":"_ab_cdc_updated_at")::text) as "_AB_CDC_UPDATED_AT", | |
| ARRAY_COMPACT( | |
| ARRAY_CAT( | |
| CASE WHEN "_airbyte_meta":"changes" IS NOT NULL | |
| THEN "_airbyte_meta":"changes" | |
| ELSE ARRAY_CONSTRUCT() | |
| END, | |
| ARRAY_CONSTRUCT(CASE | |
| WHEN (TYPEOF("_airbyte_data":"id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"name") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"name")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'name', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"acronym") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"acronym")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'acronym', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"created_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'created_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"updated_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'updated_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_lsn") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_lsn', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_deleted_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_deleted_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_deleted_at', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_updated_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_updated_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_updated_at', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END))) as "_airbyte_cast_errors", | |
| "_airbyte_raw_id", | |
| TIMESTAMPADD( | |
| HOUR, | |
| EXTRACT(timezone_hour from "_airbyte_extracted_at"), | |
| TIMESTAMPADD( | |
| MINUTE, | |
| EXTRACT(timezone_minute from "_airbyte_extracted_at"), | |
| CONVERT_TIMEZONE('UTC', "_airbyte_extracted_at") | |
| ) | |
| ) | |
| as "_airbyte_extracted_at", | |
| "_airbyte_meta", | |
| "_airbyte_generation_id" | |
| FROM "airbyte_internal"."XXX_PUBLIC_raw__stream_pil2" | |
| WHERE | |
| "_airbyte_loaded_at" IS NULL | |
| ) | |
| SELECT | |
| "ID", | |
| "NAME", | |
| "ACRONYM", | |
| "CREATED_TS", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| CASE WHEN "_airbyte_meta" IS NOT NULL | |
| THEN OBJECT_INSERT("_airbyte_meta", 'changes', "_airbyte_cast_errors", true) | |
| ELSE OBJECT_CONSTRUCT('changes', "_airbyte_cast_errors") | |
| END AS "_AIRBYTE_META", | |
| "_airbyte_raw_id" AS "_AIRBYTE_RAW_ID", | |
| "_airbyte_extracted_at" AS "_AIRBYTE_EXTRACTED_AT", | |
| "_airbyte_generation_id" AS "_AIRBYTE_GENERATION_ID" | |
| FROM intermediate_data; | |
| UPDATE "airbyte_internal"."XXX_PUBLIC_raw__stream_pil2" | |
| SET "_airbyte_loaded_at" = CURRENT_TIMESTAMP() | |
| WHERE "_airbyte_loaded_at" IS NULL | |
| ; | |
| COMMIT; | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.off. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-8 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_sta" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.asy. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):288 Skipping typing and deduping for stream XXX_PUBLIC.asy because it had no records during this sync and no unprocessed records from a previous sync. | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.asy. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-10 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_rid" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.config. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.ope. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):288 Skipping typing and deduping for stream XXX_PUBLIC.config because it had no records during this sync and no unprocessed records from a previous sync. | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):288 Skipping typing and deduping for stream XXX_PUBLIC.ope because it had no records during this sync and no unprocessed records from a previous sync. | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.config. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.ope. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.daw. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-7 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_bag" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-1 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_fli" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):288 Skipping typing and deduping for stream XXX_PUBLIC.daw because it had no records during this sync and no unprocessed records from a previous sync. | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.daw. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-9 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_con3" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.dri. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):288 Skipping typing and deduping for stream XXX_PUBLIC.dri because it had no records during this sync and no unprocessed records from a previous sync. | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.dri. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_tri" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.sta. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.reg. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.t.TyperDeduperUtil(executeTypeAndDedupe):212 Attempting typing and deduping for XXX_PUBLIC.sta with suffix | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.t.TyperDeduperUtil(executeTypeAndDedupe):212 Attempting typing and deduping for XXX_PUBLIC.reg with suffix | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.veh_type. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.pur. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):288 Skipping typing and deduping for stream XXX_PUBLIC.pur because it had no records during this sync and no unprocessed records from a previous sync. | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.t.TyperDeduperUtil(executeTypeAndDedupe):212 Attempting typing and deduping for XXX_PUBLIC.veh_type with suffix | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.pur. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-3 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_gue2" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-8 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 95a01729-fd2f-4f52-9031-59dba284df73-500dced0-b470-44d8-b8ad-4932ce180e7b: BEGIN TRANSACTION; | |
| INSERT INTO "XXX_PUBLIC"."STA" | |
| ( | |
| "ID", | |
| "LAT", | |
| "LNG", | |
| "NAME", | |
| "FAA_CODE", | |
| "NUM_FATO", | |
| "IATA_CODE", | |
| "ICAO_CODE", | |
| "REG_ID", | |
| "CREATED_TS", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "DESCRIPTION", | |
| "TAXI_MINUTES", | |
| "FATO_DIAMETER_FT", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| "MAX_TOTAL_AIRCRAFT", | |
| "MAX_RUNWAY_LENGTH_FT", | |
| "_AIRBYTE_META", | |
| "_AIRBYTE_RAW_ID", | |
| "_AIRBYTE_EXTRACTED_AT", | |
| "_AIRBYTE_GENERATION_ID" | |
| ) | |
| WITH intermediate_data AS ( | |
| SELECT | |
| (("_airbyte_data":"id")::text) as "ID", | |
| CAST(("_airbyte_data":"lat")::text as FLOAT) as "LAT", | |
| CAST(("_airbyte_data":"lng")::text as FLOAT) as "LNG", | |
| (("_airbyte_data":"name")::text) as "NAME", | |
| (("_airbyte_data":"faa_code")::text) as "FAA_CODE", | |
| CAST(("_airbyte_data":"num_fato")::text as NUMBER) as "NUM_FATO", | |
| (("_airbyte_data":"iata_code")::text) as "IATA_CODE", | |
| (("_airbyte_data":"icao_code")::text) as "ICAO_CODE", | |
| (("_airbyte_data":"reg_id")::text) as "REG_ID", | |
| CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "CREATED_TS", | |
| CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "UPDATED_TS", | |
| CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) as "_AB_CDC_LSN", | |
| (("_airbyte_data":"description")::text) as "DESCRIPTION", | |
| CAST(("_airbyte_data":"taxi_minutes")::text as FLOAT) as "TAXI_MINUTES", | |
| CAST(("_airbyte_data":"fato_diameter_ft")::text as FLOAT) as "FATO_DIAMETER_FT", | |
| (("_airbyte_data":"_ab_cdc_deleted_at")::text) as "_AB_CDC_DELETED_AT", | |
| (("_airbyte_data":"_ab_cdc_updated_at")::text) as "_AB_CDC_UPDATED_AT", | |
| CAST(("_airbyte_data":"max_total_aircraft")::text as NUMBER) as "MAX_TOTAL_AIRCRAFT", | |
| CAST(("_airbyte_data":"max_runway_length_ft")::text as FLOAT) as "MAX_RUNWAY_LENGTH_FT", | |
| ARRAY_COMPACT( | |
| ARRAY_CAT( | |
| CASE WHEN "_airbyte_meta":"changes" IS NOT NULL | |
| THEN "_airbyte_meta":"changes" | |
| ELSE ARRAY_CONSTRUCT() | |
| END, | |
| ARRAY_CONSTRUCT(CASE | |
| WHEN (TYPEOF("_airbyte_data":"id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"lat") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"lat")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'lat', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"lng") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"lng")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'lng', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"name") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"name")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'name', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"faa_code") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"faa_code")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'faa_code', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"num_fato") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"num_fato")::text as NUMBER) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'num_fato', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"iata_code") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"iata_code")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'iata_code', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"icao_code") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"icao_code")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'icao_code', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"reg_id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"reg_id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'reg_id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"created_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'created_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"updated_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'updated_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_lsn") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_lsn', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"description") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"description")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'description', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"taxi_minutes") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"taxi_minutes")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'taxi_minutes', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"fato_diameter_ft") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"fato_diameter_ft")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'fato_diameter_ft', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_deleted_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_deleted_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_deleted_at', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_updated_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_updated_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_updated_at', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"max_total_aircraft") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"max_total_aircraft")::text as NUMBER) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'max_total_aircraft', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"max_runway_length_ft") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"max_runway_length_ft")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'max_runway_length_ft', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END))) as "_airbyte_cast_errors", | |
| "_airbyte_raw_id", | |
| TIMESTAMPADD( | |
| HOUR, | |
| EXTRACT(timezone_hour from "_airbyte_extracted_at"), | |
| TIMESTAMPADD( | |
| MINUTE, | |
| EXTRACT(timezone_minute from "_airbyte_extracted_at"), | |
| CONVERT_TIMEZONE('UTC', "_airbyte_extracted_at") | |
| ) | |
| ) | |
| as "_airbyte_extracted_at", | |
| "_airbyte_meta", | |
| "_airbyte_generation_id" | |
| FROM "airbyte_internal"."XXX_PUBLIC_raw__stream_sta" | |
| WHERE | |
| "_airbyte_loaded_at" IS NULL | |
| AND TIMESTAMPADD( | |
| HOUR, | |
| EXTRACT(timezone_hour from "_airbyte_extracted_at"), | |
| TIMESTAMPADD( | |
| MINUTE, | |
| EXTRACT(timezone_minute from "_airbyte_extracted_at"), | |
| CONVERT_TIMEZONE('UTC', "_airbyte_extracted_at") | |
| ) | |
| ) | |
| > '2024-07-13T06:31:32.646Z' | |
| ) | |
| SELECT | |
| "ID", | |
| "LAT", | |
| "LNG", | |
| "NAME", | |
| "FAA_CODE", | |
| "NUM_FATO", | |
| "IATA_CODE", | |
| "ICAO_CODE", | |
| "REG_ID", | |
| "CREATED_TS", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "DESCRIPTION", | |
| "TAXI_MINUTES", | |
| "FATO_DIAMETER_FT", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| "MAX_TOTAL_AIRCRAFT", | |
| "MAX_RUNWAY_LENGTH_FT", | |
| CASE WHEN "_airbyte_meta" IS NOT NULL | |
| THEN OBJECT_INSERT("_airbyte_meta", 'changes', "_airbyte_cast_errors", true) | |
| ELSE OBJECT_CONSTRUCT('changes', "_airbyte_cast_errors") | |
| END AS "_AIRBYTE_META", | |
| "_airbyte_raw_id" AS "_AIRBYTE_RAW_ID", | |
| "_airbyte_extracted_at" AS "_AIRBYTE_EXTRACTED_AT", | |
| "_airbyte_generation_id" AS "_AIRBYTE_GENERATION_ID" | |
| FROM intermediate_data; | |
| UPDATE "airbyte_internal"."XXX_PUBLIC_raw__stream_sta" | |
| SET "_airbyte_loaded_at" = CURRENT_TIMESTAMP() | |
| WHERE "_airbyte_loaded_at" IS NULL | |
| ; | |
| COMMIT; | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-4 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 202af1cd-6efb-4b89-b5c4-28d528f338a5-ab75c8be-8542-46dd-b65b-e25d6e9b65fd: BEGIN TRANSACTION; | |
| INSERT INTO "XXX_PUBLIC"."REG" | |
| ( | |
| "ID", | |
| "NAME", | |
| "TZINFO", | |
| "QUEUE_URL", | |
| "CREATED_TS", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| "_AIRBYTE_META", | |
| "_AIRBYTE_RAW_ID", | |
| "_AIRBYTE_EXTRACTED_AT", | |
| "_AIRBYTE_GENERATION_ID" | |
| ) | |
| WITH intermediate_data AS ( | |
| SELECT | |
| (("_airbyte_data":"id")::text) as "ID", | |
| (("_airbyte_data":"name")::text) as "NAME", | |
| (("_airbyte_data":"tzinfo")::text) as "TZINFO", | |
| (("_airbyte_data":"queue_url")::text) as "QUEUE_URL", | |
| CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "CREATED_TS", | |
| CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "UPDATED_TS", | |
| CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) as "_AB_CDC_LSN", | |
| (("_airbyte_data":"_ab_cdc_deleted_at")::text) as "_AB_CDC_DELETED_AT", | |
| (("_airbyte_data":"_ab_cdc_updated_at")::text) as "_AB_CDC_UPDATED_AT", | |
| ARRAY_COMPACT( | |
| ARRAY_CAT( | |
| CASE WHEN "_airbyte_meta":"changes" IS NOT NULL | |
| THEN "_airbyte_meta":"changes" | |
| ELSE ARRAY_CONSTRUCT() | |
| END, | |
| ARRAY_CONSTRUCT(CASE | |
| WHEN (TYPEOF("_airbyte_data":"id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"name") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"name")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'name', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"tzinfo") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"tzinfo")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'tzinfo', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"queue_url") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"queue_url")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'queue_url', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"created_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'created_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"updated_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'updated_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_lsn") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_lsn', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_deleted_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_deleted_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_deleted_at', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_updated_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_updated_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_updated_at', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END))) as "_airbyte_cast_errors", | |
| "_airbyte_raw_id", | |
| TIMESTAMPADD( | |
| HOUR, | |
| EXTRACT(timezone_hour from "_airbyte_extracted_at"), | |
| TIMESTAMPADD( | |
| MINUTE, | |
| EXTRACT(timezone_minute from "_airbyte_extracted_at"), | |
| CONVERT_TIMEZONE('UTC', "_airbyte_extracted_at") | |
| ) | |
| ) | |
| as "_airbyte_extracted_at", | |
| "_airbyte_meta", | |
| "_airbyte_generation_id" | |
| FROM "airbyte_internal"."XXX_PUBLIC_raw__stream_reg" | |
| WHERE | |
| "_airbyte_loaded_at" IS NULL | |
| AND TIMESTAMPADD( | |
| HOUR, | |
| EXTRACT(timezone_hour from "_airbyte_extracted_at"), | |
| TIMESTAMPADD( | |
| MINUTE, | |
| EXTRACT(timezone_minute from "_airbyte_extracted_at"), | |
| CONVERT_TIMEZONE('UTC', "_airbyte_extracted_at") | |
| ) | |
| ) | |
| > '2024-07-14T07:17:08.244999999Z' | |
| ) | |
| SELECT | |
| "ID", | |
| "NAME", | |
| "TZINFO", | |
| "QUEUE_URL", | |
| "CREATED_TS", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| CASE WHEN "_airbyte_meta" IS NOT NULL | |
| THEN OBJECT_INSERT("_airbyte_meta", 'changes', "_airbyte_cast_errors", true) | |
| ELSE OBJECT_CONSTRUCT('changes', "_airbyte_cast_errors") | |
| END AS "_AIRBYTE_META", | |
| "_airbyte_raw_id" AS "_AIRBYTE_RAW_ID", | |
| "_airbyte_extracted_at" AS "_AIRBYTE_EXTRACTED_AT", | |
| "_airbyte_generation_id" AS "_AIRBYTE_GENERATION_ID" | |
| FROM intermediate_data; | |
| UPDATE "airbyte_internal"."XXX_PUBLIC_raw__stream_reg" | |
| SET "_airbyte_loaded_at" = CURRENT_TIMESTAMP() | |
| WHERE "_airbyte_loaded_at" IS NULL | |
| ; | |
| COMMIT; | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-5 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 8deebae9-75a5-44b9-9039-77a36798f50b-52d1ab47-e187-4dc6-80a1-be5d411d6a29: BEGIN TRANSACTION; | |
| INSERT INTO "XXX_PUBLIC"."VEH_TYPE" | |
| ( | |
| "ID", | |
| "NAME", | |
| "CREATED_TS", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "CAPABLE_OF_CTOL", | |
| "CAPABLE_OF_VTOL", | |
| "TYPE_DESIGNATOR", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| "MIN_RUNWAY_LENGTH_FOR_CTOL_FT", | |
| "_AIRBYTE_META", | |
| "_AIRBYTE_RAW_ID", | |
| "_AIRBYTE_EXTRACTED_AT", | |
| "_AIRBYTE_GENERATION_ID" | |
| ) | |
| WITH intermediate_data AS ( | |
| SELECT | |
| (("_airbyte_data":"id")::text) as "ID", | |
| (("_airbyte_data":"name")::text) as "NAME", | |
| CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "CREATED_TS", | |
| CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "UPDATED_TS", | |
| CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) as "_AB_CDC_LSN", | |
| CAST(("_airbyte_data":"capable_of_ctol")::text as BOOLEAN) as "CAPABLE_OF_CTOL", | |
| CAST(("_airbyte_data":"capable_of_vtol")::text as BOOLEAN) as "CAPABLE_OF_VTOL", | |
| (("_airbyte_data":"type_designator")::text) as "TYPE_DESIGNATOR", | |
| (("_airbyte_data":"_ab_cdc_deleted_at")::text) as "_AB_CDC_DELETED_AT", | |
| (("_airbyte_data":"_ab_cdc_updated_at")::text) as "_AB_CDC_UPDATED_AT", | |
| CAST(("_airbyte_data":"min_runway_length_for_ctol_ft")::text as FLOAT) as "MIN_RUNWAY_LENGTH_FOR_CTOL_FT", | |
| ARRAY_COMPACT( | |
| ARRAY_CAT( | |
| CASE WHEN "_airbyte_meta":"changes" IS NOT NULL | |
| THEN "_airbyte_meta":"changes" | |
| ELSE ARRAY_CONSTRUCT() | |
| END, | |
| ARRAY_CONSTRUCT(CASE | |
| WHEN (TYPEOF("_airbyte_data":"id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"name") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"name")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'name', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"created_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'created_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"updated_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'updated_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_lsn") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_lsn', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"capable_of_ctol") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"capable_of_ctol")::text as BOOLEAN) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'capable_of_ctol', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"capable_of_vtol") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"capable_of_vtol")::text as BOOLEAN) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'capable_of_vtol', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"type_designator") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"type_designator")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'type_designator', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_deleted_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_deleted_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_deleted_at', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_updated_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_updated_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_updated_at', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"min_runway_length_for_ctol_ft") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"min_runway_length_for_ctol_ft")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'min_runway_length_for_ctol_ft', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END))) as "_airbyte_cast_errors", | |
| "_airbyte_raw_id", | |
| TIMESTAMPADD( | |
| HOUR, | |
| EXTRACT(timezone_hour from "_airbyte_extracted_at"), | |
| TIMESTAMPADD( | |
| MINUTE, | |
| EXTRACT(timezone_minute from "_airbyte_extracted_at"), | |
| CONVERT_TIMEZONE('UTC', "_airbyte_extracted_at") | |
| ) | |
| ) | |
| as "_airbyte_extracted_at", | |
| "_airbyte_meta", | |
| "_airbyte_generation_id" | |
| FROM "airbyte_internal"."XXX_PUBLIC_raw__stream_veh_type" | |
| WHERE | |
| "_airbyte_loaded_at" IS NULL | |
| AND TIMESTAMPADD( | |
| HOUR, | |
| EXTRACT(timezone_hour from "_airbyte_extracted_at"), | |
| TIMESTAMPADD( | |
| MINUTE, | |
| EXTRACT(timezone_minute from "_airbyte_extracted_at"), | |
| CONVERT_TIMEZONE('UTC', "_airbyte_extracted_at") | |
| ) | |
| ) | |
| > '2024-07-14T07:17:08.244999999Z' | |
| ) | |
| SELECT | |
| "ID", | |
| "NAME", | |
| "CREATED_TS", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "CAPABLE_OF_CTOL", | |
| "CAPABLE_OF_VTOL", | |
| "TYPE_DESIGNATOR", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| "MIN_RUNWAY_LENGTH_FOR_CTOL_FT", | |
| CASE WHEN "_airbyte_meta" IS NOT NULL | |
| THEN OBJECT_INSERT("_airbyte_meta", 'changes', "_airbyte_cast_errors", true) | |
| ELSE OBJECT_CONSTRUCT('changes', "_airbyte_cast_errors") | |
| END AS "_AIRBYTE_META", | |
| "_airbyte_raw_id" AS "_AIRBYTE_RAW_ID", | |
| "_airbyte_extracted_at" AS "_AIRBYTE_EXTRACTED_AT", | |
| "_airbyte_generation_id" AS "_AIRBYTE_GENERATION_ID" | |
| FROM intermediate_data; | |
| UPDATE "airbyte_internal"."XXX_PUBLIC_raw__stream_veh_type" | |
| SET "_airbyte_loaded_at" = CURRENT_TIMESTAMP() | |
| WHERE "_airbyte_loaded_at" IS NULL | |
| ; | |
| COMMIT; | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.rid. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):288 Skipping typing and deduping for stream XXX_PUBLIC.rid because it had no records during this sync and no unprocessed records from a previous sync. | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.rid. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-10 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_act" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.bag. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.con3. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):288 Skipping typing and deduping for stream XXX_PUBLIC.bag because it had no records during this sync and no unprocessed records from a previous sync. | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):288 Skipping typing and deduping for stream XXX_PUBLIC.con3 because it had no records during this sync and no unprocessed records from a previous sync. | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.bag. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.con3. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-7 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_ter" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-9 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_tri2" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.fli. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.t.TyperDeduperUtil(executeTypeAndDedupe):212 Attempting typing and deduping for XXX_PUBLIC.fli with suffix | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-1 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 0f33afac-2060-4943-9a8c-bf417b644163-4b4e992b-3fc6-4448-889a-6c2cb5dd9de1: BEGIN TRANSACTION; | |
| INSERT INTO "XXX_PUBLIC"."FLI" | |
| ( | |
| "ID", | |
| "NUMBER", | |
| "STATUS", | |
| "CREATED_TS", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "CREATION_TYPE", | |
| "FOREFLI_ID", | |
| "PIL_ID", | |
| "ORIGIN_STA_ID", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| "ASSIGNED_VEH_ID", | |
| "GATE_IN_ACT_ID", | |
| "GATE_OUT_ACT_ID", | |
| "PLANNED_DESTINATION_STA_ID", | |
| "WHEELS_ON_ACT_ID", | |
| "WHEELS_OFF_ACT_ID", | |
| "_AIRBYTE_META", | |
| "_AIRBYTE_RAW_ID", | |
| "_AIRBYTE_EXTRACTED_AT", | |
| "_AIRBYTE_GENERATION_ID" | |
| ) | |
| WITH intermediate_data AS ( | |
| SELECT | |
| (("_airbyte_data":"id")::text) as "ID", | |
| (("_airbyte_data":"number")::text) as "NUMBER", | |
| (("_airbyte_data":"status")::text) as "STATUS", | |
| CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "CREATED_TS", | |
| CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "UPDATED_TS", | |
| CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) as "_AB_CDC_LSN", | |
| (("_airbyte_data":"creation_type")::text) as "CREATION_TYPE", | |
| (("_airbyte_data":"forefli_id")::text) as "FOREFLI_ID", | |
| (("_airbyte_data":"pil_id")::text) as "PIL_ID", | |
| (("_airbyte_data":"origin_sta_id")::text) as "ORIGIN_STA_ID", | |
| (("_airbyte_data":"_ab_cdc_deleted_at")::text) as "_AB_CDC_DELETED_AT", | |
| (("_airbyte_data":"_ab_cdc_updated_at")::text) as "_AB_CDC_UPDATED_AT", | |
| (("_airbyte_data":"assigned_veh_id")::text) as "ASSIGNED_VEH_ID", | |
| (("_airbyte_data":"gate_in_act_id")::text) as "GATE_IN_ACT_ID", | |
| (("_airbyte_data":"gate_out_act_id")::text) as "GATE_OUT_ACT_ID", | |
| (("_airbyte_data":"planned_destination_sta_id")::text) as "PLANNED_DESTINATION_STA_ID", | |
| (("_airbyte_data":"wheels_on_act_id")::text) as "WHEELS_ON_ACT_ID", | |
| (("_airbyte_data":"wheels_off_act_id")::text) as "WHEELS_OFF_ACT_ID", | |
| ARRAY_COMPACT( | |
| ARRAY_CAT( | |
| CASE WHEN "_airbyte_meta":"changes" IS NOT NULL | |
| THEN "_airbyte_meta":"changes" | |
| ELSE ARRAY_CONSTRUCT() | |
| END, | |
| ARRAY_CONSTRUCT(CASE | |
| WHEN (TYPEOF("_airbyte_data":"id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"number") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"number")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'number', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"status") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"status")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'status', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"created_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'created_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"updated_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'updated_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_lsn") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_lsn', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"creation_type") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"creation_type")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'creation_type', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"forefli_id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"forefli_id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'forefli_id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"pil_id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"pil_id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'pil_id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"origin_sta_id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"origin_sta_id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'origin_sta_id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_deleted_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_deleted_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_deleted_at', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_updated_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_updated_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_updated_at', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"assigned_veh_id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"assigned_veh_id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'assigned_veh_id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"gate_in_act_id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"gate_in_act_id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'gate_in_act_id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"gate_out_act_id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"gate_out_act_id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'gate_out_act_id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"planned_destination_sta_id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"planned_destination_sta_id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'planned_destination_sta_id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"wheels_on_act_id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"wheels_on_act_id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'wheels_on_act_id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"wheels_off_act_id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"wheels_off_act_id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'wheels_off_act_id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END))) as "_airbyte_cast_errors", | |
| "_airbyte_raw_id", | |
| TIMESTAMPADD( | |
| HOUR, | |
| EXTRACT(timezone_hour from "_airbyte_extracted_at"), | |
| TIMESTAMPADD( | |
| MINUTE, | |
| EXTRACT(timezone_minute from "_airbyte_extracted_at"), | |
| CONVERT_TIMEZONE('UTC', "_airbyte_extracted_at") | |
| ) | |
| ) | |
| as "_airbyte_extracted_at", | |
| "_airbyte_meta", | |
| "_airbyte_generation_id" | |
| FROM "airbyte_internal"."XXX_PUBLIC_raw__stream_fli" | |
| WHERE | |
| "_airbyte_loaded_at" IS NULL | |
| AND TIMESTAMPADD( | |
| HOUR, | |
| EXTRACT(timezone_hour from "_airbyte_extracted_at"), | |
| TIMESTAMPADD( | |
| MINUTE, | |
| EXTRACT(timezone_minute from "_airbyte_extracted_at"), | |
| CONVERT_TIMEZONE('UTC', "_airbyte_extracted_at") | |
| ) | |
| ) | |
| > '2024-07-14T07:17:08.244999999Z' | |
| ) | |
| SELECT | |
| "ID", | |
| "NUMBER", | |
| "STATUS", | |
| "CREATED_TS", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "CREATION_TYPE", | |
| "FOREFLI_ID", | |
| "PIL_ID", | |
| "ORIGIN_STA_ID", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| "ASSIGNED_VEH_ID", | |
| "GATE_IN_ACT_ID", | |
| "GATE_OUT_ACT_ID", | |
| "PLANNED_DESTINATION_STA_ID", | |
| "WHEELS_ON_ACT_ID", | |
| "WHEELS_OFF_ACT_ID", | |
| CASE WHEN "_airbyte_meta" IS NOT NULL | |
| THEN OBJECT_INSERT("_airbyte_meta", 'changes', "_airbyte_cast_errors", true) | |
| ELSE OBJECT_CONSTRUCT('changes', "_airbyte_cast_errors") | |
| END AS "_AIRBYTE_META", | |
| "_airbyte_raw_id" AS "_AIRBYTE_RAW_ID", | |
| "_airbyte_extracted_at" AS "_AIRBYTE_EXTRACTED_AT", | |
| "_airbyte_generation_id" AS "_AIRBYTE_GENERATION_ID" | |
| FROM intermediate_data; | |
| UPDATE "airbyte_internal"."XXX_PUBLIC_raw__stream_fli" | |
| SET "_airbyte_loaded_at" = CURRENT_TIMESTAMP() | |
| WHERE "_airbyte_loaded_at" IS NULL | |
| ; | |
| COMMIT; | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.tri. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):288 Skipping typing and deduping for stream XXX_PUBLIC.tri because it had no records during this sync and no unprocessed records from a previous sync. | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.tri. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_veh" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.gue2. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):288 Skipping typing and deduping for stream XXX_PUBLIC.gue2 because it had no records during this sync and no unprocessed records from a previous sync. | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.gue2. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-3 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_con2" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.act. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.t.TyperDeduperUtil(executeTypeAndDedupe):212 Attempting typing and deduping for XXX_PUBLIC.act with suffix | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-10 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 1d7034c0-0c6e-4847-b248-6f0621b34c08-d1004974-a6ea-440f-8425-60723b237302: BEGIN TRANSACTION; | |
| INSERT INTO "XXX_PUBLIC"."ACT" | |
| ( | |
| "ID", | |
| "ACTUAL_TS", | |
| "LATEST_TS", | |
| "CREATED_TS", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "EARLIEST_TS", | |
| "ESTIMATED_TS", | |
| "SCHEDULED_TS", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| "_AIRBYTE_META", | |
| "_AIRBYTE_RAW_ID", | |
| "_AIRBYTE_EXTRACTED_AT", | |
| "_AIRBYTE_GENERATION_ID" | |
| ) | |
| WITH intermediate_data AS ( | |
| SELECT | |
| (("_airbyte_data":"id")::text) as "ID", | |
| CASE | |
| WHEN ("_airbyte_data":"actual_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"actual_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"actual_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"actual_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"actual_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"actual_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"actual_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"actual_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"actual_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "ACTUAL_TS", | |
| CASE | |
| WHEN ("_airbyte_data":"latest_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"latest_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"latest_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"latest_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"latest_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"latest_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"latest_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"latest_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"latest_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "LATEST_TS", | |
| CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "CREATED_TS", | |
| CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "UPDATED_TS", | |
| CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) as "_AB_CDC_LSN", | |
| CASE | |
| WHEN ("_airbyte_data":"earliest_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"earliest_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"earliest_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"earliest_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"earliest_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"earliest_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"earliest_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"earliest_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"earliest_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "EARLIEST_TS", | |
| CASE | |
| WHEN ("_airbyte_data":"estimated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"estimated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"estimated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"estimated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"estimated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"estimated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"estimated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"estimated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"estimated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "ESTIMATED_TS", | |
| CASE | |
| WHEN ("_airbyte_data":"scheduled_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"scheduled_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"scheduled_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"scheduled_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"scheduled_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"scheduled_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"scheduled_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"scheduled_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"scheduled_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "SCHEDULED_TS", | |
| (("_airbyte_data":"_ab_cdc_deleted_at")::text) as "_AB_CDC_DELETED_AT", | |
| (("_airbyte_data":"_ab_cdc_updated_at")::text) as "_AB_CDC_UPDATED_AT", | |
| ARRAY_COMPACT( | |
| ARRAY_CAT( | |
| CASE WHEN "_airbyte_meta":"changes" IS NOT NULL | |
| THEN "_airbyte_meta":"changes" | |
| ELSE ARRAY_CONSTRUCT() | |
| END, | |
| ARRAY_CONSTRUCT(CASE | |
| WHEN (TYPEOF("_airbyte_data":"id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"actual_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"actual_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"actual_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"actual_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"actual_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"actual_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"actual_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"actual_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"actual_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"actual_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'actual_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"latest_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"latest_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"latest_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"latest_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"latest_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"latest_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"latest_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"latest_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"latest_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"latest_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'latest_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"created_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'created_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"updated_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'updated_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_lsn") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_lsn', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"earliest_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"earliest_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"earliest_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"earliest_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"earliest_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"earliest_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"earliest_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"earliest_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"earliest_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"earliest_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'earliest_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"estimated_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"estimated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"estimated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"estimated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"estimated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"estimated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"estimated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"estimated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"estimated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"estimated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'estimated_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"scheduled_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"scheduled_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"scheduled_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"scheduled_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"scheduled_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"scheduled_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"scheduled_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"scheduled_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"scheduled_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"scheduled_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'scheduled_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_deleted_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_deleted_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_… | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.ter. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):288 Skipping typing and deduping for stream XXX_PUBLIC.ter because it had no records during this sync and no unprocessed records from a previous sync. | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.ter. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-7 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_gue" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.tri2. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):288 Skipping typing and deduping for stream XXX_PUBLIC.tri2 because it had no records during this sync and no unprocessed records from a previous sync. | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.tri2. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-9 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_pil" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.veh. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.t.TyperDeduperUtil(executeTypeAndDedupe):212 Attempting typing and deduping for XXX_PUBLIC.veh with suffix | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.con2. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):288 Skipping typing and deduping for stream XXX_PUBLIC.con2 because it had no records during this sync and no unprocessed records from a previous sync. | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.con2. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-3 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_con1" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 08949498-9b9f-43bb-89cc-bcb97fdb34fc-63b2131e-f909-4523-b2f1-757e21be4360: BEGIN TRANSACTION; | |
| INSERT INTO "XXX_PUBLIC"."VEH" | |
| ( | |
| "ID", | |
| "REG_ID", | |
| "CREATED_TS", | |
| "LATEST_LAT", | |
| "LATEST_LNG", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "TAIL_NUMBER", | |
| "PAX_CAPACITY", | |
| "MAX_CARGO_LBS", | |
| "OPERATOR_CODE", | |
| "SERIAL_NUMBER", | |
| "MINIMUM_PILOTS", | |
| "CAPABLE_OF_CTOL", | |
| "CAPABLE_OF_VTOL", | |
| "VEH_TYPE_ID", | |
| "LATEST_STA_ID", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| "MAX_LANDING_WEIGHT_LBS", | |
| "MAX_TAKEOFF_WEIGHT_LBS", | |
| "MAX_ZERO_FUEL_WEIGHT_LBS", | |
| "MIN_RUNWAY_LENGTH_FOR_CTOL", | |
| "OPERATING_EMPTY_WEIGHT_LBS", | |
| "_AIRBYTE_META", | |
| "_AIRBYTE_RAW_ID", | |
| "_AIRBYTE_EXTRACTED_AT", | |
| "_AIRBYTE_GENERATION_ID" | |
| ) | |
| WITH intermediate_data AS ( | |
| SELECT | |
| (("_airbyte_data":"id")::text) as "ID", | |
| (("_airbyte_data":"reg_id")::text) as "REG_ID", | |
| CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "CREATED_TS", | |
| CAST(("_airbyte_data":"latest_lat")::text as FLOAT) as "LATEST_LAT", | |
| CAST(("_airbyte_data":"latest_lng")::text as FLOAT) as "LATEST_LNG", | |
| CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "UPDATED_TS", | |
| CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) as "_AB_CDC_LSN", | |
| (("_airbyte_data":"tail_number")::text) as "TAIL_NUMBER", | |
| CAST(("_airbyte_data":"pax_capacity")::text as NUMBER) as "PAX_CAPACITY", | |
| CAST(("_airbyte_data":"max_cargo_lbs")::text as FLOAT) as "MAX_CARGO_LBS", | |
| (("_airbyte_data":"operator_code")::text) as "OPERATOR_CODE", | |
| (("_airbyte_data":"serial_number")::text) as "SERIAL_NUMBER", | |
| CAST(("_airbyte_data":"minimum_pilots")::text as NUMBER) as "MINIMUM_PILOTS", | |
| CAST(("_airbyte_data":"capable_of_ctol")::text as BOOLEAN) as "CAPABLE_OF_CTOL", | |
| CAST(("_airbyte_data":"capable_of_vtol")::text as BOOLEAN) as "CAPABLE_OF_VTOL", | |
| (("_airbyte_data":"veh_type_id")::text) as "VEH_TYPE_ID", | |
| (("_airbyte_data":"latest_sta_id")::text) as "LATEST_STA_ID", | |
| (("_airbyte_data":"_ab_cdc_deleted_at")::text) as "_AB_CDC_DELETED_AT", | |
| (("_airbyte_data":"_ab_cdc_updated_at")::text) as "_AB_CDC_UPDATED_AT", | |
| CAST(("_airbyte_data":"max_landing_weight_lbs")::text as FLOAT) as "MAX_LANDING_WEIGHT_LBS", | |
| CAST(("_airbyte_data":"max_takeoff_weight_lbs")::text as FLOAT) as "MAX_TAKEOFF_WEIGHT_LBS", | |
| CAST(("_airbyte_data":"max_zero_fuel_weight_lbs")::text as FLOAT) as "MAX_ZERO_FUEL_WEIGHT_LBS", | |
| CAST(("_airbyte_data":"min_runway_length_for_ctol")::text as FLOAT) as "MIN_RUNWAY_LENGTH_FOR_CTOL", | |
| CAST(("_airbyte_data":"operating_empty_weight_lbs")::text as FLOAT) as "OPERATING_EMPTY_WEIGHT_LBS", | |
| ARRAY_COMPACT( | |
| ARRAY_CAT( | |
| CASE WHEN "_airbyte_meta":"changes" IS NOT NULL | |
| THEN "_airbyte_meta":"changes" | |
| ELSE ARRAY_CONSTRUCT() | |
| END, | |
| ARRAY_CONSTRUCT(CASE | |
| WHEN (TYPEOF("_airbyte_data":"id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"reg_id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"reg_id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'reg_id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"created_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'created_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"latest_lat") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"latest_lat")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'latest_lat', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"latest_lng") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"latest_lng")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'latest_lng', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"updated_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'updated_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_lsn") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_lsn', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"tail_number") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"tail_number")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'tail_number', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"pax_capacity") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"pax_capacity")::text as NUMBER) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'pax_capacity', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"max_cargo_lbs") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"max_cargo_lbs")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'max_cargo_lbs', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"operator_code") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"operator_code")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'operator_code', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"serial_number") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"serial_number")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'serial_number', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"minimum_pilots") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"minimum_pilots")::text as NUMBER) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'minimum_pilots', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"capable_of_ctol") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"capable_of_ctol")::text as BOOLEAN) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'capable_of_ctol', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"capable_of_vtol") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"capable_of_vtol")::text as BOOLEAN) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'capable_of_vtol', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"veh_type_id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"veh_type_id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'veh_type_id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"latest_sta_id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"latest_sta_id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'latest_sta_id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_deleted_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_deleted_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_deleted_at', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_updated_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_updated_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_updated_at', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"max_landing_weight_lbs") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"max_landing_weight_lbs")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'max_landing_weight_lbs', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"max_takeoff_weight_lbs") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"max_takeoff_weight_lbs")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'max_takeoff_weight_lbs', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"max_zero_fuel_weight_lbs") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"max_zero_fuel_weight_lbs")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'max_zero_fuel_weight_lbs', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"min_runway_length_for_ctol") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"min_runway_length_for_ctol")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'min_runway_length_for_ctol', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"operating_empty_weight_lbs") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"operating_empty_weight_lbs")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'operating_empty_weight_lbs', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END))) as "_airbyte_cast_errors", | |
| "_airbyte_raw_id", | |
| TIMESTAMPADD( | |
| HOUR, | |
| EXTRACT(timezone_hour from "_airbyte_extracted_at"), | |
| TIMESTAMPADD( | |
| MINUTE, | |
| EXTRACT(timezone_minute from "_airbyte_extracted_at"), | |
| CONVERT_TIMEZONE('UTC', "_airbyte_extracted_at") | |
| ) | |
| ) | |
| as "_airbyte_extracted_at", | |
| "_airbyte_meta", | |
| "_airbyte_generation_id" | |
| FROM "airbyte_internal"."XXX_PUBLIC_raw__stream_veh" | |
| WHERE | |
| "_airbyte_loaded_at" IS NULL | |
| AND TIMESTAMPADD( | |
| HOUR, | |
| EXTRACT(timezone_hour from "_airbyte_extracted_at"), | |
| TIMESTAMPADD( | |
| MINUTE, | |
| EXTRACT(timezone_minute from "_airbyte_extracted_at"), | |
| CONVERT_TIMEZONE('UTC', "_airbyte_extracted_at") | |
| ) | |
| ) | |
| > '2024-07-13T06:31:32.854Z' | |
| ) | |
| SELECT | |
| "ID", | |
| "REG_ID", | |
| "CREATED_TS", | |
| "LATEST_LAT", | |
| "LATEST_LNG", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "TAIL_NUMBER", | |
| "PAX_CAPACITY", | |
| "MAX_CARGO_LBS", | |
| "OPERATOR_CODE", | |
| "SERIAL_NUMBER", | |
| "MINIMUM_PILOTS", | |
| "CAPABLE_OF_CTOL", | |
| "CAPABLE_OF_VTOL", | |
| "VEH_TYPE_ID", | |
| "LATEST_STA_ID", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| "MAX_LANDING_WEIGHT_LBS", | |
| "MAX_TAKEOFF_WEIGHT_LBS", | |
| "MAX_ZERO_FUEL_WEIGHT_LBS", | |
| "MIN_RUNWAY_LENGTH_FOR_CTOL", | |
| "OPERATING_EMPTY_WEIGHT_LBS", | |
| CASE WHEN "_airbyte_meta" IS NOT NULL | |
| THEN OBJECT_INSERT("_airbyte_meta", 'changes', "_airbyte_cast_errors", true) | |
| ELSE OBJECT_CONSTRUCT('changes', "_airbyte_cast_errors") | |
| END AS "_AIRBYTE_META", | |
| "_airbyte_raw_id" AS "_AIRBYTE_RAW_ID", | |
| "_airbyte_extracted_at" AS "_AIRBYTE_EXTRACTED_AT", | |
| "_airbyte_generation_id" AS "_AIRBYTE_GENERATION_ID" | |
| FROM intermediate_data; | |
| UPDATE "airbyte_internal"."XXX_PUBLIC_raw__stream_veh" | |
| SET "_airbyte_loaded_at" = CURRENT_TIMESTAMP() | |
| WHERE "_airbyte_loaded_at" IS NULL | |
| ; | |
| COMMIT; | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.pil. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.gue. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.t.TyperDeduperUtil(executeTypeAndDedupe):212 Attempting typing and deduping for XXX_PUBLIC.pil with suffix | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.t.TyperDeduperUtil(executeTypeAndDedupe):212 Attempting typing and deduping for XXX_PUBLIC.gue with suffix | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-9 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 6665aee2-362f-478f-975a-2976bdf58310-436e3a3e-bd8c-49aa-b1cc-39f16c9f5816: BEGIN TRANSACTION; | |
| INSERT INTO "XXX_PUBLIC"."PIL" | |
| ( | |
| "ID", | |
| "EMAIL", | |
| "LAST_NAME", | |
| "CREATED_TS", | |
| "FIRST_NAME", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "HASHED_PASSWORD", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| "_AIRBYTE_META", | |
| "_AIRBYTE_RAW_ID", | |
| "_AIRBYTE_EXTRACTED_AT", | |
| "_AIRBYTE_GENERATION_ID" | |
| ) | |
| WITH intermediate_data AS ( | |
| SELECT | |
| (("_airbyte_data":"id")::text) as "ID", | |
| (("_airbyte_data":"email")::text) as "EMAIL", | |
| (("_airbyte_data":"last_name")::text) as "LAST_NAME", | |
| CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "CREATED_TS", | |
| (("_airbyte_data":"first_name")::text) as "FIRST_NAME", | |
| CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "UPDATED_TS", | |
| CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) as "_AB_CDC_LSN", | |
| (("_airbyte_data":"hashed_password")::text) as "HASHED_PASSWORD", | |
| (("_airbyte_data":"_ab_cdc_deleted_at")::text) as "_AB_CDC_DELETED_AT", | |
| (("_airbyte_data":"_ab_cdc_updated_at")::text) as "_AB_CDC_UPDATED_AT", | |
| ARRAY_COMPACT( | |
| ARRAY_CAT( | |
| CASE WHEN "_airbyte_meta":"changes" IS NOT NULL | |
| THEN "_airbyte_meta":"changes" | |
| ELSE ARRAY_CONSTRUCT() | |
| END, | |
| ARRAY_CONSTRUCT(CASE | |
| WHEN (TYPEOF("_airbyte_data":"id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"email") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"email")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'email', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"last_name") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"last_name")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'last_name', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"created_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'created_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"first_name") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"first_name")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'first_name', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"updated_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'updated_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_lsn") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_lsn', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"hashed_password") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"hashed_password")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'hashed_password', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_deleted_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_deleted_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_deleted_at', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_updated_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_updated_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_updated_at', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END))) as "_airbyte_cast_errors", | |
| "_airbyte_raw_id", | |
| TIMESTAMPADD( | |
| HOUR, | |
| EXTRACT(timezone_hour from "_airbyte_extracted_at"), | |
| TIMESTAMPADD( | |
| MINUTE, | |
| EXTRACT(timezone_minute from "_airbyte_extracted_at"), | |
| CONVERT_TIMEZONE('UTC', "_airbyte_extracted_at") | |
| ) | |
| ) | |
| as "_airbyte_extracted_at", | |
| "_airbyte_meta", | |
| "_airbyte_generation_id" | |
| FROM "airbyte_internal"."XXX_PUBLIC_raw__stream_pil" | |
| WHERE | |
| "_airbyte_loaded_at" IS NULL | |
| AND TIMESTAMPADD( | |
| HOUR, | |
| EXTRACT(timezone_hour from "_airbyte_extracted_at"), | |
| TIMESTAMPADD( | |
| MINUTE, | |
| EXTRACT(timezone_minute from "_airbyte_extracted_at"), | |
| CONVERT_TIMEZONE('UTC', "_airbyte_extracted_at") | |
| ) | |
| ) | |
| > '2024-07-14T07:17:08.244999999Z' | |
| ) | |
| SELECT | |
| "ID", | |
| "EMAIL", | |
| "LAST_NAME", | |
| "CREATED_TS", | |
| "FIRST_NAME", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "HASHED_PASSWORD", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| CASE WHEN "_airbyte_meta" IS NOT NULL | |
| THEN OBJECT_INSERT("_airbyte_meta", 'changes', "_airbyte_cast_errors", true) | |
| ELSE OBJECT_CONSTRUCT('changes', "_airbyte_cast_errors") | |
| END AS "_AIRBYTE_META", | |
| "_airbyte_raw_id" AS "_AIRBYTE_RAW_ID", | |
| "_airbyte_extracted_at" AS "_AIRBYTE_EXTRACTED_AT", | |
| "_airbyte_generation_id" AS "_AIRBYTE_GENERATION_ID" | |
| FROM intermediate_data; | |
| UPDATE "airbyte_internal"."XXX_PUBLIC_raw__stream_pil" | |
| SET "_airbyte_loaded_at" = CURRENT_TIMESTAMP() | |
| WHERE "_airbyte_loaded_at" IS NULL | |
| ; | |
| COMMIT; | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-7 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 0343a25a-3d73-4345-a9fe-26872a5f5e5a-463169a6-5a41-4ee9-a4b9-ca1f8ee64892: BEGIN TRANSACTION; | |
| INSERT INTO "XXX_PUBLIC"."GUE" | |
| ( | |
| "ID", | |
| "ZIP", | |
| "CITY", | |
| "EMAIL", | |
| "STATE", | |
| "ADDRESS", | |
| "COUNTRY", | |
| "LAST_NAME", | |
| "BIRTH_DATE", | |
| "CREATED_TS", | |
| "FIRST_NAME", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "SIGNED_TOS_ID", | |
| "HASHED_PASSWORD", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| "COGNITO_GOOGLE_SUB", | |
| "COGNITO_NATIVE_SUB", | |
| "ESTIMATED_WEIGHT_LBS", | |
| "_AIRBYTE_META", | |
| "_AIRBYTE_RAW_ID", | |
| "_AIRBYTE_EXTRACTED_AT", | |
| "_AIRBYTE_GENERATION_ID" | |
| ) | |
| WITH intermediate_data AS ( | |
| SELECT | |
| (("_airbyte_data":"id")::text) as "ID", | |
| (("_airbyte_data":"zip")::text) as "ZIP", | |
| (("_airbyte_data":"city")::text) as "CITY", | |
| (("_airbyte_data":"email")::text) as "EMAIL", | |
| (("_airbyte_data":"state")::text) as "STATE", | |
| (("_airbyte_data":"address")::text) as "ADDRESS", | |
| (("_airbyte_data":"country")::text) as "COUNTRY", | |
| (("_airbyte_data":"last_name")::text) as "LAST_NAME", | |
| CAST(("_airbyte_data":"birth_date")::text as DATE) as "BIRTH_DATE", | |
| CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "CREATED_TS", | |
| (("_airbyte_data":"first_name")::text) as "FIRST_NAME", | |
| CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "UPDATED_TS", | |
| CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) as "_AB_CDC_LSN", | |
| CAST(("_airbyte_data":"signed_tos_id")::text as NUMBER) as "SIGNED_TOS_ID", | |
| (("_airbyte_data":"hashed_password")::text) as "HASHED_PASSWORD", | |
| (("_airbyte_data":"_ab_cdc_deleted_at")::text) as "_AB_CDC_DELETED_AT", | |
| (("_airbyte_data":"_ab_cdc_updated_at")::text) as "_AB_CDC_UPDATED_AT", | |
| (("_airbyte_data":"cognito_google_sub")::text) as "COGNITO_GOOGLE_SUB", | |
| (("_airbyte_data":"cognito_native_sub")::text) as "COGNITO_NATIVE_SUB", | |
| CAST(("_airbyte_data":"estimated_weight_lbs")::text as FLOAT) as "ESTIMATED_WEIGHT_LBS", | |
| ARRAY_COMPACT( | |
| ARRAY_CAT( | |
| CASE WHEN "_airbyte_meta":"changes" IS NOT NULL | |
| THEN "_airbyte_meta":"changes" | |
| ELSE ARRAY_CONSTRUCT() | |
| END, | |
| ARRAY_CONSTRUCT(CASE | |
| WHEN (TYPEOF("_airbyte_data":"id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"zip") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"zip")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'zip', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"city") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"city")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'city', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"email") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"email")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'email', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"state") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"state")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'state', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"address") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"address")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'address', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"country") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"country")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'country', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"last_name") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"last_name")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'last_name', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"birth_date") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"birth_date")::text as DATE) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'birth_date', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"created_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'created_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"first_name") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"first_name")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'first_name', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"updated_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'updated_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_lsn") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_lsn', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"signed_tos_id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"signed_tos_id")::text as NUMBER) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'signed_tos_id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"hashed_password") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"hashed_password")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'hashed_password', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_deleted_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_deleted_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_deleted_at', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_updated_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_updated_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_updated_at', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"cognito_google_sub") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"cognito_google_sub")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'cognito_google_sub', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"cognito_native_sub") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"cognito_native_sub")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'cognito_native_sub', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"estimated_weight_lbs") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"estimated_weight_lbs")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'estimated_weight_lbs', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END))) as "_airbyte_cast_errors", | |
| "_airbyte_raw_id", | |
| TIMESTAMPADD( | |
| HOUR, | |
| EXTRACT(timezone_hour from "_airbyte_extracted_at"), | |
| TIMESTAMPADD( | |
| MINUTE, | |
| EXTRACT(timezone_minute from "_airbyte_extracted_at"), | |
| CONVERT_TIMEZONE('UTC', "_airbyte_extracted_at") | |
| ) | |
| ) | |
| as "_airbyte_extracted_at", | |
| "_airbyte_meta", | |
| "_airbyte_generation_id" | |
| FROM "airbyte_internal"."XXX_PUBLIC_raw__stream_gue" | |
| WHERE | |
| "_airbyte_loaded_at" IS NULL | |
| AND TIMESTAMPADD( | |
| HOUR, | |
| EXTRACT(timezone_hour from "_airbyte_extracted_at"), | |
| TIMESTAMPADD( | |
| MINUTE, | |
| EXTRACT(timezone_minute from "_airbyte_extracted_at"), | |
| CONVERT_TIMEZONE('UTC', "_airbyte_extracted_at") | |
| ) | |
| ) | |
| > '2024-07-14T07:17:08.244999999Z' | |
| ) | |
| SELECT | |
| "ID", | |
| "ZIP", | |
| "CITY", | |
| "EMAIL", | |
| "STATE", | |
| "ADDRESS", | |
| "COUNTRY", | |
| "LAST_NAME", | |
| "BIRTH_DATE", | |
| "CREATED_TS", | |
| "FIRST_NAME", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "SIGNED_TOS_ID", | |
| "HASHED_PASSWORD", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| "COGNITO_GOOGLE_SUB", | |
| "COGNITO_NATIVE_SUB", | |
| "ESTIMATED_WEIGHT_LBS", | |
| CASE WHEN "_airbyte_meta" IS NOT NULL | |
| THEN OBJECT_INSERT("_airbyte_meta", 'changes', "_airbyte_cast_errors", true) | |
| ELSE OBJECT_CONSTRUCT('changes', "_airbyte_cast_errors") | |
| END AS "_AIRBYTE_META", | |
| "_airbyte_raw_id" AS "_AIRBYTE_RAW_ID", | |
| "_airbyte_extracted_at" AS "_AIRBYTE_EXTRACTED_AT", | |
| "_airbyte_generation_id" AS "_AIRBYTE_GENERATION_ID" | |
| FROM intermediate_data; | |
| UPDATE "airbyte_internal"."XXX_PUBLIC_raw__stream_gue" | |
| SET "_airbyte_loaded_at" = CURRENT_TIMESTAMP() | |
| WHERE "_airbyte_loaded_at" IS NULL | |
| ; | |
| COMMIT; | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.con1. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):288 Skipping typing and deduping for stream XXX_PUBLIC.con1 because it had no records during this sync and no unprocessed records from a previous sync. | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.con1. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-3 i.a.i.d.s.o.SnowflakeStorageOperation(cleanupStage):141 Cleaning up stage "airbyte_internal"."XXX_PUBLIC_raw__stream_rou" | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):267 Not overwriting raw table for XXX_PUBLIC.rou. Truncate sync: false; stream success: true | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.t.TyperDeduperUtil(executeTypeAndDedupe):212 Attempting typing and deduping for XXX_PUBLIC.rou with suffix | |
| 2024-07-14 08:00:30 [43mdestination[0m > INFO sync-operations-3 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):241 Executing sql 6f59b787-c96d-4572-8998-e981ac7bf0af-d9397735-2f57-41ec-99ff-f42a39357157: BEGIN TRANSACTION; | |
| INSERT INTO "XXX_PUBLIC"."ROU" | |
| ( | |
| "ID", | |
| "REG_ID", | |
| "CREATED_TS", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "BASE_FARE_USD", | |
| "DISTANCE_MILES", | |
| "DURATION_MINUTES", | |
| "ORIGIN_STA_ID", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| "DESTINATION_STA_ID", | |
| "_AIRBYTE_META", | |
| "_AIRBYTE_RAW_ID", | |
| "_AIRBYTE_EXTRACTED_AT", | |
| "_AIRBYTE_GENERATION_ID" | |
| ) | |
| WITH intermediate_data AS ( | |
| SELECT | |
| (("_airbyte_data":"id")::text) as "ID", | |
| (("_airbyte_data":"reg_id")::text) as "REG_ID", | |
| CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "CREATED_TS", | |
| CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| as "UPDATED_TS", | |
| CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) as "_AB_CDC_LSN", | |
| CAST(("_airbyte_data":"base_fare_usd")::text as NUMBER) as "BASE_FARE_USD", | |
| CAST(("_airbyte_data":"distance_miles")::text as FLOAT) as "DISTANCE_MILES", | |
| CAST(("_airbyte_data":"duration_minutes")::text as FLOAT) as "DURATION_MINUTES", | |
| (("_airbyte_data":"origin_sta_id")::text) as "ORIGIN_STA_ID", | |
| (("_airbyte_data":"_ab_cdc_deleted_at")::text) as "_AB_CDC_DELETED_AT", | |
| (("_airbyte_data":"_ab_cdc_updated_at")::text) as "_AB_CDC_UPDATED_AT", | |
| (("_airbyte_data":"destination_sta_id")::text) as "DESTINATION_STA_ID", | |
| ARRAY_COMPACT( | |
| ARRAY_CAT( | |
| CASE WHEN "_airbyte_meta":"changes" IS NOT NULL | |
| THEN "_airbyte_meta":"changes" | |
| ELSE ARRAY_CONSTRUCT() | |
| END, | |
| ARRAY_CONSTRUCT(CASE | |
| WHEN (TYPEOF("_airbyte_data":"id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"reg_id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"reg_id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'reg_id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"created_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"created_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"created_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"created_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'created_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"updated_ts") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CASE | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SSTZH') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{4}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZHTZM') | |
| WHEN ("_airbyte_data":"updated_ts")::TEXT REGEXP '\\d{4}-\\d{2}-\\d{2}T(\\d{2}:){2}\\d{2}\\.\\d{1,7}(\\+|-)\\d{2}' | |
| THEN TO_TIMESTAMP_TZ(("_airbyte_data":"updated_ts")::TEXT, 'YYYY-MM-DDTHH24:MI:SS.FFTZH') | |
| ELSE CAST(("_airbyte_data":"updated_ts")::TEXT AS TIMESTAMP_TZ) | |
| END | |
| IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'updated_ts', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_lsn") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"_ab_cdc_lsn")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_lsn', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"base_fare_usd") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"base_fare_usd")::text as NUMBER) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'base_fare_usd', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"distance_miles") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"distance_miles")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'distance_miles', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"duration_minutes") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND (CAST(("_airbyte_data":"duration_minutes")::text as FLOAT) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'duration_minutes', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"origin_sta_id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"origin_sta_id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'origin_sta_id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_deleted_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_deleted_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_deleted_at', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"_ab_cdc_updated_at") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"_ab_cdc_updated_at")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', '_ab_cdc_updated_at', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END, | |
| CASE | |
| WHEN (TYPEOF("_airbyte_data":"destination_sta_id") NOT IN ('NULL', 'NULL_VALUE')) | |
| AND ((("_airbyte_data":"destination_sta_id")::text) IS NULL) | |
| THEN OBJECT_CONSTRUCT('field', 'destination_sta_id', 'change', 'NULLED', 'reason', 'DESTINATION_TYPECAST_ERROR') | |
| ELSE NULL | |
| END))) as "_airbyte_cast_errors", | |
| "_airbyte_raw_id", | |
| TIMESTAMPADD( | |
| HOUR, | |
| EXTRACT(timezone_hour from "_airbyte_extracted_at"), | |
| TIMESTAMPADD( | |
| MINUTE, | |
| EXTRACT(timezone_minute from "_airbyte_extracted_at"), | |
| CONVERT_TIMEZONE('UTC', "_airbyte_extracted_at") | |
| ) | |
| ) | |
| as "_airbyte_extracted_at", | |
| "_airbyte_meta", | |
| "_airbyte_generation_id" | |
| FROM "airbyte_internal"."XXX_PUBLIC_raw__stream_rou" | |
| WHERE | |
| "_airbyte_loaded_at" IS NULL | |
| AND TIMESTAMPADD( | |
| HOUR, | |
| EXTRACT(timezone_hour from "_airbyte_extracted_at"), | |
| TIMESTAMPADD( | |
| MINUTE, | |
| EXTRACT(timezone_minute from "_airbyte_extracted_at"), | |
| CONVERT_TIMEZONE('UTC', "_airbyte_extracted_at") | |
| ) | |
| ) | |
| > '2024-07-14T07:17:08.244999999Z' | |
| ) | |
| SELECT | |
| "ID", | |
| "REG_ID", | |
| "CREATED_TS", | |
| "UPDATED_TS", | |
| "_AB_CDC_LSN", | |
| "BASE_FARE_USD", | |
| "DISTANCE_MILES", | |
| "DURATION_MINUTES", | |
| "ORIGIN_STA_ID", | |
| "_AB_CDC_DELETED_AT", | |
| "_AB_CDC_UPDATED_AT", | |
| "DESTINATION_STA_ID", | |
| CASE WHEN "_airbyte_meta" IS NOT NULL | |
| THEN OBJECT_INSERT("_airbyte_meta", 'changes', "_airbyte_cast_errors", true) | |
| ELSE OBJECT_CONSTRUCT('changes', "_airbyte_cast_errors") | |
| END AS "_AIRBYTE_META", | |
| "_airbyte_raw_id" AS "_AIRBYTE_RAW_ID", | |
| "_airbyte_extracted_at" AS "_AIRBYTE_EXTRACTED_AT", | |
| "_airbyte_generation_id" AS "_AIRBYTE_GENERATION_ID" | |
| FROM intermediate_data; | |
| UPDATE "airbyte_internal"."XXX_PUBLIC_raw__stream_rou" | |
| SET "_airbyte_loaded_at" = CURRENT_TIMESTAMP() | |
| WHERE "_airbyte_loaded_at" IS NULL | |
| ; | |
| COMMIT; | |
| 2024-07-14 08:00:31 [43mdestination[0m > INFO sync-operations-2 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 3bd028e3-20f5-45a8-ac35-51d63745c7e5-22cc4384-b6b2-4373-88f6-607179599268 completed in 1947 ms | |
| 2024-07-14 08:00:31 [43mdestination[0m > INFO sync-operations-2 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.pil2. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:33 [43mdestination[0m > INFO sync-operations-4 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 202af1cd-6efb-4b89-b5c4-28d528f338a5-ab75c8be-8542-46dd-b65b-e25d6e9b65fd completed in 3400 ms | |
| 2024-07-14 08:00:33 [43mdestination[0m > INFO sync-operations-4 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.reg. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:34 [43mdestination[0m > INFO sync-operations-9 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 6665aee2-362f-478f-975a-2976bdf58310-436e3a3e-bd8c-49aa-b1cc-39f16c9f5816 completed in 4606 ms | |
| 2024-07-14 08:00:34 [43mdestination[0m > INFO sync-operations-9 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.pil. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:36 [43mdestination[0m > INFO sync-operations-5 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 8deebae9-75a5-44b9-9039-77a36798f50b-52d1ab47-e187-4dc6-80a1-be5d411d6a29 completed in 6523 ms | |
| 2024-07-14 08:00:36 [43mdestination[0m > INFO sync-operations-5 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.veh_type. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:36 [43mdestination[0m > INFO sync-operations-8 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 95a01729-fd2f-4f52-9031-59dba284df73-500dced0-b470-44d8-b8ad-4932ce180e7b completed in 6540 ms | |
| 2024-07-14 08:00:36 [43mdestination[0m > INFO sync-operations-8 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.sta. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:36 [43mdestination[0m > INFO sync-operations-1 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 0f33afac-2060-4943-9a8c-bf417b644163-4b4e992b-3fc6-4448-889a-6c2cb5dd9de1 completed in 6765 ms | |
| 2024-07-14 08:00:36 [43mdestination[0m > INFO sync-operations-1 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.fli. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:37 [43mdestination[0m > INFO sync-operations-3 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 6f59b787-c96d-4572-8998-e981ac7bf0af-d9397735-2f57-41ec-99ff-f42a39357157 completed in 6731 ms | |
| 2024-07-14 08:00:37 [43mdestination[0m > INFO sync-operations-3 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.rou. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:37 [43mdestination[0m > INFO sync-operations-10 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 1d7034c0-0c6e-4847-b248-6f0621b34c08-d1004974-a6ea-440f-8425-60723b237302 completed in 6948 ms | |
| 2024-07-14 08:00:37 [43mdestination[0m > INFO sync-operations-10 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.act. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:37 [43mdestination[0m > INFO sync-operations-6 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 08949498-9b9f-43bb-89cc-bcb97fdb34fc-63b2131e-f909-4523-b2f1-757e21be4360 completed in 6926 ms | |
| 2024-07-14 08:00:37 [43mdestination[0m > INFO sync-operations-6 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.veh. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:37 [43mdestination[0m > INFO sync-operations-7 i.a.i.d.s.t.SnowflakeDestinationHandler(execute):263 Sql 0343a25a-3d73-4345-a9fe-26872a5f5e5a-463169a6-5a41-4ee9-a4b9-ca1f8ee64892 completed in 7005 ms | |
| 2024-07-14 08:00:37 [43mdestination[0m > INFO sync-operations-7 i.a.i.b.d.o.AbstractStreamOperation(finalizeTable):327 Not overwriting final table for XXX_PUBLIC.gue. Truncate sync: false; stream success: true; final table suffix not blank: false | |
| 2024-07-14 08:00:37 [43mdestination[0m > INFO main i.a.i.b.d.o.DefaultSyncOperation(finalizeStreams):150 Cleaning up sync operation thread pools | |
| 2024-07-14 08:00:37 [43mdestination[0m > INFO main i.a.c.i.d.a.AsyncStreamConsumer(close):195 class io.airbyte.cdk.integrations.destination.async.AsyncStreamConsumer closed | |
| 2024-07-14 08:00:37 [43mdestination[0m > INFO main i.a.c.i.b.IntegrationRunner(runInternal):269 Completed integration: io.airbyte.integrations.destination.snowflake.SnowflakeDestination | |
| 2024-07-14 08:00:37 [43mdestination[0m > INFO main i.a.c.i.b.a.AdaptiveDestinationRunner$Runner(run):69 Completed destination: io.airbyte.integrations.destination.snowflake.SnowflakeDestination | |
| 2024-07-14 08:00:39 [46mreplication-orchestrator[0m > (pod: production-hm-airbyte / destination-snowflake-write-923-0-foxvf) - Closed all resources for pod | |
| 2024-07-14 08:00:39 [46mreplication-orchestrator[0m > readFromDestination: done. (writeToDestFailed:false, dest.isFinished:true) | |
| 2024-07-14 08:00:39 [46mreplication-orchestrator[0m > thread status... timeout thread: false , replication thread: true | |
| 2024-07-14 08:00:39 [46mreplication-orchestrator[0m > Closing StateCheckSumCountEventHandler | |
| 2024-07-14 08:00:39 [46mreplication-orchestrator[0m > No checksum errors were reported in the entire sync. | |
| 2024-07-14 08:00:39 [46mreplication-orchestrator[0m > sync summary: { | |
| "status" : "completed", | |
| "recordsSynced" : 58, | |
| "bytesSynced" : 29694, | |
| "startTime" : 1720943243307, | |
| "endTime" : 1720944039237, | |
| "totalStats" : { | |
| "bytesCommitted" : 29694, | |
| "bytesEmitted" : 29694, | |
| "destinationStateMessagesEmitted" : 377, | |
| "destinationWriteEndTime" : 1720944039162, | |
| "destinationWriteStartTime" : 1720943243336, | |
| "meanSecondsBeforeSourceStateMessageEmitted" : 769, | |
| "maxSecondsBeforeSourceStateMessageEmitted" : 27, | |
| "maxSecondsBetweenStateMessageEmittedandCommitted" : 772, | |
| "meanSecondsBetweenStateMessageEmittedandCommitted" : 406, | |
| "recordsEmitted" : 58, | |
| "recordsCommitted" : 58, | |
| "replicationEndTime" : 1720944039165, | |
| "replicationStartTime" : 1720943243307, | |
| "sourceReadEndTime" : 1720944027796, | |
| "sourceReadStartTime" : 1720943243337, | |
| "sourceStateMessagesEmitted" : 377 | |
| }, | |
| "streamStats" : [ { | |
| "streamName" : "bag", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 0, | |
| "bytesEmitted" : 0, | |
| "recordsEmitted" : 0, | |
| "recordsCommitted" : 0 | |
| } | |
| }, { | |
| "streamName" : "config", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 0, | |
| "bytesEmitted" : 0, | |
| "recordsEmitted" : 0, | |
| "recordsCommitted" : 0 | |
| } | |
| }, { | |
| "streamName" : "con1", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 0, | |
| "bytesEmitted" : 0, | |
| "recordsEmitted" : 0, | |
| "recordsCommitted" : 0 | |
| } | |
| }, { | |
| "streamName" : "fli", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 6880, | |
| "bytesEmitted" : 6880, | |
| "recordsEmitted" : 8, | |
| "recordsCommitted" : 8 | |
| } | |
| }, { | |
| "streamName" : "rid", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 0, | |
| "bytesEmitted" : 0, | |
| "recordsEmitted" : 0, | |
| "recordsCommitted" : 0 | |
| } | |
| }, { | |
| "streamName" : "pur", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 0, | |
| "bytesEmitted" : 0, | |
| "recordsEmitted" : 0, | |
| "recordsCommitted" : 0 | |
| } | |
| }, { | |
| "streamName" : "pil2", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 556, | |
| "bytesEmitted" : 556, | |
| "recordsEmitted" : 2, | |
| "recordsCommitted" : 2 | |
| } | |
| }, { | |
| "streamName" : "reg", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 360, | |
| "bytesEmitted" : 360, | |
| "recordsEmitted" : 1, | |
| "recordsCommitted" : 1 | |
| } | |
| }, { | |
| "streamName" : "con2", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 0, | |
| "bytesEmitted" : 0, | |
| "recordsEmitted" : 0, | |
| "recordsCommitted" : 0 | |
| } | |
| }, { | |
| "streamName" : "tri2", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 0, | |
| "bytesEmitted" : 0, | |
| "recordsEmitted" : 0, | |
| "recordsCommitted" : 0 | |
| } | |
| }, { | |
| "streamName" : "daw", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 0, | |
| "bytesEmitted" : 0, | |
| "recordsEmitted" : 0, | |
| "recordsCommitted" : 0 | |
| } | |
| }, { | |
| "streamName" : "gue2", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 0, | |
| "bytesEmitted" : 0, | |
| "recordsEmitted" : 0, | |
| "recordsCommitted" : 0 | |
| } | |
| }, { | |
| "streamName" : "ope", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 0, | |
| "bytesEmitted" : 0, | |
| "recordsEmitted" : 0, | |
| "recordsCommitted" : 0 | |
| } | |
| }, { | |
| "streamName" : "rou", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 2930, | |
| "bytesEmitted" : 2930, | |
| "recordsEmitted" : 6, | |
| "recordsCommitted" : 6 | |
| } | |
| }, { | |
| "streamName" : "dri", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 0, | |
| "bytesEmitted" : 0, | |
| "recordsEmitted" : 0, | |
| "recordsCommitted" : 0 | |
| } | |
| }, { | |
| "streamName" : "gue", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 598, | |
| "bytesEmitted" : 598, | |
| "recordsEmitted" : 1, | |
| "recordsCommitted" : 1 | |
| } | |
| }, { | |
| "streamName" : "veh_type", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 369, | |
| "bytesEmitted" : 369, | |
| "recordsEmitted" : 1, | |
| "recordsCommitted" : 1 | |
| } | |
| }, { | |
| "streamName" : "asy", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 0, | |
| "bytesEmitted" : 0, | |
| "recordsEmitted" : 0, | |
| "recordsCommitted" : 0 | |
| } | |
| }, { | |
| "streamName" : "sta", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 1621, | |
| "bytesEmitted" : 1621, | |
| "recordsEmitted" : 3, | |
| "recordsCommitted" : 3 | |
| } | |
| }, { | |
| "streamName" : "act", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 13664, | |
| "bytesEmitted" : 13664, | |
| "recordsEmitted" : 32, | |
| "recordsCommitted" : 32 | |
| } | |
| }, { | |
| "streamName" : "pil", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 398, | |
| "bytesEmitted" : 398, | |
| "recordsEmitted" : 1, | |
| "recordsCommitted" : 1 | |
| } | |
| }, { | |
| "streamName" : "tri", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 0, | |
| "bytesEmitted" : 0, | |
| "recordsEmitted" : 0, | |
| "recordsCommitted" : 0 | |
| } | |
| }, { | |
| "streamName" : "veh", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 2318, | |
| "bytesEmitted" : 2318, | |
| "recordsEmitted" : 3, | |
| "recordsCommitted" : 3 | |
| } | |
| }, { | |
| "streamName" : "ter", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 0, | |
| "bytesEmitted" : 0, | |
| "recordsEmitted" : 0, | |
| "recordsCommitted" : 0 | |
| } | |
| }, { | |
| "streamName" : "off", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 0, | |
| "bytesEmitted" : 0, | |
| "recordsEmitted" : 0, | |
| "recordsCommitted" : 0 | |
| } | |
| }, { | |
| "streamName" : "con3", | |
| "streamNamespace" : "public", | |
| "stats" : { | |
| "bytesCommitted" : 0, | |
| "bytesEmitted" : 0, | |
| "recordsEmitted" : 0, | |
| "recordsCommitted" : 0 | |
| } | |
| } ], | |
| "performanceMetrics" : { | |
| "processFromSource" : { | |
| "elapsedTimeInNanos" : 201917650, | |
| "executionCount" : 138, | |
| "avgExecTimeInNanos" : 1463171.3768115942 | |
| }, | |
| "readFromSource" : { | |
| "elapsedTimeInNanos" : 774917003907, | |
| "executionCount" : 250830, | |
| "avgExecTimeInNanos" : 3089411.170541801 | |
| }, | |
| "processFromDest" : { | |
| "elapsedTimeInNanos" : 151001150, | |
| "executionCount" : 27, | |
| "avgExecTimeInNanos" : 5592635.185185186 | |
| }, | |
| "writeToDest" : { | |
| "elapsedTimeInNanos" : 98495976, | |
| "executionCount" : 85, | |
| "avgExecTimeInNanos" : 1158776.188235294 | |
| }, | |
| "readFromDest" : { | |
| "elapsedTimeInNanos" : 786345232047, | |
| "executionCount" : 387977, | |
| "avgExecTimeInNanos" : 2026783.113553123 | |
| } | |
| } | |
| } | |
| 2024-07-14 08:00:39 [46mreplication-orchestrator[0m > failures: [ ] | |
| 2024-07-14 08:00:39 [46mreplication-orchestrator[0m > Returning output... | |
| 2024-07-14 08:00:39 [46mreplication-orchestrator[0m > | |
| 2024-07-14 08:00:39 [46mreplication-orchestrator[0m > ----- END REPLICATION ----- | |
| 2024-07-14 08:00:39 [46mreplication-orchestrator[0m > | |
| 2024-07-14 08:00:39 [46mreplication-orchestrator[0m > Writing async status SUCCEEDED for KubePodInfo[namespace=production-hm-airbyte, name=orchestrator-repl-job-923-attempt-0, mainContainerInfo=KubeContainerInfo[image=airbyte/container-orchestrator:0.63.6, pullPolicy=IfNotPresent]]... | |
| 2024-07-14 08:00:39 [32mINFO[m i.a.a.SegmentAnalyticsClient(close):240 - Closing Segment analytics client... | |
| 2024-07-14 08:00:39 [32mINFO[m i.a.a.BlockingShutdownAnalyticsPlugin(waitForFlush):296 - Waiting for Segment analytic client to flush enqueued messages... | |
| 2024-07-14 08:00:39 [32mINFO[m i.a.a.BlockingShutdownAnalyticsPlugin(waitForFlush):308 - Segment analytic client flush complete. | |
| 2024-07-14 08:00:39 [32mINFO[m i.a.a.SegmentAnalyticsClient(close):244 - Segment analytics client closed. No new events will be accepted. | |
| 2024-07-14 08:00:43 [46mplatform[0m > State Store reports orchestrator pod orchestrator-repl-job-923-attempt-0 succeeded | |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment