petabridge / akka.persistence.azure Goto Github PK

[ERROR][10/24/2023 17:33:17.452Z][Thread 0146][akka.tcp://[email protected]:9223/system/sharding/sessions/10/mysession-dffffd5a-2917-4286-8650-e6d2e028dbd8] Persistence failure when replaying events for persistenceId [mysession-dffffd5a-2917-4286-8650-e6d2e028dbd8]. Last known sequence number [0]
Cause: Azure.RequestFailedException: The specified blob does not exist.
RequestId:<guid>
Time:2023-10-24T17:33:17.4521243Z
Status: 404 (The specified blob does not exist.)
ErrorCode: BlobNotFound
Headers:
Server: Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0
x-ms-request-id: <guid>
x-ms-client-request-id: <guid>
x-ms-version: 2021-12-02
x-ms-error-code: BlobNotFound
Date: Tue, 24 Oct 2023 17:33:17 GMT
Content-Length: 215
Content-Type: application/xml
at Azure.Storage.Blobs.BlobRestClient.DownloadAsync(String snapshot, String versionId, Nullable`1 timeout, String range, String leaseId, Nullable`1 rangeGetContentMD5, Nullable`1 rangeGetContentCRC64, String encryptionKey, String encryptionKeySha256, Nullable`1 encryptionAlgorithm, Nullable`1 ifModifiedSince, Nullable`1 ifUnmodifiedSince, String ifMatch, String ifNoneMatch, String ifTags, CancellationToken cancellationToken)
at Azure.Storage.Blobs.Specialized.BlobBaseClient.StartDownloadAsync(HttpRange range, BlobRequestConditions conditions, DownloadTransferValidationOptions validationOptions, Int64 startOffset, Boolean async, CancellationToken cancellationToken)
at Azure.Storage.Blobs.Specialized.BlobBaseClient.DownloadStreamingInternal(HttpRange range, BlobRequestConditions conditions, DownloadTransferValidationOptions transferValidationOverride, IProgress`1 progressHandler, String operationName, Boolean async, CancellationToken cancellationToken)
at Azure.Storage.Blobs.Specialized.BlobBaseClient.DownloadStreamingDirect(HttpRange range, BlobRequestConditions conditions, DownloadTransferValidationOptions transferValidationOverride, IProgress`1 progressHandler, String operationName, Boolean async, CancellationToken cancellationToken)
at Azure.Storage.Blobs.Specialized.BlobBaseClient.DownloadInternal(HttpRange range, BlobRequestConditions conditions, Boolean rangeGetContentHash, Boolean async, CancellationToken cancellationToken)
at Azure.Storage.Blobs.Specialized.BlobBaseClient.DownloadAsync(HttpRange range, BlobRequestConditions conditions, Boolean rangeGetContentHash, CancellationToken cancellationToken)
at Azure.Storage.Blobs.Specialized.BlobBaseClient.DownloadAsync(CancellationToken cancellationToken)
at Akka.Persistence.Azure.Snapshot.AzureBlobSnapshotStore.LoadAsync(String persistenceId, SnapshotSelectionCriteria criteria)
at Akka.Util.Internal.AtomicState.CallThrough[T](Func`1 task)
at Akka.Util.Internal.AtomicState.CallThrough[T](Func`1 task)

            if (credentialSetup**?**.HasValue)

Failed to deserialize instance of type . Failed to deserialize object of type [MyCompany.SystemStateService.Core.Actors.StaticStateActor+NewStateMessage] from the stream. Cause: Failed to deserialize object of type [System.Text.Json.JsonElement] from the stream. Cause: Failed to deserialize object of type [System.Text.Json.JsonDocument] from the stream. Cause: Unable to cast object of type 'System.Boolean' to type 'MetadataDb'. Failed to deserialize object of type [MyCompany.SystemStateService.Core.Actors.StaticStateActor+NewStateMessage] from the stream. Cause: Failed to deserialize object of type [System.Text.Json.JsonElement] from the stream. Cause: Failed to deserialize object of type [System.Text.Json.JsonDocument] from the stream. Cause: Unable to cast object of type 'System.Boolean' to type 'MetadataDb'. Failed to deserialize object of type [System.Text.Json.JsonElement] from the stream. Cause: Failed to deserialize object of type [System.Text.Json.JsonDocument] from the stream. Cause: Unable to cast object of type 'System.Boolean' to type 'MetadataDb'. Failed to deserialize object of type [System.Text.Json.JsonDocument] from the stream. Cause: Unable to cast object of type 'System.Boolean' to type 'MetadataDb'. Unable to cast object of type 'System.Boolean' to type 'MetadataDb'. 


System.Runtime.Serialization.SerializationException:
   at Akka.Serialization.HyperionSerializer.FromBinary (Akka.Serialization.Hyperion, Version=1.5.14.0, Culture=neutral, PublicKeyToken=null)
   at Akka.Serialization.Serialization.Deserialize (Akka, Version=1.5.14.0, Culture=neutral, PublicKeyToken=null)
   at Akka.Persistence.Serialization.PersistenceMessageSerializer.GetPayload (Akka.Persistence, Version=1.5.14.0, Culture=neutral, PublicKeyToken=null)
   at Akka.Persistence.Serialization.PersistenceMessageSerializer.GetPersistentRepresentation (Akka.Persistence, Version=1.5.14.0, Culture=neutral, PublicKeyToken=null)
   at Akka.Persistence.Serialization.PersistenceMessageSerializer.FromBinary (Akka.Persistence, Version=1.5.14.0, Culture=neutral, PublicKeyToken=null)
   at Akka.Serialization.Serializer.FromBinary (Akka, Version=1.5.14.0, Culture=neutral, PublicKeyToken=null)
   at Akka.Persistence.Azure.SerializationHelper.PersistentFromBytes (Akka.Persistence.Azure, Version=1.5.13.0, Culture=neutral, PublicKeyToken=null)
   at Akka.Persistence.Azure.Journal.AzureTableStorageJournal+<ReplayMessagesAsync>d__21.MoveNext (Akka.Persistence.Azure, Version=1.5.13.0, Culture=neutral, PublicKeyToken=null)
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw (System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e)
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e)
   at Akka.Persistence.Journal.AsyncWriteJournal+<>c__DisplayClass18_0+<<HandleReplayMessages>g__ExecuteHighestSequenceNr|0>d.MoveNext (Akka.Persistence, Version=1.5.14.0, Culture=neutral, PublicKeyToken=null)
Inner exception System.Runtime.Serialization.SerializationException handled at Akka.Serialization.HyperionSerializer.FromBinary:
   at Hyperion.ValueSerializers.ObjectSerializer.ReadValue (Hyperion, Version=0.12.2.0, Culture=neutral, PublicKeyToken=null)
   at Hyperion.Serializer.Deserialize (Hyperion, Version=0.12.2.0, Culture=neutral, PublicKeyToken=null)
   at Akka.Serialization.HyperionSerializer.FromBinary (Akka.Serialization.Hyperion, Version=1.5.14.0, Culture=neutral, PublicKeyToken=null)
Inner exception System.Runtime.Serialization.SerializationException handled at Hyperion.ValueSerializers.ObjectSerializer.ReadValue:
   at Hyperion.ValueSerializers.ObjectSerializer.ReadValue (Hyperion, Version=0.12.2.0, Culture=neutral, PublicKeyToken=null)
   at lambda_method180 (Anonymously Hosted DynamicMethods Assembly, Version=0.0.0.0, Culture=neutral, PublicKeyToken=null)
   at Hyperion.ValueSerializers.ObjectSerializer.ReadValue (Hyperion, Version=0.12.2.0, Culture=neutral, PublicKeyToken=null)
Inner exception System.Runtime.Serialization.SerializationException handled at Hyperion.ValueSerializers.ObjectSerializer.ReadValue:
   at Hyperion.ValueSerializers.ObjectSerializer.ReadValue (Hyperion, Version=0.12.2.0, Culture=neutral, PublicKeyToken=null)
   at lambda_method188 (Anonymously Hosted DynamicMethods Assembly, Version=0.0.0.0, Culture=neutral, PublicKeyToken=null)
   at Hyperion.ValueSerializers.ObjectSerializer.ReadValue (Hyperion, Version=0.12.2.0, Culture=neutral, PublicKeyToken=null)
Inner exception System.InvalidCastException handled at Hyperion.ValueSerializers.ObjectSerializer.ReadValue:
   at lambda_method190 (Anonymously Hosted DynamicMethods Assembly, Version=0.0.0.0, Culture=neutral, PublicKeyToken=null)
   at Hyperion.ValueSerializers.ObjectSerializer.ReadValue (Hyperion, Version=0.12.2.0, Culture=neutral, PublicKeyToken=null)

akka.actor {
	provider = "Akka.Cluster.ClusterActorRefProvider, Akka.Cluster"
}
akka.remote {
	dot-netty.tcp {
		hostname = "127.0.0.1"
		port = 5054
	}
}
akka.cluster {
	seed-nodes = ["akka.tcp://[email protected]:4053"]
	roles = ["sharded-node"]
	sharding {
        journal-plugin-id = "akka.persistence.journal.sharding"
        snapshot-plugin-id = "akka.persistence.snapshot-store.sharding"
    }
}

akka.persistence {
  journal {
	azure-table {
	  # qualified type name of the Azure Table Storage persistence journal actor
	  class = "Akka.Persistence.Azure.Journal.AzureTableStorageJournal, Akka.Persistence.Azure"

	  # connection string, as described here: https://docs.microsoft.com/en-us/azure/storage/common/storage-configure-connection-string
	  connection-string = "[redacted]"

	  # the name of the Windows Azure Table used to persist journal events
	  table-name = "journaldev"

	  #  Initial timeout to use when connecting to Azure Storage for the first time.
	  connect-timeout = 3s

	  # Timeouts for individual read, write, and delete requests to Azure Storage.
	  request-timeout = 3s

	  # Toggle for verbose logging. Logs individual requests to Azure.
	  # Intended only for debugging purposes. akka.loglevel must be set to DEBUG
	  # in order for this setting to be effective.
	  verbose-logging = off

	  # dispatcher used to drive journal actor
	  plugin-dispatcher = "akka.actor.default-dispatcher"
	}
	sharding {
				class = "Akka.Persistence.Azure.Journal.AzureTableStorageJournal, Akka.Persistence.Azure"
				plugin-dispatcher = "akka.actor.default-dispatcher"
				connection-string = "[redacted]"	      
				connection-timeout = 3s
				table-name = shardingdev
				auto-initialize = on
				metadata-table-name = shardingmetadata
	}
  }  

  query {
	journal {
	  azure-table {
		# Implementation class of the Azure ReadJournalProvider
		class = "Akka.Persistence.Azure.Query.AzureTableStorageReadJournalProvider, Akka.Persistence.Azure"
  
		# Absolute path to the write journal plugin configuration entry that this 
		# query journal will connect to. 
		# If undefined (or "") it will connect to the default journal as specified by the
		# akka.persistence.journal.plugin property.
		write-plugin = ""
  
		# How many events to fetch in one query (replay) and keep buffered until they
		# are delivered downstreams.
		max-buffer-size = 100

		# The Azure Table write journal is notifying the query side as soon as things
		# are persisted, but for efficiency reasons the query side retrieves the events 
		# in batches that sometimes can be delayed up to the configured `refresh-interval`.
		refresh-interval = 3s
	  }
	}
  }

  snapshot-store {
	azure-blob-store {
	  # qualified type name of the Azure Blob Storage persistence snapshot storage actor
	  class = "Akka.Persistence.Azure.Snapshot.AzureBlobSnapshotStore, Akka.Persistence.Azure"

	  # connection string, as described here: https://docs.microsoft.com/en-us/azure/storage/common/storage-configure-connection-string
	  connection-string = "[redacted]" 

	  # the name of the Windows Azure Blob Store container used to persist snapshots
	  container-name = "snapshotdev"

	  #  Initial timeout to use when connecting to Azure Storage for the first time.
	  connect-timeout = 3s

	  # Timeouts for individual read, write, and delete requests to Azure Storage.
	  request-timeout = 3s

	  # Toggle for verbose logging. Logs individual requests to Azure.
	  # Intended only for debugging purposes. akka.loglevel must be set to DEBUG
	  # in order for this setting to be effective.
	  verbose-logging = off

	  # dispatcher used to drive snapshot storage actor
	  plugin-dispatcher = "akka.actor.default-dispatcher"
	}
	sharding {
		    class = "Akka.Persistence.Azure.Snapshot.AzureBlobSnapshotStore, Akka.Persistence.Azure"
		    plugin-dispatcher = "akka.actor.default-dispatcher"
			connection-string = "[redacted]"	      
		    connection-timeout = 3s
		    table-name = "shardingsnapshotdev"
		    auto-initialize = on
	}
  }
}

Cause: Microsoft.WindowsAzure.Storage.StorageException: Element 0 in the batch returned an unexpected response code.
   at Microsoft.WindowsAzure.Storage.Core.Executor.Executor.ExecuteAsyncInternal[T](RESTCommand`1 cmd, IRetryPolicy policy, OperationContext operationContext, CancellationToken token) in C:\Program Files (x86)\Jenkins\workspace\release_dotnet_master\Lib\WindowsRuntime\Core\Executor\Executor.cs:line 316
   at Akka.Persistence.Azure.Journal.AzureTableStorageJournal.WriteMessagesAsync(IEnumerable`1 atomicWrites)
Request Information
RequestID:f7cdc5bd-b002-0003-2d3a-47f6f2000000
RequestDate:Sat, 20 Jun 2020 19:40:07 GMT
StatusMessage:0:Bad Request - Error in query syntax.
ErrorCode:
ErrorMessage:0:Bad Request - Error in query syntax.

.WithAzurePersistence(
    azureStorageConnectionString,
    true,
    containerName,
    tableName,
    builder =>
    {
        builder.AddWriteEventAdapter<TaggingEventAdapter>(
            "projection-tagger",
            new[] { typeof(IHasEntraTenantId) }
        );
    }
)

private void QueryEvents()
{
    var materializer = Context.System.Materializer();
    var projectionActorRef = Self;

    currentEventsByTagQuery
        .CurrentEventsByTag(tag, Offset.NoOffset())
        .Select(env => env.Event)
        .RunWith(
            Sink.ActorRef<object>(
                projectionActorRef,
                new ProjectionRebuildNoMoreEvents { EntraTenantId = entraTenantId },
                (ex) =>
                    new FailedEndOfStream { EntraTenantId = entraTenantId, Reason = ex.Message }
            ),
            materializer
        );
}

Name of the table
Table names must conform to these rules:

Table names must be unique within an account.
Table names may contain only alphanumeric characters.
Table names cannot begin with a numeric character.
Table names are case-insensitive.
Table names must be from 3 to 63 characters long.
Some table names are reserved, including "tables". Attempting to create a table with a reserved table name returns error code 404 (Bad Request).
These rules are also described by the regular expression "^[A-Za-z][A-Za-z0-9]{2,62}$".

Table names preserve the case with which they were created, but are case-insensitive when used.

A container name must be a valid DNS name, conforming to the following naming rules:

Container names must start with a letter or number, and can contain only letters, numbers, and the dash (-) character.
Every dash (-) character must be immediately preceded and followed by a letter or number; consecutive dashes are not permitted in container names.
All letters in a container name must be lowercase.
Container names must be from 3 through 63 characters long.

Cause: System.FormatException: Received a malformed formatted message. Log level: [DebugLevel], Template: [Azure table storage wrote entity with status code [{1}]], args: [204]
 ---> System.FormatException: Index (zero based) must be greater than or equal to zero and less than the size of the argument list.
   at System.Text.StringBuilder.AppendFormatHelper(IFormatProvider provider, String format, ParamsArray args)
   at System.String.FormatHelper(IFormatProvider provider, String format, ParamsArray args)
   at System.String.Format(String format, Object[] args)
   at Akka.Event.DefaultLogMessageFormatter.Format(String format, Object[] args)
   at Akka.Event.LogMessage.ToString()
   at System.Text.StringBuilder.AppendFormatHelper(IFormatProvider provider, String format, ParamsArray args)
   at System.String.FormatHelper(IFormatProvider provider, String format, ParamsArray args)
   at System.String.Format(String format, Object[] args)
   at Akka.Event.LogEvent.ToString()
   at Akka.TestKit.Xunit2.Internals.TestOutputLogger.HandleLogEvent(LogEvent e)
   --- End of inner exception stack trace ---
   at Akka.TestKit.Xunit2.Internals.TestOutputLogger.HandleLogEvent(LogEvent e)
   at lambda_method(Closure , Object , Action`1 , Action`1 , Action`1 , Action`1 , Action`1 )
   at Akka.Tools.MatchHandler.PartialHandlerArgumentsCapture`6.Handle(T value)
   at Akka.Actor.ReceiveActor.ExecutePartialMessageHandler(Object message, PartialAction`1 partialAction)
   at Akka.Actor.ReceiveActor.OnReceive(Object message)
   at Akka.Actor.UntypedActor.Receive(Object message)
   at Akka.Actor.ActorBase.AroundReceive(Receive receive, Object message)
   at Akka.Actor.ActorCell.ReceiveMessage(Object message)
   at Akka.Actor.ActorCell.Invoke(Envelope envelope)